2024-04-21T22:09:52.960 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-21T22:09:52.960 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544 --verbose --name teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/orig.config.yaml 2024-04-21T22:09:53.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T22:09:53.115 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7667544' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 430e09df97c8fc7dc2b2ae424f68ed11366c540f owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 676 sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b sleep_before_teardown: 0 subset: 46/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 430e09df97c8fc7dc2b2ae424f68ed11366c540f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdvywbN7HWnt1rJMBnL0ktxobcfHJiZYTiU+V1Muo8x8eNVKcd2DXAp3L/tQat06JgMe/hoKNQHzAzeS9pK/Hs= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJv2qeaG3WP5r1PBOBCQU3FYz0fdWZUHMfdIzFJa9lDj1m+QjavqSpU6dmUmZJLVqdjld9xV7hluTWCdc+pbyk= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDq7nOWza3WbMav0MTBFDPrDaw8LNNnt/QvoZBGcu/ij/1x+JPIdfA73+seCZajB2WpanGOSPCJguy75JQYBA0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-21_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-21T22:09:53.116 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa; will attempt to use it 2024-04-21T22:09:53.116 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks 2024-04-21T22:09:53.116 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-21T22:09:53.118 INFO:teuthology.task.internal:Checking packages... 2024-04-21T22:09:53.140 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '820a2f8ced66152ed3d765c31444b8076ea28c6b' 2024-04-21T22:09:53.141 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-21T22:09:53.141 INFO:teuthology.packaging:ref: None 2024-04-21T22:09:53.141 INFO:teuthology.packaging:tag: None 2024-04-21T22:09:53.141 INFO:teuthology.packaging:branch: squid 2024-04-21T22:09:53.141 INFO:teuthology.packaging:sha1: 820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:09:53.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-21T22:09:53.464 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2407.g430e09df 2024-04-21T22:09:53.466 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-21T22:09:53.473 INFO:teuthology.task.internal:no buildpackages task found 2024-04-21T22:09:53.473 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-21T22:09:53.503 INFO:teuthology.task.internal:Saving configuration 2024-04-21T22:09:53.525 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-21T22:09:53.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T22:09:53.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.535473', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdvywbN7HWnt1rJMBnL0ktxobcfHJiZYTiU+V1Muo8x8eNVKcd2DXAp3L/tQat06JgMe/hoKNQHzAzeS9pK/Hs='} 2024-04-21T22:09:53.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.532087', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJv2qeaG3WP5r1PBOBCQU3FYz0fdWZUHMfdIzFJa9lDj1m+QjavqSpU6dmUmZJLVqdjld9xV7hluTWCdc+pbyk='} 2024-04-21T22:09:53.595 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.533678', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDq7nOWza3WbMav0MTBFDPrDaw8LNNnt/QvoZBGcu/ij/1x+JPIdfA73+seCZajB2WpanGOSPCJguy75JQYBA0='} 2024-04-21T22:09:53.596 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-21T22:09:53.603 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-21T22:09:53.604 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-21T22:09:53.604 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-21T22:09:53.604 INFO:teuthology.run_tasks:Running task console_log... 2024-04-21T22:09:53.733 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1f14d73160>, signals=[15]) 2024-04-21T22:09:53.734 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-21T22:09:53.744 INFO:teuthology.task.internal:Opening connections... 2024-04-21T22:09:53.745 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:09:53.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:09:53.825 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-21T22:09:53.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:09:53.899 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-04-21T22:09:53.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:09:53.975 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-21T22:09:53.985 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-04-21T22:09:54.004 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-04-21T22:09:54.004 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-21T22:09:54.062 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-04-21T22:09:54.062 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-04-21T22:09:54.062 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-04-21T22:09:54.062 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T22:09:54.063 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T22:09:54.064 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-21T22:09:54.082 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-21T22:09:54.100 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-21T22:09:54.100 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-21T22:09:54.158 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T22:09:54.159 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T22:09:54.160 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T22:09:54.160 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-21T22:09:54.182 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-04-21T22:09:54.200 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-04-21T22:09:54.201 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-21T22:09:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-21T22:09:54.258 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-21T22:09:54.258 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-21T22:09:54.281 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-21T22:09:54.294 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-21T22:09:54.320 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-21T22:09:54.321 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-04-21T22:09:54.323 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-21T22:09:54.325 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-04-21T22:09:54.342 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-21T22:09:54.354 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-21T22:09:54.354 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-04-21T22:09:54.381 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-21T22:09:54.383 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-04-21T22:09:54.408 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-21T22:09:54.488 INFO:teuthology.run_tasks:Running task kernel... 2024-04-21T22:09:54.503 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-21T22:09:54.504 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-21T22:09:54.504 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-21T22:09:54.504 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T22:09:54.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:09:54.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-21T22:09:54.706 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-21T22:09:54.706 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-21T22:09:54.707 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-21T22:09:54.724 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-437.el9.x86_64 2024-04-21T22:09:54.724 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-21T22:09:54.724 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-21T22:09:54.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum upgrade -y linux-firmware 2024-04-21T22:09:56.807 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-21T22:10:00.715 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 19 MB 00:02 2024-04-21T22:10:12.824 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 760 kB/s | 6.2 MB 00:08 2024-04-21T22:10:14.349 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-21T22:10:15.967 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-21T22:10:21.142 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-04-21T22:10:23.230 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-04-21T22:10:23.231 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-04-21T22:10:23.232 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-04-21T22:10:23.331 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-21T22:10:23.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-21T22:10:23.559 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-21T22:10:23.559 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-21T22:10:23.562 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi018.front.sepia.ceph.com to complete... 2024-04-21T22:10:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21 22:10:39 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-21T22:10:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:FINISHED --2024-04-21 22:10:39-- 2024-04-21T22:10:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:Total wall clock time: 16s 2024-04-21T22:10:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:Downloaded: 1 files, 341M in 15s (22.1 MB/s) 2024-04-21T22:10:39.398 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-21T22:10:39.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-21T22:10:41.582 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying... ######################################## 2024-04-21T22:10:41.700 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing... ######################################## 2024-04-21T22:10:41.809 INFO:teuthology.orchestra.run.smithi018.stdout:Updating / installing... 2024-04-21T22:10:50.116 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-21T22:11:30.181 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-21T22:11:30.182 DEBUG:teuthology.orchestra.run.smithi018:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-21T22:11:30.270 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-21T22:11:30.271 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-21T22:11:30.272 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-21T22:11:30.273 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-21T22:11:30.274 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-21T22:11:30.275 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-21T22:11:30.276 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-21T22:11:30.277 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-21T22:11:30.278 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-21T22:11:30.279 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-21T22:11:30.280 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-21T22:11:30.281 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-21T22:11:30.282 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-21T22:11:30.283 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-21T22:11:30.284 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-21T22:11:30.285 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-21T22:11:30.286 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-21T22:11:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-21T22:11:30.288 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-21T22:11:30.289 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-21T22:11:30.290 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-21T22:11:30.291 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-21T22:11:30.292 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-21T22:11:30.293 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-21T22:11:30.294 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-21T22:11:30.295 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-21T22:11:30.296 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-21T22:11:30.297 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-21T22:11:30.298 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-21T22:11:30.299 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-21T22:11:30.300 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-21T22:11:30.301 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-21T22:11:30.302 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-21T22:11:30.303 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-21T22:11:30.304 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-21T22:11:30.305 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-21T22:11:30.306 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-21T22:11:30.307 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-21T22:11:30.307 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-21T22:11:30.307 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-21T22:11:30.307 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-21T22:11:30.309 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-21T22:11:30.310 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-21T22:11:30.311 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-21T22:11:30.312 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-21T22:11:30.313 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-21T22:11:30.314 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-21T22:11:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-21T22:11:30.316 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-21T22:11:30.317 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-21T22:11:30.318 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-21T22:11:30.319 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-21T22:11:30.320 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-21T22:11:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-21T22:11:30.322 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-21T22:11:30.323 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-21T22:11:30.324 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-21T22:11:30.325 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-21T22:11:30.326 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-21T22:11:30.327 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-21T22:11:30.328 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-21T22:11:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-21T22:11:30.330 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-21T22:11:30.331 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-21T22:11:30.332 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-21T22:11:30.333 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-21T22:11:30.334 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-21T22:11:30.335 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-21T22:11:30.336 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-21T22:11:30.337 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-21T22:11:30.338 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-21T22:11:30.339 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-21T22:11:30.340 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-21T22:11:30.341 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-21T22:11:30.342 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-21T22:11:30.343 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-21T22:11:30.344 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-21T22:11:30.345 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-21T22:11:30.346 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-21T22:11:30.347 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-21T22:11:30.348 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-21T22:11:30.349 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-21T22:11:30.350 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-21T22:11:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-21T22:11:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-21T22:11:30.353 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-21T22:11:30.354 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-21T22:11:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-21T22:11:30.356 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-21T22:11:30.357 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-21T22:11:30.358 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-21T22:11:30.359 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-21T22:11:30.360 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-21T22:11:30.361 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-21T22:11:30.362 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-21T22:11:30.363 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-21T22:11:30.364 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-21T22:11:30.365 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-21T22:11:30.366 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-21T22:11:30.367 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-21T22:11:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-21T22:11:30.369 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-21T22:11:30.370 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-21T22:11:30.371 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-21T22:11:30.372 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-21T22:11:30.373 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-21T22:11:30.374 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-21T22:11:30.375 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-21T22:11:30.376 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-21T22:11:30.377 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-21T22:11:30.378 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-21T22:11:30.379 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-21T22:11:30.380 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-21T22:11:30.381 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-21T22:11:30.382 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-21T22:11:30.383 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-21T22:11:30.384 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-21T22:11:30.385 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-21T22:11:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-21T22:11:30.387 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-21T22:11:30.388 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-21T22:11:30.389 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-21T22:11:30.390 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-21T22:11:30.391 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-21T22:11:30.392 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-21T22:11:30.393 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-21T22:11:30.394 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-21T22:11:30.395 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-21T22:11:30.396 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-21T22:11:30.397 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-21T22:11:30.398 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-21T22:11:30.399 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-21T22:11:30.400 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-21T22:11:30.401 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-21T22:11:30.402 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-21T22:11:30.403 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-21T22:11:30.404 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-21T22:11:30.405 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-21T22:11:30.406 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-21T22:11:30.407 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-21T22:11:30.408 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-21T22:11:30.409 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-21T22:11:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-21T22:11:30.411 INFO:teuthology.orchestra.run.smithi018.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-21T22:11:30.416 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.416 DEBUG:teuthology.orchestra.run.smithi018:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:postinstall scriptlet (using /bin/sh): 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:for file in vmlinuz System.map config; do 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: fi 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-21T22:11:30.440 INFO:teuthology.orchestra.run.smithi018.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.441 INFO:teuthology.orchestra.run.smithi018.stdout:fi 2024-04-21T22:11:30.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-04-21T22:11:30.526 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-04-21T22:11:30.527 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-04-21T22:11:30.527 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 68.el9 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8264254 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-21T22:11:30.528 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:11:30.529 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-04-21T22:11:30.530 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-21T22:11:30.530 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:30.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-21T22:11:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-04-21T22:11:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-21T22:11:32.580 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-04-21T22:11:32.583 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-21T22:11:32.598 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.EQzJT8DXtI 2024-04-21T22:11:32.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EQzJT8DXtI 2024-04-21T22:11:32.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.EQzJT8DXtI 2024-04-21T22:11:32.810 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.EQzJT8DXtI is 6KB 2024-04-21T22:11:32.830 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.EQzJT8DXtI 2024-04-21T22:11:32.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-04-21T22:11:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-21T22:11:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-21T22:11:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-21T22:11:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-21T22:11:32.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-21T22:11:33.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-04-21T22:12:03.092 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-21T22:12:03.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:12:03.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:12:21.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-21T22:12:30.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:12:30.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:13:30.667 DEBUG:teuthology.orchestra.remote:timed out 2024-04-21T22:13:42.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:13:42.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:13:43.097 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-21T22:13:43.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:13:43.695 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-21T22:13:43.696 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-21T22:13:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:6.9.0-rc3-g806ec36b2112 2024-04-21T22:13:43.751 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-21T22:13:43.751 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-21T22:13:43.751 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-21T22:13:44.753 DEBUG:teuthology.parallel:result is None 2024-04-21T22:13:44.753 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-21T22:13:44.761 INFO:teuthology.task.internal:Creating test directory... 2024-04-21T22:13:44.762 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T22:13:44.769 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T22:13:44.773 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T22:13:44.821 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-21T22:13:44.829 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-21T22:13:44.857 INFO:teuthology.task.internal:Creating archive directory... 2024-04-21T22:13:44.857 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T22:13:44.865 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T22:13:44.868 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T22:13:44.939 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-21T22:13:44.946 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-21T22:13:44.947 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T22:13:44.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:13:44.964 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T22:13:44.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:13:44.981 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T22:13:44.989 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T22:13:45.007 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T22:13:45.038 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.072 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.072 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.088 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.122 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.176 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T22:13:45.180 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-21T22:13:45.188 INFO:teuthology.task.internal:Configuring sudo... 2024-04-21T22:13:45.188 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T22:13:45.195 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T22:13:45.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T22:13:45.282 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-21T22:13:45.292 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-21T22:13:45.292 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T22:13:45.298 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T22:13:45.300 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T22:13:45.346 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:45.429 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:45.531 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:45.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:45.709 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:13:45.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T22:13:45.810 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:45.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:45.917 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:46.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:46.053 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:13:46.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T22:13:46.122 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:46.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T22:13:46.220 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:46.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T22:13:46.345 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:13:46.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T22:13:46.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-04-21T22:13:46.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-21T22:13:46.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-04-21T22:13:46.455 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:13:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:13:46.537 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:13:46.925 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-21T22:13:46.933 INFO:teuthology.task.internal:Starting timer... 2024-04-21T22:13:46.933 INFO:teuthology.run_tasks:Running task pcp... 2024-04-21T22:13:46.986 INFO:teuthology.run_tasks:Running task selinux... 2024-04-21T22:13:47.019 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-21T22:13:47.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-04-21T22:13:47.127 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-04-21T22:13:47.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-04-21T22:13:47.199 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-04-21T22:13:47.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-04-21T22:13:47.273 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-04-21T22:13:47.275 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-21T22:13:47.275 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-04-21T22:13:47.337 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-04-21T22:13:47.337 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-04-21T22:13:47.359 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-04-21T22:13:47.359 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-04-21T22:13:47.382 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-04-21T22:13:47.382 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive'} 2024-04-21T22:13:47.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:13:47.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:13:47.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:13:47.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:13:47.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:13:47.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:13:47.523 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-21T22:13:47.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-04-21T22:13:47.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-04-21T22:13:47.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-04-21T22:13:47.662 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-21T22:13:47.672 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-21T22:13:47.677 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-21T22:13:47.810 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-21T22:13:47.829 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-21T22:13:47.831 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi047.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-21T22:19:03.486 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2024-04-21T22:19:03.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:19:03.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:19:03.609 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-21T22:19:03.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-21T22:19:03.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-21T22:19:03.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:19:03.845 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-21T22:19:03.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-21T22:19:03.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-21T22:19:03.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T22:19:04.005 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-21T22:19:04.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-21T22:19:04.087 INFO:teuthology.run_tasks:Running task clock... 2024-04-21T22:19:04.099 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-21T22:19:04.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T22:19:04.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:19:04.107 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T22:19:04.107 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:19:04.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T22:19:04.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:19:04.141 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T22:19:04.156 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T22:19:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T22:19:04.170 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T22:19:04.182 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-04-21T22:19:04.193 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-04-21T22:19:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-04-21T22:19:04.198 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-04-21T22:19:04.207 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T22:19:04.218 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T22:19:04.221 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T22:19:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T22:19:04.244 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-21T22:19:04.278 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:19:04.282 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:19:04.282 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-21T22:19:04.282 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.282 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.283 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.283 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.285 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.289 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.319 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-04-21T22:19:04.353 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-04-21T22:19:04.396 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-21T22:19:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-21T22:19:04.590 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.601 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:19:04.603 INFO:teuthology.run_tasks:Running task install... 2024-04-21T22:19:04.612 DEBUG:teuthology.task.install:project ceph 2024-04-21T22:19:04.612 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'}} 2024-04-21T22:19:04.612 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b'} 2024-04-21T22:19:04.612 INFO:teuthology.task.install:Using flavor: default 2024-04-21T22:19:04.617 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-21T22:19:04.617 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-21T22:19:04.618 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'tag': None, 'wait_for_package': False} 2024-04-21T22:19:04.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:19:04.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'tag': None, 'wait_for_package': False} 2024-04-21T22:19:04.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:19:04.621 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'tag': None, 'wait_for_package': False} 2024-04-21T22:19:04.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:19:04.766 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/ 2024-04-21T22:19:04.766 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2405.g820a2f8c 2024-04-21T22:19:04.792 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/ 2024-04-21T22:19:04.792 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2405.g820a2f8c 2024-04-21T22:19:04.836 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/ 2024-04-21T22:19:04.836 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2405.g820a2f8c 2024-04-21T22:19:04.902 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T22:19:04.902 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:19:04.903 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T22:19:04.934 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T22:19:04.934 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:19:04.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T22:19:04.935 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T22:19:04.935 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820a2f8ced66152ed3d765c31444b8076ea28c6b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T22:19:05.005 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-21T22:19:05.005 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:19:05.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-21T22:19:05.006 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T22:19:05.031 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T22:19:05.031 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820a2f8ced66152ed3d765c31444b8076ea28c6b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T22:19:05.033 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-21T22:19:05.034 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820a2f8ced66152ed3d765c31444b8076ea28c6b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-21T22:19:05.085 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T22:19:05.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T22:19:05.151 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-04-21T22:19:05.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-04-21T22:19:05.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-21T22:19:05.176 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T22:19:05.240 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-04-21T22:19:05.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-04-21T22:19:05.290 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-21T22:19:05.374 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-04-21T22:19:05.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-04-21T22:19:05.391 INFO:teuthology.orchestra.run.smithi047.stdout:48 files removed 2024-04-21T22:19:05.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T22:19:05.468 INFO:teuthology.orchestra.run.smithi081.stdout:48 files removed 2024-04-21T22:19:05.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T22:19:05.714 INFO:teuthology.orchestra.run.smithi018.stdout:48 files removed 2024-04-21T22:19:05.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-21T22:19:06.095 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 206 kB/s | 83 kB 00:00 2024-04-21T22:19:06.164 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 202 kB/s | 83 kB 00:00 2024-04-21T22:19:06.470 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-21T22:19:06.582 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-21T22:19:06.676 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-04-21T22:19:06.804 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-04-21T22:19:06.983 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 5.0 kB/s | 1.8 kB 00:00 2024-04-21T22:19:07.259 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 23 kB/s | 11 kB 00:00 2024-04-21T22:19:07.354 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-21T22:19:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-21T22:19:07.818 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 3.9 kB/s | 1.8 kB 00:00 2024-04-21T22:19:09.801 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-21T22:19:09.833 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-21T22:19:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-04-21T22:19:14.064 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-21T22:19:14.085 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-04-21T22:19:14.750 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 19 MB 00:02 2024-04-21T22:19:15.460 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-04-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-21T22:19:17.058 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-21T22:19:19.608 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-21T22:19:21.510 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-21T22:19:22.417 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-21T22:19:22.878 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-21T22:19:24.635 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:24.635 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:24.646 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T22:19:24.647 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T22:19:24.648 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T22:19:24.649 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T22:19:24.650 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T22:19:24.653 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T22:19:24.654 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T22:19:24.717 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 6.6 k 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.4 M 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 889 k 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 145 k 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 1.5 M 2024-04-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 141 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 3.5 M 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 7.4 M 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 49 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 10 M 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 48 M 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 264 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 762 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 222 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 27 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 18 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 32 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 745 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 127 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 161 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 321 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 298 k 2024-04-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 99 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 86 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 171 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.4 M 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 21 M 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 32 k 2024-04-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 2.4 M 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 249 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 4.7 M 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 17 M 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 15 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 25 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 164 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 501 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.3 M 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 45 k 2024-04-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 133 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout:Install 148 Packages 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-04-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:19:24.749 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 216 M 2024-04-21T22:19:24.749 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-04-21T22:19:25.435 INFO:teuthology.orchestra.run.smithi047.stdout:(1/150): ceph-19.0.0-2405.g820a2f8c.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-04-21T22:19:25.818 INFO:teuthology.orchestra.run.smithi047.stdout:(2/150): ceph-fuse-19.0.0-2405.g820a2f8c.el9.x8 2.3 MB/s | 889 kB 00:00 2024-04-21T22:19:25.902 INFO:teuthology.orchestra.run.smithi047.stdout:(3/150): ceph-immutable-object-cache-19.0.0-240 1.7 MB/s | 145 kB 00:00 2024-04-21T22:19:26.336 INFO:teuthology.orchestra.run.smithi047.stdout:(4/150): ceph-base-19.0.0-2405.g820a2f8c.el9.x8 4.8 MB/s | 5.4 MB 00:01 2024-04-21T22:19:26.494 INFO:teuthology.orchestra.run.smithi047.stdout:(5/150): ceph-mds-19.0.0-2405.g820a2f8c.el9.x86 4.0 MB/s | 2.4 MB 00:00 2024-04-21T22:19:26.577 INFO:teuthology.orchestra.run.smithi047.stdout:(6/150): ceph-mgr-19.0.0-2405.g820a2f8c.el9.x86 6.2 MB/s | 1.5 MB 00:00 2024-04-21T22:19:26.794 INFO:teuthology.orchestra.run.smithi047.stdout:(7/150): ceph-common-19.0.0-2405.g820a2f8c.el9. 13 MB/s | 21 MB 00:01 2024-04-21T22:19:27.386 INFO:teuthology.orchestra.run.smithi047.stdout:(8/150): ceph-mon-19.0.0-2405.g820a2f8c.el9.x86 5.3 MB/s | 4.7 MB 00:00 2024-04-21T22:19:27.486 INFO:teuthology.orchestra.run.smithi047.stdout:(9/150): ceph-selinux-19.0.0-2405.g820a2f8c.el9 252 kB/s | 25 kB 00:00 2024-04-21T22:19:27.637 INFO:teuthology.orchestra.run.smithi047.stdout:(10/150): ceph-radosgw-19.0.0-2405.g820a2f8c.el 12 MB/s | 10 MB 00:00 2024-04-21T22:19:27.721 INFO:teuthology.orchestra.run.smithi047.stdout:(11/150): cephfs-mirror-19.0.0-2405.g820a2f8c.e 2.6 MB/s | 222 kB 00:00 2024-04-21T22:19:27.796 INFO:teuthology.orchestra.run.smithi047.stdout:(12/150): cephfs-shell-19.0.0-2405.g820a2f8c.el 361 kB/s | 27 kB 00:00 2024-04-21T22:19:27.880 INFO:teuthology.orchestra.run.smithi047.stdout:(13/150): libcephfs-devel-19.0.0-2405.g820a2f8c 380 kB/s | 32 kB 00:00 2024-04-21T22:19:28.106 INFO:teuthology.orchestra.run.smithi047.stdout:(14/150): ceph-osd-19.0.0-2405.g820a2f8c.el9.x8 11 MB/s | 17 MB 00:01 2024-04-21T22:19:28.139 INFO:teuthology.orchestra.run.smithi047.stdout:(15/150): libcephfs2-19.0.0-2405.g820a2f8c.el9. 2.8 MB/s | 745 kB 00:00 2024-04-21T22:19:28.172 INFO:teuthology.orchestra.run.smithi047.stdout:(16/150): libcephsqlite-19.0.0-2405.g820a2f8c.e 2.4 MB/s | 164 kB 00:00 2024-04-21T22:19:28.214 INFO:teuthology.orchestra.run.smithi047.stdout:(17/150): librados-devel-19.0.0-2405.g820a2f8c. 1.7 MB/s | 127 kB 00:00 2024-04-21T22:19:28.248 INFO:teuthology.orchestra.run.smithi047.stdout:(18/150): libradosstriper1-19.0.0-2405.g820a2f8 6.5 MB/s | 501 kB 00:00 2024-04-21T22:19:28.348 INFO:teuthology.orchestra.run.smithi047.stdout:(19/150): python3-ceph-argparse-19.0.0-2405.g82 451 kB/s | 45 kB 00:00 2024-04-21T22:19:28.448 INFO:teuthology.orchestra.run.smithi047.stdout:(20/150): python3-ceph-common-19.0.0-2405.g820a 1.3 MB/s | 133 kB 00:00 2024-04-21T22:19:28.557 INFO:teuthology.orchestra.run.smithi047.stdout:(21/150): python3-cephfs-19.0.0-2405.g820a2f8c. 1.5 MB/s | 161 kB 00:00 2024-04-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi047.stdout:(22/150): librgw2-19.0.0-2405.g820a2f8c.el9.x86 12 MB/s | 5.3 MB 00:00 2024-04-21T22:19:28.674 INFO:teuthology.orchestra.run.smithi047.stdout:(23/150): python3-rados-19.0.0-2405.g820a2f8c.e 2.7 MB/s | 321 kB 00:00 2024-04-21T22:19:28.716 INFO:teuthology.orchestra.run.smithi047.stdout:(24/150): python3-rbd-19.0.0-2405.g820a2f8c.el9 4.4 MB/s | 298 kB 00:00 2024-04-21T22:19:28.750 INFO:teuthology.orchestra.run.smithi047.stdout:(25/150): python3-rgw-19.0.0-2405.g820a2f8c.el9 1.3 MB/s | 99 kB 00:00 2024-04-21T22:19:28.775 INFO:teuthology.orchestra.run.smithi047.stdout:(26/150): rbd-fuse-19.0.0-2405.g820a2f8c.el9.x8 1.4 MB/s | 86 kB 00:00 2024-04-21T22:19:29.003 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-04-21T22:19:29.050 INFO:teuthology.orchestra.run.smithi047.stdout:(27/150): rbd-mirror-19.0.0-2405.g820a2f8c.el9. 10 MB/s | 3.1 MB 00:00 2024-04-21T22:19:29.117 INFO:teuthology.orchestra.run.smithi047.stdout:(28/150): ceph-grafana-dashboards-19.0.0-2405.g 477 kB/s | 32 kB 00:00 2024-04-21T22:19:29.184 INFO:teuthology.orchestra.run.smithi047.stdout:(29/150): ceph-mgr-cephadm-19.0.0-2405.g820a2f8 2.1 MB/s | 141 kB 00:00 2024-04-21T22:19:29.226 INFO:teuthology.orchestra.run.smithi047.stdout:(30/150): rbd-nbd-19.0.0-2405.g820a2f8c.el9.x86 378 kB/s | 171 kB 00:00 2024-04-21T22:19:29.588 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 21 MB 00:14 2024-04-21T22:19:29.626 INFO:teuthology.orchestra.run.smithi047.stdout:(31/150): ceph-mgr-dashboard-19.0.0-2405.g820a2 7.9 MB/s | 3.5 MB 00:00 2024-04-21T22:19:29.710 INFO:teuthology.orchestra.run.smithi047.stdout:(32/150): ceph-mgr-modules-core-19.0.0-2405.g82 2.9 MB/s | 249 kB 00:00 2024-04-21T22:19:29.802 INFO:teuthology.orchestra.run.smithi047.stdout:(33/150): ceph-mgr-rook-19.0.0-2405.g820a2f8c.e 538 kB/s | 49 kB 00:00 2024-04-21T22:19:29.877 INFO:teuthology.orchestra.run.smithi047.stdout:(34/150): ceph-prometheus-alerts-19.0.0-2405.g8 204 kB/s | 15 kB 00:00 2024-04-21T22:19:29.961 INFO:teuthology.orchestra.run.smithi047.stdout:(35/150): ceph-volume-19.0.0-2405.g820a2f8c.el9 3.1 MB/s | 264 kB 00:00 2024-04-21T22:19:30.053 INFO:teuthology.orchestra.run.smithi047.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 9.0 MB/s | 7.4 MB 00:00 2024-04-21T22:19:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:(37/150): cephadm-19.0.0-2405.g820a2f8c.el9.noa 5.6 MB/s | 762 kB 00:00 2024-04-21T22:19:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:(38/150): cephfs-top-19.0.0-2405.g820a2f8c.el9. 243 kB/s | 18 kB 00:00 2024-04-21T22:19:30.320 INFO:teuthology.orchestra.run.smithi047.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 357 kB/s | 80 kB 00:00 2024-04-21T22:19:30.404 INFO:teuthology.orchestra.run.smithi047.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-21T22:19:30.446 INFO:teuthology.orchestra.run.smithi047.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-21T22:19:30.488 INFO:teuthology.orchestra.run.smithi047.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-21T22:19:30.538 INFO:teuthology.orchestra.run.smithi047.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-21T22:19:30.563 INFO:teuthology.orchestra.run.smithi047.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-21T22:19:30.606 INFO:teuthology.orchestra.run.smithi047.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-21T22:19:30.631 INFO:teuthology.orchestra.run.smithi047.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-21T22:19:30.673 INFO:teuthology.orchestra.run.smithi047.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-21T22:19:30.706 INFO:teuthology.orchestra.run.smithi047.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-04-21T22:19:31.132 INFO:teuthology.orchestra.run.smithi047.stdout:(49/150): ceph-test-19.0.0-2405.g820a2f8c.el9.x 13 MB/s | 48 MB 00:03 2024-04-21T22:19:31.165 INFO:teuthology.orchestra.run.smithi047.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-04-21T22:19:31.190 INFO:teuthology.orchestra.run.smithi047.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 221 kB/s | 107 kB 00:00 2024-04-21T22:19:31.216 INFO:teuthology.orchestra.run.smithi047.stdout:(52/150): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-04-21T22:19:31.249 INFO:teuthology.orchestra.run.smithi047.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-21T22:19:31.274 INFO:teuthology.orchestra.run.smithi047.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-04-21T22:19:31.316 INFO:teuthology.orchestra.run.smithi047.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 274 kB/s | 18 kB 00:00 2024-04-21T22:19:31.408 INFO:teuthology.orchestra.run.smithi047.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-21T22:19:31.433 INFO:teuthology.orchestra.run.smithi047.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.8 MB/s | 160 kB 00:00 2024-04-21T22:19:31.467 INFO:teuthology.orchestra.run.smithi047.stdout:(58/150): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-04-21T22:19:31.492 INFO:teuthology.orchestra.run.smithi047.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 548 kB/s | 45 kB 00:00 2024-04-21T22:19:31.526 INFO:teuthology.orchestra.run.smithi047.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-21T22:19:31.529 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:31.531 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:31.552 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T22:19:31.553 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T22:19:31.555 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T22:19:31.556 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T22:19:31.561 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T22:19:31.562 INFO:teuthology.orchestra.run.smithi047.stdout:(61/150): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-04-21T22:19:31.562 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T22:19:31.563 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T22:19:31.576 INFO:teuthology.orchestra.run.smithi047.stdout:(62/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-04-21T22:19:31.594 INFO:teuthology.orchestra.run.smithi047.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-21T22:19:31.627 INFO:teuthology.orchestra.run.smithi047.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-21T22:19:31.638 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-04-21T22:19:31.652 INFO:teuthology.orchestra.run.smithi047.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-21T22:19:31.654 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 6.6 k 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.4 M 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 889 k 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 145 k 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 1.5 M 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 141 k 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 3.5 M 2024-04-21T22:19:31.655 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 7.4 M 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 49 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 10 M 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 48 M 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 264 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 762 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 222 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 27 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 18 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 32 k 2024-04-21T22:19:31.656 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 745 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 127 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 161 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 321 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 298 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 99 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 86 k 2024-04-21T22:19:31.657 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 171 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.4 M 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 21 M 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 32 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 2.4 M 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 249 k 2024-04-21T22:19:31.658 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 4.7 M 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 17 M 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 15 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 25 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 164 k 2024-04-21T22:19:31.659 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 501 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.3 M 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T22:19:31.660 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 45 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 133 k 2024-04-21T22:19:31.661 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 2 Packages 2024-04-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 216 M 2024-04-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-04-21T22:19:31.794 INFO:teuthology.orchestra.run.smithi047.stdout:(66/150): openblas-0.3.21-2.el9.x86_64.rpm 176 kB/s | 35 kB 00:00 2024-04-21T22:19:31.920 INFO:teuthology.orchestra.run.smithi047.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-04-21T22:19:32.012 INFO:teuthology.orchestra.run.smithi047.stdout:(68/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2024-04-21T22:19:32.078 INFO:teuthology.orchestra.run.smithi047.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-04-21T22:19:32.104 INFO:teuthology.orchestra.run.smithi047.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-21T22:19:32.162 INFO:teuthology.orchestra.run.smithi047.stdout:(71/150): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-04-21T22:19:32.204 INFO:teuthology.orchestra.run.smithi047.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-21T22:19:32.246 INFO:teuthology.orchestra.run.smithi047.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-04-21T22:19:32.347 INFO:teuthology.orchestra.run.smithi047.stdout:(74/150): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-21T22:19:32.388 INFO:teuthology.orchestra.run.smithi047.stdout:(75/150): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-21T22:19:32.414 INFO:teuthology.orchestra.run.smithi047.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-21T22:19:32.497 INFO:teuthology.orchestra.run.smithi047.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-21T22:19:32.523 INFO:teuthology.orchestra.run.smithi047.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-04-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi047.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-04-21T22:19:32.573 INFO:teuthology.orchestra.run.smithi047.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-21T22:19:32.598 INFO:teuthology.orchestra.run.smithi047.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-04-21T22:19:32.649 INFO:teuthology.orchestra.run.smithi047.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-21T22:19:32.674 INFO:teuthology.orchestra.run.smithi047.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-21T22:19:32.749 INFO:teuthology.orchestra.run.smithi047.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-04-21T22:19:32.774 INFO:teuthology.orchestra.run.smithi047.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 614 kB/s | 77 kB 00:00 2024-04-21T22:19:32.800 INFO:teuthology.orchestra.run.smithi047.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-04-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi047.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi047.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-21T22:19:32.875 INFO:teuthology.orchestra.run.smithi047.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-21T22:19:32.919 INFO:teuthology.orchestra.run.smithi047.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 544 kB/s | 51 kB 00:00 2024-04-21T22:19:32.942 INFO:teuthology.orchestra.run.smithi047.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-04-21T22:19:32.993 INFO:teuthology.orchestra.run.smithi047.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 566 kB/s | 42 kB 00:00 2024-04-21T22:19:33.027 INFO:teuthology.orchestra.run.smithi047.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 527 kB/s | 44 kB 00:00 2024-04-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi047.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi047.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-04-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi047.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-21T22:19:33.163 INFO:teuthology.orchestra.run.smithi018.stdout:(1/150): ceph-19.0.0-2405.g820a2f8c.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-04-21T22:19:33.178 INFO:teuthology.orchestra.run.smithi047.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-21T22:19:33.220 INFO:teuthology.orchestra.run.smithi047.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi047.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-21T22:19:33.430 INFO:teuthology.orchestra.run.smithi018.stdout:(2/150): ceph-fuse-19.0.0-2405.g820a2f8c.el9.x8 3.3 MB/s | 889 kB 00:00 2024-04-21T22:19:33.554 INFO:teuthology.orchestra.run.smithi047.stdout:(100/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-21T22:19:33.579 INFO:teuthology.orchestra.run.smithi047.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 177 kB/s | 64 kB 00:00 2024-04-21T22:19:33.597 INFO:teuthology.orchestra.run.smithi018.stdout:(3/150): ceph-base-19.0.0-2405.g820a2f8c.el9.x8 7.7 MB/s | 5.4 MB 00:00 2024-04-21T22:19:33.604 INFO:teuthology.orchestra.run.smithi047.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 125 kB/s | 45 kB 00:00 2024-04-21T22:19:33.630 INFO:teuthology.orchestra.run.smithi018.stdout:(4/150): ceph-immutable-object-cache-19.0.0-240 727 kB/s | 145 kB 00:00 2024-04-21T22:19:33.646 INFO:teuthology.orchestra.run.smithi047.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-04-21T22:19:33.713 INFO:teuthology.orchestra.run.smithi047.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-04-21T22:19:33.856 INFO:teuthology.orchestra.run.smithi018.stdout:(5/150): ceph-mds-19.0.0-2405.g820a2f8c.el9.x86 9.2 MB/s | 2.4 MB 00:00 2024-04-21T22:19:33.939 INFO:teuthology.orchestra.run.smithi018.stdout:(6/150): ceph-mgr-19.0.0-2405.g820a2f8c.el9.x86 4.9 MB/s | 1.5 MB 00:00 2024-04-21T22:19:34.122 INFO:teuthology.orchestra.run.smithi047.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 54 kB/s | 19 kB 00:00 2024-04-21T22:19:34.280 INFO:teuthology.orchestra.run.smithi047.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 487 kB/s | 309 kB 00:00 2024-04-21T22:19:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:(107/150): abseil-cpp-20211102.0-3.el9.x86_64.r 764 kB/s | 548 kB 00:00 2024-04-21T22:19:34.372 INFO:teuthology.orchestra.run.smithi047.stdout:(108/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-04-21T22:19:34.423 INFO:teuthology.orchestra.run.smithi047.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-21T22:19:34.481 INFO:teuthology.orchestra.run.smithi047.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-04-21T22:19:34.531 INFO:teuthology.orchestra.run.smithi047.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi047.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-21T22:19:34.774 INFO:teuthology.orchestra.run.smithi047.stdout:(113/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-04-21T22:19:34.838 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 5.5 kB/s | 1.7 kB 00:00 2024-04-21T22:19:34.850 INFO:teuthology.orchestra.run.smithi047.stdout:(114/150): libarrow-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-04-21T22:19:34.874 INFO:teuthology.orchestra.run.smithi047.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 325 kB/s | 43 kB 00:00 2024-04-21T22:19:34.900 INFO:teuthology.orchestra.run.smithi047.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 257 kB/s | 32 kB 00:00 2024-04-21T22:19:34.901 INFO:teuthology.orchestra.run.smithi018.stdout:(7/150): ceph-common-19.0.0-2405.g820a2f8c.el9. 10 MB/s | 21 MB 00:02 2024-04-21T22:19:34.950 INFO:teuthology.orchestra.run.smithi047.stdout:(117/150): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-21T22:19:35.008 INFO:teuthology.orchestra.run.smithi047.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-21T22:19:35.033 INFO:teuthology.orchestra.run.smithi047.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-04-21T22:19:35.040 INFO:teuthology.orchestra.run.smithi018.stdout:(8/150): ceph-mon-19.0.0-2405.g820a2f8c.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-04-21T22:19:35.084 INFO:teuthology.orchestra.run.smithi047.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-21T22:19:35.106 INFO:teuthology.orchestra.run.smithi018.stdout:(9/150): ceph-selinux-19.0.0-2405.g820a2f8c.el9 384 kB/s | 25 kB 00:00 2024-04-21T22:19:35.134 INFO:teuthology.orchestra.run.smithi047.stdout:(121/150): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-04-21T22:19:35.159 INFO:teuthology.orchestra.run.smithi047.stdout:(122/150): python3-google-auth-2.28.2-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-04-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi047.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi047.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-21T22:19:35.293 INFO:teuthology.orchestra.run.smithi047.stdout:(125/150): python3-grpcio-tools-1.46.7-10.el9.x 908 kB/s | 144 kB 00:00 2024-04-21T22:19:35.344 INFO:teuthology.orchestra.run.smithi047.stdout:(126/150): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-21T22:19:35.369 INFO:teuthology.orchestra.run.smithi047.stdout:(127/150): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi047.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-21T22:19:35.444 INFO:teuthology.orchestra.run.smithi047.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-21T22:19:35.495 INFO:teuthology.orchestra.run.smithi047.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-21T22:19:35.520 INFO:teuthology.orchestra.run.smithi047.stdout:(131/150): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-04-21T22:19:35.545 INFO:teuthology.orchestra.run.smithi047.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 785 kB/s | 79 kB 00:00 2024-04-21T22:19:35.557 INFO:teuthology.orchestra.run.smithi018.stdout:(10/150): ceph-radosgw-19.0.0-2405.g820a2f8c.el 16 MB/s | 10 MB 00:00 2024-04-21T22:19:35.596 INFO:teuthology.orchestra.run.smithi047.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-04-21T22:19:35.632 INFO:teuthology.orchestra.run.smithi018.stdout:(11/150): cephfs-mirror-19.0.0-2405.g820a2f8c.e 2.9 MB/s | 222 kB 00:00 2024-04-21T22:19:35.637 INFO:teuthology.orchestra.run.smithi047.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-21T22:19:35.663 INFO:teuthology.orchestra.run.smithi047.stdout:(135/150): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-04-21T22:19:35.696 INFO:teuthology.orchestra.run.smithi047.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-04-21T22:19:35.715 INFO:teuthology.orchestra.run.smithi018.stdout:(12/150): cephfs-shell-19.0.0-2405.g820a2f8c.el 328 kB/s | 27 kB 00:00 2024-04-21T22:19:35.755 INFO:teuthology.orchestra.run.smithi047.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 240 kB/s | 28 kB 00:00 2024-04-21T22:19:35.774 INFO:teuthology.orchestra.run.smithi018.stdout:(13/150): libcephfs-devel-19.0.0-2405.g820a2f8c 554 kB/s | 32 kB 00:00 2024-04-21T22:19:35.781 INFO:teuthology.orchestra.run.smithi047.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-04-21T22:19:35.805 INFO:teuthology.orchestra.run.smithi047.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-21T22:19:35.856 INFO:teuthology.orchestra.run.smithi047.stdout:(140/150): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-21T22:19:35.877 INFO:teuthology.orchestra.run.smithi018.stdout:(14/150): libcephfs2-19.0.0-2405.g820a2f8c.el9. 7.3 MB/s | 745 kB 00:00 2024-04-21T22:19:35.881 INFO:teuthology.orchestra.run.smithi047.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-04-21T22:19:35.906 INFO:teuthology.orchestra.run.smithi047.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-04-21T22:19:35.941 INFO:teuthology.orchestra.run.smithi018.stdout:(15/150): libcephsqlite-19.0.0-2405.g820a2f8c.e 2.4 MB/s | 164 kB 00:00 2024-04-21T22:19:35.973 INFO:teuthology.orchestra.run.smithi047.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-21T22:19:35.999 INFO:teuthology.orchestra.run.smithi047.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 765 kB/s | 90 kB 00:00 2024-04-21T22:19:36.008 INFO:teuthology.orchestra.run.smithi018.stdout:(16/150): librados-devel-19.0.0-2405.g820a2f8c. 1.9 MB/s | 127 kB 00:00 2024-04-21T22:19:36.032 INFO:teuthology.orchestra.run.smithi047.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-21T22:19:36.066 INFO:teuthology.orchestra.run.smithi047.stdout:(146/150): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-04-21T22:19:36.108 INFO:teuthology.orchestra.run.smithi047.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-21T22:19:36.125 INFO:teuthology.orchestra.run.smithi018.stdout:(17/150): libradosstriper1-19.0.0-2405.g820a2f8 4.2 MB/s | 501 kB 00:00 2024-04-21T22:19:36.175 INFO:teuthology.orchestra.run.smithi047.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-21T22:19:36.559 INFO:teuthology.orchestra.run.smithi018.stdout:(18/150): librgw2-19.0.0-2405.g820a2f8c.el9.x86 12 MB/s | 5.3 MB 00:00 2024-04-21T22:19:36.626 INFO:teuthology.orchestra.run.smithi018.stdout:(19/150): python3-ceph-argparse-19.0.0-2405.g82 690 kB/s | 45 kB 00:00 2024-04-21T22:19:36.750 INFO:teuthology.orchestra.run.smithi047.stdout:(149/150): librbd1-19.0.0-2405.g820a2f8c.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-04-21T22:19:36.843 INFO:teuthology.orchestra.run.smithi018.stdout:(20/150): ceph-osd-19.0.0-2405.g820a2f8c.el9.x8 5.8 MB/s | 17 MB 00:02 2024-04-21T22:19:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:(21/150): python3-ceph-common-19.0.0-2405.g820a 456 kB/s | 133 kB 00:00 2024-04-21T22:19:36.952 INFO:teuthology.orchestra.run.smithi018.stdout:(22/150): python3-cephfs-19.0.0-2405.g820a2f8c. 1.5 MB/s | 161 kB 00:00 2024-04-21T22:19:36.988 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:36.989 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-21T22:19:37.000 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-21T22:19:37.001 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-21T22:19:37.002 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-21T22:19:37.002 INFO:teuthology.orchestra.run.smithi018.stdout:(23/150): python3-rados-19.0.0-2405.g820a2f8c.e 3.8 MB/s | 321 kB 00:00 2024-04-21T22:19:37.002 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-21T22:19:37.004 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-21T22:19:37.006 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-21T22:19:37.007 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-21T22:19:37.061 INFO:teuthology.orchestra.run.smithi018.stdout:(24/150): python3-rbd-19.0.0-2405.g820a2f8c.el9 2.7 MB/s | 298 kB 00:00 2024-04-21T22:19:37.066 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-04-21T22:19:37.086 INFO:teuthology.orchestra.run.smithi018.stdout:(25/150): python3-rgw-19.0.0-2405.g820a2f8c.el9 1.2 MB/s | 99 kB 00:00 2024-04-21T22:19:37.087 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-04-21T22:19:37.087 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-04-21T22:19:37.087 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 6.6 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.4 M 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 889 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 145 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 1.5 M 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 141 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 3.5 M 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 7.4 M 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 49 k 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 10 M 2024-04-21T22:19:37.088 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 48 M 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 264 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 762 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 222 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 27 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 18 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 32 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 745 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 127 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-21T22:19:37.089 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 161 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 321 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 298 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 99 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 86 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 171 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-04-21T22:19:37.090 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.4 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 3.1 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 21 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 32 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 2.4 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 249 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 4.7 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 17 M 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2405.g820a2f8c.el9 ceph-noarch 15 k 2024-04-21T22:19:37.091 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 25 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 164 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-21T22:19:37.092 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 501 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 5.3 M 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-21T22:19:37.093 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-21T22:19:37.094 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 45 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.0.0-2405.g820a2f8c.el9 ceph 133 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-21T22:19:37.095 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-21T22:19:37.096 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-21T22:19:37.097 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-21T22:19:37.098 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-21T22:19:37.099 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-21T22:19:37.100 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-21T22:19:37.101 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-21T22:19:37.102 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-21T22:19:37.103 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-21T22:19:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 2 Packages 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 216 M 2024-04-21T22:19:37.105 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-04-21T22:19:37.111 INFO:teuthology.orchestra.run.smithi018.stdout:(26/150): rbd-fuse-19.0.0-2405.g820a2f8c.el9.x8 1.7 MB/s | 86 kB 00:00 2024-04-21T22:19:37.186 INFO:teuthology.orchestra.run.smithi018.stdout:(27/150): rbd-nbd-19.0.0-2405.g820a2f8c.el9.x86 2.3 MB/s | 171 kB 00:00 2024-04-21T22:19:37.279 INFO:teuthology.orchestra.run.smithi018.stdout:(28/150): ceph-grafana-dashboards-19.0.0-2405.g 349 kB/s | 32 kB 00:00 2024-04-21T22:19:37.390 INFO:teuthology.orchestra.run.smithi018.stdout:(29/150): rbd-mirror-19.0.0-2405.g820a2f8c.el9. 10 MB/s | 3.1 MB 00:00 2024-04-21T22:19:37.421 INFO:teuthology.orchestra.run.smithi018.stdout:(30/150): ceph-mgr-cephadm-19.0.0-2405.g820a2f8 1.0 MB/s | 141 kB 00:00 2024-04-21T22:19:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:(31/150): ceph-mgr-dashboard-19.0.0-2405.g820a2 11 MB/s | 3.5 MB 00:00 2024-04-21T22:19:37.797 INFO:teuthology.orchestra.run.smithi018.stdout:(32/150): ceph-mgr-modules-core-19.0.0-2405.g82 3.2 MB/s | 249 kB 00:00 2024-04-21T22:19:37.855 INFO:teuthology.orchestra.run.smithi018.stdout:(33/150): ceph-mgr-rook-19.0.0-2405.g820a2f8c.e 863 kB/s | 49 kB 00:00 2024-04-21T22:19:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:(34/150): ceph-prometheus-alerts-19.0.0-2405.g8 234 kB/s | 15 kB 00:00 2024-04-21T22:19:37.972 INFO:teuthology.orchestra.run.smithi081.stdout:(1/150): ceph-19.0.0-2405.g820a2f8c.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-04-21T22:19:37.998 INFO:teuthology.orchestra.run.smithi018.stdout:(35/150): ceph-volume-19.0.0-2405.g820a2f8c.el9 3.5 MB/s | 264 kB 00:00 2024-04-21T22:19:38.128 INFO:teuthology.orchestra.run.smithi018.stdout:(36/150): cephadm-19.0.0-2405.g820a2f8c.el9.noa 5.8 MB/s | 762 kB 00:00 2024-04-21T22:19:38.198 INFO:teuthology.orchestra.run.smithi018.stdout:(37/150): cephfs-top-19.0.0-2405.g820a2f8c.el9. 263 kB/s | 18 kB 00:00 2024-04-21T22:19:38.448 INFO:teuthology.orchestra.run.smithi081.stdout:(2/150): ceph-fuse-19.0.0-2405.g820a2f8c.el9.x8 1.8 MB/s | 889 kB 00:00 2024-04-21T22:19:38.473 INFO:teuthology.orchestra.run.smithi018.stdout:(38/150): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-04-21T22:19:38.523 INFO:teuthology.orchestra.run.smithi081.stdout:(3/150): ceph-immutable-object-cache-19.0.0-240 1.9 MB/s | 145 kB 00:00 2024-04-21T22:19:38.542 INFO:teuthology.orchestra.run.smithi047.stdout:(150/150): librados2-19.0.0-2405.g820a2f8c.el9. 1.4 MB/s | 3.4 MB 00:02 2024-04-21T22:19:38.550 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-04-21T22:19:38.551 INFO:teuthology.orchestra.run.smithi047.stdout:Total 16 MB/s | 216 MB 00:13 2024-04-21T22:19:38.624 INFO:teuthology.orchestra.run.smithi018.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 190 kB/s | 80 kB 00:00 2024-04-21T22:19:38.898 INFO:teuthology.orchestra.run.smithi081.stdout:(4/150): ceph-base-19.0.0-2405.g820a2f8c.el9.x8 4.8 MB/s | 5.4 MB 00:01 2024-04-21T22:19:38.899 INFO:teuthology.orchestra.run.smithi018.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 712 kB/s | 195 kB 00:00 2024-04-21T22:19:39.091 INFO:teuthology.orchestra.run.smithi018.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-21T22:19:39.107 INFO:teuthology.orchestra.run.smithi081.stdout:(5/150): ceph-mgr-19.0.0-2405.g820a2f8c.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-04-21T22:19:39.165 INFO:teuthology.orchestra.run.smithi081.stdout:(6/150): ceph-mds-19.0.0-2405.g820a2f8c.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-04-21T22:19:39.328 INFO:teuthology.orchestra.run.smithi018.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 941 kB/s | 803 kB 00:00 2024-04-21T22:19:39.383 INFO:teuthology.orchestra.run.smithi018.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-04-21T22:19:39.433 INFO:teuthology.orchestra.run.smithi018.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-21T22:19:39.492 INFO:teuthology.orchestra.run.smithi018.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-04-21T22:19:39.553 INFO:teuthology.orchestra.run.smithi018.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-21T22:19:39.601 INFO:teuthology.orchestra.run.smithi018.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-04-21T22:19:39.613 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-04-21T22:19:39.615 INFO:teuthology.orchestra.run.smithi081.stdout:(7/150): ceph-mon-19.0.0-2405.g820a2f8c.el9.x86 9.2 MB/s | 4.7 MB 00:00 2024-04-21T22:19:39.753 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-04-21T22:19:39.753 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-04-21T22:19:39.835 INFO:teuthology.orchestra.run.smithi018.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-21T22:19:39.885 INFO:teuthology.orchestra.run.smithi018.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-21T22:19:39.927 INFO:teuthology.orchestra.run.smithi018.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-04-21T22:19:39.944 INFO:teuthology.orchestra.run.smithi018.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 371 kB/s | 21 kB 00:00 2024-04-21T22:19:39.994 INFO:teuthology.orchestra.run.smithi018.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-21T22:19:40.011 INFO:teuthology.orchestra.run.smithi018.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 33 kB 00:00 2024-04-21T22:19:40.062 INFO:teuthology.orchestra.run.smithi018.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-21T22:19:40.151 INFO:teuthology.orchestra.run.smithi018.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 127 kB/s | 11 kB 00:00 2024-04-21T22:19:40.229 INFO:teuthology.orchestra.run.smithi018.stdout:(56/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-21T22:19:40.262 INFO:teuthology.orchestra.run.smithi018.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-21T22:19:40.288 INFO:teuthology.orchestra.run.smithi018.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 788 kB/s | 45 kB 00:00 2024-04-21T22:19:40.346 INFO:teuthology.orchestra.run.smithi018.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-21T22:19:40.397 INFO:teuthology.orchestra.run.smithi018.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-04-21T22:19:40.422 INFO:teuthology.orchestra.run.smithi018.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 343 kB/s | 25 kB 00:00 2024-04-21T22:19:40.455 INFO:teuthology.orchestra.run.smithi018.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 816 kB/s | 47 kB 00:00 2024-04-21T22:19:40.489 INFO:teuthology.orchestra.run.smithi018.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-21T22:19:40.523 INFO:teuthology.orchestra.run.smithi018.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-21T22:19:40.573 INFO:teuthology.orchestra.run.smithi018.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 426 kB/s | 35 kB 00:00 2024-04-21T22:19:40.733 INFO:teuthology.orchestra.run.smithi081.stdout:(8/150): ceph-radosgw-19.0.0-2405.g820a2f8c.el9 9.2 MB/s | 10 MB 00:01 2024-04-21T22:19:40.800 INFO:teuthology.orchestra.run.smithi081.stdout:(9/150): ceph-selinux-19.0.0-2405.g820a2f8c.el9 379 kB/s | 25 kB 00:00 2024-04-21T22:19:41.099 INFO:teuthology.orchestra.run.smithi018.stdout:(66/150): ceph-test-19.0.0-2405.g820a2f8c.el9.x 8.1 MB/s | 48 MB 00:05 2024-04-21T22:19:41.241 INFO:teuthology.orchestra.run.smithi018.stdout:(67/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 6.2 MB/s | 4.1 MB 00:00 2024-04-21T22:19:41.325 INFO:teuthology.orchestra.run.smithi081.stdout:(10/150): ceph-osd-19.0.0-2405.g820a2f8c.el9.x8 7.8 MB/s | 17 MB 00:02 2024-04-21T22:19:41.341 INFO:teuthology.orchestra.run.smithi018.stdout:(68/150): openblas-openmp-0.3.21-2.el9.x86_64.r 5.8 MB/s | 4.7 MB 00:00 2024-04-21T22:19:41.393 INFO:teuthology.orchestra.run.smithi018.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-04-21T22:19:41.394 INFO:teuthology.orchestra.run.smithi081.stdout:(11/150): cephfs-mirror-19.0.0-2405.g820a2f8c.e 3.3 MB/s | 222 kB 00:00 2024-04-21T22:19:41.425 INFO:teuthology.orchestra.run.smithi018.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-21T22:19:41.459 INFO:teuthology.orchestra.run.smithi081.stdout:(12/150): cephfs-shell-19.0.0-2405.g820a2f8c.el 406 kB/s | 27 kB 00:00 2024-04-21T22:19:41.526 INFO:teuthology.orchestra.run.smithi081.stdout:(13/150): libcephfs-devel-19.0.0-2405.g820a2f8c 475 kB/s | 32 kB 00:00 2024-04-21T22:19:41.533 INFO:teuthology.orchestra.run.smithi018.stdout:(71/150): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-21T22:19:41.558 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-04-21T22:19:41.558 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-04-21T22:19:41.575 INFO:teuthology.orchestra.run.smithi018.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-04-21T22:19:41.601 INFO:teuthology.orchestra.run.smithi018.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-21T22:19:41.659 INFO:teuthology.orchestra.run.smithi081.stdout:(14/150): libcephfs2-19.0.0-2405.g820a2f8c.el9. 5.5 MB/s | 745 kB 00:00 2024-04-21T22:19:41.667 INFO:teuthology.orchestra.run.smithi018.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-21T22:19:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:(75/150): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-04-21T22:19:41.827 INFO:teuthology.orchestra.run.smithi018.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-04-21T22:19:41.860 INFO:teuthology.orchestra.run.smithi081.stdout:(15/150): ceph-common-19.0.0-2405.g820a2f8c.el9 5.2 MB/s | 21 MB 00:04 2024-04-21T22:19:41.876 INFO:teuthology.orchestra.run.smithi018.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 310 kB/s | 26 kB 00:00 2024-04-21T22:19:41.885 INFO:teuthology.orchestra.run.smithi081.stdout:(16/150): libcephsqlite-19.0.0-2405.g820a2f8c.e 726 kB/s | 164 kB 00:00 2024-04-21T22:19:41.902 INFO:teuthology.orchestra.run.smithi018.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 258 kB/s | 19 kB 00:00 2024-04-21T22:19:41.927 INFO:teuthology.orchestra.run.smithi081.stdout:(17/150): librados-devel-19.0.0-2405.g820a2f8c. 1.9 MB/s | 127 kB 00:00 2024-04-21T22:19:41.935 INFO:teuthology.orchestra.run.smithi018.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-21T22:19:41.952 INFO:teuthology.orchestra.run.smithi081.stdout:(18/150): libradosstriper1-19.0.0-2405.g820a2f8 7.3 MB/s | 501 kB 00:00 2024-04-21T22:19:41.961 INFO:teuthology.orchestra.run.smithi018.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 600 kB/s | 35 kB 00:00 2024-04-21T22:19:42.011 INFO:teuthology.orchestra.run.smithi081.stdout:(19/150): python3-ceph-argparse-19.0.0-2405.g82 772 kB/s | 45 kB 00:00 2024-04-21T22:19:42.019 INFO:teuthology.orchestra.run.smithi018.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-21T22:19:42.078 INFO:teuthology.orchestra.run.smithi081.stdout:(20/150): python3-ceph-common-19.0.0-2405.g820a 1.9 MB/s | 133 kB 00:00 2024-04-21T22:19:42.136 INFO:teuthology.orchestra.run.smithi018.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-21T22:19:42.145 INFO:teuthology.orchestra.run.smithi081.stdout:(21/150): python3-cephfs-19.0.0-2405.g820a2f8c. 2.4 MB/s | 161 kB 00:00 2024-04-21T22:19:42.178 INFO:teuthology.orchestra.run.smithi018.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-04-21T22:19:42.204 INFO:teuthology.orchestra.run.smithi018.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-21T22:19:42.220 INFO:teuthology.orchestra.run.smithi081.stdout:(22/150): python3-rados-19.0.0-2405.g820a2f8c.e 4.2 MB/s | 321 kB 00:00 2024-04-21T22:19:42.256 INFO:teuthology.orchestra.run.smithi018.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 554 kB/s | 42 kB 00:00 2024-04-21T22:19:42.295 INFO:teuthology.orchestra.run.smithi081.stdout:(23/150): python3-rbd-19.0.0-2405.g820a2f8c.el9 3.9 MB/s | 298 kB 00:00 2024-04-21T22:19:42.296 INFO:teuthology.orchestra.run.smithi018.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-04-21T22:19:42.329 INFO:teuthology.orchestra.run.smithi018.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-21T22:19:42.362 INFO:teuthology.orchestra.run.smithi081.stdout:(24/150): python3-rgw-19.0.0-2405.g820a2f8c.el9 1.5 MB/s | 99 kB 00:00 2024-04-21T22:19:42.363 INFO:teuthology.orchestra.run.smithi018.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-21T22:19:42.388 INFO:teuthology.orchestra.run.smithi018.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 876 kB/s | 51 kB 00:00 2024-04-21T22:19:42.430 INFO:teuthology.orchestra.run.smithi081.stdout:(25/150): rbd-fuse-19.0.0-2405.g820a2f8c.el9.x8 1.3 MB/s | 86 kB 00:00 2024-04-21T22:19:42.431 INFO:teuthology.orchestra.run.smithi018.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 806 kB/s | 54 kB 00:00 2024-04-21T22:19:42.530 INFO:teuthology.orchestra.run.smithi081.stdout:(26/150): librgw2-19.0.0-2405.g820a2f8c.el9.x86 8.8 MB/s | 5.3 MB 00:00 2024-04-21T22:19:42.547 INFO:teuthology.orchestra.run.smithi018.stdout:(91/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-04-21T22:19:42.572 INFO:teuthology.orchestra.run.smithi018.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 297 kB/s | 42 kB 00:00 2024-04-21T22:19:42.606 INFO:teuthology.orchestra.run.smithi018.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 762 kB/s | 44 kB 00:00 2024-04-21T22:19:42.622 INFO:teuthology.orchestra.run.smithi081.stdout:(27/150): rbd-nbd-19.0.0-2405.g820a2f8c.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-21T22:19:42.640 INFO:teuthology.orchestra.run.smithi018.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-21T22:19:42.694 INFO:teuthology.orchestra.run.smithi018.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 414 kB/s | 36 kB 00:00 2024-04-21T22:19:42.723 INFO:teuthology.orchestra.run.smithi018.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 574 kB/s | 47 kB 00:00 2024-04-21T22:19:42.730 INFO:teuthology.orchestra.run.smithi081.stdout:(28/150): rbd-mirror-19.0.0-2405.g820a2f8c.el9. 10 MB/s | 3.1 MB 00:00 2024-04-21T22:19:42.756 INFO:teuthology.orchestra.run.smithi081.stdout:(29/150): ceph-grafana-dashboards-19.0.0-2405.g 238 kB/s | 32 kB 00:00 2024-04-21T22:19:42.757 INFO:teuthology.orchestra.run.smithi018.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 4.8 MB/s | 305 kB 00:00 2024-04-21T22:19:42.781 INFO:teuthology.orchestra.run.smithi081.stdout:(30/150): ceph-mgr-cephadm-19.0.0-2405.g820a2f8 2.7 MB/s | 141 kB 00:00 2024-04-21T22:19:42.782 INFO:teuthology.orchestra.run.smithi018.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 993 kB/s | 58 kB 00:00 2024-04-21T22:19:42.817 INFO:teuthology.orchestra.run.smithi018.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-21T22:19:42.841 INFO:teuthology.orchestra.run.smithi018.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-21T22:19:42.875 INFO:teuthology.orchestra.run.smithi018.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-04-21T22:19:42.934 INFO:teuthology.orchestra.run.smithi018.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-04-21T22:19:43.051 INFO:teuthology.orchestra.run.smithi018.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-04-21T22:19:43.315 INFO:teuthology.orchestra.run.smithi081.stdout:(31/150): ceph-mgr-dashboard-19.0.0-2405.g820a2 6.3 MB/s | 3.5 MB 00:00 2024-04-21T22:19:43.351 INFO:teuthology.orchestra.run.smithi018.stdout:(104/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-21T22:19:43.390 INFO:teuthology.orchestra.run.smithi081.stdout:(32/150): ceph-mgr-modules-core-19.0.0-2405.g82 3.3 MB/s | 249 kB 00:00 2024-04-21T22:19:43.393 INFO:teuthology.orchestra.run.smithi018.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-21T22:19:43.482 INFO:teuthology.orchestra.run.smithi081.stdout:(33/150): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-21T22:19:43.500 INFO:teuthology.orchestra.run.smithi018.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 131 kB/s | 19 kB 00:00 2024-04-21T22:19:43.507 INFO:teuthology.orchestra.run.smithi081.stdout:(34/150): ceph-mgr-rook-19.0.0-2405.g820a2f8c.e 421 kB/s | 49 kB 00:00 2024-04-21T22:19:43.532 INFO:teuthology.orchestra.run.smithi081.stdout:(35/150): ceph-prometheus-alerts-19.0.0-2405.g8 306 kB/s | 15 kB 00:00 2024-04-21T22:19:43.558 INFO:teuthology.orchestra.run.smithi081.stdout:(36/150): ceph-volume-19.0.0-2405.g820a2f8c.el9 5.1 MB/s | 264 kB 00:00 2024-04-21T22:19:43.577 INFO:teuthology.orchestra.run.smithi018.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 349 kB/s | 26 kB 00:00 2024-04-21T22:19:43.610 INFO:teuthology.orchestra.run.smithi018.stdout:(108/150): gperftools-libs-2.9.1-2.el9.x86_64.r 553 kB/s | 309 kB 00:00 2024-04-21T22:19:43.616 INFO:teuthology.orchestra.run.smithi081.stdout:(37/150): cephadm-19.0.0-2405.g820a2f8c.el9.noa 8.9 MB/s | 762 kB 00:00 2024-04-21T22:19:43.633 INFO:teuthology.orchestra.run.smithi081.stdout:(38/150): cephfs-top-19.0.0-2405.g820a2f8c.el9. 242 kB/s | 18 kB 00:00 2024-04-21T22:19:43.719 INFO:teuthology.orchestra.run.smithi018.stdout:(109/150): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-21T22:19:43.744 INFO:teuthology.orchestra.run.smithi018.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2024-04-21T22:19:43.769 INFO:teuthology.orchestra.run.smithi018.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 426 kB/s | 67 kB 00:00 2024-04-21T22:19:43.803 INFO:teuthology.orchestra.run.smithi018.stdout:(112/150): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-21T22:19:43.862 INFO:teuthology.orchestra.run.smithi018.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 757 kB/s | 43 kB 00:00 2024-04-21T22:19:43.929 INFO:teuthology.orchestra.run.smithi018.stdout:(114/150): python3-cachetools-4.2.4-1.el9.noarc 489 kB/s | 32 kB 00:00 2024-04-21T22:19:43.962 INFO:teuthology.orchestra.run.smithi018.stdout:(115/150): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-04-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi018.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 260 kB/s | 15 kB 00:00 2024-04-21T22:19:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-21T22:19:44.055 INFO:teuthology.orchestra.run.smithi018.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-04-21T22:19:44.088 INFO:teuthology.orchestra.run.smithi018.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-04-21T22:19:44.114 INFO:teuthology.orchestra.run.smithi018.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 610 kB/s | 35 kB 00:00 2024-04-21T22:19:44.147 INFO:teuthology.orchestra.run.smithi018.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-04-21T22:19:44.215 INFO:teuthology.orchestra.run.smithi018.stdout:(122/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2024-04-21T22:19:44.248 INFO:teuthology.orchestra.run.smithi018.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-21T22:19:44.274 INFO:teuthology.orchestra.run.smithi018.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-04-21T22:19:44.316 INFO:teuthology.orchestra.run.smithi018.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 266 kB/s | 18 kB 00:00 2024-04-21T22:19:44.333 INFO:teuthology.orchestra.run.smithi018.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-04-21T22:19:44.408 INFO:teuthology.orchestra.run.smithi018.stdout:(127/150): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-04-21T22:19:44.441 INFO:teuthology.orchestra.run.smithi018.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-04-21T22:19:44.458 INFO:teuthology.orchestra.run.smithi018.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 158 kB/s | 20 kB 00:00 2024-04-21T22:19:44.500 INFO:teuthology.orchestra.run.smithi018.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-21T22:19:44.517 INFO:teuthology.orchestra.run.smithi018.stdout:(131/150): python3-logutils-0.3.5-21.el9.noarch 799 kB/s | 46 kB 00:00 2024-04-21T22:19:44.542 INFO:teuthology.orchestra.run.smithi018.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 949 kB/s | 79 kB 00:00 2024-04-21T22:19:44.571 INFO:teuthology.orchestra.run.smithi018.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 822 kB/s | 58 kB 00:00 2024-04-21T22:19:44.601 INFO:teuthology.orchestra.run.smithi018.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-21T22:19:44.627 INFO:teuthology.orchestra.run.smithi018.stdout:(135/150): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-04-21T22:19:44.652 INFO:teuthology.orchestra.run.smithi018.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-21T22:19:44.677 INFO:teuthology.orchestra.run.smithi018.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-04-21T22:19:44.683 INFO:teuthology.orchestra.run.smithi081.stdout:(39/150): ceph-test-19.0.0-2405.g820a2f8c.el9.x 12 MB/s | 48 MB 00:03 2024-04-21T22:19:44.709 INFO:teuthology.orchestra.run.smithi081.stdout:(40/150): fuse-2.9.9-15.el9.x86_64.rpm 73 kB/s | 80 kB 00:01 2024-04-21T22:19:44.728 INFO:teuthology.orchestra.run.smithi018.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-04-21T22:19:44.753 INFO:teuthology.orchestra.run.smithi018.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 793 kB/s | 59 kB 00:00 2024-04-21T22:19:44.795 INFO:teuthology.orchestra.run.smithi018.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-21T22:19:44.820 INFO:teuthology.orchestra.run.smithi018.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 391 kB/s | 36 kB 00:00 2024-04-21T22:19:44.846 INFO:teuthology.orchestra.run.smithi018.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2024-04-21T22:19:44.879 INFO:teuthology.orchestra.run.smithi018.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-21T22:19:44.904 INFO:teuthology.orchestra.run.smithi018.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-21T22:19:44.938 INFO:teuthology.orchestra.run.smithi018.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2024-04-21T22:19:44.971 INFO:teuthology.orchestra.run.smithi018.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-21T22:19:45.055 INFO:teuthology.orchestra.run.smithi018.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-21T22:19:45.122 INFO:teuthology.orchestra.run.smithi018.stdout:(148/150): python3-werkzeug-2.0.3-3.el9.1.noarc 1.5 MB/s | 427 kB 00:00 2024-04-21T22:19:45.406 INFO:teuthology.orchestra.run.smithi018.stdout:(149/150): librbd1-19.0.0-2405.g820a2f8c.el9.x8 9.0 MB/s | 3.1 MB 00:00 2024-04-21T22:19:45.489 INFO:teuthology.orchestra.run.smithi018.stdout:(150/150): librados2-19.0.0-2405.g820a2f8c.el9. 6.7 MB/s | 3.4 MB 00:00 2024-04-21T22:19:45.495 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-04-21T22:19:45.496 INFO:teuthology.orchestra.run.smithi018.stdout:Total 16 MB/s | 216 MB 00:13 2024-04-21T22:19:45.509 INFO:teuthology.orchestra.run.smithi081.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 428 kB/s | 803 kB 00:01 2024-04-21T22:19:45.534 INFO:teuthology.orchestra.run.smithi081.stdout:(42/150): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-04-21T22:19:45.593 INFO:teuthology.orchestra.run.smithi081.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 286 kB/s | 253 kB 00:00 2024-04-21T22:19:46.427 INFO:teuthology.orchestra.run.smithi081.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 119 kB/s | 106 kB 00:00 2024-04-21T22:19:46.452 INFO:teuthology.orchestra.run.smithi081.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 157 kB/s | 135 kB 00:00 2024-04-21T22:19:47.186 INFO:teuthology.orchestra.run.smithi081.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 165 kB/s | 125 kB 00:00 2024-04-21T22:19:47.319 INFO:teuthology.orchestra.run.smithi081.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 248 kB/s | 215 kB 00:00 2024-04-21T22:19:47.461 INFO:teuthology.orchestra.run.smithi081.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-21T22:19:47.520 INFO:teuthology.orchestra.run.smithi081.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-21T22:19:47.579 INFO:teuthology.orchestra.run.smithi081.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-04-21T22:19:47.604 INFO:teuthology.orchestra.run.smithi081.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-04-21T22:19:47.654 INFO:teuthology.orchestra.run.smithi081.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-21T22:19:47.658 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-04-21T22:19:47.679 INFO:teuthology.orchestra.run.smithi081.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-04-21T22:19:47.728 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T22:19:47.738 INFO:teuthology.orchestra.run.smithi081.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 314 kB/s | 18 kB 00:00 2024-04-21T22:19:47.753 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T22:19:47.797 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T22:19:47.813 INFO:teuthology.orchestra.run.smithi081.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-21T22:19:47.847 INFO:teuthology.orchestra.run.smithi081.stdout:(56/150): python3-cryptography-36.0.1-4.el9.x86 537 kB/s | 1.2 MB 00:02 2024-04-21T22:19:47.872 INFO:teuthology.orchestra.run.smithi081.stdout:(57/150): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2024-04-21T22:19:47.897 INFO:teuthology.orchestra.run.smithi081.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-21T22:19:47.922 INFO:teuthology.orchestra.run.smithi081.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-04-21T22:19:47.956 INFO:teuthology.orchestra.run.smithi081.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-21T22:19:47.998 INFO:teuthology.orchestra.run.smithi081.stdout:(61/150): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-21T22:19:48.023 INFO:teuthology.orchestra.run.smithi081.stdout:(62/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 253 kB/s | 25 kB 00:00 2024-04-21T22:19:48.049 INFO:teuthology.orchestra.run.smithi081.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-04-21T22:19:48.074 INFO:teuthology.orchestra.run.smithi081.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-21T22:19:48.099 INFO:teuthology.orchestra.run.smithi081.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-21T22:19:48.124 INFO:teuthology.orchestra.run.smithi081.stdout:(66/150): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-04-21T22:19:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T22:19:48.233 INFO:teuthology.orchestra.run.smithi081.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-21T22:19:48.279 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:19:48.333 INFO:teuthology.orchestra.run.smithi081.stdout:(68/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-04-21T22:19:48.386 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-04-21T22:19:48.400 INFO:teuthology.orchestra.run.smithi081.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-04-21T22:19:48.411 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:19:48.426 INFO:teuthology.orchestra.run.smithi081.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-21T22:19:48.446 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:19:48.526 INFO:teuthology.orchestra.run.smithi081.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-21T22:19:48.539 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:19:48.581 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:19:48.609 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T22:19:48.609 INFO:teuthology.orchestra.run.smithi081.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-04-21T22:19:48.616 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-04-21T22:19:48.616 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-04-21T22:19:48.635 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T22:19:48.660 INFO:teuthology.orchestra.run.smithi081.stdout:(73/150): postgresql-13.14-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-04-21T22:19:48.693 INFO:teuthology.orchestra.run.smithi081.stdout:(74/150): python3-attrs-20.3.0-7.el9.noarch.rpm 523 kB/s | 87 kB 00:00 2024-04-21T22:19:48.752 INFO:teuthology.orchestra.run.smithi081.stdout:(75/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-21T22:19:48.777 INFO:teuthology.orchestra.run.smithi081.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-21T22:19:48.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T22:19:48.849 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T22:19:48.870 INFO:teuthology.orchestra.run.smithi081.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-04-21T22:19:48.876 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:19:48.895 INFO:teuthology.orchestra.run.smithi081.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-04-21T22:19:48.920 INFO:teuthology.orchestra.run.smithi081.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-04-21T22:19:48.962 INFO:teuthology.orchestra.run.smithi081.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-21T22:19:48.981 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:19:48.987 INFO:teuthology.orchestra.run.smithi081.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-04-21T22:19:49.010 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi081.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-21T22:19:49.062 INFO:teuthology.orchestra.run.smithi081.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-21T22:19:49.073 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:19:49.095 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:19:49.119 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:19:49.138 INFO:teuthology.orchestra.run.smithi081.stdout:(84/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-04-21T22:19:49.163 INFO:teuthology.orchestra.run.smithi081.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 614 kB/s | 77 kB 00:00 2024-04-21T22:19:49.180 INFO:teuthology.orchestra.run.smithi081.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-04-21T22:19:49.205 INFO:teuthology.orchestra.run.smithi081.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-21T22:19:49.222 INFO:teuthology.orchestra.run.smithi081.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-04-21T22:19:49.247 INFO:teuthology.orchestra.run.smithi081.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-04-21T22:19:49.273 INFO:teuthology.orchestra.run.smithi081.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-04-21T22:19:49.298 INFO:teuthology.orchestra.run.smithi081.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 708 kB/s | 54 kB 00:00 2024-04-21T22:19:49.337 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:19:49.340 INFO:teuthology.orchestra.run.smithi081.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-04-21T22:19:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-04-21T22:19:49.370 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:19:49.416 INFO:teuthology.orchestra.run.smithi081.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-21T22:19:49.441 INFO:teuthology.orchestra.run.smithi081.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 476 kB/s | 36 kB 00:00 2024-04-21T22:19:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T22:19:49.483 INFO:teuthology.orchestra.run.smithi081.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-21T22:19:49.525 INFO:teuthology.orchestra.run.smithi081.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-21T22:19:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T22:19:49.618 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T22:19:49.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T22:19:49.684 INFO:teuthology.orchestra.run.smithi081.stdout:(98/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-21T22:19:49.709 INFO:teuthology.orchestra.run.smithi081.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 256 kB/s | 58 kB 00:00 2024-04-21T22:19:49.722 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T22:19:49.734 INFO:teuthology.orchestra.run.smithi081.stdout:(100/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 448 kB/s | 94 kB 00:00 2024-04-21T22:19:49.762 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T22:19:49.784 INFO:teuthology.orchestra.run.smithi081.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-04-21T22:19:49.805 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T22:19:49.809 INFO:teuthology.orchestra.run.smithi081.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-04-21T22:19:49.838 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T22:19:49.865 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T22:19:49.910 INFO:teuthology.orchestra.run.smithi081.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-04-21T22:19:49.939 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T22:19:49.943 INFO:teuthology.orchestra.run.smithi081.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-04-21T22:19:49.977 INFO:teuthology.orchestra.run.smithi081.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2024-04-21T22:19:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T22:19:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T22:19:50.044 INFO:teuthology.orchestra.run.smithi081.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-04-21T22:19:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T22:19:50.111 INFO:teuthology.orchestra.run.smithi081.stdout:(107/150): libarrow-9.0.0-10.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-04-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi081.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-04-21T22:19:50.150 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T22:19:50.170 INFO:teuthology.orchestra.run.smithi081.stdout:(109/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 206 kB/s | 26 kB 00:00 2024-04-21T22:19:50.190 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 30/152 2024-04-21T22:19:50.195 INFO:teuthology.orchestra.run.smithi081.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-04-21T22:19:50.221 INFO:teuthology.orchestra.run.smithi081.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 893 kB/s | 67 kB 00:00 2024-04-21T22:19:50.233 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 31/152 2024-04-21T22:19:50.261 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 32/152 2024-04-21T22:19:50.262 INFO:teuthology.orchestra.run.smithi081.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-04-21T22:19:50.296 INFO:teuthology.orchestra.run.smithi081.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-04-21T22:19:50.321 INFO:teuthology.orchestra.run.smithi081.stdout:(114/150): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-21T22:19:50.336 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T22:19:50.347 INFO:teuthology.orchestra.run.smithi081.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-04-21T22:19:50.381 INFO:teuthology.orchestra.run.smithi081.stdout:(116/150): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-21T22:19:50.385 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T22:19:50.406 INFO:teuthology.orchestra.run.smithi081.stdout:(117/150): python3-certifi-2021.10.8-2.el9.noar 178 kB/s | 15 kB 00:00 2024-04-21T22:19:50.431 INFO:teuthology.orchestra.run.smithi081.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-21T22:19:50.456 INFO:teuthology.orchestra.run.smithi081.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-21T22:19:50.462 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T22:19:50.481 INFO:teuthology.orchestra.run.smithi081.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 701 kB/s | 35 kB 00:00 2024-04-21T22:19:50.506 INFO:teuthology.orchestra.run.smithi081.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-04-21T22:19:50.532 INFO:teuthology.orchestra.run.smithi081.stdout:(122/150): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-21T22:19:50.557 INFO:teuthology.orchestra.run.smithi081.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-21T22:19:50.582 INFO:teuthology.orchestra.run.smithi081.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-04-21T22:19:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-04-21T22:19:50.609 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T22:19:50.633 INFO:teuthology.orchestra.run.smithi081.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-04-21T22:19:50.658 INFO:teuthology.orchestra.run.smithi081.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-21T22:19:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T22:19:50.683 INFO:teuthology.orchestra.run.smithi081.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-04-21T22:19:50.734 INFO:teuthology.orchestra.run.smithi081.stdout:(129/150): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-21T22:19:50.759 INFO:teuthology.orchestra.run.smithi081.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-04-21T22:19:50.784 INFO:teuthology.orchestra.run.smithi081.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-21T22:19:50.801 INFO:teuthology.orchestra.run.smithi081.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-04-21T22:19:50.827 INFO:teuthology.orchestra.run.smithi081.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 6.3 MB/s | 272 kB 00:00 2024-04-21T22:19:50.844 INFO:teuthology.orchestra.run.smithi081.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 389 kB/s | 16 kB 00:00 2024-04-21T22:19:50.869 INFO:teuthology.orchestra.run.smithi081.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-21T22:19:50.894 INFO:teuthology.orchestra.run.smithi081.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-04-21T22:19:50.920 INFO:teuthology.orchestra.run.smithi081.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-04-21T22:19:50.953 INFO:teuthology.orchestra.run.smithi081.stdout:(138/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-04-21T22:19:50.979 INFO:teuthology.orchestra.run.smithi081.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-21T22:19:51.004 INFO:teuthology.orchestra.run.smithi081.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-04-21T22:19:51.029 INFO:teuthology.orchestra.run.smithi081.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-21T22:19:51.055 INFO:teuthology.orchestra.run.smithi081.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-04-21T22:19:51.072 INFO:teuthology.orchestra.run.smithi081.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-04-21T22:19:51.097 INFO:teuthology.orchestra.run.smithi081.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-21T22:19:51.122 INFO:teuthology.orchestra.run.smithi081.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-04-21T22:19:51.147 INFO:teuthology.orchestra.run.smithi081.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-21T22:19:51.173 INFO:teuthology.orchestra.run.smithi081.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-04-21T22:19:51.251 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T22:19:51.323 INFO:teuthology.orchestra.run.smithi081.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-21T22:19:51.330 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-04-21T22:19:51.330 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-04-21T22:19:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T22:19:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T22:19:51.421 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T22:19:51.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 42/152 2024-04-21T22:19:51.484 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T22:19:51.531 INFO:teuthology.orchestra.run.smithi081.stdout:(149/150): librbd1-19.0.0-2405.g820a2f8c.el9.x8 8.7 MB/s | 3.1 MB 00:00 2024-04-21T22:19:51.541 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T22:19:51.616 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T22:19:51.634 INFO:teuthology.orchestra.run.smithi081.stdout:(150/150): librados2-19.0.0-2405.g820a2f8c.el9. 7.0 MB/s | 3.4 MB 00:00 2024-04-21T22:19:51.636 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-04-21T22:19:51.636 INFO:teuthology.orchestra.run.smithi081.stdout:Total 15 MB/s | 216 MB 00:14 2024-04-21T22:19:51.651 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T22:19:51.688 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T22:19:51.735 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T22:19:51.770 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T22:19:51.814 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T22:19:51.857 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T22:19:52.003 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T22:19:52.053 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T22:19:52.083 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T22:19:52.125 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T22:19:52.224 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T22:19:52.257 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T22:19:52.297 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T22:19:52.322 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T22:19:52.347 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T22:19:52.428 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T22:19:52.565 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T22:19:52.604 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T22:19:52.632 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T22:19:52.667 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T22:19:52.713 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T22:19:52.714 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-04-21T22:19:52.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T22:19:52.788 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T22:19:52.818 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T22:19:52.841 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-04-21T22:19:52.841 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-04-21T22:19:52.853 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T22:19:52.970 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T22:19:53.147 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T22:19:53.239 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T22:19:53.338 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T22:19:53.386 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T22:19:53.424 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T22:19:53.473 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T22:19:53.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T22:19:53.652 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T22:19:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T22:19:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T22:19:54.506 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T22:19:54.546 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-04-21T22:19:54.547 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-04-21T22:19:54.612 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T22:19:54.665 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T22:19:54.758 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T22:19:54.799 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T22:19:54.985 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T22:19:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T22:19:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T22:19:55.791 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T22:19:55.909 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T22:19:57.231 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T22:19:57.317 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T22:19:57.337 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T22:19:57.369 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T22:19:57.690 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T22:19:57.732 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:19:57.824 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:19:57.854 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 98/152 2024-04-21T22:19:57.859 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-04-21T22:19:57.890 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T22:19:57.947 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T22:19:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T22:19:58.303 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T22:19:58.387 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T22:19:58.418 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:19:58.490 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:19:58.624 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 102/152 2024-04-21T22:19:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T22:19:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:19:59.020 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:19:59.054 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:19:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:19:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:19:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T22:19:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T22:19:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T22:19:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T22:19:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:00.063 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:00.110 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:20:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:20:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:20:00.338 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:20:00.390 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-04-21T22:20:00.467 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-21T22:20:00.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-21T22:20:00.535 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-21T22:20:00.643 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:20:00.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:20:00.890 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-21T22:20:00.917 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T22:20:01.002 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:20:01.043 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T22:20:01.087 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T22:20:01.108 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 5/152 2024-04-21T22:20:01.116 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:01.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T22:20:01.145 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:20:01.149 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T22:20:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:20:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T22:20:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:20:01.324 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-21T22:20:01.343 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T22:20:01.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-21T22:20:01.387 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T22:20:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T22:20:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-21T22:20:01.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-21T22:20:01.569 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T22:20:01.583 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T22:20:01.669 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:01.687 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T22:20:01.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:20:01.718 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:01.739 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 13/152 2024-04-21T22:20:01.746 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T22:20:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:20:01.769 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:01.779 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-21T22:20:01.859 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T22:20:01.873 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:01.873 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T22:20:01.873 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T22:20:01.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:01.899 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 30/152 2024-04-21T22:20:01.920 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:01.949 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 31/152 2024-04-21T22:20:01.961 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:20:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 32/152 2024-04-21T22:20:01.994 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-21T22:20:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-21T22:20:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T22:20:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T22:20:02.198 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-21T22:20:02.234 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-21T22:20:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T22:20:02.270 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-21T22:20:02.343 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-21T22:20:02.377 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-21T22:20:02.421 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-21T22:20:02.453 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-21T22:20:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T22:20:02.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-21T22:20:02.531 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T22:20:02.550 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-21T22:20:02.613 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-21T22:20:02.642 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-21T22:20:02.678 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-21T22:20:02.755 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-21T22:20:02.789 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 30/152 2024-04-21T22:20:02.857 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 31/152 2024-04-21T22:20:02.886 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 32/152 2024-04-21T22:20:02.957 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-21T22:20:03.009 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-21T22:20:03.086 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-21T22:20:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-21T22:20:03.271 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T22:20:03.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-21T22:20:03.382 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T22:20:03.450 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T22:20:03.501 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T22:20:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 42/152 2024-04-21T22:20:03.610 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T22:20:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T22:20:03.811 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T22:20:03.823 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-21T22:20:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T22:20:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-21T22:20:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T22:20:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-21T22:20:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-21T22:20:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T22:20:04.026 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 42/152 2024-04-21T22:20:04.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-21T22:20:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T22:20:04.115 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-21T22:20:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T22:20:04.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-21T22:20:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T22:20:04.226 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-21T22:20:04.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-21T22:20:04.310 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-21T22:20:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-21T22:20:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-21T22:20:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-21T22:20:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T22:20:04.516 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T22:20:04.556 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T22:20:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-21T22:20:04.607 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T22:20:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-21T22:20:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-21T22:20:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T22:20:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-21T22:20:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T22:20:04.835 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-21T22:20:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T22:20:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-21T22:20:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T22:20:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T22:20:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-21T22:20:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T22:20:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T22:20:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T22:20:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T22:20:05.179 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-21T22:20:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T22:20:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T22:20:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T22:20:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T22:20:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T22:20:05.373 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-21T22:20:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T22:20:05.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-21T22:20:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T22:20:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T22:20:05.482 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-21T22:20:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T22:20:05.555 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-21T22:20:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T22:20:05.648 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-21T22:20:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T22:20:05.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T22:20:05.716 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-21T22:20:05.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T22:20:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-21T22:20:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-21T22:20:05.840 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T22:20:05.895 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T22:20:05.904 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-21T22:20:06.038 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-21T22:20:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-21T22:20:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-21T22:20:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-21T22:20:06.465 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-21T22:20:06.626 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-21T22:20:06.627 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T22:20:06.675 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T22:20:06.693 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-21T22:20:06.726 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T22:20:06.997 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T22:20:07.250 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T22:20:07.338 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T22:20:07.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T22:20:07.546 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T22:20:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T22:20:07.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T22:20:07.669 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-21T22:20:07.726 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-21T22:20:07.759 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-21T22:20:07.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-21T22:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-21T22:20:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-21T22:20:08.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-21T22:20:08.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T22:20:08.367 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-21T22:20:08.407 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-21T22:20:08.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T22:20:08.518 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-21T22:20:09.417 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-21T22:20:09.569 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-21T22:20:09.659 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T22:20:09.739 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T22:20:09.766 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T22:20:09.800 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T22:20:10.102 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T22:20:10.146 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:20:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:20:10.267 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 98/152 2024-04-21T22:20:10.304 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T22:20:10.773 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T22:20:10.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:20:10.870 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:20:10.893 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 102/152 2024-04-21T22:20:11.312 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-21T22:20:11.414 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-21T22:20:11.456 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-21T22:20:11.499 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-21T22:20:11.924 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-21T22:20:11.967 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:20:12.091 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 97/152 2024-04-21T22:20:12.141 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 98/152 2024-04-21T22:20:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-21T22:20:12.804 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-21T22:20:12.845 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:20:12.931 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 101/152 2024-04-21T22:20:12.955 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 102/152 2024-04-21T22:20:13.115 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:13.148 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:13.687 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:13.726 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-04-21T22:20:13.730 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:13.815 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:13.815 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T22:20:13.815 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T22:20:13.815 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:13.844 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:13.915 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:13.931 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:13.931 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:13.931 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T22:20:13.931 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:15.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:15.503 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:15.743 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:15.766 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:15.767 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:15.845 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:16.227 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:16.251 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:16.251 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:16.251 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T22:20:16.251 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:16.252 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:16.252 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:16.358 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T22:20:16.416 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T22:20:16.489 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T22:20:16.521 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 103/152 2024-04-21T22:20:16.565 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:16.690 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T22:20:16.737 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T22:20:16.758 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 104/152 2024-04-21T22:20:16.758 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-21T22:20:16.758 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-21T22:20:16.758 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:16.799 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:16.819 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T22:20:16.916 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T22:20:17.068 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T22:20:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T22:20:17.143 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T22:20:17.171 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T22:20:17.633 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:17.661 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:17.694 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 122/152 2024-04-21T22:20:17.757 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 123/152 2024-04-21T22:20:17.785 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:19.928 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:19.953 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:20.062 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:20.232 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 127/152 2024-04-21T22:20:20.264 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:20.288 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:20.288 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:20.288 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T22:20:20.289 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:20.289 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:20.289 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:20.339 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:20.350 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:20.455 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 130/152 2024-04-21T22:20:20.505 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 131/152 2024-04-21T22:20:21.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T22:20:21.492 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:21.516 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:21.559 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:21.582 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:21.582 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T22:20:21.583 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:21.626 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:21.650 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:21.977 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:22.000 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:25.051 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:25.051 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-04-21T22:20:25.051 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-04-21T22:20:25.051 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-04-21T22:20:25.051 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-04-21T22:20:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-04-21T22:20:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-04-21T22:20:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-04-21T22:20:25.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:25.240 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:25.240 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T22:20:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:26.736 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:26.764 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 137/152 2024-04-21T22:20:26.806 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 138/152 2024-04-21T22:20:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 139/152 2024-04-21T22:20:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T22:20:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T22:20:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:27.008 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:27.009 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:27.009 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T22:20:27.009 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:27.009 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:27.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:27.098 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 142/152 2024-04-21T22:20:27.143 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T22:20:27.173 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 144/152 2024-04-21T22:20:27.445 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:27.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:27.575 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T22:20:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T22:20:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T22:20:27.824 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T22:20:27.871 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:27.891 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T22:20:27.989 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T22:20:28.078 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T22:20:28.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T22:20:28.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T22:20:28.295 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T22:20:28.331 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T22:20:28.700 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:28.729 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:28.741 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 146/152 2024-04-21T22:20:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 122/152 2024-04-21T22:20:28.817 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T22:20:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 123/152 2024-04-21T22:20:28.852 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:28.858 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T22:20:28.942 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T22:20:28.971 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T22:20:28.971 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:29.046 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:29.046 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:30.047 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 105/152 2024-04-21T22:20:30.047 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-04-21T22:20:30.047 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-04-21T22:20:30.048 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:30.278 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:30.329 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 106/152 2024-04-21T22:20:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:30.329 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-21T22:20:30.329 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:30.888 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:30.913 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:31.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 127/152 2024-04-21T22:20:31.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:31.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:31.274 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:31.285 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:31.383 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 130/152 2024-04-21T22:20:31.431 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 131/152 2024-04-21T22:20:32.035 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 107/152 2024-04-21T22:20:32.135 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.135 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-21T22:20:32.136 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:32.136 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-21T22:20:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:32.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T22:20:32.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:32.393 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:32.436 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:32.458 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.458 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T22:20:32.458 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:32.470 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 108/152 2024-04-21T22:20:32.470 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.470 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-21T22:20:32.470 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:32.471 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-21T22:20:32.471 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:32.504 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:32.526 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:32.526 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.526 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T22:20:32.526 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:32.527 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:32.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:32.829 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:32.852 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:32.852 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T22:20:32.852 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:32.852 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:33.072 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 109/152 2024-04-21T22:20:33.072 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:33.072 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-21T22:20:33.073 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:33.073 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-21T22:20:33.073 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:33.225 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-21T22:20:33.316 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-21T22:20:33.393 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-21T22:20:33.648 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-21T22:20:33.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-21T22:20:33.800 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-21T22:20:33.910 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-21T22:20:34.088 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-21T22:20:34.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-21T22:20:34.184 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-21T22:20:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 1/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 3/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 4/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 5/152 2024-04-21T22:20:34.825 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 8/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 9/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 10/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 11/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 13/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 14/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 15/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 16/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 17/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 18/152 2024-04-21T22:20:34.826 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 19/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 20/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 21/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 22/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 23/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 24/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 25/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 26/152 2024-04-21T22:20:34.827 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 27/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 28/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 29/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 30/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 31/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 32/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 33/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 34/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 35/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 36/152 2024-04-21T22:20:34.839 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 37/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 38/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 39/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T22:20:34.840 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T22:20:34.841 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T22:20:34.842 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T22:20:34.843 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T22:20:34.844 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T22:20:34.845 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T22:20:34.846 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T22:20:34.847 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T22:20:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T22:20:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 149/152 2024-04-21T22:20:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T22:20:34.848 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 151/152 2024-04-21T22:20:34.848 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:34.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 121/152 2024-04-21T22:20:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 122/152 2024-04-21T22:20:35.049 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 123/152 2024-04-21T22:20:35.080 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:36.432 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 124/152 2024-04-21T22:20:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-04-21T22:20:36.990 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.991 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T22:20:36.992 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T22:20:36.993 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T22:20:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T22:20:36.995 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T22:20:36.996 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T22:20:36.997 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T22:20:36.998 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T22:20:36.999 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:37.000 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-21T22:20:37.001 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-04-21T22:20:37.329 DEBUG:teuthology.parallel:result is None 2024-04-21T22:20:37.358 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 137/152 2024-04-21T22:20:37.399 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 138/152 2024-04-21T22:20:37.440 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 139/152 2024-04-21T22:20:37.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T22:20:37.500 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T22:20:37.681 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 142/152 2024-04-21T22:20:37.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T22:20:37.739 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 125/152 2024-04-21T22:20:37.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 144/152 2024-04-21T22:20:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:37.927 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 126/152 2024-04-21T22:20:38.115 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 127/152 2024-04-21T22:20:38.151 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 128/152 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-21T22:20:38.232 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:38.294 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:38.334 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 129/152 2024-04-21T22:20:38.383 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:38.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 130/152 2024-04-21T22:20:38.548 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 131/152 2024-04-21T22:20:39.215 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 146/152 2024-04-21T22:20:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T22:20:39.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T22:20:39.425 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T22:20:39.466 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T22:20:39.466 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:39.541 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:39.541 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-21T22:20:39.680 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:39.750 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 133/152 2024-04-21T22:20:39.750 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:39.750 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-21T22:20:39.750 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:39.751 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-21T22:20:39.751 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:39.814 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2405.g820a2 134/152 2024-04-21T22:20:39.890 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:39.890 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-21T22:20:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:39.964 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 135/152 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-21T22:20:40.044 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:40.500 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 136/152 2024-04-21T22:20:40.501 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-21T22:20:40.501 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-21T22:20:40.501 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:40.501 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-21T22:20:40.501 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 1/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 3/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 4/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 5/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:20:45.467 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 8/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 9/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 10/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 11/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 13/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 14/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 15/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 16/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 17/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 18/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 19/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 20/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 21/152 2024-04-21T22:20:45.468 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 22/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 23/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 24/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 25/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 26/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 27/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 28/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 29/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 30/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 31/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 32/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 33/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 34/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 35/152 2024-04-21T22:20:45.469 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 36/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 37/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 38/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 39/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T22:20:45.470 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T22:20:45.471 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T22:20:45.472 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T22:20:45.473 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T22:20:45.474 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T22:20:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T22:20:45.476 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T22:20:45.477 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T22:20:45.478 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 149/152 2024-04-21T22:20:45.478 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T22:20:45.478 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 151/152 2024-04-21T22:20:45.723 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 137/152 2024-04-21T22:20:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 138/152 2024-04-21T22:20:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 139/152 2024-04-21T22:20:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-21T22:20:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-21T22:20:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 142/152 2024-04-21T22:20:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-21T22:20:46.420 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 144/152 2024-04-21T22:20:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:47.402 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:47.464 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-21T22:20:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T22:20:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.489 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T22:20:47.490 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T22:20:47.491 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T22:20:47.492 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T22:20:47.493 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.494 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T22:20:47.495 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T22:20:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T22:20:47.497 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T22:20:47.498 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.499 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T22:20:47.500 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T22:20:47.501 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T22:20:47.502 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T22:20:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T22:20:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:20:47.503 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-04-21T22:20:47.865 DEBUG:teuthology.parallel:result is None 2024-04-21T22:20:48.780 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 146/152 2024-04-21T22:20:48.908 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-21T22:20:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-21T22:20:49.183 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-21T22:20:49.231 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-21T22:20:49.231 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:49.389 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-21T22:20:49.390 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:49.946 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:49.946 INFO:teuthology.orchestra.run.smithi018.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-21T22:20:49.946 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:55.709 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 1/152 2024-04-21T22:20:55.709 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 3/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 4/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2405.g820a2 5/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 6/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 7/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 8/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 9/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 10/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 11/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 12/152 2024-04-21T22:20:55.710 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 13/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 14/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_ 15/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 16/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 17/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_6 18/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86 19/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 20/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el 21/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9. 22/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_6 23/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 24/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 25/152 2024-04-21T22:20:55.711 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 26/152 2024-04-21T22:20:55.712 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 27/152 2024-04-21T22:20:55.723 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 28/152 2024-04-21T22:20:55.723 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 29/152 2024-04-21T22:20:55.723 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c. 30/152 2024-04-21T22:20:55.723 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noa 31/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.n 32/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2405.g820 33/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el 34/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 35/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.e 36/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 37/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 38/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 39/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-21T22:20:55.724 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-21T22:20:55.725 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-21T22:20:55.726 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-21T22:20:55.727 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-21T22:20:55.728 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-21T22:20:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-21T22:20:55.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-21T22:20:55.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-21T22:20:55.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 149/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-21T22:20:55.733 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 151/152 2024-04-21T22:20:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-21T22:20:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.0.0-2405.g820a2f8c.el9.noarch 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-21T22:20:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-21T22:20:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-21T22:20:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.14-1.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-21T22:20:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-21T22:20:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-21T22:20:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-21T22:20:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-21T22:20:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-21T22:20:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-21T22:20:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-21T22:20:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-21T22:20:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-21T22:20:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-21T22:20:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-21T22:20:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-21T22:20:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-21T22:20:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-21T22:20:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-21T22:20:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-21T22:20:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-21T22:20:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.0.0-2405.g820a2f8c.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-3.el9.x86_64 2024-04-21T22:20:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-21T22:20:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:20:58.188 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-04-21T22:20:58.715 DEBUG:teuthology.parallel:result is None 2024-04-21T22:20:58.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:20:58.860 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T22:20:58.916 INFO:teuthology.orchestra.run.smithi018.stdout:19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:58.916 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:58.916 INFO:teuthology.task.install:The correct ceph version 19.0.0-2405.g820a2f8c is installed. 2024-04-21T22:20:58.919 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:20:59.068 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T22:20:59.094 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:59.095 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:59.095 INFO:teuthology.task.install:The correct ceph version 19.0.0-2405.g820a2f8c is installed. 2024-04-21T22:20:59.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:20:59.312 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-21T22:20:59.338 INFO:teuthology.orchestra.run.smithi081.stdout:19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:59.338 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2405.g820a2f8c.el9 2024-04-21T22:20:59.338 INFO:teuthology.task.install:The correct ceph version 19.0.0-2405.g820a2f8c is installed. 2024-04-21T22:20:59.340 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-21T22:20:59.341 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:20:59.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T22:20:59.413 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:20:59.413 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T22:20:59.444 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:20:59.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T22:20:59.475 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-21T22:20:59.475 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:20:59.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T22:20:59.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T22:20:59.643 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:20:59.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T22:20:59.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T22:20:59.744 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:20:59.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T22:20:59.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T22:20:59.839 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-21T22:20:59.839 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:20:59.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T22:20:59.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T22:21:00.023 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:21:00.023 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T22:21:00.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T22:21:00.113 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:21:00.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T22:21:00.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T22:21:00.210 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-21T22:21:00.210 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:21:00.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T22:21:00.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T22:21:00.373 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:21:00.374 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T22:21:00.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T22:21:00.463 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:21:00.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T22:21:00.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T22:21:00.559 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-21T22:21:00.656 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-21T22:21:00.656 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:21:00.656 INFO:tasks.cephadm:Cluster fsid is 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:21:00.656 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-21T22:21:00.657 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.18', 'mon.b': '172.21.15.47', 'mon.c': '172.21.15.81'} 2024-04-21T22:21:00.657 INFO:tasks.cephadm:First mon is mon.a on smithi018 2024-04-21T22:21:00.657 INFO:tasks.cephadm:First mgr is x 2024-04-21T22:21:00.657 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-21T22:21:00.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-04-21T22:21:00.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-04-21T22:21:00.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-04-21T22:21:00.789 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-21T22:21:00.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:21:01.006 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '820a2f8ced66152ed3d765c31444b8076ea28c6b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/54945/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2405-g820a2f8c', 'node_name': '172.21.4.69+confusa07', 'job_name': 'ceph-dev-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2405.g820a2f8c'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-20 17:52:04.986240', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}] 2024-04-21T22:21:01.154 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 820a2f8ced66152ed3d765c31444b8076ea28c6b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:21:01.156 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/x86_64/flavors/default/cephadm 2024-04-21T22:21:01.156 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:02.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 781418 Apr 21 22:21 /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:02.084 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:02.921 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 781418 Apr 21 22:21 /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:02.921 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/820a2f8ced66152ed3d765c31444b8076ea28c6b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:03.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 781418 Apr 21 22:21 /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:03.474 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:03.522 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:03.541 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-21T22:21:03.573 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b on all hosts... 2024-04-21T22:21:03.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b pull 2024-04-21T22:21:03.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b pull 2024-04-21T22:21:03.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b pull 2024-04-21T22:21:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b... 2024-04-21T22:21:05.287 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b... 2024-04-21T22:21:05.794 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b... 2024-04-21T22:21:34.532 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-21T22:21:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev)", 2024-04-21T22:21:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32", 2024-04-21T22:21:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-04-21T22:21:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9" 2024-04-21T22:21:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-04-21T22:21:34.533 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-21T22:21:38.259 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-21T22:21:38.259 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev)", 2024-04-21T22:21:38.259 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32", 2024-04-21T22:21:38.259 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-04-21T22:21:38.260 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9" 2024-04-21T22:21:38.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-04-21T22:21:38.260 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-21T22:21:44.059 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev)", 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32", 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9" 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:21:44.060 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:21:44.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-04-21T22:21:44.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-04-21T22:21:44.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-04-21T22:21:44.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-04-21T22:21:44.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-04-21T22:21:44.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-04-21T22:21:44.417 INFO:tasks.cephadm:Writing seed config... 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-21T22:21:44.418 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-21T22:21:44.419 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-21T22:21:44.420 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-21T22:21:44.421 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-21T22:21:44.422 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:21:44.422 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-21T22:21:44.484 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6ef0a334-002d-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-21T22:21:44.484 DEBUG:teuthology.orchestra.run.smithi018:mon.a> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service 2024-04-21T22:21:44.532 DEBUG:teuthology.orchestra.run.smithi018:mgr.x> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x.service 2024-04-21T22:21:44.577 INFO:tasks.cephadm:Bootstrapping... 2024-04-21T22:21:44.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b -v bootstrap --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.18 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:21:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-04-21T22:21:44.865 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b', '-v', 'bootstrap', '--fsid', '6ef0a334-002d-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.18', '--skip-admin-label'] 2024-04-21T22:21:44.865 INFO:teuthology.orchestra.run.smithi018.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-21T22:21:44.866 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying podman|docker is present... 2024-04-21T22:21:44.930 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-21T22:21:44.930 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying lvm2 is present... 2024-04-21T22:21:44.931 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying time synchronization is in place... 2024-04-21T22:21:44.952 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-21T22:21:44.952 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-21T22:21:44.969 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-21T22:21:44.970 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:21:44.992 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-04-21T22:21:45.013 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-04-21T22:21:45.013 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-04-21T22:21:45.014 INFO:teuthology.orchestra.run.smithi018.stdout:Repeating the final host check... 2024-04-21T22:21:45.077 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-21T22:21:45.077 INFO:teuthology.orchestra.run.smithi018.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-21T22:21:45.077 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl is present 2024-04-21T22:21:45.077 INFO:teuthology.orchestra.run.smithi018.stdout:lvcreate is present 2024-04-21T22:21:45.095 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-21T22:21:45.095 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-21T22:21:45.114 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-21T22:21:45.114 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:21:45.137 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout enabled 2024-04-21T22:21:45.158 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout active 2024-04-21T22:21:45.158 INFO:teuthology.orchestra.run.smithi018.stdout:Unit chronyd.service is enabled and running 2024-04-21T22:21:45.158 INFO:teuthology.orchestra.run.smithi018.stdout:Host looks OK 2024-04-21T22:21:45.158 INFO:teuthology.orchestra.run.smithi018.stdout:Cluster fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:21:45.159 INFO:teuthology.orchestra.run.smithi018.stdout:Acquiring lock 140549134967712 on /run/cephadm/6ef0a334-002d-11ef-bc93-c7b262605968.lock 2024-04-21T22:21:45.159 INFO:teuthology.orchestra.run.smithi018.stdout:Lock 140549134967712 acquired on /run/cephadm/6ef0a334-002d-11ef-bc93-c7b262605968.lock 2024-04-21T22:21:45.160 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 3300 ... 2024-04-21T22:21:45.162 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying IP 172.21.15.18 port 6789 ... 2024-04-21T22:21:45.162 INFO:teuthology.orchestra.run.smithi018.stdout:Base mon IP(s) is [172.21.15.18:3300, 172.21.15.18:6789], mon addrv is [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-04-21T22:21:45.177 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.18 metric 100 2024-04-21T22:21:45.178 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.18 metric 100 2024-04-21T22:21:45.190 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-21T22:21:45.191 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-21T22:21:45.191 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1362/64 scope link noprefixroute 2024-04-21T22:21:45.203 INFO:teuthology.orchestra.run.smithi018.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-21T22:21:45.206 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-04-21T22:21:45.206 INFO:teuthology.orchestra.run.smithi018.stdout:Mon IP `172.21.15.18` is in CIDR network `172.21.0.0/20` 2024-04-21T22:21:45.206 INFO:teuthology.orchestra.run.smithi018.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-21T22:21:45.209 INFO:teuthology.orchestra.run.smithi018.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-21T22:21:45.212 INFO:teuthology.orchestra.run.smithi018.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b... 2024-04-21T22:21:45.861 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stdout 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b... 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Getting image source signatures 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:4706d97462bc6e0886c6ef3c0b1ac67e3e6a7e63a606e29958996d1fc15dafd8 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Copying config sha256:6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 2024-04-21T22:21:45.862 INFO:teuthology.orchestra.run.smithi018.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-21T22:21:56.594 INFO:teuthology.orchestra.run.smithi018.stdout:ceph: stdout ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev) 2024-04-21T22:21:56.594 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph version: ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev) 2024-04-21T22:21:56.594 INFO:teuthology.orchestra.run.smithi018.stdout:Extracting ceph user uid/gid from container image... 2024-04-21T22:21:57.757 INFO:teuthology.orchestra.run.smithi018.stdout:stat: stdout 167 167 2024-04-21T22:21:57.758 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial keys... 2024-04-21T22:21:58.840 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQCGkSVmZztwDBAAuGa8GeW39M/+pqs7ZOhqPQ== 2024-04-21T22:21:59.999 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQCHkSVmzGu9ERAABOd7GTgUA0AgQgzR40sjtw== 2024-04-21T22:22:01.350 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph-authtool: stdout AQCIkSVma0gAHhAAk2lswFLcGtdJVgCvt6khGA== 2024-04-21T22:22:01.353 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial monmap... 2024-04-21T22:22:02.612 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-21T22:22:02.612 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-21T22:22:02.612 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:02.612 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-21T22:22:02.612 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool for a [v2:172.21.15.18:3300,v1:172.21.15.18:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-21T22:22:02.613 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-04-21T22:22:02.613 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: set fsid to 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:02.613 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-21T22:22:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:22:02.613 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mon... 2024-04-21T22:22:03.775 INFO:teuthology.orchestra.run.smithi018.stdout:create mon.a on 2024-04-21T22:22:04.138 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-21T22:22:04.392 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-21T22:22:04.682 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target. 2024-04-21T22:22:04.682 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target. 2024-04-21T22:22:05.122 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a 2024-04-21T22:22:05.122 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-21T22:22:05.439 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target.wants/ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968@.service. 2024-04-21T22:22:06.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:05 smithi018 podman[26232]: 2024-04-21 22:22:05.762044871 +0000 UTC m=+0.034965629 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:22:06.116 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 podman[26232]: 2024-04-21 22:22:06.1154495 +0000 UTC m=+0.388370302 container init 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-04-21T22:22:06.261 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T22:22:06.261 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-04-21T22:22:06.278 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T22:22:06.278 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:22:06.278 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-04-21T22:22:06.278 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-04-21T22:22:06.279 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon to start... 2024-04-21T22:22:06.279 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mon... 2024-04-21T22:22:06.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 podman[26232]: 2024-04-21 22:22:06.126759418 +0000 UTC m=+0.399680199 container start 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-04-21T22:22:06.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 ceph-mon[26250]: mkfs 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:06.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 ceph-mon[26250]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-21T22:22:06.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 bash[26232]: 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 2024-04-21T22:22:06.428 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:06 smithi018 systemd[1]: Started Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: monmap epoch 1 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: last_changed 2024-04-21T22:22:01.886929+0000 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: min_mon_release 19 (squid) 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: election_strategy: 1 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: fsmap 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: osdmap e1: 0 total, 0 up, 0 in 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: mgrmap e1: no daemons active 2024-04-21T22:22:07.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:07 smithi018 ceph-mon[26250]: from='client.? 172.21.15.18:0/1769961481' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-21T22:22:07.633 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout cluster: 2024-04-21T22:22:07.634 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout id: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-21T22:22:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout services: 2024-04-21T22:22:07.635 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.783002s) 2024-04-21T22:22:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-21T22:22:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-21T22:22:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:07.636 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout data: 2024-04-21T22:22:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-21T22:22:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-21T22:22:07.637 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout pgs: 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.894+0000 7ff329000700 1 Processor -- start 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.894+0000 7ff329000700 1 -- start start 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.895+0000 7ff329000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.895+0000 7ff329000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff324108960 con 0x7ff324108000 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.896+0000 7ff321e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.896+0000 7ff321e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38220/0 (socket says 172.21.15.18:38220) 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.896+0000 7ff321e00700 1 -- 172.21.15.18:0/3406699534 learned_addr learned my addr 172.21.15.18:0/3406699534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.897+0000 7ff321e00700 1 -- 172.21.15.18:0/3406699534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff324108ae0 con 0x7ff324108000 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.897+0000 7ff321e00700 1 --2- 172.21.15.18:0/3406699534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff3140098a0 tx=0x7ff314009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4ca150d0b57e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.897+0000 7ff320a00700 1 -- 172.21.15.18:0/3406699534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff314004160 con 0x7ff324108000 2024-04-21T22:22:07.639 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.897+0000 7ff320a00700 1 -- 172.21.15.18:0/3406699534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314004300 con 0x7ff324108000 2024-04-21T22:22:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.897+0000 7ff320a00700 1 -- 172.21.15.18:0/3406699534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3140036a0 con 0x7ff324108000 2024-04-21T22:22:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 -- 172.21.15.18:0/3406699534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 msgr2=0x7ff324108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 --2- 172.21.15.18:0/3406699534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff3140098a0 tx=0x7ff314009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 -- 172.21.15.18:0/3406699534 shutdown_connections 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 --2- 172.21.15.18:0/3406699534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff324108420 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 -- 172.21.15.18:0/3406699534 >> 172.21.15.18:0/3406699534 conn(0x7ff3241036a0 msgr2=0x7ff324105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 -- 172.21.15.18:0/3406699534 shutdown_connections 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.898+0000 7ff329000700 1 -- 172.21.15.18:0/3406699534 wait complete. 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.899+0000 7ff329000700 1 Processor -- start 2024-04-21T22:22:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.899+0000 7ff329000700 1 -- start start 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff329000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff329000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3241094b0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff321e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff321e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38222/0 (socket says 172.21.15.18:38222) 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff321e00700 1 -- 172.21.15.18:0/1769961481 learned_addr learned my addr 172.21.15.18:0/1769961481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.900+0000 7ff321e00700 1 -- 172.21.15.18:0/1769961481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32407e0b0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff321e00700 1 --2- 172.21.15.18:0/1769961481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff314000c00 tx=0x7ff314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff314003db0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314011630 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff314011950 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32407c2a0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32407c7e0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.901+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff314011af0 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.902+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff31401c450 con 0x7ff324108000 2024-04-21T22:22:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.902+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff324063890 con 0x7ff324108000 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.906+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff314032020 con 0x7ff324108000 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.986+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7ff32407ca60 con 0x7ff324108000 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.987+0000 7ff31aa00700 1 -- 172.21.15.18:0/1769961481 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7ff314004260 con 0x7ff324108000 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.988+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 msgr2=0x7ff32407db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.988+0000 7ff329000700 1 --2- 172.21.15.18:0/1769961481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff314000c00 tx=0x7ff314004750 comp rx=0 tx=0).stop 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.988+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 shutdown_connections 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.988+0000 7ff329000700 1 --2- 172.21.15.18:0/1769961481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff324108000 0x7ff32407db70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.988+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 >> 172.21.15.18:0/1769961481 conn(0x7ff3241036a0 msgr2=0x7ff32418fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.989+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 shutdown_connections 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:06.989+0000 7ff329000700 1 -- 172.21.15.18:0/1769961481 wait complete. 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:mon is available 2024-04-21T22:22:07.645 INFO:teuthology.orchestra.run.smithi018.stdout:Assimilating anything we can from ceph.conf... 2024-04-21T22:22:08.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:08 smithi018 ceph-mon[26250]: from='client.? 172.21.15.18:0/1928974676' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-21T22:22:08.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:08 smithi018 ceph-mon[26250]: from='client.? 172.21.15.18:0/1928974676' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-21T22:22:09.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:09.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-04-21T22:22:09.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:09.052 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.18:3300,v1:172.21.15.18:6789] 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-04-21T22:22:09.054 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.252+0000 7fd9c8e00700 1 Processor -- start 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.253+0000 7fd9c8e00700 1 -- start start 2024-04-21T22:22:09.059 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.253+0000 7fd9c8e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.253+0000 7fd9c8e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c407f250 con 0x7fd9c407e860 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.253+0000 7fd9c1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.254+0000 7fd9c1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38236/0 (socket says 172.21.15.18:38236) 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.254+0000 7fd9c1e00700 1 -- 172.21.15.18:0/2243083806 learned_addr learned my addr 172.21.15.18:0/2243083806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.254+0000 7fd9c1e00700 1 -- 172.21.15.18:0/2243083806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c407fa60 con 0x7fd9c407e860 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.254+0000 7fd9c1e00700 1 --2- 172.21.15.18:0/2243083806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40098a0 tx=0x7fd9b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617ce8751910bd10 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.255+0000 7fd9c0a00700 1 -- 172.21.15.18:0/2243083806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4004160 con 0x7fd9c407e860 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.255+0000 7fd9c0a00700 1 -- 172.21.15.18:0/2243083806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b4004300 con 0x7fd9c407e860 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.255+0000 7fd9c0a00700 1 -- 172.21.15.18:0/2243083806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b40036a0 con 0x7fd9c407e860 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.255+0000 7fd9c8e00700 1 -- 172.21.15.18:0/2243083806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 msgr2=0x7fd9c407ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.255+0000 7fd9c8e00700 1 --2- 172.21.15.18:0/2243083806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40098a0 tx=0x7fd9b4009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.256+0000 7fd9c8e00700 1 -- 172.21.15.18:0/2243083806 shutdown_connections 2024-04-21T22:22:09.060 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.256+0000 7fd9c8e00700 1 --2- 172.21.15.18:0/2243083806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c407ec80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.256+0000 7fd9c8e00700 1 -- 172.21.15.18:0/2243083806 >> 172.21.15.18:0/2243083806 conn(0x7fd9c407d630 msgr2=0x7fd9c407da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.256+0000 7fd9c8e00700 1 -- 172.21.15.18:0/2243083806 shutdown_connections 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.256+0000 7fd9c8e00700 1 -- 172.21.15.18:0/2243083806 wait complete. 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.257+0000 7fd9c8e00700 1 Processor -- start 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.257+0000 7fd9c8e00700 1 -- start start 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.257+0000 7fd9c8e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.257+0000 7fd9c8e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c407ff90 con 0x7fd9c407e860 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.258+0000 7fd9c1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.258+0000 7fd9c1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38250/0 (socket says 172.21.15.18:38250) 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.258+0000 7fd9c1e00700 1 -- 172.21.15.18:0/1928974676 learned_addr learned my addr 172.21.15.18:0/1928974676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.258+0000 7fd9c1e00700 1 -- 172.21.15.18:0/1928974676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c41a20d0 con 0x7fd9c407e860 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.258+0000 7fd9c1e00700 1 --2- 172.21.15.18:0/1928974676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4000c00 tx=0x7fd9b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4003db0 con 0x7fd9c407e860 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b4011630 con 0x7fd9c407e860 2024-04-21T22:22:09.061 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4011950 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c41a2360 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c41a5050 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9b4011af0 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.259+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd9b401c450 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.260+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c4063890 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.263+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd9b4032020 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.342+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fd9c402dd40 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.352+0000 7fd9baa00700 1 -- 172.21.15.18:0/1928974676 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fd9b4004260 con 0x7fd9c407e860 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.353+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 msgr2=0x7fd9c41a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.353+0000 7fd9c8e00700 1 --2- 172.21.15.18:0/1928974676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4000c00 tx=0x7fd9b4004750 comp rx=0 tx=0).stop 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.353+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 shutdown_connections 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.353+0000 7fd9c8e00700 1 --2- 172.21.15.18:0/1928974676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9c407e860 0x7fd9c41a1b90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.353+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 >> 172.21.15.18:0/1928974676 conn(0x7fd9c407d630 msgr2=0x7fd9c4107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:09.062 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.354+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 shutdown_connections 2024-04-21T22:22:09.063 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:08.354+0000 7fd9c8e00700 1 -- 172.21.15.18:0/1928974676 wait complete. 2024-04-21T22:22:09.063 INFO:teuthology.orchestra.run.smithi018.stdout:Generating new minimal ceph.conf... 2024-04-21T22:22:10.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:09 smithi018 ceph-mon[26250]: from='client.? 172.21.15.18:0/590110596' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.673+0000 7f6ae1600700 1 Processor -- start 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.674+0000 7f6ae1600700 1 -- start start 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.674+0000 7f6ae1600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.674+0000 7f6ae1600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10ab80 con 0x7f6adc10a190 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.675+0000 7f6adaa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.675+0000 7f6adaa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38266/0 (socket says 172.21.15.18:38266) 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.675+0000 7f6adaa00700 1 -- 172.21.15.18:0/2303578120 learned_addr learned my addr 172.21.15.18:0/2303578120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.675+0000 7f6adaa00700 1 -- 172.21.15.18:0/2303578120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc10b340 con 0x7f6adc10a190 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.675+0000 7f6adaa00700 1 --2- 172.21.15.18:0/2303578120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e80 tx=0x7f6acc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28306bcfe52b46a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.676+0000 7f6ada000700 1 -- 172.21.15.18:0/2303578120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc017070 con 0x7f6adc10a190 2024-04-21T22:22:10.397 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.676+0000 7f6ada000700 1 -- 172.21.15.18:0/2303578120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6acc00b8c0 con 0x7f6adc10a190 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.676+0000 7f6ada000700 1 -- 172.21.15.18:0/2303578120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc0045c0 con 0x7f6adc10a190 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.676+0000 7f6ae1600700 1 -- 172.21.15.18:0/2303578120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 msgr2=0x7f6adc10a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.676+0000 7f6ae1600700 1 --2- 172.21.15.18:0/2303578120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009e80 tx=0x7f6acc00b330 comp rx=0 tx=0).stop 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.677+0000 7f6ae1600700 1 -- 172.21.15.18:0/2303578120 shutdown_connections 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.677+0000 7f6ae1600700 1 --2- 172.21.15.18:0/2303578120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc10a5b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.677+0000 7f6ae1600700 1 -- 172.21.15.18:0/2303578120 >> 172.21.15.18:0/2303578120 conn(0x7f6adc07d630 msgr2=0x7f6adc07da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.677+0000 7f6ae1600700 1 -- 172.21.15.18:0/2303578120 shutdown_connections 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.677+0000 7f6ae1600700 1 -- 172.21.15.18:0/2303578120 wait complete. 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.678+0000 7f6ae1600700 1 Processor -- start 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.678+0000 7f6ae1600700 1 -- start start 2024-04-21T22:22:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.678+0000 7f6ae1600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.678+0000 7f6ae1600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc10e570 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.679+0000 7f6adaa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.679+0000 7f6adaa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38272/0 (socket says 172.21.15.18:38272) 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.679+0000 7f6adaa00700 1 -- 172.21.15.18:0/590110596 learned_addr learned my addr 172.21.15.18:0/590110596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.679+0000 7f6adaa00700 1 -- 172.21.15.18:0/590110596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc19e550 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.679+0000 7f6adaa00700 1 --2- 172.21.15.18:0/590110596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009530 tx=0x7f6acc00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc020020 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6acc003b50 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc017040 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc19e7e0 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc1a14d0 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6acc023020 con 0x7f6adc10a190 2024-04-21T22:22:10.399 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.680+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6acc00f050 con 0x7f6adc10a190 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.681+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc10e6f0 con 0x7f6adc10a190 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.684+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6acc02a020 con 0x7f6adc10a190 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.762+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6adc1a1a30 con 0x7f6adc10a190 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.763+0000 7f6ad3e00700 1 -- 172.21.15.18:0/590110596 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f6acc00b860 con 0x7f6adc10a190 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 msgr2=0x7f6adc19e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 --2- 172.21.15.18:0/590110596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009530 tx=0x7f6acc00bd50 comp rx=0 tx=0).stop 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 shutdown_connections 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 --2- 172.21.15.18:0/590110596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc10a190 0x7f6adc19e010 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 >> 172.21.15.18:0/590110596 conn(0x7f6adc07d630 msgr2=0x7f6adc107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.764+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 shutdown_connections 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:09.765+0000 7f6ae1600700 1 -- 172.21.15.18:0/590110596 wait complete. 2024-04-21T22:22:10.400 INFO:teuthology.orchestra.run.smithi018.stdout:Restarting the monitor... 2024-04-21T22:22:10.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:10 smithi018 systemd[1]: Stopping Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:22:11.282 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a[26246]: 2024-04-21T22:22:10.894+0000 7fb40e600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:22:11.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a[26246]: 2024-04-21T22:22:10.894+0000 7fb40e600700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-21T22:22:11.283 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:10 smithi018 podman[26492]: 2024-04-21 22:22:10.945601177 +0000 UTC m=+0.190577402 container died 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-21T22:22:11.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:11 smithi018 podman[26492]: 2024-04-21 22:22:11.3940924 +0000 UTC m=+0.639068654 container cleanup 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-21T22:22:11.586 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:11 smithi018 bash[26492]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a 2024-04-21T22:22:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:11 smithi018 podman[26506]: 2024-04-21 22:22:11.586297109 +0000 UTC m=+0.619929419 container remove 7bf4b26cd907389675a69d2849f458ca2c35a9e6fbb40633d8b007846cb85356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-21T22:22:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-21T22:22:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 systemd[1]: Stopped Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:22:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service: Consumed 1.962s CPU time. 2024-04-21T22:22:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 systemd[1]: Starting Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:22:12.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 podman[26595]: 2024-04-21 22:22:12.408506174 +0000 UTC m=+0.039692946 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:22:12.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 podman[26595]: 2024-04-21 22:22:12.512148384 +0000 UTC m=+0.143335200 container create bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:22:12.879 INFO:teuthology.orchestra.run.smithi018.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 podman[26595]: 2024-04-21 22:22:12.751909621 +0000 UTC m=+0.383096455 container init bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 podman[26595]: 2024-04-21 22:22:12.764357548 +0000 UTC m=+0.395544344 container start bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, ceph=True, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=) 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: set uid:gid to 167:167 (ceph:ceph) 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev), process ceph-mon, pid 2 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: pidfile_write: ignore empty --pid-file 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: load: jerasure load: lrc 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: RocksDB version: 7.9.2 2024-04-21T22:22:13.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Git sha 0 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Compile date 2024-04-20 15:04:30 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: DB SUMMARY 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: DB Session ID: XAOK7PKTAPC17J6AY9YJ 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: CURRENT file: CURRENT 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: IDENTITY file: IDENTITY 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106680 ; 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.error_if_exists: 0 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.create_if_missing: 0 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.paranoid_checks: 1 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-21T22:22:13.033 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.env: 0x556512d9ec60 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.fs: PosixFileSystem 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.info_log: 0x5565163fbae0 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_file_opening_threads: 16 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.statistics: (nil) 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.use_fsync: 0 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_log_file_size: 0 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.keep_log_file_num: 1000 2024-04-21T22:22:13.034 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.recycle_log_file_num: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_fallocate: 1 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_mmap_reads: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_mmap_writes: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.use_direct_reads: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.create_missing_column_families: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.db_log_dir: 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.wal_dir: 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-21T22:22:13.035 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.advise_random_on_open: 1 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.db_write_buffer_size: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.write_buffer_manager: 0x5565163ce1e0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.rate_limiter: (nil) 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.wal_recovery_mode: 2 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enable_thread_tracking: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enable_pipelined_write: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.unordered_write: 0 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-21T22:22:13.036 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-21T22:22:13.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.row_cache: None 2024-04-21T22:22:13.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.wal_filter: None 2024-04-21T22:22:13.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-21T22:22:13.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_ingest_behind: 0 2024-04-21T22:22:13.037 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.two_write_queues: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.manual_wal_flush: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.wal_compression: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.atomic_flush: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.log_readahead_size: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.best_efforts_recovery: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.allow_data_in_errors: 0 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.db_host_id: __hostname__ 2024-04-21T22:22:13.038 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_background_jobs: 2 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_background_compactions: -1 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_subcompactions: 1 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_total_wal_size: 0 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_open_files: -1 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bytes_per_sync: 0 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-21T22:22:13.039 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_readahead_size: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_background_flushes: -1 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Compression algorithms supported: 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kZSTD supported: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kXpressCompression supported: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kLZ4HCCompression supported: 1 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kZlibCompression supported: 1 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kSnappyCompression supported: 1 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kLZ4Compression supported: 1 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: kBZip2Compression supported: 0 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-21T22:22:13.040 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.merge_operator: 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_filter: None 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_filter_factory: None 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.sst_partitioner_factory: None 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5565163fbbe0) 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks: 1 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: pin_top_level_index_and_filter: 1 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_type: 0 2024-04-21T22:22:13.041 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_index_type: 0 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_shortening: 1 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: checksum: 4 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: no_block_cache: 0 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache: 0x5565163ff090 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_name: BinnedLRUCache 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_options: 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: capacity : 536870912 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_shard_bits : 4 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: strict_capacity_limit : 0 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: high_pri_pool_ratio: 0.000 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_cache_compressed: (nil) 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: persistent_cache: (nil) 2024-04-21T22:22:13.042 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size: 4096 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_size_deviation: 10 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_restart_interval: 16 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: index_block_restart_interval: 1 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: metadata_block_size: 4096 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: partition_filters: 0 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: use_delta_encoding: 1 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: filter_policy: bloomfilter 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: whole_key_filtering: 1 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: verify_compression: 0 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: read_amp_bytes_per_bit: 0 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: format_version: 5 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_index_compression: 1 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: block_align: 0 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: max_auto_readahead_size: 262144 2024-04-21T22:22:13.043 INFO:journalctl@ceph.mon.a.smithi018.stdout: prepopulate_block_cache: 0 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout: initial_auto_readahead_size: 8192 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout: num_file_reads_for_auto_readahead: 2 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.write_buffer_size: 33554432 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_write_buffer_number: 2 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression: NoCompression 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression: Disabled 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.prefix_extractor: nullptr 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.num_levels: 7 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-21T22:22:13.044 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.level: 32767 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.strategy: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.enabled: false 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:22:13.045 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.target_file_size_base: 67108864 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-21T22:22:13.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.arena_block_size: 1048576 2024-04-21T22:22:13.047 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.disable_auto_compactions: 0 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.table_properties_collectors: 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.inplace_update_support: 0 2024-04-21T22:22:13.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.bloom_locality: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.max_successive_merges: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.paranoid_file_checks: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.force_consistency_checks: 1 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.report_bg_io_stats: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.ttl: 2592000 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enable_blob_files: false 2024-04-21T22:22:13.049 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.min_blob_size: 0 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_file_size: 268435456 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.blob_file_starting_level: 0 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3bfd96d2-4e63-482a-8b5b-e7a2a2780639 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738132823601, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-21T22:22:13.050 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738132825565, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101539, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99457, "index_size": 300, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14657, "raw_average_key_size": 50, "raw_value_size": 91568, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713738132, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3bfd96d2-4e63-482a-8b5b-e7a2a2780639", "db_session_id": "XAOK7PKTAPC17J6AY9YJ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738132825736, "job": 1, "event": "recovery_finished"} 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5565164f0000 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: DB pointer 0x5565164da000 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** DB Stats ** 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:22:13.051 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: L0 2/0 100.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: Sum 2/0 100.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** Compaction Stats [default] ** 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 79.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-21T22:22:13.052 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Cumulative compaction: 0.00 GB write, 14.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Interval compaction: 0.00 GB write, 14.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache BinnedLRUCache@0x5565163ff090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.6e-05 secs_since: 0 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: starting mon.a rank 0 at public addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] at bind addrs [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:13.053 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???) e1 preinit fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).mds e1 new map 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).mds e1 print_map 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: e1 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: legacy client fscid: -1 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout: No filesystems configured 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-21T22:22:13.054 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 bash[26595]: bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 systemd[1]: Started Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: monmap epoch 1 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: last_changed 2024-04-21T22:22:01.886929+0000 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: min_mon_release 19 (squid) 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: election_strategy: 1 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: fsmap 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: osdmap e1: 0 total, 0 up, 0 in 2024-04-21T22:22:13.055 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:12 smithi018 ceph-mon[26614]: mgrmap e1: no daemons active 2024-04-21T22:22:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.611+0000 7fe617200700 1 Processor -- start 2024-04-21T22:22:14.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.611+0000 7fe617200700 1 -- start start 2024-04-21T22:22:14.304 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.612+0000 7fe617200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:14.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.612+0000 7fe617200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe618082530 con 0x7fe61810ecd0 2024-04-21T22:22:14.305 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.612+0000 7fe615e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.612+0000 7fe615e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38286/0 (socket says 172.21.15.18:38286) 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.612+0000 7fe615e00700 1 -- 172.21.15.18:0/2873307191 learned_addr learned my addr 172.21.15.18:0/2873307191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.613+0000 7fe615e00700 1 -- 172.21.15.18:0/2873307191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe618111600 con 0x7fe61810ecd0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.613+0000 7fe615e00700 1 --2- 172.21.15.18:0/2873307191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098a0 tx=0x7fe608009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505169e5e0baa778 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.613+0000 7fe614a00700 1 -- 172.21.15.18:0/2873307191 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe608004160 con 0x7fe61810ecd0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.613+0000 7fe614a00700 1 -- 172.21.15.18:0/2873307191 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe608004300 con 0x7fe61810ecd0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.613+0000 7fe614a00700 1 -- 172.21.15.18:0/2873307191 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe608011b50 con 0x7fe61810ecd0 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 -- 172.21.15.18:0/2873307191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 msgr2=0x7fe6181110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 --2- 172.21.15.18:0/2873307191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098a0 tx=0x7fe608009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:14.306 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 -- 172.21.15.18:0/2873307191 shutdown_connections 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 --2- 172.21.15.18:0/2873307191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181110c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 -- 172.21.15.18:0/2873307191 >> 172.21.15.18:0/2873307191 conn(0x7fe61807d450 msgr2=0x7fe61807f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 -- 172.21.15.18:0/2873307191 shutdown_connections 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.614+0000 7fe617200700 1 -- 172.21.15.18:0/2873307191 wait complete. 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.615+0000 7fe617200700 1 Processor -- start 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe617200700 1 -- start start 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe617200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe617200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6181125b0 con 0x7fe61810ecd0 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe615e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:14.310 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe615e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38302/0 (socket says 172.21.15.18:38302) 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.616+0000 7fe615e00700 1 -- 172.21.15.18:0/1618337258 learned_addr learned my addr 172.21.15.18:0/1618337258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe615e00700 1 -- 172.21.15.18:0/1618337258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6181a2830 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe615e00700 1 --2- 172.21.15.18:0/1618337258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe608011850 tx=0x7fe608011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe608003af0 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe608020070 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6181a2ac0 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6080195a0 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.617+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6181a57b0 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.618+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe608019c30 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.618+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe608011e00 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.619+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6180693b0 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.622+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe60801a770 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.698+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fe6181a5980 con 0x7fe61810ecd0 2024-04-21T22:22:14.311 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.703+0000 7fe60ea00700 1 -- 172.21.15.18:0/1618337258 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fe60801a950 con 0x7fe61810ecd0 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.704+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 msgr2=0x7fe6181a22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.704+0000 7fe617200700 1 --2- 172.21.15.18:0/1618337258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe608011850 tx=0x7fe608011c10 comp rx=0 tx=0).stop 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.705+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 shutdown_connections 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.705+0000 7fe617200700 1 --2- 172.21.15.18:0/1618337258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61810ecd0 0x7fe6181a22f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.705+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 >> 172.21.15.18:0/1618337258 conn(0x7fe61807d450 msgr2=0x7fe61807e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.705+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 shutdown_connections 2024-04-21T22:22:14.312 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:13.705+0000 7fe617200700 1 -- 172.21.15.18:0/1618337258 wait complete. 2024-04-21T22:22:14.313 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-21T22:22:14.331 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:22:14.331 INFO:teuthology.orchestra.run.smithi018.stdout:Creating mgr... 2024-04-21T22:22:14.333 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-21T22:22:14.334 INFO:teuthology.orchestra.run.smithi018.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-21T22:22:14.765 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x 2024-04-21T22:22:14.765 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-21T22:22:15.031 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968.target.wants/ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6ef0a334-002d-11ef-bc93-c7b262605968@.service. 2024-04-21T22:22:15.048 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:14 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1618337258' entity='client.admin' 2024-04-21T22:22:15.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 systemd[1]: Starting Ceph mgr.x for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:22:15.750 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 podman[26828]: 2024-04-21 22:22:15.367902033 +0000 UTC m=+0.037718901 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b 2024-04-21T22:22:15.750 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 podman[26828]: 2024-04-21 22:22:15.48441092 +0000 UTC m=+0.154227783 container create 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:22:15.750 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 podman[26828]: 2024-04-21 22:22:15.749076905 +0000 UTC m=+0.418893799 container init 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-21T22:22:15.909 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T22:22:15.909 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-04-21T22:22:15.930 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T22:22:15.930 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:22:15.930 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-04-21T22:22:15.930 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to enable service . firewalld.service is not available 2024-04-21T22:22:15.954 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T22:22:15.954 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-04-21T22:22:15.971 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T22:22:15.971 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:22:15.971 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-04-21T22:22:15.972 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-21T22:22:15.972 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr to start... 2024-04-21T22:22:15.972 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr... 2024-04-21T22:22:16.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 podman[26828]: 2024-04-21 22:22:15.758413104 +0000 UTC m=+0.428229964 container start 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416) 2024-04-21T22:22:16.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 bash[26828]: 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 2024-04-21T22:22:16.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 systemd[1]: Started Ceph mgr.x for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:22:16.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:15.987+0000 7fd1a8cfc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:22:16.351 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:16.250+0000 7fd1a8cfc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:22:16.693 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:16.391+0000 7fd1a8cfc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:22:17.088 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:16 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1340511689' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T22:22:17.088 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:16.826+0000 7fd1a8cfc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:22:17.088 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:16.941+0000 7fd1a8cfc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:22:17.564 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T22:22:17.567 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.568 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T22:22:17.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:17.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T22:22:17.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T22:22:17.569 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T22:22:17.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T22:22:17.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T22:22:17.576 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T22:22:17.577 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T22:22:06.206776+0000", 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:17.578 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.602+0000 7f7fc2e00700 1 Processor -- start 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.602+0000 7f7fc2e00700 1 -- start start 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.603+0000 7f7fc2e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.603+0000 7f7fc2e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc1077c0 con 0x7f7fbc106e60 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.603+0000 7f7fbbe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.604+0000 7f7fbbe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44148/0 (socket says 172.21.15.18:44148) 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.604+0000 7f7fbbe00700 1 -- 172.21.15.18:0/3920083791 learned_addr learned my addr 172.21.15.18:0/3920083791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.604+0000 7f7fbbe00700 1 -- 172.21.15.18:0/3920083791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc107fc0 con 0x7f7fbc106e60 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.604+0000 7f7fbbe00700 1 --2- 172.21.15.18:0/3920083791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0098a0 tx=0x7f7fac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea82323fe95d092f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.605+0000 7f7fbaa00700 1 -- 172.21.15.18:0/3920083791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac004160 con 0x7f7fbc106e60 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.605+0000 7f7fbaa00700 1 -- 172.21.15.18:0/3920083791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fac004300 con 0x7f7fbc106e60 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.605+0000 7f7fbaa00700 1 -- 172.21.15.18:0/3920083791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac011b50 con 0x7f7fbc106e60 2024-04-21T22:22:17.579 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.605+0000 7f7fc2e00700 1 -- 172.21.15.18:0/3920083791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 msgr2=0x7f7fbc107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.605+0000 7f7fc2e00700 1 --2- 172.21.15.18:0/3920083791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0098a0 tx=0x7f7fac009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.606+0000 7f7fc2e00700 1 -- 172.21.15.18:0/3920083791 shutdown_connections 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.606+0000 7f7fc2e00700 1 --2- 172.21.15.18:0/3920083791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc107280 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.606+0000 7f7fc2e00700 1 -- 172.21.15.18:0/3920083791 >> 172.21.15.18:0/3920083791 conn(0x7f7fbc1024a0 msgr2=0x7f7fbc1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.606+0000 7f7fc2e00700 1 -- 172.21.15.18:0/3920083791 shutdown_connections 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.606+0000 7f7fc2e00700 1 -- 172.21.15.18:0/3920083791 wait complete. 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.607+0000 7f7fc2e00700 1 Processor -- start 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.607+0000 7f7fc2e00700 1 -- start start 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.607+0000 7f7fc2e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.607+0000 7f7fc2e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc10b280 con 0x7f7fbc106e60 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.608+0000 7f7fbbe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.608+0000 7f7fbbe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44160/0 (socket says 172.21.15.18:44160) 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.608+0000 7f7fbbe00700 1 -- 172.21.15.18:0/1340511689 learned_addr learned my addr 172.21.15.18:0/1340511689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.608+0000 7f7fbbe00700 1 -- 172.21.15.18:0/1340511689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc19e580 con 0x7f7fbc106e60 2024-04-21T22:22:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.608+0000 7f7fbbe00700 1 --2- 172.21.15.18:0/1340511689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7fac011b60 tx=0x7f7fac011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac003b20 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fac003cc0 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc19e810 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac024840 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc1a1500 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7fac022020 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.609+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7fac011e00 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.610+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fbc063890 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.613+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7fac043dd0 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.693+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7fbc02de70 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.694+0000 7f7fb8c00700 1 -- 172.21.15.18:0/1340511689 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7fac032020 con 0x7f7fbc106e60 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.695+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 msgr2=0x7f7fbc19e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.695+0000 7f7fc2e00700 1 --2- 172.21.15.18:0/1340511689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7fac011b60 tx=0x7f7fac011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.695+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 shutdown_connections 2024-04-21T22:22:17.581 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.695+0000 7f7fc2e00700 1 --2- 172.21.15.18:0/1340511689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fbc106e60 0x7f7fbc19e040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:17.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.695+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 >> 172.21.15.18:0/1340511689 conn(0x7f7fbc1024a0 msgr2=0x7f7fbc103300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:17.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.696+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 shutdown_connections 2024-04-21T22:22:17.582 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:16.696+0000 7f7fc2e00700 1 -- 172.21.15.18:0/1340511689 wait complete. 2024-04-21T22:22:17.582 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (1/15)... 2024-04-21T22:22:18.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:18.586+0000 7fd1a8cfc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:22:18.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:18.820+0000 7fd1a8cfc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:22:19.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:19.038+0000 7fd1a8cfc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:22:19.730 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:19.428+0000 7fd1a8cfc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:22:19.731 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:19.555+0000 7fd1a8cfc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:22:20.024 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:19.819+0000 7fd1a8cfc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:22:20.274 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:20.086+0000 7fd1a8cfc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:22:20.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:20 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1921885639' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T22:22:21.014 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:21.019 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T22:22:21.020 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T22:22:21.021 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:21.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T22:22:21.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T22:22:21.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.022 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T22:22:21.023 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T22:22:21.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:21.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:21.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.024 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T22:22:06.206776+0000", 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.179+0000 7f3f6d200700 1 Processor -- start 2024-04-21T22:22:21.029 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.179+0000 7f3f6d200700 1 -- start start 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.179+0000 7f3f6d200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.179+0000 7f3f6d200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6807e170 con 0x7f3f6807dd50 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.180+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.180+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44176/0 (socket says 172.21.15.18:44176) 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.180+0000 7f3f65e00700 1 -- 172.21.15.18:0/2502179222 learned_addr learned my addr 172.21.15.18:0/2502179222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.180+0000 7f3f65e00700 1 -- 172.21.15.18:0/2502179222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6807c800 con 0x7f3f6807dd50 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.181+0000 7f3f65e00700 1 --2- 172.21.15.18:0/2502179222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098a0 tx=0x7f3f58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6366eb20e6134719 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.181+0000 7f3f64a00700 1 -- 172.21.15.18:0/2502179222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f58004160 con 0x7f3f6807dd50 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.181+0000 7f3f64a00700 1 -- 172.21.15.18:0/2502179222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f58004300 con 0x7f3f6807dd50 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.181+0000 7f3f64a00700 1 -- 172.21.15.18:0/2502179222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f58011b50 con 0x7f3f6807dd50 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 -- 172.21.15.18:0/2502179222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 msgr2=0x7f3f6807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 --2- 172.21.15.18:0/2502179222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098a0 tx=0x7f3f58009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 -- 172.21.15.18:0/2502179222 shutdown_connections 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 --2- 172.21.15.18:0/2502179222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6807c2c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 -- 172.21.15.18:0/2502179222 >> 172.21.15.18:0/2502179222 conn(0x7f3f681036a0 msgr2=0x7f3f68105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 -- 172.21.15.18:0/2502179222 shutdown_connections 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.182+0000 7f3f6d200700 1 -- 172.21.15.18:0/2502179222 wait complete. 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.183+0000 7f3f6d200700 1 Processor -- start 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.183+0000 7f3f6d200700 1 -- start start 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.183+0000 7f3f6d200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.183+0000 7f3f6d200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6810e3d0 con 0x7f3f6807dd50 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.184+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.184+0000 7f3f65e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44178/0 (socket says 172.21.15.18:44178) 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.184+0000 7f3f65e00700 1 -- 172.21.15.18:0/1921885639 learned_addr learned my addr 172.21.15.18:0/1921885639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.184+0000 7f3f65e00700 1 -- 172.21.15.18:0/1921885639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6819e5a0 con 0x7f3f6807dd50 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.184+0000 7f3f65e00700 1 --2- 172.21.15.18:0/1921885639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011b60 tx=0x7f3f58011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:21.031 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f58003970 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6819e830 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f58003b10 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f58024610 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f681a1520 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f58024c50 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.185+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f58011e00 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.186+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f68063890 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.189+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3f5801a9f0 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.268+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3f681a16f0 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.269+0000 7f3f5ea00700 1 -- 172.21.15.18:0/1921885639 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f3f5801a430 con 0x7f3f6807dd50 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.270+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 msgr2=0x7f3f6819e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.270+0000 7f3f6d200700 1 --2- 172.21.15.18:0/1921885639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011b60 tx=0x7f3f58011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.270+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 shutdown_connections 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.270+0000 7f3f6d200700 1 --2- 172.21.15.18:0/1921885639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6807dd50 0x7f3f6819e060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.270+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 >> 172.21.15.18:0/1921885639 conn(0x7f3f681036a0 msgr2=0x7f3f68104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:21.033 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.271+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 shutdown_connections 2024-04-21T22:22:21.033 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:20.271+0000 7f3f6d200700 1 -- 172.21.15.18:0/1921885639 wait complete. 2024-04-21T22:22:21.033 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (2/15)... 2024-04-21T22:22:21.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:20.912+0000 7fd1a8cfc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:22:21.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:21.482+0000 7fd1a8cfc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:22:21.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:21.613+0000 7fd1a8cfc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:22:22.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:21.883+0000 7fd1a8cfc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:22:22.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:22.573+0000 7fd1a8cfc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:22:22.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:22.700+0000 7fd1a8cfc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:22:23.294 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:23.030+0000 7fd1a8cfc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:22:23.294 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:23.220+0000 7fd1a8cfc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:22:23.554 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:23.355+0000 7fd1a8cfc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:22:23.555 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:23.511+0000 7fd1a8cfc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:22:23.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:23.639+0000 7fd1a8cfc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:22:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:23 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2407326628' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T22:22:24.446 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T22:22:24.447 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T22:22:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T22:22:24.449 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.449 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T22:22:24.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:24.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T22:22:24.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T22:22:24.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T22:22:06.206776+0000", 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:24.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.611+0000 7f6697600700 1 Processor -- start 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.611+0000 7f6697600700 1 -- start start 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.612+0000 7f6697600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.612+0000 7f6697600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f669007c820 con 0x7f669007dd70 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.612+0000 7f6694c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.612+0000 7f6694c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44186/0 (socket says 172.21.15.18:44186) 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.612+0000 7f6694c00700 1 -- 172.21.15.18:0/659557605 learned_addr learned my addr 172.21.15.18:0/659557605 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.613+0000 7f6694c00700 1 -- 172.21.15.18:0/659557605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669007c9a0 con 0x7f669007dd70 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.613+0000 7f6694c00700 1 --2- 172.21.15.18:0/659557605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66840098a0 tx=0x7f6684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ab8ec997aa24b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:24.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f668f400700 1 -- 172.21.15.18:0/659557605 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684004160 con 0x7f669007dd70 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f668f400700 1 -- 172.21.15.18:0/659557605 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6684004300 con 0x7f669007dd70 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f668f400700 1 -- 172.21.15.18:0/659557605 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684011b50 con 0x7f669007dd70 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f6697600700 1 -- 172.21.15.18:0/659557605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 msgr2=0x7f669007c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f6697600700 1 --2- 172.21.15.18:0/659557605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f66840098a0 tx=0x7f6684009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f6697600700 1 -- 172.21.15.18:0/659557605 shutdown_connections 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f6697600700 1 --2- 172.21.15.18:0/659557605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669007c2e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.614+0000 7f6697600700 1 -- 172.21.15.18:0/659557605 >> 172.21.15.18:0/659557605 conn(0x7f66901036a0 msgr2=0x7f6690105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.615+0000 7f6697600700 1 -- 172.21.15.18:0/659557605 shutdown_connections 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.615+0000 7f6697600700 1 -- 172.21.15.18:0/659557605 wait complete. 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6697600700 1 Processor -- start 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6697600700 1 -- start start 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6697600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6697600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f669010e410 con 0x7f669007dd70 2024-04-21T22:22:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6694c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6694c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44192/0 (socket says 172.21.15.18:44192) 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.616+0000 7f6694c00700 1 -- 172.21.15.18:0/2407326628 learned_addr learned my addr 172.21.15.18:0/2407326628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.617+0000 7f6694c00700 1 -- 172.21.15.18:0/2407326628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669019e5a0 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.617+0000 7f6694c00700 1 --2- 172.21.15.18:0/2407326628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6684011b60 tx=0x7f6684011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.617+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684003970 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.617+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6684003b10 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.617+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6684024610 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.618+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669019e830 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.618+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901a1520 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.618+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6684024c50 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.618+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6684011e00 con 0x7f669007dd70 2024-04-21T22:22:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.619+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6690063890 con 0x7f669007dd70 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.622+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6684043dd0 con 0x7f669007dd70 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.702+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f66901a16f0 con 0x7f669007dd70 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.703+0000 7f668d600700 1 -- 172.21.15.18:0/2407326628 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f6684032030 con 0x7f669007dd70 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.704+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 msgr2=0x7f669019e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.704+0000 7f6697600700 1 --2- 172.21.15.18:0/2407326628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6684011b60 tx=0x7f6684011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.704+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 shutdown_connections 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.704+0000 7f6697600700 1 --2- 172.21.15.18:0/2407326628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f669007dd70 0x7f669019e060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.704+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 >> 172.21.15.18:0/2407326628 conn(0x7f66901036a0 msgr2=0x7f6690104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.705+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 shutdown_connections 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:23.705+0000 7f6697600700 1 -- 172.21.15.18:0/2407326628 wait complete. 2024-04-21T22:22:24.460 INFO:teuthology.orchestra.run.smithi018.stdout:mgr not available, waiting (3/15)... 2024-04-21T22:22:24.995 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:24.704+0000 7fd1a8cfc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:22:24.995 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:24.994+0000 7fd1a8cfc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:22:25.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: Activating manager daemon x 2024-04-21T22:22:25.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: mgrmap e2: x(active, starting, since 0.0102888s) 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: Manager daemon x is now available 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' 2024-04-21T22:22:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:25 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' 2024-04-21T22:22:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:26 smithi018 ceph-mon[26614]: from='mgr.14100 172.21.15.18:0/1325242971' entity='mgr.x' 2024-04-21T22:22:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:26 smithi018 ceph-mon[26614]: mgrmap e3: x(active, since 1.0227s) 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "health": { 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-21T22:22:28.221 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 0 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "a" 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-21T22:22:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-21T22:22:28.223 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-21T22:22:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "restful" 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ], 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-21T22:22:28.232 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "modified": "2024-04-21T22:22:06.206776+0000", 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout }, 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.122+0000 7faa71200700 1 Processor -- start 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.122+0000 7faa71200700 1 -- start start 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.123+0000 7faa71200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.123+0000 7faa71200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c07bdd0 con 0x7faa6c108ab0 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.123+0000 7faa69e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.123+0000 7faa69e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36030/0 (socket says 172.21.15.18:36030) 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.123+0000 7faa69e00700 1 -- 172.21.15.18:0/2029533075 learned_addr learned my addr 172.21.15.18:0/2029533075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.124+0000 7faa69e00700 1 -- 172.21.15.18:0/2029533075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c10b3e0 con 0x7faa6c108ab0 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.124+0000 7faa69e00700 1 --2- 172.21.15.18:0/2029533075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0098a0 tx=0x7faa5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b482a79d098c90bb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.124+0000 7faa68a00700 1 -- 172.21.15.18:0/2029533075 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa5c004160 con 0x7faa6c108ab0 2024-04-21T22:22:28.233 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.124+0000 7faa68a00700 1 -- 172.21.15.18:0/2029533075 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa5c004300 con 0x7faa6c108ab0 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.124+0000 7faa68a00700 1 -- 172.21.15.18:0/2029533075 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa5c011b50 con 0x7faa6c108ab0 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.125+0000 7faa71200700 1 -- 172.21.15.18:0/2029533075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 msgr2=0x7faa6c10aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.125+0000 7faa71200700 1 --2- 172.21.15.18:0/2029533075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0098a0 tx=0x7faa5c009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.125+0000 7faa71200700 1 -- 172.21.15.18:0/2029533075 shutdown_connections 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.125+0000 7faa71200700 1 --2- 172.21.15.18:0/2029533075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c10aea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.125+0000 7faa71200700 1 -- 172.21.15.18:0/2029533075 >> 172.21.15.18:0/2029533075 conn(0x7faa6c1024a0 msgr2=0x7faa6c1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.126+0000 7faa71200700 1 -- 172.21.15.18:0/2029533075 shutdown_connections 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.126+0000 7faa71200700 1 -- 172.21.15.18:0/2029533075 wait complete. 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa71200700 1 Processor -- start 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa71200700 1 -- start start 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa71200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa71200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c10c260 con 0x7faa6c108ab0 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa69e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa69e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36032/0 (socket says 172.21.15.18:36032) 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.127+0000 7faa69e00700 1 -- 172.21.15.18:0/1137395154 learned_addr learned my addr 172.21.15.18:0/1137395154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:28.234 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.128+0000 7faa69e00700 1 -- 172.21.15.18:0/1137395154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c19c340 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.128+0000 7faa69e00700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa5c011b60 tx=0x7faa5c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.128+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa5c003b20 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.128+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa5c003cc0 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.128+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa5c024840 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.129+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c19c5d0 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.129+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c19f2c0 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.130+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c063890 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.130+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7faa5c022020 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.130+0000 7faa62a00700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 0x7faa5003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.130+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa5c011e00 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.131+0000 7faa69400700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 0x7faa5003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.131+0000 7faa69400700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 0x7faa5003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa58006fd0 tx=0x7faa58006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.137+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7faa5c04cae0 con 0x7faa6c108ab0 2024-04-21T22:22:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.455+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa6c19f490 con 0x7faa6c108ab0 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.456+0000 7faa62a00700 1 -- 172.21.15.18:0/1137395154 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7faa6c19f490 con 0x7faa6c108ab0 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 msgr2=0x7faa5003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 0x7faa5003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa58006fd0 tx=0x7faa58006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 msgr2=0x7faa6c19be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa5c011b60 tx=0x7faa5c011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 shutdown_connections 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7faa50039050 0x7faa5003b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 --2- 172.21.15.18:0/1137395154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6c108ab0 0x7faa6c19be00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 >> 172.21.15.18:0/1137395154 conn(0x7faa6c1024a0 msgr2=0x7faa6c102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 shutdown_connections 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:27.459+0000 7faa71200700 1 -- 172.21.15.18:0/1137395154 wait complete. 2024-04-21T22:22:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:mgr is available 2024-04-21T22:22:28.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:28 smithi018 ceph-mon[26614]: mgrmap e4: x(active, since 2s) 2024-04-21T22:22:28.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:28 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1137395154' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-21T22:22:29.533 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:29 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1345138001' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [global] 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout fsid = 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:29.889 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout [osd] 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-21T22:22:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.889+0000 7f675f200700 1 Processor -- start 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.889+0000 7f675f200700 1 -- start start 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.889+0000 7f675f200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.890+0000 7f675f200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f675807be90 con 0x7f67581089f0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.890+0000 7f6757e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.890+0000 7f6757e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36048/0 (socket says 172.21.15.18:36048) 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.890+0000 7f6757e00700 1 -- 172.21.15.18:0/1690110239 learned_addr learned my addr 172.21.15.18:0/1690110239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.890+0000 7f6757e00700 1 -- 172.21.15.18:0/1690110239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675810b320 con 0x7f67581089f0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.891+0000 7f6757e00700 1 --2- 172.21.15.18:0/1690110239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f67480098a0 tx=0x7f6748009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f926fe22fa9f3b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.891+0000 7f6756a00700 1 -- 172.21.15.18:0/1690110239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6748004160 con 0x7f67581089f0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.891+0000 7f6756a00700 1 -- 172.21.15.18:0/1690110239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6748004300 con 0x7f67581089f0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.891+0000 7f6756a00700 1 -- 172.21.15.18:0/1690110239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6748011b50 con 0x7f67581089f0 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 -- 172.21.15.18:0/1690110239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 msgr2=0x7f675810ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 --2- 172.21.15.18:0/1690110239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f67480098a0 tx=0x7f6748009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:29.897 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 -- 172.21.15.18:0/1690110239 shutdown_connections 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 --2- 172.21.15.18:0/1690110239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675810ade0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 -- 172.21.15.18:0/1690110239 >> 172.21.15.18:0/1690110239 conn(0x7f67581024a0 msgr2=0x7f67581048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 -- 172.21.15.18:0/1690110239 shutdown_connections 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.892+0000 7f675f200700 1 -- 172.21.15.18:0/1690110239 wait complete. 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.893+0000 7f675f200700 1 Processor -- start 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.893+0000 7f675f200700 1 -- start start 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f675f200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f675f200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f675810c200 con 0x7f67581089f0 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f6757e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f6757e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36064/0 (socket says 172.21.15.18:36064) 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f6757e00700 1 -- 172.21.15.18:0/1345138001 learned_addr learned my addr 172.21.15.18:0/1345138001 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.894+0000 7f6757e00700 1 -- 172.21.15.18:0/1345138001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675819c2e0 con 0x7f67581089f0 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f6757e00700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6748011670 tx=0x7f6748011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:29.898 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67480039c0 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6748011e50 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f674801a5c0 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675819c5d0 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.895+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675819f260 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.897+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f6748024430 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.896+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6758063890 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.897+0000 7f6754c00700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 0x7f673c03b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.897+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f674804d3b0 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.898+0000 7f6757400700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 0x7f673c03b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.898+0000 7f6757400700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 0x7f673c03b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6744006fd0 tx=0x7f6744006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:28.903+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f674802d3f0 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.128+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f67581a0b80 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.130+0000 7f6754c00700 1 -- 172.21.15.18:0/1345138001 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f6748024720 con 0x7f67581089f0 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.133+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 msgr2=0x7f673c03b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:29.899 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.133+0000 7f675f200700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 0x7f673c03b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6744006fd0 tx=0x7f6744006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.133+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 msgr2=0x7f675819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.133+0000 7f675f200700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6748011670 tx=0x7f6748011b60 comp rx=0 tx=0).stop 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 shutdown_connections 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f673c039000 0x7f673c03b4c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 --2- 172.21.15.18:0/1345138001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67581089f0 0x7f675819bda0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 >> 172.21.15.18:0/1345138001 conn(0x7f67581024a0 msgr2=0x7f6758103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 shutdown_connections 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:29.134+0000 7f675f200700 1 -- 172.21.15.18:0/1345138001 wait complete. 2024-04-21T22:22:29.900 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling cephadm module... 2024-04-21T22:22:31.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:30 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3086815267' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-21T22:22:31.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setuser ceph since I am not root 2024-04-21T22:22:31.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setgroup ceph since I am not root 2024-04-21T22:22:31.569 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:31.188+0000 7fe6039e7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:22:31.569 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:31.435+0000 7fe6039e7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:22:31.569 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:31.568+0000 7fe6039e7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:22:31.700 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.543+0000 7f907d400700 1 Processor -- start 2024-04-21T22:22:31.700 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.543+0000 7f907d400700 1 -- start start 2024-04-21T22:22:31.700 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.543+0000 7f907d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.543+0000 7f907d400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9078108970 con 0x7f9078108010 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.544+0000 7f9076800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.544+0000 7f9076800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36070/0 (socket says 172.21.15.18:36070) 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.544+0000 7f9076800700 1 -- 172.21.15.18:0/443173588 learned_addr learned my addr 172.21.15.18:0/443173588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.544+0000 7f9076800700 1 -- 172.21.15.18:0/443173588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9078108af0 con 0x7f9078108010 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.544+0000 7f9076800700 1 --2- 172.21.15.18:0/443173588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90680098a0 tx=0x7f9068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8936d836bab50be server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.545+0000 7f9075400700 1 -- 172.21.15.18:0/443173588 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9068004160 con 0x7f9078108010 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.545+0000 7f9075400700 1 -- 172.21.15.18:0/443173588 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9068004300 con 0x7f9078108010 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.545+0000 7f9075400700 1 -- 172.21.15.18:0/443173588 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9068011b50 con 0x7f9078108010 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 -- 172.21.15.18:0/443173588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 msgr2=0x7f9078108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:31.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 --2- 172.21.15.18:0/443173588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90680098a0 tx=0x7f9068009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 -- 172.21.15.18:0/443173588 shutdown_connections 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 --2- 172.21.15.18:0/443173588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f9078108430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 -- 172.21.15.18:0/443173588 >> 172.21.15.18:0/443173588 conn(0x7f9078103690 msgr2=0x7f9078105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 -- 172.21.15.18:0/443173588 shutdown_connections 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.546+0000 7f907d400700 1 -- 172.21.15.18:0/443173588 wait complete. 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.547+0000 7f907d400700 1 Processor -- start 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.547+0000 7f907d400700 1 -- start start 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.547+0000 7f907d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.547+0000 7f907d400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9078109f90 con 0x7f9078108010 2024-04-21T22:22:31.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.548+0000 7f9076800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.548+0000 7f9076800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36074/0 (socket says 172.21.15.18:36074) 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.548+0000 7f9076800700 1 -- 172.21.15.18:0/3086815267 learned_addr learned my addr 172.21.15.18:0/3086815267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.548+0000 7f9076800700 1 -- 172.21.15.18:0/3086815267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907807e0b0 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.548+0000 7f9076800700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9068011b60 tx=0x7f9068011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.549+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9068003b20 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.549+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9068003cc0 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.549+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9068024840 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.549+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907807c2a0 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.549+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907807c7e0 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.550+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f9068022020 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.550+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9078063890 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.551+0000 7f906f400700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 0x7f905c03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.551+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9068011e00 con 0x7f9078108010 2024-04-21T22:22:31.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.551+0000 7f9075e00700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 0x7f905c03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.552+0000 7f9075e00700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 0x7f905c03b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9064006fd0 tx=0x7f9064006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.556+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f906800b3e0 con 0x7f9078108010 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.838+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f907807ca60 con 0x7f9078108010 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.891+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f906804ce20 con 0x7f9078108010 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.894+0000 7f906f400700 1 -- 172.21.15.18:0/3086815267 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f906802c350 con 0x7f9078108010 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 msgr2=0x7f905c03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 0x7f905c03b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9064006fd0 tx=0x7f9064006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 msgr2=0x7f907807db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9068011b60 tx=0x7f9068011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 shutdown_connections 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f905c039050 0x7f905c03b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 --2- 172.21.15.18:0/3086815267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9078108010 0x7f907807db70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.896+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 >> 172.21.15.18:0/3086815267 conn(0x7f9078103690 msgr2=0x7f9078104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:31.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.897+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 shutdown_connections 2024-04-21T22:22:31.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:30.897+0000 7f907d400700 1 -- 172.21.15.18:0/3086815267 wait complete. 2024-04-21T22:22:32.197 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:31.977+0000 7fe6039e7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:22:32.197 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:32.097+0000 7fe6039e7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:22:32.197 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3086815267' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-21T22:22:32.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:31 smithi018 ceph-mon[26614]: mgrmap e5: x(active, since 5s) 2024-04-21T22:22:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:32 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4091328910' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-21T22:22:33.406 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.357+0000 7fd9a9c00700 1 Processor -- start 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.357+0000 7fd9a9c00700 1 -- start start 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.358+0000 7fd9a9c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.358+0000 7fd9a9c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a41077c0 con 0x7fd9a4106e60 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.358+0000 7fd9a2a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.358+0000 7fd9a2a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36088/0 (socket says 172.21.15.18:36088) 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.358+0000 7fd9a2a00700 1 -- 172.21.15.18:0/3526110762 learned_addr learned my addr 172.21.15.18:0/3526110762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.359+0000 7fd9a2a00700 1 -- 172.21.15.18:0/3526110762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a4107fc0 con 0x7fd9a4106e60 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.359+0000 7fd9a2a00700 1 --2- 172.21.15.18:0/3526110762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9940098a0 tx=0x7fd994009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180f8514e5969167 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.359+0000 7fd9a1600700 1 -- 172.21.15.18:0/3526110762 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd994004160 con 0x7fd9a4106e60 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.359+0000 7fd9a1600700 1 -- 172.21.15.18:0/3526110762 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd994004300 con 0x7fd9a4106e60 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.359+0000 7fd9a1600700 1 -- 172.21.15.18:0/3526110762 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd994011b50 con 0x7fd9a4106e60 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 -- 172.21.15.18:0/3526110762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 msgr2=0x7fd9a4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:33.407 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/3526110762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9940098a0 tx=0x7fd994009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 -- 172.21.15.18:0/3526110762 shutdown_connections 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/3526110762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a4107280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 -- 172.21.15.18:0/3526110762 >> 172.21.15.18:0/3526110762 conn(0x7fd9a41024a0 msgr2=0x7fd9a41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 -- 172.21.15.18:0/3526110762 shutdown_connections 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.360+0000 7fd9a9c00700 1 -- 172.21.15.18:0/3526110762 wait complete. 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.361+0000 7fd9a9c00700 1 Processor -- start 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a9c00700 1 -- start start 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a9c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a9c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a4108cc0 con 0x7fd9a4106e60 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a2a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a2a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36090/0 (socket says 172.21.15.18:36090) 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.362+0000 7fd9a2a00700 1 -- 172.21.15.18:0/4091328910 learned_addr learned my addr 172.21.15.18:0/4091328910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd9a2a00700 1 -- 172.21.15.18:0/4091328910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a419e580 con 0x7fd9a4106e60 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd9a2a00700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd994011b60 tx=0x7fd994011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd994003b20 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd994003cc0 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a419e810 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd994024840 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.363+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a41a1500 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a4063890 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd994022020 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd99b400700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 0x7fd98803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd994011e00 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd9a2000700 1 -- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 msgr2=0x7fd98803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.365+0000 7fd9a2000700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 0x7fd98803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.370+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd99404cb30 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.566+0000 7fd9a2000700 1 -- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 msgr2=0x7fd98803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.566+0000 7fd9a2000700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 0x7fd98803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.694+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd9a41a16d0 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.695+0000 7fd99b400700 1 -- 172.21.15.18:0/4091328910 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd9a41a16d0 con 0x7fd9a4106e60 2024-04-21T22:22:33.409 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 msgr2=0x7fd98803b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 0x7fd98803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 msgr2=0x7fd9a419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd994011b60 tx=0x7fd994011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 shutdown_connections 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7fd9880390a0 0x7fd98803b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 --2- 172.21.15.18:0/4091328910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9a4106e60 0x7fd9a419e040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 >> 172.21.15.18:0/4091328910 conn(0x7fd9a41024a0 msgr2=0x7fd9a41945e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 shutdown_connections 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:32.698+0000 7fd9a9c00700 1 -- 172.21.15.18:0/4091328910 wait complete. 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-04-21T22:22:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 5... 2024-04-21T22:22:33.961 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:33.692+0000 7fe6039e7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:22:33.961 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:33.938+0000 7fe6039e7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:22:34.212 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:34.159+0000 7fe6039e7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:22:34.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:34.548+0000 7fe6039e7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:22:34.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:34.674+0000 7fe6039e7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:22:35.191 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:34.931+0000 7fe6039e7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:22:35.191 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:35.191+0000 7fe6039e7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:22:36.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:36.000+0000 7fe6039e7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:22:36.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:36.564+0000 7fe6039e7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:22:36.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:36.695+0000 7fe6039e7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:22:37.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:36.964+0000 7fe6039e7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:22:38.090 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:37.627+0000 7fe6039e7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:22:38.091 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:37.754+0000 7fe6039e7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:22:38.091 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:38.090+0000 7fe6039e7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:22:38.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:38.279+0000 7fe6039e7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:22:38.688 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:38.408+0000 7fe6039e7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:22:38.689 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:38.563+0000 7fe6039e7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:22:39.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:38.688+0000 7fe6039e7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:22:40.014 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:39.720+0000 7fe6039e7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:22:40.014 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:22:40.013+0000 7fe6039e7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:22:40.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: Active manager daemon x restarted 2024-04-21T22:22:40.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: Activating manager daemon x 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: osdmap e2: 0 total, 0 up, 0 in 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: mgrmap e6: x(active, starting, since 0.00488004s) 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:22:40.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:40 smithi018 ceph-mon[26614]: Manager daemon x is now available 2024-04-21T22:22:41.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:22:41.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:41 smithi018 ceph-mon[26614]: mgrmap e7: x(active, since 1.01569s) 2024-04-21T22:22:41.784 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:22:41.784 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-21T22:22:41.784 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-21T22:22:41.785 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:22:41.785 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.002+0000 7f7371200700 1 Processor -- start 2024-04-21T22:22:41.785 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.003+0000 7f7371200700 1 -- start start 2024-04-21T22:22:41.785 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.003+0000 7f7371200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:41.786 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.003+0000 7f7371200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f736c07be70 con 0x7f736c108a30 2024-04-21T22:22:41.786 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.004+0000 7f7369e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:41.786 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.004+0000 7f7369e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36098/0 (socket says 172.21.15.18:36098) 2024-04-21T22:22:41.787 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.004+0000 7f7369e00700 1 -- 172.21.15.18:0/1859248979 learned_addr learned my addr 172.21.15.18:0/1859248979 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:41.787 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.004+0000 7f7369e00700 1 -- 172.21.15.18:0/1859248979 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c10b360 con 0x7f736c108a30 2024-04-21T22:22:41.787 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.004+0000 7f7369e00700 1 --2- 172.21.15.18:0/1859248979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098a0 tx=0x7f735c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d209bf7733cea555 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:41.788 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.005+0000 7f7369400700 1 -- 172.21.15.18:0/1859248979 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f735c004160 con 0x7f736c108a30 2024-04-21T22:22:41.788 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.005+0000 7f7369400700 1 -- 172.21.15.18:0/1859248979 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f735c004300 con 0x7f736c108a30 2024-04-21T22:22:41.788 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.005+0000 7f7369400700 1 -- 172.21.15.18:0/1859248979 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f735c011b50 con 0x7f736c108a30 2024-04-21T22:22:41.788 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 -- 172.21.15.18:0/1859248979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 msgr2=0x7f736c10ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 --2- 172.21.15.18:0/1859248979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098a0 tx=0x7f735c009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 -- 172.21.15.18:0/1859248979 shutdown_connections 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 --2- 172.21.15.18:0/1859248979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c10ae20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 -- 172.21.15.18:0/1859248979 >> 172.21.15.18:0/1859248979 conn(0x7f736c1024a0 msgr2=0x7f736c1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 -- 172.21.15.18:0/1859248979 shutdown_connections 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.006+0000 7f7371200700 1 -- 172.21.15.18:0/1859248979 wait complete. 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.007+0000 7f7371200700 1 Processor -- start 2024-04-21T22:22:41.789 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.007+0000 7f7371200700 1 -- start start 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.008+0000 7f7371200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.008+0000 7f7371200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f736c10c2a0 con 0x7f736c108a30 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.008+0000 7f7369e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.008+0000 7f7369e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36108/0 (socket says 172.21.15.18:36108) 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.008+0000 7f7369e00700 1 -- 172.21.15.18:0/1039385817 learned_addr learned my addr 172.21.15.18:0/1039385817 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7369e00700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c19e550 con 0x7f736c108a30 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7369e00700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f735c011b60 tx=0x7f735c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f735c003b20 con 0x7f736c108a30 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f735c003cc0 con 0x7f736c108a30 2024-04-21T22:22:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f735c024840 con 0x7f736c108a30 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c19e7e0 con 0x7f736c108a30 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.009+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a14d0 con 0x7f736c108a30 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f735c022020 con 0x7f736c108a30 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7363400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f735003bc20 con 0x7f7350039050 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f735c011e00 con 0x7f736c108a30 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7361400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.011+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.212+0000 7f7361400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.212+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.613+0000 7f7361400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:34.613+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:35.414+0000 7f7361400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:41.793 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:35.414+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:22:41.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:37.016+0000 7f7361400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/4119930103 2024-04-21T22:22:41.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:37.016+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-21T22:22:41.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:40.022+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f735c0249e0 con 0x7f736c108a30 2024-04-21T22:22:41.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:40.022+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 msgr2=0x7f735003b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:22:41.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:40.022+0000 7f7363400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.028+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f735c04ee10 con 0x7f736c108a30 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.029+0000 7f7363400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 0x7f735003ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.029+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f735c00af30 con 0x7f735003c980 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.030+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 0x7f735003ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.034+0000 7f7361400700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 0x7f735003ed70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7354003a10 tx=0x7f7354009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.035+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f735c00af30 con 0x7f735003c980 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.044+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f736c0693b0 con 0x7f735003c980 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.045+0000 7f7363400700 1 -- 172.21.15.18:0/1039385817 <== mgr.14120 v2:172.21.15.18:6800/3876986128 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f736c0693b0 con 0x7f735003c980 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.045+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 msgr2=0x7f735003ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.045+0000 7f7371200700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 0x7f735003ed70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7354003a10 tx=0x7f7354009290 comp rx=0 tx=0).stop 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.045+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 msgr2=0x7f736c19e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.045+0000 7f7371200700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f735c011b60 tx=0x7f735c011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 shutdown_connections 2024-04-21T22:22:41.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f735003c980 0x7f735003ed70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f736c108a30 0x7f736c19e010 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 --2- 172.21.15.18:0/1039385817 >> [v2:172.21.15.18:6800/4119930103,v1:172.21.15.18:6801/4119930103] conn(0x7f7350039050 0x7f735003b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 >> 172.21.15.18:0/1039385817 conn(0x7f736c1024a0 msgr2=0x7f736c102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 shutdown_connections 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:41.046+0000 7f7371200700 1 -- 172.21.15.18:0/1039385817 wait complete. 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 5 is available 2024-04-21T22:22:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:Setting orchestrator backend to cephadm... 2024-04-21T22:22:42.417 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:42 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:42.417 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:42 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:43.446 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:43 smithi018 ceph-mon[26614]: mgrmap e8: x(active, since 2s) 2024-04-21T22:22:43.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:43 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:22:43.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:43 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:43.447 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:43 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.453+0000 7f8e56000700 1 Processor -- start 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.453+0000 7f8e56000700 1 -- start start 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.454+0000 7f8e56000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.454+0000 7f8e56000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5007be10 con 0x7f8e50106870 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.454+0000 7f8e4f400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:43.455 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.454+0000 7f8e4f400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60668/0 (socket says 172.21.15.18:60668) 2024-04-21T22:22:43.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.454+0000 7f8e4f400700 1 -- 172.21.15.18:0/3245925905 learned_addr learned my addr 172.21.15.18:0/3245925905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:43.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.455+0000 7f8e4f400700 1 -- 172.21.15.18:0/3245925905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e501071d0 con 0x7f8e50106870 2024-04-21T22:22:43.456 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.455+0000 7f8e4f400700 1 --2- 172.21.15.18:0/3245925905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4080cf5d0f59d0a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:43.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.456+0000 7f8e4ea00700 1 -- 172.21.15.18:0/3245925905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e40004160 con 0x7f8e50106870 2024-04-21T22:22:43.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.456+0000 7f8e4ea00700 1 -- 172.21.15.18:0/3245925905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e40004300 con 0x7f8e50106870 2024-04-21T22:22:43.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.456+0000 7f8e4ea00700 1 -- 172.21.15.18:0/3245925905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e40011b50 con 0x7f8e50106870 2024-04-21T22:22:43.457 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.456+0000 7f8e56000700 1 -- 172.21.15.18:0/3245925905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 msgr2=0x7f8e50106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:43.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.456+0000 7f8e56000700 1 --2- 172.21.15.18:0/3245925905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e40009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:43.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.457+0000 7f8e56000700 1 -- 172.21.15.18:0/3245925905 shutdown_connections 2024-04-21T22:22:43.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.457+0000 7f8e56000700 1 --2- 172.21.15.18:0/3245925905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e50106c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:43.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.457+0000 7f8e56000700 1 -- 172.21.15.18:0/3245925905 >> 172.21.15.18:0/3245925905 conn(0x7f8e50102450 msgr2=0x7f8e50104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:43.458 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.457+0000 7f8e56000700 1 -- 172.21.15.18:0/3245925905 shutdown_connections 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.457+0000 7f8e56000700 1 -- 172.21.15.18:0/3245925905 wait complete. 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.458+0000 7f8e56000700 1 Processor -- start 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.458+0000 7f8e56000700 1 -- start start 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e56000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e56000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50108180 con 0x7f8e50106870 2024-04-21T22:22:43.459 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e4f400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:43.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e4f400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60676/0 (socket says 172.21.15.18:60676) 2024-04-21T22:22:43.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e4f400700 1 -- 172.21.15.18:0/4202778553 learned_addr learned my addr 172.21.15.18:0/4202778553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:43.460 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.459+0000 7f8e4f400700 1 -- 172.21.15.18:0/4202778553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5019e560 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e4f400700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e40011670 tx=0x7f8e40011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e400039c0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e40011e50 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5019e7f0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e4001a5c0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.460+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e501a14e0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.462+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8e4001a8c0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.462+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50063890 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.462+0000 7f8e4cc00700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 0x7f8e3403b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.462+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8e4004d5a0 con 0x7f8e50106870 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.462+0000 7f8e47e00700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 0x7f8e3403b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.463+0000 7f8e47e00700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 0x7f8e3403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006fd0 tx=0x7f8e38006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:43.462 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.470+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8e40019c70 con 0x7f8e50106870 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.712+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f8e500008d0 con 0x7f8e34039000 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.720+0000 7f8e4cc00700 1 -- 172.21.15.18:0/4202778553 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8e500008d0 con 0x7f8e34039000 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 msgr2=0x7f8e3403b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 0x7f8e3403b4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e38006fd0 tx=0x7f8e38006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 msgr2=0x7f8e5019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e40011670 tx=0x7f8e40011b60 comp rx=0 tx=0).stop 2024-04-21T22:22:43.463 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 shutdown_connections 2024-04-21T22:22:43.464 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f8e34039000 0x7f8e3403b4c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:43.464 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 --2- 172.21.15.18:0/4202778553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e50106870 0x7f8e5019e020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:43.464 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 >> 172.21.15.18:0/4202778553 conn(0x7f8e50102450 msgr2=0x7f8e50194c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:43.464 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 shutdown_connections 2024-04-21T22:22:43.464 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:42.723+0000 7f8e56000700 1 -- 172.21.15.18:0/4202778553 wait complete. 2024-04-21T22:22:45.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-21T22:22:45.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.088+0000 7f519fa00700 1 Processor -- start 2024-04-21T22:22:45.097 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.088+0000 7f519fa00700 1 -- start start 2024-04-21T22:22:45.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.089+0000 7f519fa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:45.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.089+0000 7f519fa00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f519807c910 con 0x7f519807de90 2024-04-21T22:22:45.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.089+0000 7f519d000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:45.098 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.089+0000 7f519d000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60692/0 (socket says 172.21.15.18:60692) 2024-04-21T22:22:45.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.089+0000 7f519d000700 1 -- 172.21.15.18:0/358634848 learned_addr learned my addr 172.21.15.18:0/358634848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:45.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.090+0000 7f519d000700 1 -- 172.21.15.18:0/358634848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519807ca90 con 0x7f519807de90 2024-04-21T22:22:45.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.090+0000 7f519d000700 1 --2- 172.21.15.18:0/358634848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098a0 tx=0x7f518c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f11fff6b12fc3ec server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:45.099 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.090+0000 7f5197400700 1 -- 172.21.15.18:0/358634848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f518c004160 con 0x7f519807de90 2024-04-21T22:22:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.090+0000 7f5197400700 1 -- 172.21.15.18:0/358634848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f518c004300 con 0x7f519807de90 2024-04-21T22:22:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.090+0000 7f5197400700 1 -- 172.21.15.18:0/358634848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f518c011b50 con 0x7f519807de90 2024-04-21T22:22:45.101 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 -- 172.21.15.18:0/358634848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 msgr2=0x7f519807c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:45.101 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 --2- 172.21.15.18:0/358634848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098a0 tx=0x7f518c009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:45.101 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 -- 172.21.15.18:0/358634848 shutdown_connections 2024-04-21T22:22:45.101 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 --2- 172.21.15.18:0/358634848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519807c340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:45.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 -- 172.21.15.18:0/358634848 >> 172.21.15.18:0/358634848 conn(0x7f5198103600 msgr2=0x7f5198105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:45.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 -- 172.21.15.18:0/358634848 shutdown_connections 2024-04-21T22:22:45.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.091+0000 7f519fa00700 1 -- 172.21.15.18:0/358634848 wait complete. 2024-04-21T22:22:45.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.093+0000 7f519fa00700 1 Processor -- start 2024-04-21T22:22:45.102 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.093+0000 7f519fa00700 1 -- start start 2024-04-21T22:22:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519fa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519fa00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f519810e520 con 0x7f519807de90 2024-04-21T22:22:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519d000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519d000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60706/0 (socket says 172.21.15.18:60706) 2024-04-21T22:22:45.104 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519d000700 1 -- 172.21.15.18:0/2780845857 learned_addr learned my addr 172.21.15.18:0/2780845857 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:45.104 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.094+0000 7f519d000700 1 -- 172.21.15.18:0/2780845857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519819e5b0 con 0x7f519807de90 2024-04-21T22:22:45.104 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f519d000700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f518c011b60 tx=0x7f518c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:45.104 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f518c003970 con 0x7f519807de90 2024-04-21T22:22:45.105 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f518c003b10 con 0x7f519807de90 2024-04-21T22:22:45.105 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519819e840 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f518c024610 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.095+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51981a1530 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.096+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f518c01a9f0 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.096+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51980693b0 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.097+0000 7f5195600700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 0x7f518003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.097+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f518c011e00 con 0x7f519807de90 2024-04-21T22:22:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.097+0000 7f5197e00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 0x7f518003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.098+0000 7f5197e00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 0x7f518003b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5188006fd0 tx=0x7f5188006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.103+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f518c016260 con 0x7f519807de90 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.330+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5198104860 con 0x7f51800390a0 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.331+0000 7f5195600700 1 -- 172.21.15.18:0/2780845857 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5198104860 con 0x7f51800390a0 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 msgr2=0x7f518003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 0x7f518003b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5188006fd0 tx=0x7f5188006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 msgr2=0x7f519819e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f518c011b60 tx=0x7f518c011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 shutdown_connections 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f51800390a0 0x7f518003b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 --2- 172.21.15.18:0/2780845857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519807de90 0x7f519819e070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:45.108 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.334+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 >> 172.21.15.18:0/2780845857 conn(0x7f5198103600 msgr2=0x7f5198104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:45.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.335+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 shutdown_connections 2024-04-21T22:22:45.109 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:44.335+0000 7f519fa00700 1 -- 172.21.15.18:0/2780845857 wait complete. 2024-04-21T22:22:45.109 INFO:teuthology.orchestra.run.smithi018.stdout:Generating ssh key... 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: Generating public/private rsa key pair. 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: Your identification has been saved in /tmp/tmp1e5zd_ma/key. 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: Your public key has been saved in /tmp/tmp1e5zd_ma/key.pub. 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: The key fingerprint is: 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: SHA256:kKH1cwdDpxYbX7OBvJ0flk5lEDRWSiPEYJmGVyKJ3qQ ceph-6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: The key's randomart image is: 2024-04-21T22:22:46.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: +---[RSA 3072]----+ 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | o..+XO=o%+.| 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | o.++o=@+= Bo| 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | ..o+oo= ooooo| 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | E..+ .. o= | 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | S +..| 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | ..| 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | | 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | | 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: | | 2024-04-21T22:22:46.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:22:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: +----[SHA256]-----+ 2024-04-21T22:22:46.914 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.739+0000 7f617b400700 1 Processor -- start 2024-04-21T22:22:46.914 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.739+0000 7f617b400700 1 -- start start 2024-04-21T22:22:46.914 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.740+0000 7f617b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:46.914 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.740+0000 7f617b400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6174111720 con 0x7f617410ed60 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.740+0000 7f6178a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.740+0000 7f6178a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60718/0 (socket says 172.21.15.18:60718) 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.740+0000 7f6178a00700 1 -- 172.21.15.18:0/1802422700 learned_addr learned my addr 172.21.15.18:0/1802422700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.741+0000 7f6178a00700 1 -- 172.21.15.18:0/1802422700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741118a0 con 0x7f617410ed60 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.741+0000 7f6178a00700 1 --2- 172.21.15.18:0/1802422700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61680098a0 tx=0x7f6168009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca780aa374281def server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.741+0000 7f6173400700 1 -- 172.21.15.18:0/1802422700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6168004160 con 0x7f617410ed60 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.741+0000 7f6173400700 1 -- 172.21.15.18:0/1802422700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6168004300 con 0x7f617410ed60 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.741+0000 7f6173400700 1 -- 172.21.15.18:0/1802422700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6168011b50 con 0x7f617410ed60 2024-04-21T22:22:46.918 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 -- 172.21.15.18:0/1802422700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 msgr2=0x7f6174111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 --2- 172.21.15.18:0/1802422700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61680098a0 tx=0x7f6168009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 -- 172.21.15.18:0/1802422700 shutdown_connections 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 --2- 172.21.15.18:0/1802422700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f6174111150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 -- 172.21.15.18:0/1802422700 >> 172.21.15.18:0/1802422700 conn(0x7f617407d630 msgr2=0x7f617407fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 -- 172.21.15.18:0/1802422700 shutdown_connections 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.742+0000 7f617b400700 1 -- 172.21.15.18:0/1802422700 wait complete. 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.743+0000 7f617b400700 1 Processor -- start 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f617b400700 1 -- start start 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f617b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f617b400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6174112840 con 0x7f617410ed60 2024-04-21T22:22:46.919 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f6178a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f6178a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60728/0 (socket says 172.21.15.18:60728) 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f6178a00700 1 -- 172.21.15.18:0/3140584428 learned_addr learned my addr 172.21.15.18:0/3140584428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.744+0000 7f6178a00700 1 -- 172.21.15.18:0/3140584428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741a2970 con 0x7f617410ed60 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f6178a00700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6168011b60 tx=0x7f6168011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6168003b20 con 0x7f617410ed60 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6168003cc0 con 0x7f617410ed60 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61741a2c00 con 0x7f617410ed60 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6168024840 con 0x7f617410ed60 2024-04-21T22:22:46.920 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.745+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61741a58f0 con 0x7f617410ed60 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.747+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6168022020 con 0x7f617410ed60 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.747+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6174063890 con 0x7f617410ed60 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.747+0000 7f6171600700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 0x7f615c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.747+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6168011e00 con 0x7f617410ed60 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.747+0000 7f6173e00700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 0x7f615c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.748+0000 7f6173e00700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 0x7f615c03b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.752+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f616800b3e0 con 0x7f617410ed60 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:45.981+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f617407e8f0 con 0x7f615c0390a0 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.293+0000 7f6171600700 1 -- 172.21.15.18:0/3140584428 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f617407e8f0 con 0x7f615c0390a0 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.296+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 msgr2=0x7f615c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:46.923 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.296+0000 7f617b400700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 0x7f615c03b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.296+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 msgr2=0x7f61741a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.296+0000 7f617b400700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6168011b60 tx=0x7f6168011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 shutdown_connections 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f615c0390a0 0x7f615c03b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 --2- 172.21.15.18:0/3140584428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f617410ed60 0x7f61741a2430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 >> 172.21.15.18:0/3140584428 conn(0x7f617407d630 msgr2=0x7f617407e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 shutdown_connections 2024-04-21T22:22:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:46.297+0000 7f617b400700 1 -- 172.21.15.18:0/3140584428 wait complete. 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: Found migration_current of "None". Setting to last migration. 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: [21/Apr/2024:22:22:42] ENGINE Bus STARTING 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: [21/Apr/2024:22:22:42] ENGINE Serving on https://172.21.15.18:7150 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: [21/Apr/2024:22:22:42] ENGINE Serving on http://172.21.15.18:8765 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: [21/Apr/2024:22:22:42] ENGINE Bus STARTED 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:47.487 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:47.488 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: Generating ssh key... 2024-04-21T22:22:47.488 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:47.488 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:47 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:48.508 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:22:48.513 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.555+0000 7fd8e2200700 1 Processor -- start 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e2200700 1 -- start start 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e2200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e2200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc07c8f0 con 0x7fd8dc07de70 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e0e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e0e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53010/0 (socket says 172.21.15.18:53010) 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.556+0000 7fd8e0e00700 1 -- 172.21.15.18:0/3062069742 learned_addr learned my addr 172.21.15.18:0/3062069742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.557+0000 7fd8e0e00700 1 -- 172.21.15.18:0/3062069742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc07ca70 con 0x7fd8dc07de70 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.557+0000 7fd8e0e00700 1 --2- 172.21.15.18:0/3062069742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098a0 tx=0x7fd8d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f7d92ee1c880e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.557+0000 7fd8db400700 1 -- 172.21.15.18:0/3062069742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d0004160 con 0x7fd8dc07de70 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8db400700 1 -- 172.21.15.18:0/3062069742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8d0004300 con 0x7fd8dc07de70 2024-04-21T22:22:48.514 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8db400700 1 -- 172.21.15.18:0/3062069742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d0011b50 con 0x7fd8dc07de70 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 -- 172.21.15.18:0/3062069742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 msgr2=0x7fd8dc07c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 --2- 172.21.15.18:0/3062069742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00098a0 tx=0x7fd8d0009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 -- 172.21.15.18:0/3062069742 shutdown_connections 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 --2- 172.21.15.18:0/3062069742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc07c320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 -- 172.21.15.18:0/3062069742 >> 172.21.15.18:0/3062069742 conn(0x7fd8dc1033c0 msgr2=0x7fd8dc1057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 -- 172.21.15.18:0/3062069742 shutdown_connections 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.558+0000 7fd8e2200700 1 -- 172.21.15.18:0/3062069742 wait complete. 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.559+0000 7fd8e2200700 1 Processor -- start 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.559+0000 7fd8e2200700 1 -- start start 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e2200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e2200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc10e2a0 con 0x7fd8dc07de70 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e0e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e0e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53012/0 (socket says 172.21.15.18:53012) 2024-04-21T22:22:48.515 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e0e00700 1 -- 172.21.15.18:0/1547812380 learned_addr learned my addr 172.21.15.18:0/1547812380 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.560+0000 7fd8e0e00700 1 -- 172.21.15.18:0/1547812380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc19e400 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8e0e00700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009fb0 tx=0x7fd8d0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d00038b0 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8d0011e50 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d0019420 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc19e690 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.561+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc1a1380 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.562+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc0693b0 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.563+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd8d001a430 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.563+0000 7fd8d9600700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 0x7fd8c403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.563+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd8d004d320 con 0x7fd8dc07de70 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.564+0000 7fd8dbe00700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 0x7fd8c403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.564+0000 7fd8dbe00700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 0x7fd8c403b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc006fd0 tx=0x7fd8cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:48.516 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.568+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd8d0029260 con 0x7fd8dc07de70 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.790+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd8dc104680 con 0x7fd8c4039050 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.791+0000 7fd8d9600700 1 -- 172.21.15.18:0/1547812380 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fd8dc104680 con 0x7fd8c4039050 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 msgr2=0x7fd8c403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 0x7fd8c403b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc006fd0 tx=0x7fd8cc006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 msgr2=0x7fd8dc19dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009fb0 tx=0x7fd8d0011bf0 comp rx=0 tx=0).stop 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 shutdown_connections 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fd8c4039050 0x7fd8c403b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 --2- 172.21.15.18:0/1547812380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8dc07de70 0x7fd8dc19dec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 >> 172.21.15.18:0/1547812380 conn(0x7fd8dc1033c0 msgr2=0x7fd8dc103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 shutdown_connections 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:47.795+0000 7fd8e2200700 1 -- 172.21.15.18:0/1547812380 wait complete. 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-21T22:22:48.517 INFO:teuthology.orchestra.run.smithi018.stdout:Adding key to root@localhost authorized_keys... 2024-04-21T22:22:48.524 INFO:teuthology.orchestra.run.smithi018.stdout:Adding host smithi018... 2024-04-21T22:22:49.092 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:48 smithi018 ceph-mon[26614]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:50.081 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:49 smithi018 ceph-mon[26614]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:51.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:50 smithi018 ceph-mon[26614]: Deploying cephadm binary to smithi018 2024-04-21T22:22:56.672 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Added host 'smithi018' with addr '172.21.15.18' 2024-04-21T22:22:56.672 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.164+0000 7f68dce00700 1 Processor -- start 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.164+0000 7f68dce00700 1 -- start start 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.165+0000 7f68dce00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.165+0000 7f68dce00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68d810a920 con 0x7f68d8109fc0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.165+0000 7f68d7400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.165+0000 7f68d7400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53014/0 (socket says 172.21.15.18:53014) 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.165+0000 7f68d7400700 1 -- 172.21.15.18:0/775104604 learned_addr learned my addr 172.21.15.18:0/775104604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.166+0000 7f68d7400700 1 -- 172.21.15.18:0/775104604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d810aaa0 con 0x7f68d8109fc0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.166+0000 7f68d7400700 1 --2- 172.21.15.18:0/775104604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68c80098a0 tx=0x7f68c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769de70e16e2b5f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.166+0000 7f68d6000700 1 -- 172.21.15.18:0/775104604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c8004160 con 0x7f68d8109fc0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.166+0000 7f68d6000700 1 -- 172.21.15.18:0/775104604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68c8004300 con 0x7f68d8109fc0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.166+0000 7f68d6000700 1 -- 172.21.15.18:0/775104604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c8011b50 con 0x7f68d8109fc0 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 -- 172.21.15.18:0/775104604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 msgr2=0x7f68d810a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:56.673 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 --2- 172.21.15.18:0/775104604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68c80098a0 tx=0x7f68c8009bb0 comp rx=0 tx=0).stop 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 -- 172.21.15.18:0/775104604 shutdown_connections 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 --2- 172.21.15.18:0/775104604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d810a3e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 -- 172.21.15.18:0/775104604 >> 172.21.15.18:0/775104604 conn(0x7f68d807d450 msgr2=0x7f68d807d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 -- 172.21.15.18:0/775104604 shutdown_connections 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.167+0000 7f68dce00700 1 -- 172.21.15.18:0/775104604 wait complete. 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.168+0000 7f68dce00700 1 Processor -- start 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.168+0000 7f68dce00700 1 -- start start 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68dce00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68dce00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68d810bf40 con 0x7f68d8109fc0 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68d7400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68d7400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53020/0 (socket says 172.21.15.18:53020) 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68d7400700 1 -- 172.21.15.18:0/3187339079 learned_addr learned my addr 172.21.15.18:0/3187339079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:56.674 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.169+0000 7f68d7400700 1 -- 172.21.15.18:0/3187339079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d819e400 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68d7400700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f68c8011b60 tx=0x7f68c8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c8003970 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68c8003b10 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c8024610 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d819e690 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.170+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d81a1380 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.171+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f68c80248c0 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.171+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d80693b0 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.172+0000 7f68cfe00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 0x7f68bc03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.172+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f68c8011e00 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.172+0000 7f68d6a00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 0x7f68bc03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.173+0000 7f68d6a00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 0x7f68bc03b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68c4006fd0 tx=0x7f68c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.178+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f68c800b3e0 con 0x7f68d8109fc0 2024-04-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:49.410+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi018", "addr": "172.21.15.18", "target": ["mon-mgr", ""]}) -- 0x7f68d8107c40 con 0x7f68bc0390a0 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.939+0000 7f68cfe00700 1 -- 172.21.15.18:0/3187339079 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f68d8107c40 con 0x7f68bc0390a0 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.944+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 msgr2=0x7f68bc03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.944+0000 7f68dce00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 0x7f68bc03b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68c4006fd0 tx=0x7f68c4006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.944+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 msgr2=0x7f68d819dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.944+0000 7f68dce00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f68c8011b60 tx=0x7f68c8011c40 comp rx=0 tx=0).stop 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 shutdown_connections 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f68bc0390a0 0x7f68bc03b560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 --2- 172.21.15.18:0/3187339079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68d8109fc0 0x7f68d819dec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 >> 172.21.15.18:0/3187339079 conn(0x7f68d807d450 msgr2=0x7f68d8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 shutdown_connections 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:55.945+0000 7f68dce00700 1 -- 172.21.15.18:0/3187339079 wait complete. 2024-04-21T22:22:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mon service... 2024-04-21T22:22:57.236 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:56 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:22:57.237 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:56 smithi018 ceph-mon[26614]: Added host smithi018 2024-04-21T22:22:57.237 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:56 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:22:58.489 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-21T22:22:58.489 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.414+0000 7f829a800700 1 Processor -- start 2024-04-21T22:22:58.489 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.414+0000 7f829a800700 1 -- start start 2024-04-21T22:22:58.489 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.414+0000 7f829a800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:58.489 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.414+0000 7f829a800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f829407c880 con 0x7f829407dd80 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.415+0000 7f8293400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.415+0000 7f8293400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33298/0 (socket says 172.21.15.18:33298) 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.415+0000 7f8293400700 1 -- 172.21.15.18:0/2733866614 learned_addr learned my addr 172.21.15.18:0/2733866614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.415+0000 7f8293400700 1 -- 172.21.15.18:0/2733866614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829407ca00 con 0x7f829407dd80 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.416+0000 7f8293400700 1 --2- 172.21.15.18:0/2733866614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8284009e80 tx=0x7f828400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a34b3cdab7c5c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.416+0000 7f8292000700 1 -- 172.21.15.18:0/2733866614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8284017070 con 0x7f829407dd80 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.416+0000 7f8292000700 1 -- 172.21.15.18:0/2733866614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f828400b8c0 con 0x7f829407dd80 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.416+0000 7f8292000700 1 -- 172.21.15.18:0/2733866614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82840045c0 con 0x7f829407dd80 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 -- 172.21.15.18:0/2733866614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 msgr2=0x7f829407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 --2- 172.21.15.18:0/2733866614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8284009e80 tx=0x7f828400b330 comp rx=0 tx=0).stop 2024-04-21T22:22:58.493 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 -- 172.21.15.18:0/2733866614 shutdown_connections 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 --2- 172.21.15.18:0/2733866614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829407c340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 -- 172.21.15.18:0/2733866614 >> 172.21.15.18:0/2733866614 conn(0x7f8294103630 msgr2=0x7f8294105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 -- 172.21.15.18:0/2733866614 shutdown_connections 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.417+0000 7f829a800700 1 -- 172.21.15.18:0/2733866614 wait complete. 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.418+0000 7f829a800700 1 Processor -- start 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.418+0000 7f829a800700 1 -- start start 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.418+0000 7f829a800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.418+0000 7f829a800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f829410e3a0 con 0x7f829407dd80 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.419+0000 7f8293400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.419+0000 7f8293400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33304/0 (socket says 172.21.15.18:33304) 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.419+0000 7f8293400700 1 -- 172.21.15.18:0/2429319462 learned_addr learned my addr 172.21.15.18:0/2429319462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.419+0000 7f8293400700 1 -- 172.21.15.18:0/2429319462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829419e4e0 con 0x7f829407dd80 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.419+0000 7f8293400700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8284004350 tx=0x7f828400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:58.494 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.420+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8284020020 con 0x7f829407dd80 2024-04-21T22:22:58.495 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.420+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8284003c10 con 0x7f829407dd80 2024-04-21T22:22:58.495 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.420+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8284017040 con 0x7f829407dd80 2024-04-21T22:22:58.495 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.420+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829419e770 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.420+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941a1460 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.421+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8294063890 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.421+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8284023020 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.422+0000 7f828be00700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 0x7f827803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.422+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f828400f050 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.422+0000 7f8292a00700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 0x7f827803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.423+0000 7f8292a00700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 0x7f827803b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.427+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f828402a020 con 0x7f829407dd80 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.688+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8294104830 con 0x7f82780390a0 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.700+0000 7f828be00700 1 -- 172.21.15.18:0/2429319462 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8294104830 con 0x7f82780390a0 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 msgr2=0x7f827803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:58.497 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 0x7f827803b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f827c006fd0 tx=0x7f827c006e40 comp rx=0 tx=0).stop 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 msgr2=0x7f829419dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8284004350 tx=0x7f828400bd50 comp rx=0 tx=0).stop 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 shutdown_connections 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f82780390a0 0x7f827803b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 --2- 172.21.15.18:0/2429319462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f829407dd80 0x7f829419dfa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 >> 172.21.15.18:0/2429319462 conn(0x7f8294103630 msgr2=0x7f8294104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.703+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 shutdown_connections 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:22:57.704+0000 7f829a800700 1 -- 172.21.15.18:0/2429319462 wait complete. 2024-04-21T22:22:58.498 INFO:teuthology.orchestra.run.smithi018.stdout:Deploying unmanaged mgr service... 2024-04-21T22:22:58.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:58 smithi018 ceph-mon[26614]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:22:58.793 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:58 smithi018 ceph-mon[26614]: Saving service mon spec with placement count:5 2024-04-21T22:22:58.794 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:22:58 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:00 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:00 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:01.122 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-21T22:23:01.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.123+0000 7fc052e00700 1 Processor -- start 2024-04-21T22:23:01.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.123+0000 7fc052e00700 1 -- start start 2024-04-21T22:23:01.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.123+0000 7fc052e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:01.124 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.123+0000 7fc052e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c07c820 con 0x7fc04c07de30 2024-04-21T22:23:01.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.124+0000 7fc051a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:01.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.124+0000 7fc051a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33318/0 (socket says 172.21.15.18:33318) 2024-04-21T22:23:01.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.124+0000 7fc051a00700 1 -- 172.21.15.18:0/4270881155 learned_addr learned my addr 172.21.15.18:0/4270881155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:01.125 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.124+0000 7fc051a00700 1 -- 172.21.15.18:0/4270881155 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c07c9a0 con 0x7fc04c07de30 2024-04-21T22:23:01.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.125+0000 7fc051a00700 1 --2- 172.21.15.18:0/4270881155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098a0 tx=0x7fc040009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4084a69a893073 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:01.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.125+0000 7fc04be00700 1 -- 172.21.15.18:0/4270881155 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc040004160 con 0x7fc04c07de30 2024-04-21T22:23:01.126 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.125+0000 7fc04be00700 1 -- 172.21.15.18:0/4270881155 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc040004300 con 0x7fc04c07de30 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.125+0000 7fc04be00700 1 -- 172.21.15.18:0/4270881155 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc040011b20 con 0x7fc04c07de30 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 -- 172.21.15.18:0/4270881155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 msgr2=0x7fc04c07c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 --2- 172.21.15.18:0/4270881155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098a0 tx=0x7fc040009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 -- 172.21.15.18:0/4270881155 shutdown_connections 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 --2- 172.21.15.18:0/4270881155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c07c2e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 -- 172.21.15.18:0/4270881155 >> 172.21.15.18:0/4270881155 conn(0x7fc04c1033c0 msgr2=0x7fc04c1057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 -- 172.21.15.18:0/4270881155 shutdown_connections 2024-04-21T22:23:01.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.126+0000 7fc052e00700 1 -- 172.21.15.18:0/4270881155 wait complete. 2024-04-21T22:23:01.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.127+0000 7fc052e00700 1 Processor -- start 2024-04-21T22:23:01.128 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc052e00700 1 -- start start 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc052e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc052e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c10e3a0 con 0x7fc04c07de30 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc051a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc051a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33322/0 (socket says 172.21.15.18:33322) 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.128+0000 7fc051a00700 1 -- 172.21.15.18:0/4109542135 learned_addr learned my addr 172.21.15.18:0/4109542135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc051a00700 1 -- 172.21.15.18:0/4109542135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c19e3c0 con 0x7fc04c07de30 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc051a00700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0400116a0 tx=0x7fc040011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc040003ac0 con 0x7fc04c07de30 2024-04-21T22:23:01.129 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc040003c60 con 0x7fc04c07de30 2024-04-21T22:23:01.130 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04001a7d0 con 0x7fc04c07de30 2024-04-21T22:23:01.130 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c19e650 con 0x7fc04c07de30 2024-04-21T22:23:01.130 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.129+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c19eab0 con 0x7fc04c07de30 2024-04-21T22:23:01.130 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.131+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc040024430 con 0x7fc04c07de30 2024-04-21T22:23:01.131 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.131+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04c0693b0 con 0x7fc04c07de30 2024-04-21T22:23:01.131 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.131+0000 7fc04a000700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 0x7fc03403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:01.131 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.131+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc04004d620 con 0x7fc04c07de30 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.132+0000 7fc051000700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 0x7fc03403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.132+0000 7fc051000700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 0x7fc03403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc038006fd0 tx=0x7fc038006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.137+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc040011e20 con 0x7fc04c07de30 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.381+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc04c104630 con 0x7fc034039050 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.389+0000 7fc04a000700 1 -- 172.21.15.18:0/4109542135 <== mgr.14120 v2:172.21.15.18:6800/3876986128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc04c104630 con 0x7fc034039050 2024-04-21T22:23:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 msgr2=0x7fc03403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 0x7fc03403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc038006fd0 tx=0x7fc038006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 msgr2=0x7fc04c19de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc0400116a0 tx=0x7fc040011c10 comp rx=0 tx=0).stop 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 shutdown_connections 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7fc034039050 0x7fc03403b510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:01.133 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 --2- 172.21.15.18:0/4109542135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc04c07de30 0x7fc04c19de80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:01.134 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.391+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 >> 172.21.15.18:0/4109542135 conn(0x7fc04c1033c0 msgr2=0x7fc04c103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:01.134 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.392+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 shutdown_connections 2024-04-21T22:23:01.134 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:00.392+0000 7fc052e00700 1 -- 172.21.15.18:0/4109542135 wait complete. 2024-04-21T22:23:02.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:01 smithi018 ceph-mon[26614]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:02.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:01 smithi018 ceph-mon[26614]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:02.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:01 smithi018 ceph-mon[26614]: Saving service mgr spec with placement count:2 2024-04-21T22:23:02.004 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:01 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.745+0000 7ff749a00700 1 Processor -- start 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.745+0000 7ff749a00700 1 -- start start 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.745+0000 7ff749a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.745+0000 7ff749a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff74407beb0 con 0x7ff744108a00 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.746+0000 7ff742a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.746+0000 7ff742a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33328/0 (socket says 172.21.15.18:33328) 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.746+0000 7ff742a00700 1 -- 172.21.15.18:0/2553685386 learned_addr learned my addr 172.21.15.18:0/2553685386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.746+0000 7ff742a00700 1 -- 172.21.15.18:0/2553685386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74410b330 con 0x7ff744108a00 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.747+0000 7ff742a00700 1 --2- 172.21.15.18:0/2553685386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098a0 tx=0x7ff734009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19f4145f672c5af server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.747+0000 7ff741600700 1 -- 172.21.15.18:0/2553685386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734004160 con 0x7ff744108a00 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.747+0000 7ff741600700 1 -- 172.21.15.18:0/2553685386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff734004300 con 0x7ff744108a00 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.747+0000 7ff741600700 1 -- 172.21.15.18:0/2553685386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734011b20 con 0x7ff744108a00 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 -- 172.21.15.18:0/2553685386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 msgr2=0x7ff74410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 --2- 172.21.15.18:0/2553685386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7340098a0 tx=0x7ff734009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 -- 172.21.15.18:0/2553685386 shutdown_connections 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 --2- 172.21.15.18:0/2553685386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74410adf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 -- 172.21.15.18:0/2553685386 >> 172.21.15.18:0/2553685386 conn(0x7ff744102450 msgr2=0x7ff744104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 -- 172.21.15.18:0/2553685386 shutdown_connections 2024-04-21T22:23:02.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.748+0000 7ff749a00700 1 -- 172.21.15.18:0/2553685386 wait complete. 2024-04-21T22:23:02.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.749+0000 7ff749a00700 1 Processor -- start 2024-04-21T22:23:02.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.749+0000 7ff749a00700 1 -- start start 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff749a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff749a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff74410c3a0 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff742a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff742a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33334/0 (socket says 172.21.15.18:33334) 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff742a00700 1 -- 172.21.15.18:0/1206068156 learned_addr learned my addr 172.21.15.18:0/1206068156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.750+0000 7ff742a00700 1 -- 172.21.15.18:0/1206068156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74419e510 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff742a00700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7340117e0 tx=0x7ff734011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734003ba0 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff73401a910 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7340248f0 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74419e7a0 con 0x7ff744108a00 2024-04-21T22:23:02.982 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.751+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74419ec00 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.752+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff734022020 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.753+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff744063890 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.753+0000 7ff73b400700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 0x7ff72803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.753+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff73404d580 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.754+0000 7ff742000700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 0x7ff72803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.755+0000 7ff742000700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 0x7ff72803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff730006fd0 tx=0x7ff730006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:01.762+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff73400f2e0 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.003+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7ff7441a1550 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.009+0000 7ff73b400700 1 -- 172.21.15.18:0/1206068156 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7ff73402d3f0 con 0x7ff744108a00 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 msgr2=0x7ff72803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 0x7ff72803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff730006fd0 tx=0x7ff730006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 msgr2=0x7ff74419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7340117e0 tx=0x7ff734011ba0 comp rx=0 tx=0).stop 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 shutdown_connections 2024-04-21T22:23:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff7280390a0 0x7ff72803b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:02.984 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 --2- 172.21.15.18:0/1206068156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff744108a00 0x7ff74419dfd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:02.984 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 >> 172.21.15.18:0/1206068156 conn(0x7ff744102450 msgr2=0x7ff744102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:02.984 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 shutdown_connections 2024-04-21T22:23:02.984 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:02.012+0000 7ff749a00700 1 -- 172.21.15.18:0/1206068156 wait complete. 2024-04-21T22:23:03.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:03 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1206068156' entity='client.admin' 2024-04-21T22:23:03.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:03 smithi018 ceph-mon[26614]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:04.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.870+0000 7f23d9a00700 1 Processor -- start 2024-04-21T22:23:04.796 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.870+0000 7f23d9a00700 1 -- start start 2024-04-21T22:23:04.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.870+0000 7f23d9a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:04.797 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.870+0000 7f23d9a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23d407beb0 con 0x7f23d4106640 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.871+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.871+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33350/0 (socket says 172.21.15.18:33350) 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.871+0000 7f23d3e00700 1 -- 172.21.15.18:0/3334065041 learned_addr learned my addr 172.21.15.18:0/3334065041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.871+0000 7f23d3e00700 1 -- 172.21.15.18:0/3334065041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d4106fa0 con 0x7f23d4106640 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.872+0000 7f23d3e00700 1 --2- 172.21.15.18:0/3334065041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098a0 tx=0x7f23c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895dfa8acc62aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.872+0000 7f23d2a00700 1 -- 172.21.15.18:0/3334065041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c4004160 con 0x7f23d4106640 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.872+0000 7f23d2a00700 1 -- 172.21.15.18:0/3334065041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c4004300 con 0x7f23d4106640 2024-04-21T22:23:04.798 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.872+0000 7f23d2a00700 1 -- 172.21.15.18:0/3334065041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c4011b20 con 0x7f23d4106640 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 -- 172.21.15.18:0/3334065041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 msgr2=0x7f23d4106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 --2- 172.21.15.18:0/3334065041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098a0 tx=0x7f23c4009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 -- 172.21.15.18:0/3334065041 shutdown_connections 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 --2- 172.21.15.18:0/3334065041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d4106a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 -- 172.21.15.18:0/3334065041 >> 172.21.15.18:0/3334065041 conn(0x7f23d4102280 msgr2=0x7f23d41046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 -- 172.21.15.18:0/3334065041 shutdown_connections 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.873+0000 7f23d9a00700 1 -- 172.21.15.18:0/3334065041 wait complete. 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.875+0000 7f23d9a00700 1 Processor -- start 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.875+0000 7f23d9a00700 1 -- start start 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.875+0000 7f23d9a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.875+0000 7f23d9a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4108070 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.876+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.876+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33360/0 (socket says 172.21.15.18:33360) 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.876+0000 7f23d3e00700 1 -- 172.21.15.18:0/828115008 learned_addr learned my addr 172.21.15.18:0/828115008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.876+0000 7f23d3e00700 1 -- 172.21.15.18:0/828115008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d419e3d0 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.876+0000 7f23d3e00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23c4011b60 tx=0x7f23c4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.877+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c4003b60 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.877+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c401a910 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.877+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d419e660 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.877+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c4024930 con 0x7f23d4106640 2024-04-21T22:23:04.802 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.877+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d419eac0 con 0x7f23d4106640 2024-04-21T22:23:04.803 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.878+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d40693b0 con 0x7f23d4106640 2024-04-21T22:23:04.803 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.878+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f23c4022020 con 0x7f23d4106640 2024-04-21T22:23:04.803 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.879+0000 7f23d0c00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 0x7f23b803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.879+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f23c404d300 con 0x7f23d4106640 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.879+0000 7f23d3400700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 0x7f23b803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.880+0000 7f23d3400700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 0x7f23b803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23c0006fd0 tx=0x7f23c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:03.892+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f23c400b3e0 con 0x7f23d4106640 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.120+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f23d4075480 con 0x7f23d4106640 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.126+0000 7f23d0c00700 1 -- 172.21.15.18:0/828115008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f23c4021d80 con 0x7f23d4106640 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 msgr2=0x7f23b803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 0x7f23b803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23c0006fd0 tx=0x7f23c0006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 msgr2=0x7f23d419de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23c4011b60 tx=0x7f23c4011c40 comp rx=0 tx=0).stop 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 shutdown_connections 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f23b8039050 0x7f23b803b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:04.804 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 --2- 172.21.15.18:0/828115008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23d4106640 0x7f23d419de90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:04.805 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.129+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 >> 172.21.15.18:0/828115008 conn(0x7f23d4102280 msgr2=0x7f23d4194b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:04.805 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.130+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 shutdown_connections 2024-04-21T22:23:04.805 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:04.130+0000 7f23d9a00700 1 -- 172.21.15.18:0/828115008 wait complete. 2024-04-21T22:23:04.805 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling the dashboard module... 2024-04-21T22:23:04.951 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:04 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:04.951 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/828115008' entity='client.admin' 2024-04-21T22:23:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:05 smithi018 ceph-mon[26614]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:06.969 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3714760195' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-21T22:23:06.970 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:06 smithi018 ceph-mon[26614]: from='mgr.14120 172.21.15.18:0/1017716961' entity='mgr.x' 2024-04-21T22:23:06.970 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setuser ceph since I am not root 2024-04-21T22:23:06.970 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setgroup ceph since I am not root 2024-04-21T22:23:06.970 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:06.968+0000 7f15b5b88200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:23:07.220 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:07.219+0000 7f15b5b88200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:23:07.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:07.359+0000 7f15b5b88200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:23:07.773 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.476+0000 7ff5fb400700 1 Processor -- start 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.476+0000 7ff5fb400700 1 -- start start 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.477+0000 7ff5fb400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.477+0000 7ff5fb400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f407e140 con 0x7ff5f407dd20 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.477+0000 7ff5f8a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.477+0000 7ff5f8a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33374/0 (socket says 172.21.15.18:33374) 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.477+0000 7ff5f8a00700 1 -- 172.21.15.18:0/1405325999 learned_addr learned my addr 172.21.15.18:0/1405325999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.478+0000 7ff5f8a00700 1 -- 172.21.15.18:0/1405325999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f407c820 con 0x7ff5f407dd20 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.478+0000 7ff5f8a00700 1 --2- 172.21.15.18:0/1405325999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80098a0 tx=0x7ff5e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feae5ad4d6e7ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.479+0000 7ff5f3400700 1 -- 172.21.15.18:0/1405325999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8004160 con 0x7ff5f407dd20 2024-04-21T22:23:07.775 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.479+0000 7ff5f3400700 1 -- 172.21.15.18:0/1405325999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5e8004300 con 0x7ff5f407dd20 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.479+0000 7ff5f3400700 1 -- 172.21.15.18:0/1405325999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8011b20 con 0x7ff5f407dd20 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 -- 172.21.15.18:0/1405325999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 msgr2=0x7ff5f407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 --2- 172.21.15.18:0/1405325999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80098a0 tx=0x7ff5e8009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 -- 172.21.15.18:0/1405325999 shutdown_connections 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 --2- 172.21.15.18:0/1405325999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f407c2e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 -- 172.21.15.18:0/1405325999 >> 172.21.15.18:0/1405325999 conn(0x7ff5f4103630 msgr2=0x7ff5f4105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 -- 172.21.15.18:0/1405325999 shutdown_connections 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.480+0000 7ff5fb400700 1 -- 172.21.15.18:0/1405325999 wait complete. 2024-04-21T22:23:07.780 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.481+0000 7ff5fb400700 1 Processor -- start 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.481+0000 7ff5fb400700 1 -- start start 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5fb400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5fb400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f410e4c0 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5f8a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5f8a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33380/0 (socket says 172.21.15.18:33380) 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5f8a00700 1 -- 172.21.15.18:0/3714760195 learned_addr learned my addr 172.21.15.18:0/3714760195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.482+0000 7ff5f8a00700 1 -- 172.21.15.18:0/3714760195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f419e4d0 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5f8a00700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80117e0 tx=0x7ff5e8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8003ba0 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5e801a910 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f419e760 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e80248f0 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.483+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f419ebc0 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.485+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff5e8022020 con 0x7ff5f407dd20 2024-04-21T22:23:07.781 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.484+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f4063890 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.485+0000 7ff5f1600700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 0x7ff5dc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.485+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff5e804d930 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.485+0000 7ff5f3e00700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 0x7ff5dc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.486+0000 7ff5f3e00700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 0x7ff5dc03b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0006fd0 tx=0x7ff5e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.495+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff5e800f2e0 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:05.790+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff5f41a1590 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.646+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff5e804d2c0 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.649+0000 7ff5f1600700 1 -- 172.21.15.18:0/3714760195 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff5e804fd10 con 0x7ff5f407dd20 2024-04-21T22:23:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.650+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 msgr2=0x7ff5dc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 0x7ff5dc03b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0006fd0 tx=0x7ff5e0006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 msgr2=0x7ff5f419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80117e0 tx=0x7ff5e8011ba0 comp rx=0 tx=0).stop 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 shutdown_connections 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7ff5dc039050 0x7ff5dc03b510 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 --2- 172.21.15.18:0/3714760195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5f407dd20 0x7ff5f419df90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 >> 172.21.15.18:0/3714760195 conn(0x7ff5f4103630 msgr2=0x7ff5f4104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 shutdown_connections 2024-04-21T22:23:07.783 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:06.651+0000 7ff5fb400700 1 -- 172.21.15.18:0/3714760195 wait complete. 2024-04-21T22:23:07.937 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:07.772+0000 7f15b5b88200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:23:07.938 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:07.892+0000 7f15b5b88200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:23:07.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3714760195' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-21T22:23:07.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:07 smithi018 ceph-mon[26614]: mgrmap e9: x(active, since 26s) 2024-04-21T22:23:09.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/318171827' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-21T22:23:09.786 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:09.549+0000 7f15b5b88200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:23:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:23:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-21T22:23:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-21T22:23:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-21T22:23:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.801+0000 7f0485800700 1 Processor -- start 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.801+0000 7f0485800700 1 -- start start 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.801+0000 7f0485800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.801+0000 7f0485800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f048007e170 con 0x7f048007dd50 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.802+0000 7f047ea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.802+0000 7f047ea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53748/0 (socket says 172.21.15.18:53748) 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.802+0000 7f047ea00700 1 -- 172.21.15.18:0/2853537023 learned_addr learned my addr 172.21.15.18:0/2853537023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.802+0000 7f047ea00700 1 -- 172.21.15.18:0/2853537023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048007c800 con 0x7f048007dd50 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.802+0000 7f047ea00700 1 --2- 172.21.15.18:0/2853537023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04700098a0 tx=0x7f0470009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e79a3406dde145 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.803+0000 7f047d600700 1 -- 172.21.15.18:0/2853537023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470004160 con 0x7f048007dd50 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.803+0000 7f047d600700 1 -- 172.21.15.18:0/2853537023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0470004300 con 0x7f048007dd50 2024-04-21T22:23:09.878 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.803+0000 7f047d600700 1 -- 172.21.15.18:0/2853537023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470011b20 con 0x7f048007dd50 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.803+0000 7f0485800700 1 -- 172.21.15.18:0/2853537023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 msgr2=0x7f048007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.803+0000 7f0485800700 1 --2- 172.21.15.18:0/2853537023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04700098a0 tx=0x7f0470009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.804+0000 7f0485800700 1 -- 172.21.15.18:0/2853537023 shutdown_connections 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.804+0000 7f0485800700 1 --2- 172.21.15.18:0/2853537023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048007c2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.804+0000 7f0485800700 1 -- 172.21.15.18:0/2853537023 >> 172.21.15.18:0/2853537023 conn(0x7f04801036a0 msgr2=0x7f0480105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.804+0000 7f0485800700 1 -- 172.21.15.18:0/2853537023 shutdown_connections 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.804+0000 7f0485800700 1 -- 172.21.15.18:0/2853537023 wait complete. 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.805+0000 7f0485800700 1 Processor -- start 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.805+0000 7f0485800700 1 -- start start 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.805+0000 7f0485800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.805+0000 7f0485800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f048010e4f0 con 0x7f048007dd50 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.805+0000 7f047ea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:09.879 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f047ea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53760/0 (socket says 172.21.15.18:53760) 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f047ea00700 1 -- 172.21.15.18:0/318171827 learned_addr learned my addr 172.21.15.18:0/318171827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f047ea00700 1 -- 172.21.15.18:0/318171827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048019e5a0 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f047ea00700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0470011ad0 tx=0x7f0470011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470003a40 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0470003be0 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470024740 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.806+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048019e830 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.807+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048019ec90 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.808+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0480063890 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.809+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f047001ab30 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.809+0000 7f0477400700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 0x7f046403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.809+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f047004d500 con 0x7f048007dd50 2024-04-21T22:23:09.880 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.809+0000 7f047e000700 1 -- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 msgr2=0x7f046403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.809+0000 7f047e000700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 0x7f046403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:08.814+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f047004bfb0 con 0x7f048007dd50 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.010+0000 7f047e000700 1 -- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 msgr2=0x7f046403b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.010+0000 7f047e000700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 0x7f046403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.122+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f04801a1700 con 0x7f048007dd50 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.123+0000 7f0477400700 1 -- 172.21.15.18:0/318171827 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f047004c6b0 con 0x7f048007dd50 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 msgr2=0x7f046403b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 0x7f046403b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 msgr2=0x7f048019e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0470011ad0 tx=0x7f0470011bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 shutdown_connections 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f0464039100 0x7f046403b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 --2- 172.21.15.18:0/318171827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048007dd50 0x7f048019e060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:09.881 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 >> 172.21.15.18:0/318171827 conn(0x7f04801036a0 msgr2=0x7f0480104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:09.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.127+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 shutdown_connections 2024-04-21T22:23:09.882 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:09.128+0000 7f0485800700 1 -- 172.21.15.18:0/318171827 wait complete. 2024-04-21T22:23:09.882 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for the mgr to restart... 2024-04-21T22:23:09.882 INFO:teuthology.orchestra.run.smithi018.stdout:Waiting for mgr epoch 9... 2024-04-21T22:23:10.040 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:09.785+0000 7f15b5b88200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:23:10.040 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:10.008+0000 7f15b5b88200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:23:10.793 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:10.407+0000 7f15b5b88200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:23:10.794 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:10.534+0000 7f15b5b88200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:23:11.056 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:10.792+0000 7f15b5b88200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:23:11.056 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:11.054+0000 7f15b5b88200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:23:12.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:11.867+0000 7f15b5b88200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:23:12.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:12.439+0000 7f15b5b88200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:23:12.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:12.573+0000 7f15b5b88200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:23:13.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:12.849+0000 7f15b5b88200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:23:13.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:13.524+0000 7f15b5b88200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:23:13.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:13.653+0000 7f15b5b88200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:23:14.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:13.988+0000 7f15b5b88200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:23:14.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:14.176+0000 7f15b5b88200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:23:14.310 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:14.309+0000 7f15b5b88200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:23:14.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:14.466+0000 7f15b5b88200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:23:15.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:14.595+0000 7f15b5b88200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:23:15.931 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:15.632+0000 7f15b5b88200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:23:15.931 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:23:15.929+0000 7f15b5b88200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:23:16.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: Active manager daemon x restarted 2024-04-21T22:23:16.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: Activating manager daemon x 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: osdmap e3: 0 total, 0 up, 0 in 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: mgrmap e10: x(active, starting, since 0.00470545s) 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:23:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:15 smithi018 ceph-mon[26614]: Manager daemon x is now available 2024-04-21T22:23:17.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: [21/Apr/2024:22:23:16] ENGINE Bus STARTING 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: [21/Apr/2024:22:23:16] ENGINE Serving on https://172.21.15.18:7150 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: [21/Apr/2024:22:23:16] ENGINE Serving on http://172.21.15.18:8765 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: [21/Apr/2024:22:23:16] ENGINE Bus STARTED 2024-04-21T22:23:17.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:16 smithi018 ceph-mon[26614]: mgrmap e11: x(active, since 1.01034s) 2024-04-21T22:23:17.701 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout { 2024-04-21T22:23:17.701 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-21T22:23:17.701 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout } 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.432+0000 7f84f3200700 1 Processor -- start 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.432+0000 7f84f3200700 1 -- start start 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.433+0000 7f84f3200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.433+0000 7f84f3200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec10abe0 con 0x7f84ec10a1f0 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.433+0000 7f84ebe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:17.702 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.433+0000 7f84ebe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53766/0 (socket says 172.21.15.18:53766) 2024-04-21T22:23:17.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.433+0000 7f84ebe00700 1 -- 172.21.15.18:0/288638298 learned_addr learned my addr 172.21.15.18:0/288638298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:17.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.434+0000 7f84ebe00700 1 -- 172.21.15.18:0/288638298 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec10b350 con 0x7f84ec10a1f0 2024-04-21T22:23:17.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.434+0000 7f84ebe00700 1 --2- 172.21.15.18:0/288638298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098a0 tx=0x7f84dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e52ef86348c77bb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:17.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.434+0000 7f84eaa00700 1 -- 172.21.15.18:0/288638298 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc004160 con 0x7f84ec10a1f0 2024-04-21T22:23:17.703 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.434+0000 7f84eaa00700 1 -- 172.21.15.18:0/288638298 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84dc004300 con 0x7f84ec10a1f0 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.434+0000 7f84eaa00700 1 -- 172.21.15.18:0/288638298 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc011b20 con 0x7f84ec10a1f0 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 -- 172.21.15.18:0/288638298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 msgr2=0x7f84ec10a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 --2- 172.21.15.18:0/288638298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098a0 tx=0x7f84dc009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 -- 172.21.15.18:0/288638298 shutdown_connections 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 --2- 172.21.15.18:0/288638298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec10a610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.704 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 -- 172.21.15.18:0/288638298 >> 172.21.15.18:0/288638298 conn(0x7f84ec07d660 msgr2=0x7f84ec07da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 -- 172.21.15.18:0/288638298 shutdown_connections 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.435+0000 7f84f3200700 1 -- 172.21.15.18:0/288638298 wait complete. 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.436+0000 7f84f3200700 1 Processor -- start 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.436+0000 7f84f3200700 1 -- start start 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84f3200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84f3200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec10e700 con 0x7f84ec10a1f0 2024-04-21T22:23:17.705 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84ebe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84ebe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53772/0 (socket says 172.21.15.18:53772) 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84ebe00700 1 -- 172.21.15.18:0/864385139 learned_addr learned my addr 172.21.15.18:0/864385139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84ebe00700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec19e4d0 con 0x7f84ec10a1f0 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.437+0000 7f84ebe00700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0117e0 tx=0x7f84dc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.438+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc003bf0 con 0x7f84ec10a1f0 2024-04-21T22:23:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.438+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ec19e760 con 0x7f84ec10a1f0 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.438+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84dc01a910 con 0x7f84ec10a1f0 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.438+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84dc024970 con 0x7f84ec10a1f0 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.438+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ec19ebc0 con 0x7f84ec10a1f0 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.439+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f84dc022020 con 0x7f84ec10a1f0 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.439+0000 7f84e8c00700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.439+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84ec10e880 con 0x7f84d00390a0 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.440+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f84dc04d930 con 0x7f84ec10a1f0 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.440+0000 7f84eb400700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.440+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.641+0000 7f84eb400700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:10.641+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:11.042+0000 7f84eb400700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:11.042+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:11.843+0000 7f84eb400700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:11.843+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:13.445+0000 7f84eb400700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/3876986128 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:13.445+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:15.938+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f84dc02dc90 con 0x7f84ec10a1f0 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:15.938+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 msgr2=0x7f84d003b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:23:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:15.938+0000 7f84e8c00700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.940+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f84dc04f990 con 0x7f84ec10a1f0 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.940+0000 7f84e8c00700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 0x7f84d003ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.940+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f84dc02ae50 con 0x7f84d003c970 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.941+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 0x7f84d003ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.944+0000 7f84eb400700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 0x7f84d003ed60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d8003a10 tx=0x7f84d80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.946+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f84dc02ae50 con 0x7f84d003c970 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.953+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f84ec0693b0 con 0x7f84d003c970 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.954+0000 7f84e8c00700 1 -- 172.21.15.18:0/864385139 <== mgr.14152 v2:172.21.15.18:6800/1190552149 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f84ec0693b0 con 0x7f84d003c970 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 msgr2=0x7f84d003ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 0x7f84d003ed60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d8003a10 tx=0x7f84d80092b0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 msgr2=0x7f84ec19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0117e0 tx=0x7f84dc011ba0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 shutdown_connections 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f84d003c970 0x7f84d003ed60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84ec10a1f0 0x7f84ec19df90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 --2- 172.21.15.18:0/864385139 >> [v2:172.21.15.18:6800/3876986128,v1:172.21.15.18:6801/3876986128] conn(0x7f84d00390a0 0x7f84d003b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 >> 172.21.15.18:0/864385139 conn(0x7f84ec07d660 msgr2=0x7f84ec1073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 shutdown_connections 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:16.955+0000 7f84f3200700 1 -- 172.21.15.18:0/864385139 wait complete. 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:mgr epoch 9 is available 2024-04-21T22:23:17.710 INFO:teuthology.orchestra.run.smithi018.stdout:Generating a dashboard self-signed certificate... 2024-04-21T22:23:18.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:17 smithi018 ceph-mon[26614]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-21T22:23:18.105 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:17 smithi018 ceph-mon[26614]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-21T22:23:19.299 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:18 smithi018 ceph-mon[26614]: mgrmap e12: x(active, since 2s) 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.045+0000 7f5151a00700 1 Processor -- start 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.046+0000 7f5151a00700 1 -- start start 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.046+0000 7f5151a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.046+0000 7f5151a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1076d0 con 0x7f514c106ce0 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.047+0000 7f514be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.047+0000 7f514be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43720/0 (socket says 172.21.15.18:43720) 2024-04-21T22:23:20.049 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.047+0000 7f514be00700 1 -- 172.21.15.18:0/2740496084 learned_addr learned my addr 172.21.15.18:0/2740496084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:20.050 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.047+0000 7f514be00700 1 -- 172.21.15.18:0/2740496084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c107ee0 con 0x7f514c106ce0 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.048+0000 7f514be00700 1 --2- 172.21.15.18:0/2740496084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f513c0098a0 tx=0x7f513c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed436d4f1670cb58 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.048+0000 7f514aa00700 1 -- 172.21.15.18:0/2740496084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f513c004160 con 0x7f514c106ce0 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.048+0000 7f514aa00700 1 -- 172.21.15.18:0/2740496084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c004300 con 0x7f514c106ce0 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.048+0000 7f514aa00700 1 -- 172.21.15.18:0/2740496084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f513c011b20 con 0x7f514c106ce0 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 -- 172.21.15.18:0/2740496084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 msgr2=0x7f514c107100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 --2- 172.21.15.18:0/2740496084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f513c0098a0 tx=0x7f513c009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 -- 172.21.15.18:0/2740496084 shutdown_connections 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 --2- 172.21.15.18:0/2740496084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c107100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 -- 172.21.15.18:0/2740496084 >> 172.21.15.18:0/2740496084 conn(0x7f514c102280 msgr2=0x7f514c1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 -- 172.21.15.18:0/2740496084 shutdown_connections 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.049+0000 7f5151a00700 1 -- 172.21.15.18:0/2740496084 wait complete. 2024-04-21T22:23:20.055 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.050+0000 7f5151a00700 1 Processor -- start 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.050+0000 7f5151a00700 1 -- start start 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.051+0000 7f5151a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.051+0000 7f5151a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f514c10b290 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.051+0000 7f514be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.051+0000 7f514be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43722/0 (socket says 172.21.15.18:43722) 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.051+0000 7f514be00700 1 -- 172.21.15.18:0/2605731534 learned_addr learned my addr 172.21.15.18:0/2605731534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f514be00700 1 -- 172.21.15.18:0/2605731534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c19e430 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f514be00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f513c000c00 tx=0x7f513c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f513c003b60 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c01a910 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c19e6c0 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f513c024930 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.052+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c19eb20 con 0x7f514c106ce0 2024-04-21T22:23:20.056 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.054+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514c0693b0 con 0x7f514c106ce0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.054+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f513c022020 con 0x7f514c106ce0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.054+0000 7f5148c00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 0x7f513003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.054+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f513c04d450 con 0x7f514c106ce0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.055+0000 7f514b400700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 0x7f513003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.056+0000 7f514b400700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 0x7f513003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5138006fd0 tx=0x7f5138006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.061+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f513c01ab70 con 0x7f514c106ce0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.298+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f514c02df10 con 0x7f51300390a0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.374+0000 7f5148c00700 1 -- 172.21.15.18:0/2605731534 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f514c02df10 con 0x7f51300390a0 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 msgr2=0x7f513003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 0x7f513003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5138006fd0 tx=0x7f5138006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 msgr2=0x7f514c19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f513c000c00 tx=0x7f513c011c10 comp rx=0 tx=0).stop 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 shutdown_connections 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51300390a0 0x7f513003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:20.057 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 --2- 172.21.15.18:0/2605731534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f514c106ce0 0x7f514c19def0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:20.058 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.377+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 >> 172.21.15.18:0/2605731534 conn(0x7f514c102280 msgr2=0x7f514c103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:20.058 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.378+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 shutdown_connections 2024-04-21T22:23:20.058 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:19.378+0000 7f5151a00700 1 -- 172.21.15.18:0/2605731534 wait complete. 2024-04-21T22:23:20.058 INFO:teuthology.orchestra.run.smithi018.stdout:Creating initial admin user... 2024-04-21T22:23:20.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:20 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:20.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:20 smithi018 ceph-mon[26614]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:20.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:20 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:20.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:20 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:21.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$YtxXWUifZZg21ykFRSRTTOsUrCU6BkdKo9TAZXE.KL1JCdkEGwOvC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713738201, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-21T22:23:21.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.703+0000 7f93ea000700 1 Processor -- start 2024-04-21T22:23:21.964 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.703+0000 7f93ea000700 1 -- start start 2024-04-21T22:23:21.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.703+0000 7f93ea000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:21.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.703+0000 7f93ea000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93e407beb0 con 0x7f93e41089d0 2024-04-21T22:23:21.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.704+0000 7f93e3400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:21.965 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.704+0000 7f93e3400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43732/0 (socket says 172.21.15.18:43732) 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.704+0000 7f93e3400700 1 -- 172.21.15.18:0/2766633704 learned_addr learned my addr 172.21.15.18:0/2766633704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.704+0000 7f93e3400700 1 -- 172.21.15.18:0/2766633704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e410b300 con 0x7f93e41089d0 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.705+0000 7f93e3400700 1 --2- 172.21.15.18:0/2766633704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93d40098a0 tx=0x7f93d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6597f95422bce13 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.705+0000 7f93e2a00700 1 -- 172.21.15.18:0/2766633704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d4004160 con 0x7f93e41089d0 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.705+0000 7f93e2a00700 1 -- 172.21.15.18:0/2766633704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d4004300 con 0x7f93e41089d0 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.705+0000 7f93e2a00700 1 -- 172.21.15.18:0/2766633704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d4011b20 con 0x7f93e41089d0 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 -- 172.21.15.18:0/2766633704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 msgr2=0x7f93e410adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 --2- 172.21.15.18:0/2766633704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93d40098a0 tx=0x7f93d4009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 -- 172.21.15.18:0/2766633704 shutdown_connections 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 --2- 172.21.15.18:0/2766633704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e410adc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 -- 172.21.15.18:0/2766633704 >> 172.21.15.18:0/2766633704 conn(0x7f93e41024a0 msgr2=0x7f93e41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:21.967 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 -- 172.21.15.18:0/2766633704 shutdown_connections 2024-04-21T22:23:21.968 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.706+0000 7f93ea000700 1 -- 172.21.15.18:0/2766633704 wait complete. 2024-04-21T22:23:21.968 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.708+0000 7f93ea000700 1 Processor -- start 2024-04-21T22:23:21.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.708+0000 7f93ea000700 1 -- start start 2024-04-21T22:23:21.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.708+0000 7f93ea000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:21.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.708+0000 7f93ea000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410c370 con 0x7f93e41089d0 2024-04-21T22:23:21.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.709+0000 7f93e3400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.709+0000 7f93e3400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43736/0 (socket says 172.21.15.18:43736) 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.709+0000 7f93e3400700 1 -- 172.21.15.18:0/465731304 learned_addr learned my addr 172.21.15.18:0/465731304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.709+0000 7f93e3400700 1 -- 172.21.15.18:0/465731304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4108790 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93e3400700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93d40117e0 tx=0x7f93d4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d4003ba0 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d401a910 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d40248f0 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e4106980 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.710+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e4106e40 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.711+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f93d4022020 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.711+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4063890 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.712+0000 7f93e0c00700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 0x7f93c803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.712+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f93d404da00 con 0x7f93e41089d0 2024-04-21T22:23:21.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.712+0000 7f93dbe00700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 0x7f93c803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.713+0000 7f93dbe00700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 0x7f93c803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93cc006fd0 tx=0x7f93cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.717+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f93d400f2e0 con 0x7f93e41089d0 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:20.970+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f93e41075b0 con 0x7f93c80390a0 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.232+0000 7f93e0c00700 1 -- 172.21.15.18:0/465731304 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f93e41075b0 con 0x7f93c80390a0 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 msgr2=0x7f93c803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 0x7f93c803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93cc006fd0 tx=0x7f93cc006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 msgr2=0x7f93e4108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93d40117e0 tx=0x7f93d4011ba0 comp rx=0 tx=0).stop 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 shutdown_connections 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f93c80390a0 0x7f93c803b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 --2- 172.21.15.18:0/465731304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e41089d0 0x7f93e4108250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 >> 172.21.15.18:0/465731304 conn(0x7f93e41024a0 msgr2=0x7f93e4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:21.973 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.235+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 shutdown_connections 2024-04-21T22:23:21.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:21.236+0000 7f93ea000700 1 -- 172.21.15.18:0/465731304 wait complete. 2024-04-21T22:23:21.974 INFO:teuthology.orchestra.run.smithi018.stdout:Fetching dashboard port number... 2024-04-21T22:23:22.228 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:22 smithi018 ceph-mon[26614]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:22.228 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:22 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:22.228 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:22 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:23 smithi018 ceph-mon[26614]: mgrmap e13: x(active, since 6s) 2024-04-21T22:23:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:23 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/827049537' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-21T22:23:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stdout 8443 2024-04-21T22:23:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.522+0000 7f50b5c00700 1 Processor -- start 2024-04-21T22:23:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.522+0000 7f50b5c00700 1 -- start start 2024-04-21T22:23:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.523+0000 7f50b5c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.523+0000 7f50b5c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0108960 con 0x7f50b0108000 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.523+0000 7f50aea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.523+0000 7f50aea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43750/0 (socket says 172.21.15.18:43750) 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.523+0000 7f50aea00700 1 -- 172.21.15.18:0/2106695652 learned_addr learned my addr 172.21.15.18:0/2106695652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.524+0000 7f50aea00700 1 -- 172.21.15.18:0/2106695652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b0108ae0 con 0x7f50b0108000 2024-04-21T22:23:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.524+0000 7f50aea00700 1 --2- 172.21.15.18:0/2106695652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50a00098a0 tx=0x7f50a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261fb5cd3f331ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.525+0000 7f50ad600700 1 -- 172.21.15.18:0/2106695652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a0004160 con 0x7f50b0108000 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.525+0000 7f50ad600700 1 -- 172.21.15.18:0/2106695652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a0004300 con 0x7f50b0108000 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.525+0000 7f50ad600700 1 -- 172.21.15.18:0/2106695652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a0011b20 con 0x7f50b0108000 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 -- 172.21.15.18:0/2106695652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 msgr2=0x7f50b0108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 --2- 172.21.15.18:0/2106695652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50a00098a0 tx=0x7f50a0009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 -- 172.21.15.18:0/2106695652 shutdown_connections 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 --2- 172.21.15.18:0/2106695652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b0108420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 -- 172.21.15.18:0/2106695652 >> 172.21.15.18:0/2106695652 conn(0x7f50b01036a0 msgr2=0x7f50b0105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 -- 172.21.15.18:0/2106695652 shutdown_connections 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.526+0000 7f50b5c00700 1 -- 172.21.15.18:0/2106695652 wait complete. 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.528+0000 7f50b5c00700 1 Processor -- start 2024-04-21T22:23:24.420 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.529+0000 7f50b5c00700 1 -- start start 2024-04-21T22:23:24.421 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.529+0000 7f50b5c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:24.421 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.529+0000 7f50b5c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50b010c470 con 0x7f50b0108000 2024-04-21T22:23:24.421 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.529+0000 7f50aea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:24.421 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.530+0000 7f50aea00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43762/0 (socket says 172.21.15.18:43762) 2024-04-21T22:23:24.421 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.530+0000 7f50aea00700 1 -- 172.21.15.18:0/827049537 learned_addr learned my addr 172.21.15.18:0/827049537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.530+0000 7f50aea00700 1 -- 172.21.15.18:0/827049537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b019c380 con 0x7f50b0108000 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.530+0000 7f50aea00700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009fb0 tx=0x7f50a0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.531+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a0003930 con 0x7f50b0108000 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.531+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a0003ad0 con 0x7f50b0108000 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.531+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a0019690 con 0x7f50b0108000 2024-04-21T22:23:24.422 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.531+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b019c610 con 0x7f50b0108000 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.531+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b019ca70 con 0x7f50b0108000 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.532+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f50a001a430 con 0x7f50b0108000 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.533+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b0063890 con 0x7f50b0108000 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.533+0000 7f50a7400700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 0x7f509403b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.533+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f50a004d7b0 con 0x7f50b0108000 2024-04-21T22:23:24.423 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.533+0000 7f50ae000700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 0x7f509403b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.534+0000 7f50ae000700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 0x7f509403b570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f509c006fd0 tx=0x7f509c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.538+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f50a0011e20 con 0x7f50b0108000 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.588+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f50a0023390 con 0x7f50b0108000 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.770+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f50b019f500 con 0x7f50b0108000 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.771+0000 7f50a7400700 1 -- 172.21.15.18:0/827049537 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f50a0044e20 con 0x7f50b0108000 2024-04-21T22:23:24.424 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 msgr2=0x7f509403b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 0x7f509403b570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f509c006fd0 tx=0x7f509c006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 msgr2=0x7f50b019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009fb0 tx=0x7f50a0011c10 comp rx=0 tx=0).stop 2024-04-21T22:23:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 shutdown_connections 2024-04-21T22:23:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f50940390b0 0x7f509403b570 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:24.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 --2- 172.21.15.18:0/827049537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50b0108000 0x7f50b019be40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:24.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 >> 172.21.15.18:0/827049537 conn(0x7f50b01036a0 msgr2=0x7f50b0104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:24.426 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.774+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 shutdown_connections 2024-04-21T22:23:24.429 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:22.775+0000 7f50b5c00700 1 -- 172.21.15.18:0/827049537 wait complete. 2024-04-21T22:23:24.440 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-21T22:23:24.441 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout disabled 2024-04-21T22:23:24.467 INFO:teuthology.orchestra.run.smithi018.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-21T22:23:24.468 INFO:teuthology.orchestra.run.smithi018.stdout:systemctl: stdout inactive 2024-04-21T22:23:24.468 INFO:teuthology.orchestra.run.smithi018.stdout:firewalld.service is not enabled 2024-04-21T22:23:24.468 INFO:teuthology.orchestra.run.smithi018.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-21T22:23:24.475 INFO:teuthology.orchestra.run.smithi018.stdout:Ceph Dashboard is now available at: 2024-04-21T22:23:24.475 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:24.475 INFO:teuthology.orchestra.run.smithi018.stdout: URL: https://smithi018.front.sepia.ceph.com:8443/ 2024-04-21T22:23:24.476 INFO:teuthology.orchestra.run.smithi018.stdout: User: admin 2024-04-21T22:23:24.476 INFO:teuthology.orchestra.run.smithi018.stdout: Password: tr767nkbuk 2024-04-21T22:23:24.476 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:24.477 INFO:teuthology.orchestra.run.smithi018.stdout:Saving cluster configuration to /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config directory 2024-04-21T22:23:24.479 INFO:teuthology.orchestra.run.smithi018.stdout:Enabling autotune for osd_memory_target 2024-04-21T22:23:25.970 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.091+0000 7f7113e00700 1 Processor -- start 2024-04-21T22:23:25.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.092+0000 7f7113e00700 1 -- start start 2024-04-21T22:23:25.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.092+0000 7f7113e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:25.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.092+0000 7f7113e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f711407c800 con 0x7f711407de10 2024-04-21T22:23:25.971 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.093+0000 7f7112a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.093+0000 7f7112a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43766/0 (socket says 172.21.15.18:43766) 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.093+0000 7f7112a00700 1 -- 172.21.15.18:0/2079393109 learned_addr learned my addr 172.21.15.18:0/2079393109 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.093+0000 7f7112a00700 1 -- 172.21.15.18:0/2079393109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711407c980 con 0x7f711407de10 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.093+0000 7f7112a00700 1 --2- 172.21.15.18:0/2079393109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71040098a0 tx=0x7f7104009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25fba9ecc2eb73e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.094+0000 7f7112000700 1 -- 172.21.15.18:0/2079393109 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104004160 con 0x7f711407de10 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.094+0000 7f7112000700 1 -- 172.21.15.18:0/2079393109 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7104004300 con 0x7f711407de10 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.094+0000 7f7112000700 1 -- 172.21.15.18:0/2079393109 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104011b20 con 0x7f711407de10 2024-04-21T22:23:25.972 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.094+0000 7f7113e00700 1 -- 172.21.15.18:0/2079393109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 msgr2=0x7f711407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.094+0000 7f7113e00700 1 --2- 172.21.15.18:0/2079393109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71040098a0 tx=0x7f7104009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.095+0000 7f7113e00700 1 -- 172.21.15.18:0/2079393109 shutdown_connections 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.095+0000 7f7113e00700 1 --2- 172.21.15.18:0/2079393109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711407c2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.095+0000 7f7113e00700 1 -- 172.21.15.18:0/2079393109 >> 172.21.15.18:0/2079393109 conn(0x7f71141033c0 msgr2=0x7f71141057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.095+0000 7f7113e00700 1 -- 172.21.15.18:0/2079393109 shutdown_connections 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.095+0000 7f7113e00700 1 -- 172.21.15.18:0/2079393109 wait complete. 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.096+0000 7f7113e00700 1 Processor -- start 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.096+0000 7f7113e00700 1 -- start start 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.096+0000 7f7113e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.096+0000 7f7113e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f711410e3c0 con 0x7f711407de10 2024-04-21T22:23:25.975 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.097+0000 7f7112a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:25.975 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.097+0000 7f7112a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43768/0 (socket says 172.21.15.18:43768) 2024-04-21T22:23:25.975 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.097+0000 7f7112a00700 1 -- 172.21.15.18:0/3928307834 learned_addr learned my addr 172.21.15.18:0/3928307834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:25.975 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.097+0000 7f7112a00700 1 -- 172.21.15.18:0/3928307834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711419e340 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.097+0000 7f7112a00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7104011b60 tx=0x7f7104011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.098+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104003b60 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.098+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f710401a910 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.098+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104024930 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.098+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711419e5d0 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.098+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711419ea30 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.099+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7104022020 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.099+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71140693b0 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.100+0000 7f710be00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 0x7f70f803b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.100+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f710404d4e0 con 0x7f711407de10 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.100+0000 7f710a000700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 0x7f70f803b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.101+0000 7f710a000700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 0x7f70f803b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70fc006fd0 tx=0x7f70fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.106+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f710400b3e0 con 0x7f711407de10 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.332+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f71141a1400 con 0x7f711407de10 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.333+0000 7f710be00700 1 -- 172.21.15.18:0/3928307834 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f710402de10 con 0x7f711407de10 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.335+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 msgr2=0x7f70f803b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 0x7f70f803b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f70fc006fd0 tx=0x7f70fc006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 msgr2=0x7f711419de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:25.978 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7104011b60 tx=0x7f7104011c40 comp rx=0 tx=0).stop 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 shutdown_connections 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70f80391a0 0x7f70f803b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 --2- 172.21.15.18:0/3928307834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f711407de10 0x7f711419de00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 >> 172.21.15.18:0/3928307834 conn(0x7f71141033c0 msgr2=0x7f7114103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 shutdown_connections 2024-04-21T22:23:25.979 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:25.336+0000 7f7113e00700 1 -- 172.21.15.18:0/3928307834 wait complete. 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.630+0000 7f2392a00700 1 Processor -- start 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.630+0000 7f2392a00700 1 -- start start 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.630+0000 7f2392a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.630+0000 7f2392a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10abc0 con 0x7f238c10a1d0 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.631+0000 7f238be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:27.715 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.631+0000 7f238be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42022/0 (socket says 172.21.15.18:42022) 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.631+0000 7f238be00700 1 -- 172.21.15.18:0/3404582999 learned_addr learned my addr 172.21.15.18:0/3404582999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.631+0000 7f238be00700 1 -- 172.21.15.18:0/3404582999 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c10b330 con 0x7f238c10a1d0 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f238be00700 1 --2- 172.21.15.18:0/3404582999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f237c0098a0 tx=0x7f237c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e4e52b5f6fea9f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f238aa00700 1 -- 172.21.15.18:0/3404582999 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c004160 con 0x7f238c10a1d0 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f238aa00700 1 -- 172.21.15.18:0/3404582999 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c004300 con 0x7f238c10a1d0 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f238aa00700 1 -- 172.21.15.18:0/3404582999 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c011b20 con 0x7f238c10a1d0 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f2392a00700 1 -- 172.21.15.18:0/3404582999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 msgr2=0x7f238c10a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.632+0000 7f2392a00700 1 --2- 172.21.15.18:0/3404582999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f237c0098a0 tx=0x7f237c009bb0 comp rx=0 tx=0).stop 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.633+0000 7f2392a00700 1 -- 172.21.15.18:0/3404582999 shutdown_connections 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.633+0000 7f2392a00700 1 --2- 172.21.15.18:0/3404582999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c10a5f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.633+0000 7f2392a00700 1 -- 172.21.15.18:0/3404582999 >> 172.21.15.18:0/3404582999 conn(0x7f238c07d630 msgr2=0x7f238c07da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.633+0000 7f2392a00700 1 -- 172.21.15.18:0/3404582999 shutdown_connections 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.633+0000 7f2392a00700 1 -- 172.21.15.18:0/3404582999 wait complete. 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.634+0000 7f2392a00700 1 Processor -- start 2024-04-21T22:23:27.716 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.634+0000 7f2392a00700 1 -- start start 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.634+0000 7f2392a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.634+0000 7f2392a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10e6e0 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.635+0000 7f238be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.635+0000 7f238be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42030/0 (socket says 172.21.15.18:42030) 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.635+0000 7f238be00700 1 -- 172.21.15.18:0/1261579962 learned_addr learned my addr 172.21.15.18:0/1261579962 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.635+0000 7f238be00700 1 -- 172.21.15.18:0/1261579962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c19e510 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.635+0000 7f238be00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f237c0117e0 tx=0x7f237c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.636+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c003bf0 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.636+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c01a910 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.636+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f237c024970 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.636+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c19e7a0 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.636+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c19ec00 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.637+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c063890 con 0x7f238c10a1d0 2024-04-21T22:23:27.717 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.637+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f237c022020 con 0x7f238c10a1d0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.637+0000 7f2388c00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 0x7f237003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.637+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f237c04d5c0 con 0x7f238c10a1d0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.639+0000 7f238b400700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 0x7f237003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.639+0000 7f238b400700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 0x7f237003b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2378006fd0 tx=0x7f2378006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.643+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f237c010380 con 0x7f238c10a1d0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.983+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f238c1a1550 con 0x7f238c10a1d0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.988+0000 7f2388c00700 1 -- 172.21.15.18:0/1261579962 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f237c0212c0 con 0x7f238c10a1d0 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 msgr2=0x7f237003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 0x7f237003b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2378006fd0 tx=0x7f2378006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 msgr2=0x7f238c19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f237c0117e0 tx=0x7f237c011ba0 comp rx=0 tx=0).stop 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 shutdown_connections 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f23700391a0 0x7f237003b660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:27.718 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 --2- 172.21.15.18:0/1261579962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f238c10a1d0 0x7f238c19dfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 >> 172.21.15.18:0/1261579962 conn(0x7f238c07d630 msgr2=0x7f238c107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 shutdown_connections 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr 2024-04-21T22:23:26.991+0000 7f2392a00700 1 -- 172.21.15.18:0/1261579962 wait complete. 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:Or, if you are only running a single cluster on this host: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: ceph telemetry on 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.719 INFO:teuthology.orchestra.run.smithi018.stdout:For more information see: 2024-04-21T22:23:27.720 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.720 INFO:teuthology.orchestra.run.smithi018.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-21T22:23:27.720 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:27.720 INFO:teuthology.orchestra.run.smithi018.stdout:Bootstrap complete. 2024-04-21T22:23:27.802 INFO:tasks.cephadm:Fetching config... 2024-04-21T22:23:27.803 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:23:27.803 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-21T22:23:27.852 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-21T22:23:27.852 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:23:27.852 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-21T22:23:27.935 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-21T22:23:27.935 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:23:27.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-21T22:23:28.065 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-21T22:23:28.065 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:23:28.066 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-21T22:23:28.117 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-21T22:23:28.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T22:23:28.235 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:23:28.248 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:27 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1261579962' entity='client.admin' 2024-04-21T22:23:28.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T22:23:28.305 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:23:28.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-21T22:23:28.355 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5KAgZHwi4THxNjYN7UwEvBP2kkJAwtNqg4Nt0F6C/LhZ0b9aCRsS7N3G5YTy1KWgXFZjz1FwYEm7UbawKupWLobZuxPx3PU2Wnf63nNE8+m2toMxlP562ZUe1Jc4okeHCOObjd42wzQQHa9ZjZ19hIkJ+1yJKfg8w9DmMx/QrU5FqsivzeIMOPU3+I+rSZD/O8FiMuwzOffRpCHgRV/xo1FVdMUaTLaNUrsWFVnfFvEwvrcb9fGzBo+uBzCGMmiu5wMzNcMam8eRym6iSNFy98/oU3AZ3fP+5fWsVo0OC1FbR/ukrQT9WlZh7lLPIrJtFlqMUzFUnLR0S7L6V5dIS6o0VSurC8KuvE8jKQstJb0tFEwKp4nUtxpvMgTPzYHHE9uk9g2g4ZPgaWqFaS5qMZub1rMXtDsUJX1fWwy1mRzFy7DsTsGkb1tBcn2FW8UaNa+p502mG8hncz0LDpnyPhLyIHyowEMSEX5xUZUWGTNZSaWBmUWKrlJ5yb697iOU= ceph-6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:23:28.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-21T22:23:28.831 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.611+0000 7f693fe00700 1 -- 172.21.15.18:0/2336075575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 msgr2=0x7f6938074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.611+0000 7f693fe00700 1 --2- 172.21.15.18:0/2336075575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f6938074640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f692c00b0a0 tx=0x7f692c00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:23:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.612+0000 7f693fe00700 1 -- 172.21.15.18:0/2336075575 shutdown_connections 2024-04-21T22:23:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.612+0000 7f693fe00700 1 --2- 172.21.15.18:0/2336075575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f6938074640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.612+0000 7f693fe00700 1 -- 172.21.15.18:0/2336075575 >> 172.21.15.18:0/2336075575 conn(0x7f69380fd280 msgr2=0x7f69380ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.612+0000 7f693fe00700 1 -- 172.21.15.18:0/2336075575 shutdown_connections 2024-04-21T22:23:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.612+0000 7f693fe00700 1 -- 172.21.15.18:0/2336075575 wait complete. 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.613+0000 7f693fe00700 1 Processor -- start 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.613+0000 7f693fe00700 1 -- start start 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.613+0000 7f693fe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.613+0000 7f693fe00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6938109f40 con 0x7f69380761e0 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.614+0000 7f693d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.614+0000 7f693d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42046/0 (socket says 172.21.15.18:42046) 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.614+0000 7f693d400700 1 -- 172.21.15.18:0/4169013081 learned_addr learned my addr 172.21.15.18:0/4169013081 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.614+0000 7f693d400700 1 -- 172.21.15.18:0/4169013081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6938199a00 con 0x7f69380761e0 2024-04-21T22:23:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.614+0000 7f693d400700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f692c015040 tx=0x7f692c009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.615+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692c017040 con 0x7f69380761e0 2024-04-21T22:23:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.615+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f692c022070 con 0x7f69380761e0 2024-04-21T22:23:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.615+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6938199c90 con 0x7f69380761e0 2024-04-21T22:23:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.615+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692c01d5d0 con 0x7f69380761e0 2024-04-21T22:23:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.615+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693819c980 con 0x7f69380761e0 2024-04-21T22:23:31.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.616+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f692c004000 con 0x7f69380761e0 2024-04-21T22:23:31.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.616+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693810a6c0 con 0x7f69380761e0 2024-04-21T22:23:31.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.617+0000 7f6936000700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 0x7f692003b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:31.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.617+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f692c00f050 con 0x7f69380761e0 2024-04-21T22:23:31.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.617+0000 7f693ca00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 0x7f692003b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:31.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.618+0000 7f693ca00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 0x7f692003b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6924006fd0 tx=0x7f6924006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:31.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.623+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f692c007e20 con 0x7f69380761e0 2024-04-21T22:23:31.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.854+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f693802dc40 con 0x7f69380761e0 2024-04-21T22:23:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.858+0000 7f6936000700 1 -- 172.21.15.18:0/4169013081 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f692c01c3a0 con 0x7f69380761e0 2024-04-21T22:23:31.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 msgr2=0x7f692003b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 0x7f692003b600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6924006fd0 tx=0x7f6924006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 msgr2=0x7f69381994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f692c015040 tx=0x7f692c009790 comp rx=0 tx=0).stop 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 shutdown_connections 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6920039140 0x7f692003b600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 --2- 172.21.15.18:0/4169013081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69380761e0 0x7f69381994c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:31.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.862+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 >> 172.21.15.18:0/4169013081 conn(0x7f69380fd280 msgr2=0x7f69380fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:31.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.863+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 shutdown_connections 2024-04-21T22:23:31.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:31.863+0000 7f693fe00700 1 -- 172.21.15.18:0/4169013081 wait complete. 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4169013081' entity='client.admin' 2024-04-21T22:23:32.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:32.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:32.804 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-21T22:23:32.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-21T22:23:33.262 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.936+0000 7f4345200700 1 -- 172.21.15.18:0/1719413573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 msgr2=0x7f43400746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.936+0000 7f4345200700 1 --2- 172.21.15.18:0/1719413573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f43400746c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4330009910 tx=0x7f4330009c20 comp rx=0 tx=0).stop 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.936+0000 7f4345200700 1 -- 172.21.15.18:0/1719413573 shutdown_connections 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.936+0000 7f4345200700 1 --2- 172.21.15.18:0/1719413573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f43400746c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.936+0000 7f4345200700 1 -- 172.21.15.18:0/1719413573 >> 172.21.15.18:0/1719413573 conn(0x7f43400fd230 msgr2=0x7f43400ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.937+0000 7f4345200700 1 -- 172.21.15.18:0/1719413573 shutdown_connections 2024-04-21T22:23:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.937+0000 7f4345200700 1 -- 172.21.15.18:0/1719413573 wait complete. 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.938+0000 7f4345200700 1 Processor -- start 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.938+0000 7f4345200700 1 -- start start 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.938+0000 7f4345200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.938+0000 7f4345200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f434010e3f0 con 0x7f4340076260 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.939+0000 7f433de00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.939+0000 7f433de00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51128/0 (socket says 172.21.15.18:51128) 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.939+0000 7f433de00700 1 -- 172.21.15.18:0/2275460208 learned_addr learned my addr 172.21.15.18:0/2275460208 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.939+0000 7f433de00700 1 -- 172.21.15.18:0/2275460208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434019deb0 con 0x7f4340076260 2024-04-21T22:23:35.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.939+0000 7f433de00700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4330005850 tx=0x7f4330005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:35.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.940+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4330026070 con 0x7f4340076260 2024-04-21T22:23:35.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.940+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43300044a0 con 0x7f4340076260 2024-04-21T22:23:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.940+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4330003ab0 con 0x7f4340076260 2024-04-21T22:23:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.940+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434019e140 con 0x7f4340076260 2024-04-21T22:23:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.940+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401a0e30 con 0x7f4340076260 2024-04-21T22:23:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.941+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434010eaa0 con 0x7f4340076260 2024-04-21T22:23:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.941+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4330029070 con 0x7f4340076260 2024-04-21T22:23:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.942+0000 7f4336a00700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 0x7f432403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.942+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f433001e070 con 0x7f4340076260 2024-04-21T22:23:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.942+0000 7f433d400700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 0x7f432403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:35.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.943+0000 7f433d400700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 0x7f432403b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f432c006fd0 tx=0x7f432c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:35.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:35.948+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f4330013070 con 0x7f4340076260 2024-04-21T22:23:36.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.184+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f434002dc40 con 0x7f4324039150 2024-04-21T22:23:36.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.190+0000 7f4336a00700 1 -- 172.21.15.18:0/2275460208 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f434002dc40 con 0x7f4324039150 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 msgr2=0x7f432403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 0x7f432403b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f432c006fd0 tx=0x7f432c006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 msgr2=0x7f434019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4330005850 tx=0x7f4330005030 comp rx=0 tx=0).stop 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 shutdown_connections 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4324039150 0x7f432403b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 --2- 172.21.15.18:0/2275460208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4340076260 0x7f434019d970 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:36.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 >> 172.21.15.18:0/2275460208 conn(0x7f43400fd230 msgr2=0x7f43400fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:36.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 shutdown_connections 2024-04-21T22:23:36.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:36.193+0000 7f4345200700 1 -- 172.21.15.18:0/2275460208 wait complete. 2024-04-21T22:23:36.949 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi047 2024-04-21T22:23:36.949 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:23:36.949 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.conf 2024-04-21T22:23:36.968 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:23:36.968 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:23:37.026 INFO:tasks.cephadm:Adding host smithi047 to orchestrator... 2024-04-21T22:23:37.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch host add smithi047 2024-04-21T22:23:37.444 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:37.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:23:37.590 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:37 smithi018 ceph-mon[26614]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:23:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:38 smithi018 ceph-mon[26614]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:23:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:38 smithi018 ceph-mon[26614]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:23:39.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:39 smithi018 ceph-mon[26614]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:39.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:39 smithi018 ceph-mon[26614]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:23:39.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:39.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:39.364 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:39.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 -- 172.21.15.18:0/3897767162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 msgr2=0x7fcaf8076b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:39.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 --2- 172.21.15.18:0/3897767162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf8076b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcae800b0a0 tx=0x7fcae800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:23:39.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 -- 172.21.15.18:0/3897767162 shutdown_connections 2024-04-21T22:23:39.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 --2- 172.21.15.18:0/3897767162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf8076b40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:39.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 -- 172.21.15.18:0/3897767162 >> 172.21.15.18:0/3897767162 conn(0x7fcaf80ff940 msgr2=0x7fcaf8101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:39.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 -- 172.21.15.18:0/3897767162 shutdown_connections 2024-04-21T22:23:39.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.630+0000 7fcafcc00700 1 -- 172.21.15.18:0/3897767162 wait complete. 2024-04-21T22:23:39.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.632+0000 7fcafcc00700 1 Processor -- start 2024-04-21T22:23:39.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.632+0000 7fcafcc00700 1 -- start start 2024-04-21T22:23:39.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.633+0000 7fcafcc00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:39.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.633+0000 7fcafcc00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81128e0 con 0x7fcaf8076760 2024-04-21T22:23:39.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.633+0000 7fcaf5e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:39.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.633+0000 7fcaf5e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51138/0 (socket says 172.21.15.18:51138) 2024-04-21T22:23:39.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.633+0000 7fcaf5e00700 1 -- 172.21.15.18:0/2565266115 learned_addr learned my addr 172.21.15.18:0/2565266115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:39.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcaf5e00700 1 -- 172.21.15.18:0/2565266115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf819e260 con 0x7fcaf8076760 2024-04-21T22:23:39.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcaf5e00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcae8000f80 tx=0x7fcae8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:39.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae8017040 con 0x7fcaf8076760 2024-04-21T22:23:39.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcae8022070 con 0x7fcaf8076760 2024-04-21T22:23:39.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcae801d440 con 0x7fcaf8076760 2024-04-21T22:23:39.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.634+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf819e4f0 con 0x7fcaf8076760 2024-04-21T22:23:39.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.635+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf819e950 con 0x7fcaf8076760 2024-04-21T22:23:39.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.636+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcae8004000 con 0x7fcaf8076760 2024-04-21T22:23:39.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.636+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf8077ea0 con 0x7fcaf8076760 2024-04-21T22:23:39.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.636+0000 7fcaeea00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 0x7fcadc03b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:39.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.636+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcae800f050 con 0x7fcaf8076760 2024-04-21T22:23:39.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.637+0000 7fcaf5400700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 0x7fcadc03b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:39.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.637+0000 7fcaf5400700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 0x7fcadc03b660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcae4006fd0 tx=0x7fcae4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:39.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.644+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fcae8007e20 con 0x7fcaf8076760 2024-04-21T22:23:39.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:39.879+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}) -- 0x7fcaf819f0f0 con 0x7fcadc0391a0 2024-04-21T22:23:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:41 smithi018 ceph-mon[26614]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:41 smithi018 ceph-mon[26614]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:41 smithi018 ceph-mon[26614]: Deploying cephadm binary to smithi047 2024-04-21T22:23:43.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:43 smithi018 ceph-mon[26614]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.910+0000 7fcaeea00700 1 -- 172.21.15.18:0/2565266115 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fcaf819f0f0 con 0x7fcadc0391a0 2024-04-21T22:23:44.910 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi047' with addr '172.21.15.47' 2024-04-21T22:23:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.913+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 msgr2=0x7fcadc03b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.913+0000 7fcafcc00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 0x7fcadc03b660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcae4006fd0 tx=0x7fcae4006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.913+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 msgr2=0x7fcaf819dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.913+0000 7fcafcc00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcae8000f80 tx=0x7fcae8003ce0 comp rx=0 tx=0).stop 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 shutdown_connections 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcadc0391a0 0x7fcadc03b660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 --2- 172.21.15.18:0/2565266115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf8076760 0x7fcaf819dd20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 >> 172.21.15.18:0/2565266115 conn(0x7fcaf80ff940 msgr2=0x7fcaf81010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 shutdown_connections 2024-04-21T22:23:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:44.914+0000 7fcafcc00700 1 -- 172.21.15.18:0/2565266115 wait complete. 2024-04-21T22:23:45.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:45 smithi018 ceph-mon[26614]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:45.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:45.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:45.689 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-21T22:23:46.138 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:46.800 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:46 smithi018 ceph-mon[26614]: Added host smithi047 2024-04-21T22:23:46.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:46.801 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:47.676 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:47 smithi018 ceph-mon[26614]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:48.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 -- 172.21.15.18:0/2051395110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 msgr2=0x7f0f541044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:48.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 --2- 172.21.15.18:0/2051395110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f541044a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009910 tx=0x7f0f44009c20 comp rx=0 tx=0).stop 2024-04-21T22:23:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 -- 172.21.15.18:0/2051395110 shutdown_connections 2024-04-21T22:23:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 --2- 172.21.15.18:0/2051395110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f541044a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 -- 172.21.15.18:0/2051395110 >> 172.21.15.18:0/2051395110 conn(0x7f0f540ff950 msgr2=0x7f0f54101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 -- 172.21.15.18:0/2051395110 shutdown_connections 2024-04-21T22:23:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.165+0000 7f0f59c00700 1 -- 172.21.15.18:0/2051395110 wait complete. 2024-04-21T22:23:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.166+0000 7f0f59c00700 1 Processor -- start 2024-04-21T22:23:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.167+0000 7f0f59c00700 1 -- start start 2024-04-21T22:23:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.167+0000 7f0f59c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.167+0000 7f0f59c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5410e490 con 0x7f0f541040c0 2024-04-21T22:23:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.167+0000 7f0f52a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.167+0000 7f0f52a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58128/0 (socket says 172.21.15.18:58128) 2024-04-21T22:23:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.168+0000 7f0f52a00700 1 -- 172.21.15.18:0/1565960296 learned_addr learned my addr 172.21.15.18:0/1565960296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.168+0000 7f0f52a00700 1 -- 172.21.15.18:0/1565960296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5419fb40 con 0x7f0f541040c0 2024-04-21T22:23:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.168+0000 7f0f52a00700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005850 tx=0x7f0f44005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.169+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44026070 con 0x7f0f541040c0 2024-04-21T22:23:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.169+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f4400bbd0 con 0x7f0f541040c0 2024-04-21T22:23:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.169+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5419fe30 con 0x7f0f541040c0 2024-04-21T22:23:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.169+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44003970 con 0x7f0f541040c0 2024-04-21T22:23:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.169+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f54199780 con 0x7f0f541040c0 2024-04-21T22:23:48.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.170+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f541055a0 con 0x7f0f541040c0 2024-04-21T22:23:48.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.170+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0f44029070 con 0x7f0f541040c0 2024-04-21T22:23:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.171+0000 7f0f4b400700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 0x7f0f3803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.171+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0f4401e070 con 0x7f0f541040c0 2024-04-21T22:23:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.171+0000 7f0f52000700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 0x7f0f3803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.172+0000 7f0f52000700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 0x7f0f3803b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006fd0 tx=0x7f0f40006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.177+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0f44013070 con 0x7f0f541040c0 2024-04-21T22:23:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.415+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f5419acb0 con 0x7f0f380390f0 2024-04-21T22:23:48.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.417+0000 7f0f4b400700 1 -- 172.21.15.18:0/1565960296 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f0f5419acb0 con 0x7f0f380390f0 2024-04-21T22:23:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:23:48.417 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}] 2024-04-21T22:23:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 msgr2=0x7f0f3803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 0x7f0f3803b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006fd0 tx=0x7f0f40006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 msgr2=0x7f0f5419f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005850 tx=0x7f0f44005030 comp rx=0 tx=0).stop 2024-04-21T22:23:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 shutdown_connections 2024-04-21T22:23:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0f380390f0 0x7f0f3803b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 --2- 172.21.15.18:0/1565960296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f541040c0 0x7f0f5419f600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 >> 172.21.15.18:0/1565960296 conn(0x7f0f540ff950 msgr2=0x7f0f54105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 shutdown_connections 2024-04-21T22:23:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:48.420+0000 7f0f59c00700 1 -- 172.21.15.18:0/1565960296 wait complete. 2024-04-21T22:23:49.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:49.230 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi081 2024-04-21T22:23:49.230 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:23:49.230 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.conf 2024-04-21T22:23:49.249 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:23:49.249 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:23:49.306 INFO:tasks.cephadm:Adding host smithi081 to orchestrator... 2024-04-21T22:23:49.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch host add smithi081 2024-04-21T22:23:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:50.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:49 smithi018 ceph-mon[26614]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:50.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:49 smithi018 ceph-mon[26614]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 -- 172.21.15.18:0/1251435753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 msgr2=0x7fb424107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 --2- 172.21.15.18:0/1251435753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424107e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb414009910 tx=0x7fb414009c20 comp rx=0 tx=0).stop 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 -- 172.21.15.18:0/1251435753 shutdown_connections 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 --2- 172.21.15.18:0/1251435753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424107e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 -- 172.21.15.18:0/1251435753 >> 172.21.15.18:0/1251435753 conn(0x7fb4240fd5d0 msgr2=0x7fb4240ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 -- 172.21.15.18:0/1251435753 shutdown_connections 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.866+0000 7fb423200700 1 -- 172.21.15.18:0/1251435753 wait complete. 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.867+0000 7fb423200700 1 Processor -- start 2024-04-21T22:23:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.867+0000 7fb423200700 1 -- start start 2024-04-21T22:23:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb423200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb423200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb42410c0e0 con 0x7fb424107aa0 2024-04-21T22:23:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb421e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb421e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58154/0 (socket says 172.21.15.18:58154) 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb421e00700 1 -- 172.21.15.18:0/2185857447 learned_addr learned my addr 172.21.15.18:0/2185857447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.868+0000 7fb421e00700 1 -- 172.21.15.18:0/2185857447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb424199c80 con 0x7fb424107aa0 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb421e00700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb414006010 tx=0x7fb414005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb414026070 con 0x7fb424107aa0 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb41400bbd0 con 0x7fb424107aa0 2024-04-21T22:23:51.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb414003910 con 0x7fb424107aa0 2024-04-21T22:23:51.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb424199f70 con 0x7fb424107aa0 2024-04-21T22:23:51.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.869+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42419e010 con 0x7fb424107aa0 2024-04-21T22:23:51.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.870+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4241031e0 con 0x7fb424107aa0 2024-04-21T22:23:51.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.871+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb414029070 con 0x7fb424107aa0 2024-04-21T22:23:51.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.871+0000 7fb41aa00700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 0x7fb40803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:23:51.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.871+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb41401e070 con 0x7fb424107aa0 2024-04-21T22:23:51.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.871+0000 7fb421400700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 0x7fb40803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:23:51.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.872+0000 7fb421400700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 0x7fb40803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb410006fd0 tx=0x7fb410006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:23:51.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:51.877+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb414050030 con 0x7fb424107aa0 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:23:52.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:23:52.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:52.112+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}) -- 0x7fb42419aaa0 con 0x7fb408039150 2024-04-21T22:23:53.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:23:53.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:23:53.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:23:53.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:53.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:53.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:52 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:53 smithi018 ceph-mon[26614]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:53 smithi018 ceph-mon[26614]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:23:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:53 smithi018 ceph-mon[26614]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:23:55.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:54 smithi018 ceph-mon[26614]: Deploying cephadm binary to smithi081 2024-04-21T22:23:56.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:55 smithi018 ceph-mon[26614]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.979+0000 7fb41aa00700 1 -- 172.21.15.18:0/2185857447 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb42419aaa0 con 0x7fb408039150 2024-04-21T22:23:56.979 INFO:teuthology.orchestra.run.smithi018.stdout:Added host 'smithi081' with addr '172.21.15.81' 2024-04-21T22:23:56.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.982+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 msgr2=0x7fb40803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:56.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.982+0000 7fb423200700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 0x7fb40803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb410006fd0 tx=0x7fb410006e40 comp rx=0 tx=0).stop 2024-04-21T22:23:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 msgr2=0x7fb424199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:23:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb414006010 tx=0x7fb414005030 comp rx=0 tx=0).stop 2024-04-21T22:23:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 shutdown_connections 2024-04-21T22:23:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb408039150 0x7fb40803b610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 --2- 172.21.15.18:0/2185857447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb424107aa0 0x7fb424199740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:23:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 >> 172.21.15.18:0/2185857447 conn(0x7fb4240fd5d0 msgr2=0x7fb4240ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:23:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 shutdown_connections 2024-04-21T22:23:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:23:56.983+0000 7fb423200700 1 -- 172.21.15.18:0/2185857447 wait complete. 2024-04-21T22:23:57.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-21T22:23:58.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:57 smithi018 ceph-mon[26614]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:58.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:58.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:23:58.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:58.230 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:23:59.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:58 smithi018 ceph-mon[26614]: Added host smithi081 2024-04-21T22:23:59.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:23:59.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:59 smithi018 ceph-mon[26614]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:23:59.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:23:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 -- 172.21.15.18:0/2971427701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 msgr2=0x7f68e8076b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 --2- 172.21.15.18:0/2971427701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e8076b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009910 tx=0x7f68d8009c20 comp rx=0 tx=0).stop 2024-04-21T22:24:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 -- 172.21.15.18:0/2971427701 shutdown_connections 2024-04-21T22:24:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 --2- 172.21.15.18:0/2971427701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e8076b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 -- 172.21.15.18:0/2971427701 >> 172.21.15.18:0/2971427701 conn(0x7f68e80ff980 msgr2=0x7f68e8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 -- 172.21.15.18:0/2971427701 shutdown_connections 2024-04-21T22:24:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.410+0000 7f68ecc00700 1 -- 172.21.15.18:0/2971427701 wait complete. 2024-04-21T22:24:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.411+0000 7f68ecc00700 1 Processor -- start 2024-04-21T22:24:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68ecc00700 1 -- start start 2024-04-21T22:24:00.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68ecc00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68ecc00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81128e0 con 0x7f68e8076760 2024-04-21T22:24:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68e5e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68e5e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33070/0 (socket says 172.21.15.18:33070) 2024-04-21T22:24:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.412+0000 7f68e5e00700 1 -- 172.21.15.18:0/1894383828 learned_addr learned my addr 172.21.15.18:0/1894383828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:24:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.413+0000 7f68e5e00700 1 -- 172.21.15.18:0/1894383828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e819e300 con 0x7f68e8076760 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.413+0000 7f68e5e00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68d8006010 tx=0x7f68d8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.413+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d8026070 con 0x7f68e8076760 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.413+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d800bc30 con 0x7f68e8076760 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.413+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e819e590 con 0x7f68e8076760 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.414+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d80039d0 con 0x7f68e8076760 2024-04-21T22:24:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.414+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e819e9f0 con 0x7f68e8076760 2024-04-21T22:24:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.415+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e8077ea0 con 0x7f68e8076760 2024-04-21T22:24:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.415+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f68d8029070 con 0x7f68e8076760 2024-04-21T22:24:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.415+0000 7f68dea00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 0x7f68cc03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.415+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f68d801e070 con 0x7f68e8076760 2024-04-21T22:24:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.416+0000 7f68e5400700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 0x7f68cc03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.416+0000 7f68e5400700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 0x7f68cc03b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f68d4006fd0 tx=0x7f68d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:00.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.421+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f68d8013070 con 0x7f68e8076760 2024-04-21T22:24:00.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.655+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68e819f120 con 0x7f68cc039150 2024-04-21T22:24:00.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.657+0000 7f68dea00700 1 -- 172.21.15.18:0/1894383828 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f68e819f120 con 0x7f68cc039150 2024-04-21T22:24:00.657 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:24:00.657 INFO:teuthology.orchestra.run.smithi018.stdout:[{"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}] 2024-04-21T22:24:00.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.660+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 msgr2=0x7f68cc03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:00.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.660+0000 7f68ecc00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 0x7f68cc03b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f68d4006fd0 tx=0x7f68d4006e40 comp rx=0 tx=0).stop 2024-04-21T22:24:00.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.660+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 msgr2=0x7f68e819ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:00.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.660+0000 7f68ecc00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68d8006010 tx=0x7f68d8005030 comp rx=0 tx=0).stop 2024-04-21T22:24:00.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 shutdown_connections 2024-04-21T22:24:00.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f68cc039150 0x7f68cc03b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:00.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 --2- 172.21.15.18:0/1894383828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e8076760 0x7f68e819ddc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:00.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 >> 172.21.15.18:0/1894383828 conn(0x7f68e80ff980 msgr2=0x7f68e8101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:00.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 shutdown_connections 2024-04-21T22:24:00.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:00.661+0000 7f68ecc00700 1 -- 172.21.15.18:0/1894383828 wait complete. 2024-04-21T22:24:01.365 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-21T22:24:01.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-21T22:24:01.822 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:24:02.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:01 smithi018 ceph-mon[26614]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:02.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:01 smithi018 ceph-mon[26614]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 -- 172.21.15.18:0/1386959099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 msgr2=0x7f0d280749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 --2- 172.21.15.18:0/1386959099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d280749b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009910 tx=0x7f0d18009c20 comp rx=0 tx=0).stop 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 -- 172.21.15.18:0/1386959099 shutdown_connections 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 --2- 172.21.15.18:0/1386959099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d280749b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 -- 172.21.15.18:0/1386959099 >> 172.21.15.18:0/1386959099 conn(0x7f0d280fd590 msgr2=0x7f0d280ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 -- 172.21.15.18:0/1386959099 shutdown_connections 2024-04-21T22:24:03.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.992+0000 7f0d27e00700 1 -- 172.21.15.18:0/1386959099 wait complete. 2024-04-21T22:24:03.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.993+0000 7f0d27e00700 1 Processor -- start 2024-04-21T22:24:03.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.994+0000 7f0d27e00700 1 -- start start 2024-04-21T22:24:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.994+0000 7f0d27e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.994+0000 7f0d27e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d28112720 con 0x7f0d280745d0 2024-04-21T22:24:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.995+0000 7f0d26a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.995+0000 7f0d26a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33080/0 (socket says 172.21.15.18:33080) 2024-04-21T22:24:03.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.995+0000 7f0d26a00700 1 -- 172.21.15.18:0/2776166953 learned_addr learned my addr 172.21.15.18:0/2776166953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:24:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.995+0000 7f0d26a00700 1 -- 172.21.15.18:0/2776166953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2819e1c0 con 0x7f0d280745d0 2024-04-21T22:24:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.995+0000 7f0d26a00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d18006010 tx=0x7f0d18005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.996+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d18026070 con 0x7f0d280745d0 2024-04-21T22:24:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.996+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d1800bc30 con 0x7f0d280745d0 2024-04-21T22:24:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.996+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d180039a0 con 0x7f0d280745d0 2024-04-21T22:24:03.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.996+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2819e450 con 0x7f0d280745d0 2024-04-21T22:24:03.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.996+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2819e8b0 con 0x7f0d280745d0 2024-04-21T22:24:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.997+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0d18029070 con 0x7f0d280745d0 2024-04-21T22:24:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.997+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d28075d10 con 0x7f0d280745d0 2024-04-21T22:24:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.998+0000 7f0d1fe00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 0x7f0d0c03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.998+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0d1801e070 con 0x7f0d280745d0 2024-04-21T22:24:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.998+0000 7f0d1e000700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 0x7f0d0c03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:03.999+0000 7f0d1e000700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 0x7f0d0c03b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006fd0 tx=0x7f0d10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:04.004+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0d18013070 con 0x7f0d280745d0 2024-04-21T22:24:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:24:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:04.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:04.274+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0d2819efe0 con 0x7f0d280745d0 2024-04-21T22:24:05.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:05.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:05.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:05.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:24:05.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:05.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:05.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:05.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-21T22:24:05.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.123+0000 7f0d1fe00700 1 -- 172.21.15.18:0/2776166953 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f0d1800bde0 con 0x7f0d280745d0 2024-04-21T22:24:05.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.126+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 msgr2=0x7f0d0c03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:05.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.126+0000 7f0d27e00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 0x7f0d0c03b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006fd0 tx=0x7f0d10006e40 comp rx=0 tx=0).stop 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.126+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 msgr2=0x7f0d2819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.126+0000 7f0d27e00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d18006010 tx=0x7f0d18005030 comp rx=0 tx=0).stop 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 shutdown_connections 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f0d0c039150 0x7f0d0c03b610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 --2- 172.21.15.18:0/2776166953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d280745d0 0x7f0d2819dc80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 >> 172.21.15.18:0/2776166953 conn(0x7f0d280fd590 msgr2=0x7f0d280fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 shutdown_connections 2024-04-21T22:24:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:05.127+0000 7f0d27e00700 1 -- 172.21.15.18:0/2776166953 wait complete. 2024-04-21T22:24:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-04-21T22:24:05.847 INFO:tasks.cephadm:Adding mon.a on smithi018 2024-04-21T22:24:05.847 INFO:tasks.cephadm:Adding mon.b on smithi047 2024-04-21T22:24:05.847 INFO:tasks.cephadm:Adding mon.c on smithi081 2024-04-21T22:24:05.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c' 2024-04-21T22:24:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:05 smithi018 ceph-mon[26614]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-21T22:24:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:05 smithi018 ceph-mon[26614]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:06.172 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 -- 172.21.15.81:0/174348718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 msgr2=0x7f2530100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 --2- 172.21.15.81:0/174348718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f2530100930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f252000aa20 tx=0x7f252000ad30 comp rx=0 tx=0).stop 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 -- 172.21.15.81:0/174348718 shutdown_connections 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 --2- 172.21.15.81:0/174348718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f2530100930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 -- 172.21.15.81:0/174348718 >> 172.21.15.81:0/174348718 conn(0x7f25300772b0 msgr2=0x7f25300776c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 -- 172.21.15.81:0/174348718 shutdown_connections 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.475+0000 7f2537cc7700 1 -- 172.21.15.81:0/174348718 wait complete. 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.476+0000 7f2537cc7700 1 Processor -- start 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.476+0000 7f2537cc7700 1 -- start start 2024-04-21T22:24:07.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.476+0000 7f2537cc7700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.476+0000 7f2537cc7700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f253010a0a0 con 0x7f2530100550 2024-04-21T22:24:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.477+0000 7f2535a63700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.477+0000 7f2535a63700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.81:60824/0 (socket says 172.21.15.81:60824) 2024-04-21T22:24:07.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.477+0000 7f2535a63700 1 -- 172.21.15.81:0/3661564973 learned_addr learned my addr 172.21.15.81:0/3661564973 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.477+0000 7f2535a63700 1 -- 172.21.15.81:0/3661564973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253019d970 con 0x7f2530100550 2024-04-21T22:24:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2535a63700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2520004c90 tx=0x7f2520004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2520005310 con 0x7f2530100550 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25200054b0 con 0x7f2530100550 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253019dc00 con 0x7f2530100550 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252000e790 con 0x7f2530100550 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.478+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25301975f0 con 0x7f2530100550 2024-04-21T22:24:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.479+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2530101a30 con 0x7f2530100550 2024-04-21T22:24:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.480+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f252000ea90 con 0x7f2530100550 2024-04-21T22:24:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.480+0000 7f2526ffd700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 0x7f251c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.480+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f252001e070 con 0x7f2530100550 2024-04-21T22:24:07.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.481+0000 7f2535262700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 0x7f251c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.481+0000 7f2535262700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 0x7f251c03b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f252c006fd0 tx=0x7f252c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.494+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f252000d3e0 con 0x7f2530100550 2024-04-21T22:24:07.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.699+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}) -- 0x7f2530198b20 con 0x7f251c0390f0 2024-04-21T22:24:07.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.715+0000 7f2526ffd700 1 -- 172.21.15.81:0/3661564973 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2530198b20 con 0x7f251c0390f0 2024-04-21T22:24:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mon update... 2024-04-21T22:24:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.716+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 msgr2=0x7f251c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 0x7f251c03b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f252c006fd0 tx=0x7f252c006e40 comp rx=0 tx=0).stop 2024-04-21T22:24:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 msgr2=0x7f253019d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2520004c90 tx=0x7f2520004d70 comp rx=0 tx=0).stop 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 shutdown_connections 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f251c0390f0 0x7f251c03b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 --2- 172.21.15.81:0/3661564973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2530100550 0x7f253019d430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 >> 172.21.15.81:0/3661564973 conn(0x7f25300772b0 msgr2=0x7f25300fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 shutdown_connections 2024-04-21T22:24:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:07.717+0000 7f2537cc7700 1 -- 172.21.15.81:0/3661564973 wait complete. 2024-04-21T22:24:08.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:08.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:08.394 DEBUG:teuthology.orchestra.run.smithi047:mon.b> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.b.service 2024-04-21T22:24:08.397 DEBUG:teuthology.orchestra.run.smithi081:mon.c> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.c.service 2024-04-21T22:24:08.400 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T22:24:08.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T22:24:09.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:08 smithi018 ceph-mon[26614]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:09.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:08 smithi018 ceph-mon[26614]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c;count:3 2024-04-21T22:24:09.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:08 smithi018 ceph-mon[26614]: Deploying daemon mon.c on smithi081 2024-04-21T22:24:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:10.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:09 smithi018 ceph-mon[26614]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/442569504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 msgr2=0x7f3a48103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/442569504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a48103220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009910 tx=0x7f3a44009c20 comp rx=0 tx=0).stop 2024-04-21T22:24:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/442569504 shutdown_connections 2024-04-21T22:24:11.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/442569504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a48103220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/442569504 >> 172.21.15.81:0/442569504 conn(0x7f3a480fc690 msgr2=0x7f3a480feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/442569504 shutdown_connections 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.850+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/442569504 wait complete. 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.851+0000 7f3a4fcb8700 1 Processor -- start 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.851+0000 7f3a4fcb8700 1 -- start start 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.852+0000 7f3a4fcb8700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:11.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.852+0000 7f3a4fcb8700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4810c310 con 0x7f3a48102e40 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.852+0000 7f3a4da54700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.852+0000 7f3a4da54700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.81:33604/0 (socket says 172.21.15.81:33604) 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.852+0000 7f3a4da54700 1 -- 172.21.15.81:0/182840066 learned_addr learned my addr 172.21.15.81:0/182840066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.853+0000 7f3a4da54700 1 -- 172.21.15.81:0/182840066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4819d960 con 0x7f3a48102e40 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.853+0000 7f3a4da54700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006010 tx=0x7f3a44005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a44026070 con 0x7f3a48102e40 2024-04-21T22:24:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4819dbf0 con 0x7f3a48102e40 2024-04-21T22:24:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a481975e0 con 0x7f3a48102e40 2024-04-21T22:24:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a4400bc30 con 0x7f3a48102e40 2024-04-21T22:24:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a44003a50 con 0x7f3a48102e40 2024-04-21T22:24:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.854+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4806a980 con 0x7f3a48102e40 2024-04-21T22:24:11.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.855+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3a44029070 con 0x7f3a48102e40 2024-04-21T22:24:11.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.855+0000 7f3a3effd700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 0x7f3a3403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:11.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.855+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3a4401e070 con 0x7f3a48102e40 2024-04-21T22:24:11.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.856+0000 7f3a4d253700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 0x7f3a3403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:11.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.857+0000 7f3a4d253700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 0x7f3a3403b610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:11.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:11.872+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3a44013070 con 0x7f3a48102e40 2024-04-21T22:24:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:11 smithi018 ceph-mon[26614]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:12.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.181+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3a48063890 con 0x7f3a48102e40 2024-04-21T22:24:12.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.182+0000 7f3a3effd700 1 -- 172.21.15.81:0/182840066 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f3a4400bde0 con 0x7f3a48102e40 2024-04-21T22:24:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:24:12.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","modified":"2024-04-21T22:22:01.886929Z","created":"2024-04-21T22:22:01.886929Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-21T22:24:12.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 msgr2=0x7f3a3403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:12.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 0x7f3a3403b610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a38006fd0 tx=0x7f3a38006e40 comp rx=0 tx=0).stop 2024-04-21T22:24:12.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 msgr2=0x7f3a4819d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:12.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006010 tx=0x7f3a44005050 comp rx=0 tx=0).stop 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 shutdown_connections 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3a34039150 0x7f3a3403b610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 --2- 172.21.15.81:0/182840066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a48102e40 0x7f3a4819d420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.184+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 >> 172.21.15.81:0/182840066 conn(0x7f3a480fc690 msgr2=0x7f3a48103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.185+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 shutdown_connections 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:12.185+0000 7f3a4fcb8700 1 -- 172.21.15.81:0/182840066 wait complete. 2024-04-21T22:24:12.186 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 1 2024-04-21T22:24:12.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:12 smithi081 systemd[1]: Starting Ceph mon.c for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:24:13.081 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:12 smithi081 podman[31673]: 2024-04-21 22:24:12.875690271 +0000 UTC m=+0.032827397 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:24:13.081 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:12 smithi081 podman[31673]: 2024-04-21 22:24:12.976517478 +0000 UTC m=+0.133654603 container create b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-21T22:24:13.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/182840066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 podman[31673]: 2024-04-21 22:24:13.170447968 +0000 UTC m=+0.327585094 container init b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 podman[31673]: 2024-04-21 22:24:13.173364319 +0000 UTC m=+0.330501448 container start b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8) 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: set uid:gid to 167:167 (ceph:ceph) 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev), process ceph-mon, pid 2 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pidfile_write: ignore empty --pid-file 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: load: jerasure load: lrc 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: RocksDB version: 7.9.2 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Git sha 0 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Compile date 2024-04-20 15:04:30 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: DB SUMMARY 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: DB Session ID: HL1O70RR0KN3356CX4ID 2024-04-21T22:24:13.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: CURRENT file: CURRENT 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: IDENTITY file: IDENTITY 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.error_if_exists: 0 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.create_if_missing: 0 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.paranoid_checks: 1 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.env: 0x55d1d4213c60 2024-04-21T22:24:13.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.fs: PosixFileSystem 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.info_log: 0x55d1d5d81aa0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_file_opening_threads: 16 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.statistics: (nil) 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.use_fsync: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_log_file_size: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.keep_log_file_num: 1000 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.recycle_log_file_num: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_fallocate: 1 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_mmap_reads: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_mmap_writes: 0 2024-04-21T22:24:13.391 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.use_direct_reads: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.create_missing_column_families: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.db_log_dir: 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.wal_dir: 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.advise_random_on_open: 1 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.db_write_buffer_size: 0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.write_buffer_manager: 0x55d1d5d541e0 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-21T22:24:13.392 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.rate_limiter: (nil) 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.wal_recovery_mode: 2 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enable_thread_tracking: 0 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enable_pipelined_write: 0 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.unordered_write: 0 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.row_cache: None 2024-04-21T22:24:13.393 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.wal_filter: None 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_ingest_behind: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.two_write_queues: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.manual_wal_flush: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.wal_compression: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.atomic_flush: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.log_readahead_size: 0 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-21T22:24:13.395 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.best_efforts_recovery: 0 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.allow_data_in_errors: 0 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.db_host_id: __hostname__ 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_background_jobs: 2 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_background_compactions: -1 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_subcompactions: 1 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_total_wal_size: 0 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-21T22:24:13.396 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_open_files: -1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bytes_per_sync: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_readahead_size: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_background_flushes: -1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Compression algorithms supported: 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kZSTD supported: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kXpressCompression supported: 0 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kLZ4HCCompression supported: 1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kZlibCompression supported: 1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kSnappyCompression supported: 1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kLZ4Compression supported: 1 2024-04-21T22:24:13.397 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: kBZip2Compression supported: 0 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.merge_operator: 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_filter: None 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_filter_factory: None 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.sst_partitioner_factory: None 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d1d5d81ba0) 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-21T22:24:13.398 INFO:journalctl@ceph.mon.c.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: index_type: 0 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: data_block_index_type: 0 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: index_shortening: 1 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: checksum: 4 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: no_block_cache: 0 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_cache: 0x55d1d5d85090 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_cache_options: 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: capacity : 536870912 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: num_shard_bits : 4 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: strict_capacity_limit : 0 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-04-21T22:24:13.399 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_cache_compressed: (nil) 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: persistent_cache: (nil) 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_size: 4096 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_size_deviation: 10 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_restart_interval: 16 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: index_block_restart_interval: 1 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: metadata_block_size: 4096 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: partition_filters: 0 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: use_delta_encoding: 1 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: filter_policy: bloomfilter 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: whole_key_filtering: 1 2024-04-21T22:24:13.400 INFO:journalctl@ceph.mon.c.smithi081.stdout: verify_compression: 0 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: format_version: 5 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: enable_index_compression: 1 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: block_align: 0 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: max_auto_readahead_size: 262144 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: prepopulate_block_cache: 0 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: initial_auto_readahead_size: 8192 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.write_buffer_size: 33554432 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_write_buffer_number: 2 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression: NoCompression 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression: Disabled 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.prefix_extractor: nullptr 2024-04-21T22:24:13.401 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.num_levels: 7 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.level: 32767 2024-04-21T22:24:13.402 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.strategy: 0 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.enabled: false 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.target_file_size_base: 67108864 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-21T22:24:13.403 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.arena_block_size: 1048576 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.disable_auto_compactions: 0 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-21T22:24:13.404 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.table_properties_collectors: 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.inplace_update_support: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.bloom_locality: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.max_successive_merges: 0 2024-04-21T22:24:13.405 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.paranoid_file_checks: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.force_consistency_checks: 1 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.report_bg_io_stats: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.ttl: 2592000 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enable_blob_files: false 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.min_blob_size: 0 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_file_size: 268435456 2024-04-21T22:24:13.406 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.blob_file_starting_level: 0 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7373661b-d873-4196-abb1-6523eb050c22 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738253202501, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738253202920, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713738253, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7373661b-d873-4196-abb1-6523eb050c22", "db_session_id": "HL1O70RR0KN3356CX4ID", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738253203000, "job": 1, "event": "recovery_finished"} 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-21T22:24:13.407 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d1d5e76000 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: DB pointer 0x55d1d5e60000 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: ** DB Stats ** 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:24:13.408 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:13.409 INFO:journalctl@ceph.mon.c.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: ** Compaction Stats [default] ** 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-21T22:24:13.410 INFO:journalctl@ceph.mon.c.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: Block cache BinnedLRUCache@0x55d1d5d85090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: using public_addr v2:172.21.15.81:0/0 -> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: starting mon.c rank -1 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(???) e0 preinit fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).mds e1 new map 2024-04-21T22:24:13.411 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: e1 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: legacy client fscid: -1 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout: No filesystems configured 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-21T22:24:13.412 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.413 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Deploying cephadm binary to smithi081 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Added host smithi081 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.415 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.416 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c;count:3 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: Deploying daemon mon.c on smithi081 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/182840066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 ceph-mon[31692]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 bash[31673]: b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf 2024-04-21T22:24:13.417 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:13 smithi081 systemd[1]: Started Ceph mon.c for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:24:13.761 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T22:24:13.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T22:24:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.414+0000 7f6303419700 1 -- 172.21.15.81:0/2080382499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 msgr2=0x7f62e8005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.414+0000 7f6303419700 1 --2- 172.21.15.81:0/2080382499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62e8005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009bf0 tx=0x7f62f8009f00 comp rx=0 tx=0).stop 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.414+0000 7f6303419700 1 -- 172.21.15.81:0/2080382499 shutdown_connections 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.414+0000 7f6303419700 1 --2- 172.21.15.81:0/2080382499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62e8005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.414+0000 7f6303419700 1 -- 172.21.15.81:0/2080382499 >> 172.21.15.81:0/2080382499 conn(0x7f62fc0fc6e0 msgr2=0x7f62fc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.415+0000 7f6303419700 1 -- 172.21.15.81:0/2080382499 shutdown_connections 2024-04-21T22:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.415+0000 7f6303419700 1 -- 172.21.15.81:0/2080382499 wait complete. 2024-04-21T22:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 Processor -- start 2024-04-21T22:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 -- start start 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62fc19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc108ca0 con 0x7f62fc100e70 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.416+0000 7f6303419700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc108b20 con 0x7f62fc19dad0 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56252/0 (socket says 172.21.15.81:56252) 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 -- 172.21.15.81:0/1910723939 learned_addr learned my addr 172.21.15.81:0/1910723939 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 -- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 msgr2=0x7f62fc197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 -- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 msgr2=0x7f62fc197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63009b4700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.417+0000 7f63011b5700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62fc19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.418+0000 7f63011b5700 1 -- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 msgr2=0x7f62fc197700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.418+0000 7f63011b5700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.418+0000 7f63011b5700 1 -- 172.21.15.81:0/1910723939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc19e050 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.418+0000 7f63011b5700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62fc19d590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007950 tx=0x7f62f8003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.418+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f62f8004c60 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.419+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc197ca0 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.419+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f8004e00 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.419+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f62f8005210 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.419+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc198230 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.420+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc102350 con 0x7f62fc100e70 2024-04-21T22:24:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.420+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f62f801e070 con 0x7f62fc100e70 2024-04-21T22:24:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.420+0000 7f62f27fc700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 0x7f62e003b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.420+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f62f801c070 con 0x7f62fc100e70 2024-04-21T22:24:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.421+0000 7f63009b4700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 0x7f62e003b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.422+0000 7f63009b4700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 0x7f62e003b300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009180 tx=0x7f62ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.436+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f62f80207c0 con 0x7f62fc100e70 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: mon.a calling monitor election 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: mon.c calling monitor election 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: monmap epoch 2 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: last_changed 2024-04-21T22:24:13.237328+0000 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: min_mon_release 19 (squid) 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: election_strategy: 1 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: fsmap 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: mgrmap e13: x(active, since 62s) 2024-04-21T22:24:18.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: overall HEALTH_OK 2024-04-21T22:24:18.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:18.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:18 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: mon.a calling monitor election 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: mon.c calling monitor election 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: monmap epoch 2 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:18.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: last_changed 2024-04-21T22:24:13.237328+0000 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: min_mon_release 19 (squid) 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: election_strategy: 1 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: fsmap 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: mgrmap e13: x(active, since 62s) 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: overall HEALTH_OK 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:18.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:18 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.719+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f62fc198b90 con 0x7f62fc100e70 2024-04-21T22:24:18.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.720+0000 7f62f27fc700 1 -- 172.21.15.81:0/1910723939 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f62f8004360 con 0x7f62fc100e70 2024-04-21T22:24:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:24:18.721 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","modified":"2024-04-21T22:24:13.237328Z","created":"2024-04-21T22:22:01.886929Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-21T22:24:18.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 msgr2=0x7f62e003b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:18.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 0x7f62e003b300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009180 tx=0x7f62ec008040 comp rx=0 tx=0).stop 2024-04-21T22:24:18.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 msgr2=0x7f62fc19d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:18.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62fc19d590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007950 tx=0x7f62f8003e00 comp rx=0 tx=0).stop 2024-04-21T22:24:18.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 shutdown_connections 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f62e0038e40 0x7f62e003b300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62fc100e70 0x7f62fc19d590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 --2- 172.21.15.81:0/1910723939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62fc19dad0 0x7f62fc197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 >> 172.21.15.81:0/1910723939 conn(0x7f62fc0fc6e0 msgr2=0x7f62fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 shutdown_connections 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:18.722+0000 7f6303419700 1 -- 172.21.15.81:0/1910723939 wait complete. 2024-04-21T22:24:18.724 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 2 2024-04-21T22:24:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: Deploying daemon mon.b on smithi047 2024-04-21T22:24:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/1910723939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: Deploying daemon mon.b on smithi047 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/1910723939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:20.297 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T22:24:20.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T22:24:20.539 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:24:21.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:21 smithi018 ceph-mon[26614]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:21 smithi081 ceph-mon[31692]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:21.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.986+0000 7f54e9ffb700 1 -- 172.21.15.81:0/3012901953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f54e4005670 con 0x7f54ec102fa0 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 -- 172.21.15.81:0/3012901953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec102fa0 msgr2=0x7f54ec103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 --2- 172.21.15.81:0/3012901953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec102fa0 0x7f54ec103380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009910 tx=0x7f54e4009c20 comp rx=0 tx=0).stop 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 -- 172.21.15.81:0/3012901953 shutdown_connections 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 --2- 172.21.15.81:0/3012901953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec102fa0 0x7f54ec103380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 -- 172.21.15.81:0/3012901953 >> 172.21.15.81:0/3012901953 conn(0x7f54ec0fc710 msgr2=0x7f54ec0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 -- 172.21.15.81:0/3012901953 shutdown_connections 2024-04-21T22:24:21.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 -- 172.21.15.81:0/3012901953 wait complete. 2024-04-21T22:24:21.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.987+0000 7f54f18fc700 1 Processor -- start 2024-04-21T22:24:21.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54f18fc700 1 -- start start 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54f18fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54f18fc700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 0x7f54ec1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54f18fc700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec10c3c0 con 0x7f54ec19dbf0 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54f18fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec10c240 con 0x7f54ec102fa0 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45138/0 (socket says 172.21.15.81:45138) 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 -- 172.21.15.81:0/869683483 learned_addr learned my addr 172.21.15.81:0/869683483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 -- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 msgr2=0x7f54ec19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 -- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 msgr2=0x7f54ec19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T22:24:21.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54eaffd700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:24:21.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.988+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 0x7f54ec1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:21.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.989+0000 7f54ea7fc700 1 -- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 msgr2=0x7f54ec19d6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:24:21.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.989+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:21.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.989+0000 7f54ea7fc700 1 -- 172.21.15.81:0/869683483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec19e230 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54ea7fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 0x7f54ec1978c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b4d0 tx=0x7f54d400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f54d4011630 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec197e00 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec198390 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54d4011cb0 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.990+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f54d401adf0 con 0x7f54ec19dbf0 2024-04-21T22:24:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.991+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc005330 con 0x7f54ec19dbf0 2024-04-21T22:24:21.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.991+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f54d4018020 con 0x7f54ec19dbf0 2024-04-21T22:24:21.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.992+0000 7f54f08fa700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 0x7f54d803b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:21.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.992+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54d404bf50 con 0x7f54ec19dbf0 2024-04-21T22:24:21.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.992+0000 7f54eaffd700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 0x7f54d803b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:21.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:21.993+0000 7f54eaffd700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 0x7f54d803b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54e400b5c0 tx=0x7f54e4009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.007+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f54d401f020 con 0x7f54ec19dbf0 2024-04-21T22:24:22.183 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 podman[31542]: 2024-04-21 22:24:21.984496662 +0000 UTC m=+0.018961736 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:24:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.282+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f54cc0058f0 con 0x7f54ec19dbf0 2024-04-21T22:24:22.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.283+0000 7f54f08fa700 1 -- 172.21.15.81:0/869683483 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f54d4010b60 con 0x7f54ec19dbf0 2024-04-21T22:24:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:24:22.284 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","modified":"2024-04-21T22:24:13.237328Z","created":"2024-04-21T22:22:01.886929Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-21T22:24:22.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 msgr2=0x7f54d803b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 0x7f54d803b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54e400b5c0 tx=0x7f54e4009650 comp rx=0 tx=0).stop 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 msgr2=0x7f54ec1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 0x7f54ec1978c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54d400b4d0 tx=0x7f54d400b890 comp rx=0 tx=0).stop 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 shutdown_connections 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f54d8038e90 0x7f54d803b350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54ec102fa0 0x7f54ec19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 --2- 172.21.15.81:0/869683483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54ec19dbf0 0x7f54ec1978c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 >> 172.21.15.81:0/869683483 conn(0x7f54ec0fc710 msgr2=0x7f54ec103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 shutdown_connections 2024-04-21T22:24:22.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:22.285+0000 7f54f18fc700 1 -- 172.21.15.81:0/869683483 wait complete. 2024-04-21T22:24:22.287 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 2 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 podman[31542]: 2024-04-21 22:24:22.278968522 +0000 UTC m=+0.313433596 container init ae1d53615a0983d00f2d83caabb6e403fe7b9b008a35ba7ab72e0f838afd22ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 podman[31542]: 2024-04-21 22:24:22.282095938 +0000 UTC m=+0.316561013 container start ae1d53615a0983d00f2d83caabb6e403fe7b9b008a35ba7ab72e0f838afd22ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: set uid:gid to 167:167 (ceph:ceph) 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: ceph version 19.0.0-2405-g820a2f8c (820a2f8ced66152ed3d765c31444b8076ea28c6b) squid (dev), process ceph-mon, pid 2 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pidfile_write: ignore empty --pid-file 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: load: jerasure load: lrc 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: RocksDB version: 7.9.2 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Git sha 0 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Compile date 2024-04-20 15:04:30 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: DB SUMMARY 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: DB Session ID: PK949S6BO8SBIEX90UHQ 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: CURRENT file: CURRENT 2024-04-21T22:24:22.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: IDENTITY file: IDENTITY 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.error_if_exists: 0 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.create_if_missing: 0 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.paranoid_checks: 1 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.env: 0x5562132a1c60 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.fs: PosixFileSystem 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.info_log: 0x5562146fdaa0 2024-04-21T22:24:22.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_file_opening_threads: 16 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.statistics: (nil) 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.use_fsync: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_log_file_size: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.keep_log_file_num: 1000 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.recycle_log_file_num: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_fallocate: 1 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_mmap_reads: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_mmap_writes: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.use_direct_reads: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-21T22:24:22.448 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.create_missing_column_families: 0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.db_log_dir: 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.wal_dir: 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.advise_random_on_open: 1 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.db_write_buffer_size: 0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.write_buffer_manager: 0x5562146d01e0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-21T22:24:22.449 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.rate_limiter: (nil) 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.wal_recovery_mode: 2 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enable_thread_tracking: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enable_pipelined_write: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.unordered_write: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.row_cache: None 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.wal_filter: None 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_ingest_behind: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.two_write_queues: 0 2024-04-21T22:24:22.450 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.manual_wal_flush: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.wal_compression: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.atomic_flush: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.log_readahead_size: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.best_efforts_recovery: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.allow_data_in_errors: 0 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.db_host_id: __hostname__ 2024-04-21T22:24:22.451 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_background_jobs: 2 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_background_compactions: -1 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_subcompactions: 1 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_total_wal_size: 0 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_open_files: -1 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bytes_per_sync: 0 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-21T22:24:22.452 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_readahead_size: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_background_flushes: -1 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Compression algorithms supported: 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kZSTD supported: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kXpressCompression supported: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kLZ4HCCompression supported: 1 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kZlibCompression supported: 1 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kSnappyCompression supported: 1 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kLZ4Compression supported: 1 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: kBZip2Compression supported: 0 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-21T22:24:22.453 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.merge_operator: 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_filter: None 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_filter_factory: None 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.sst_partitioner_factory: None 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5562146fdba0) 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: index_type: 0 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: data_block_index_type: 0 2024-04-21T22:24:22.454 INFO:journalctl@ceph.mon.b.smithi047.stdout: index_shortening: 1 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: checksum: 4 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: no_block_cache: 0 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_cache: 0x556214701090 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_cache_options: 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: capacity : 536870912 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: num_shard_bits : 4 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: strict_capacity_limit : 0 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_cache_compressed: (nil) 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: persistent_cache: (nil) 2024-04-21T22:24:22.455 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_size: 4096 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_size_deviation: 10 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_restart_interval: 16 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: index_block_restart_interval: 1 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: metadata_block_size: 4096 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: partition_filters: 0 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: use_delta_encoding: 1 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: filter_policy: bloomfilter 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: whole_key_filtering: 1 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: verify_compression: 0 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: format_version: 5 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: enable_index_compression: 1 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: block_align: 0 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: max_auto_readahead_size: 262144 2024-04-21T22:24:22.456 INFO:journalctl@ceph.mon.b.smithi047.stdout: prepopulate_block_cache: 0 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout: initial_auto_readahead_size: 8192 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.write_buffer_size: 33554432 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_write_buffer_number: 2 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression: NoCompression 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression: Disabled 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.prefix_extractor: nullptr 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.num_levels: 7 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-21T22:24:22.457 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.level: 32767 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.strategy: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-21T22:24:22.458 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.enabled: false 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.target_file_size_base: 67108864 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-21T22:24:22.459 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.arena_block_size: 1048576 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.disable_auto_compactions: 0 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-21T22:24:22.460 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.table_properties_collectors: 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.inplace_update_support: 0 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-21T22:24:22.461 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.bloom_locality: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.max_successive_merges: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.paranoid_file_checks: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.force_consistency_checks: 1 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.report_bg_io_stats: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.ttl: 2592000 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-21T22:24:22.462 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enable_blob_files: false 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.min_blob_size: 0 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_file_size: 268435456 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.blob_file_starting_level: 0 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 29372394-5a8d-45bf-a890-76b20030e856 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738262322980, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-21T22:24:22.463 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738262323463, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713738262, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "29372394-5a8d-45bf-a890-76b20030e856", "db_session_id": "PK949S6BO8SBIEX90UHQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713738262323555, "job": 1, "event": "recovery_finished"} 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5562147f2000 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: DB pointer 0x5562147dc000 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout: ** DB Stats ** 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:22.464 INFO:journalctl@ceph.mon.b.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: ** Compaction Stats [default] ** 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-21T22:24:22.465 INFO:journalctl@ceph.mon.b.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Cumulative compaction: 0.00 GB write, 0.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Interval compaction: 0.00 GB write, 0.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-21T22:24:22.466 INFO:journalctl@ceph.mon.b.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: Block cache BinnedLRUCache@0x556214701090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: using public_addr v2:172.21.15.47:0/0 -> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: starting mon.b rank -1 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(???) e0 preinit fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).mds e1 new map 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: e1 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T22:24:22.467 INFO:journalctl@ceph.mon.b.smithi047.stdout: legacy client fscid: -1 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout: 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout: No filesystems configured 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.468 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.469 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:24:22.469 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.469 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.470 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Deploying cephadm binary to smithi081 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Added host smithi081 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:24:22.471 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.472 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2776166953' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:22.473 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Saving service mon spec with placement smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c;count:3 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Deploying daemon mon.c on smithi081 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/182840066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.a calling monitor election 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.c calling monitor election 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.474 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: monmap epoch 2 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: last_changed 2024-04-21T22:24:13.237328+0000 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: min_mon_release 19 (squid) 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: election_strategy: 1 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: fsmap 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:22.475 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mgrmap e13: x(active, since 62s) 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: overall HEALTH_OK 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: Deploying daemon mon.b on smithi047 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/1910723939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 ceph-mon[31561]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 bash[31542]: ae1d53615a0983d00f2d83caabb6e403fe7b9b008a35ba7ab72e0f838afd22ba 2024-04-21T22:24:22.476 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:22 smithi047 systemd[1]: Started Ceph mon.b for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:24:22.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:22 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/869683483' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:22.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:22 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/869683483' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:23.817 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-21T22:24:23.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-21T22:24:24.055 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: mon.c calling monitor election 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: mon.a calling monitor election 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: monmap epoch 3 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: min_mon_release 19 (squid) 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: election_strategy: 1 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:27.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: fsmap 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: mgrmap e13: x(active, since 71s) 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: overall HEALTH_OK 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:27.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: mon.c calling monitor election 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: mon.a calling monitor election 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: monmap epoch 3 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: min_mon_release 19 (squid) 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: election_strategy: 1 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: fsmap 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: mgrmap e13: x(active, since 71s) 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: overall HEALTH_OK 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:27.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.457+0000 7ff011fea700 1 -- 172.21.15.81:0/375273936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c100ea0 msgr2=0x7feff4005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.457+0000 7ff011fea700 1 --2- 172.21.15.81:0/375273936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c100ea0 0x7feff4005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feffc005fa0 tx=0x7feffc00ffc0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.457+0000 7ff011fea700 1 -- 172.21.15.81:0/375273936 shutdown_connections 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.457+0000 7ff011fea700 1 --2- 172.21.15.81:0/375273936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c100ea0 0x7feff4005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.457+0000 7ff011fea700 1 -- 172.21.15.81:0/375273936 >> 172.21.15.81:0/375273936 conn(0x7ff00c0fc770 msgr2=0x7ff00c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.458+0000 7ff011fea700 1 -- 172.21.15.81:0/375273936 shutdown_connections 2024-04-21T22:24:28.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.458+0000 7ff011fea700 1 -- 172.21.15.81:0/375273936 wait complete. 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 Processor -- start 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 -- start start 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c100ea0 0x7ff00c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c19dba0 0x7ff00c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c108c80 con 0x7ff00c19dba0 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c108b00 con 0x7ff00c100ea0 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff011fea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c108e00 con 0x7ff00c197dc0 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:28.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39342/0 (socket says 172.21.15.81:39342) 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 -- 172.21.15.81:0/3365263556 learned_addr learned my addr 172.21.15.81:0/3365263556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00affd700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c19dba0 0x7ff00c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00b7fe700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c100ea0 0x7ff00c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 -- 172.21.15.81:0/3365263556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c100ea0 msgr2=0x7ff00c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c100ea0 0x7ff00c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 -- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c19dba0 msgr2=0x7ff00c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c19dba0 0x7ff00c197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.459+0000 7ff00bfff700 1 -- 172.21.15.81:0/3365263556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c1a44c0 con 0x7ff00c197dc0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff00bfff700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff00400ba50 tx=0x7ff00400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004019070 con 0x7ff00c197dc0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff004014440 con 0x7ff00c197dc0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c1a4750 con 0x7ff00c197dc0 2024-04-21T22:24:28.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0040075b0 con 0x7ff00c197dc0 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.460+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c1a4c60 con 0x7ff00c197dc0 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.461+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff00401c070 con 0x7ff00c197dc0 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.461+0000 7ff008ff9700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 0x7feff803ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.461+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff00404c7d0 con 0x7ff00c197dc0 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.461+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c102380 con 0x7ff00c197dc0 2024-04-21T22:24:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.461+0000 7ff00b7fe700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 0x7feff803ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:28.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.462+0000 7ff00b7fe700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 0x7feff803ba40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feffc00fcb0 tx=0x7feffc005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.466+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff00400e0a0 con 0x7ff00c197dc0 2024-04-21T22:24:28.703 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:28.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:28.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:28.704 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.754+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff00c02db30 con 0x7ff00c197dc0 2024-04-21T22:24:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.755+0000 7ff008ff9700 1 -- 172.21.15.81:0/3365263556 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7ff004012500 con 0x7ff00c197dc0 2024-04-21T22:24:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-04-21T22:24:28.755 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","modified":"2024-04-21T22:24:22.348436Z","created":"2024-04-21T22:22:01.886929Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-21T22:24:28.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 msgr2=0x7feff803ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 0x7feff803ba40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feffc00fcb0 tx=0x7feffc005900 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 msgr2=0x7ff00c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff00400ba50 tx=0x7ff00400bd60 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 shutdown_connections 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c197dc0 0x7ff00c198270 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7feff8039580 0x7feff803ba40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff00c100ea0 0x7ff00c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 --2- 172.21.15.81:0/3365263556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff00c19dba0 0x7ff00c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 >> 172.21.15.81:0/3365263556 conn(0x7ff00c0fc770 msgr2=0x7ff00c18eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 shutdown_connections 2024-04-21T22:24:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:28.757+0000 7ff011fea700 1 -- 172.21.15.81:0/3365263556 wait complete. 2024-04-21T22:24:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 3 2024-04-21T22:24:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/869683483' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: mon.c calling monitor election 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: mon.a calling monitor election 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: monmap epoch 3 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: min_mon_release 19 (squid) 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: election_strategy: 1 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:29.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: fsmap 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: mgrmap e13: x(active, since 71s) 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: overall HEALTH_OK 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:29.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:29.936 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-21T22:24:29.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-21T22:24:30.378 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:24:30.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mon.b calling monitor election 2024-04-21T22:24:30.522 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mon.b calling monitor election 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mon.c calling monitor election 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mon.a calling monitor election 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: monmap epoch 3 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: min_mon_release 19 (squid) 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: election_strategy: 1 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:30.523 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: fsmap 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: mgrmap e13: x(active, since 73s) 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: overall HEALTH_OK 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.524 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mon.b calling monitor election 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mon.b calling monitor election 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mon.c calling monitor election 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mon.a calling monitor election 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: monmap epoch 3 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: min_mon_release 19 (squid) 2024-04-21T22:24:30.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: election_strategy: 1 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: fsmap 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: mgrmap e13: x(active, since 73s) 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: overall HEALTH_OK 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mon.b calling monitor election 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mon.b calling monitor election 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mon.c calling monitor election 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mon.a calling monitor election 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: monmap epoch 3 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:30.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: last_changed 2024-04-21T22:24:22.348436+0000 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: created 2024-04-21T22:22:01.886929+0000 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: min_mon_release 19 (squid) 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: election_strategy: 1 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: 0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: 1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.c 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: 2: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: fsmap 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: osdmap e4: 0 total, 0 up, 0 in 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: mgrmap e13: x(active, since 73s) 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: overall HEALTH_OK 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:30.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:31.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:31.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:31.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:32.499 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:32 smithi018 ceph-mon[26614]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T22:24:32.499 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:32 smithi018 ceph-mon[26614]: Reconfiguring daemon mon.a on smithi018 2024-04-21T22:24:32.524 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:32 smithi047 ceph-mon[31561]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T22:24:32.524 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:32 smithi047 ceph-mon[31561]: Reconfiguring daemon mon.a on smithi018 2024-04-21T22:24:32.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:32 smithi081 ceph-mon[31692]: Reconfiguring mon.a (unknown last config time)... 2024-04-21T22:24:32.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:32 smithi081 ceph-mon[31692]: Reconfiguring daemon mon.a on smithi018 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 -- 172.21.15.18:0/2638771362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 msgr2=0x7f0934069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 --2- 172.21.15.18:0/2638771362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f0934069650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f092800b0a0 tx=0x7f092800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 -- 172.21.15.18:0/2638771362 shutdown_connections 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 --2- 172.21.15.18:0/2638771362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f0934069650 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 -- 172.21.15.18:0/2638771362 >> 172.21.15.18:0/2638771362 conn(0x7f0934076690 msgr2=0x7f0934076aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 -- 172.21.15.18:0/2638771362 shutdown_connections 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.771+0000 7f093c000700 1 -- 172.21.15.18:0/2638771362 wait complete. 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.772+0000 7f093c000700 1 Processor -- start 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.772+0000 7f093c000700 1 -- start start 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 0x7f09341a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09341a2e50 0x7f09341a3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0934112870 con 0x7f0934106b70 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09341126f0 con 0x7f09341a2e50 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093c000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09341129f0 con 0x7f093419e580 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f0939600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f0939600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48502/0 (socket says 172.21.15.18:48502) 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f0939600700 1 -- 172.21.15.18:0/2492402529 learned_addr learned my addr 172.21.15.18:0/2492402529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f0938c00700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 0x7f09341a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.773+0000 7f093a000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09341a2e50 0x7f09341a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 -- 172.21.15.18:0/2492402529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09341a2e50 msgr2=0x7f09341a3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09341a2e50 0x7f09341a3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 -- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 msgr2=0x7f093419e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 -- 172.21.15.18:0/2492402529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09341aabc0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0939600700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.774+0000 7f0938c00700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 0x7f09341a2910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f092000b550 tx=0x7f092000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.775+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920004230 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.775+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09341aadf0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.775+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09200043d0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.775+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920011ad0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.775+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09341ab2a0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.776+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0920011cd0 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.776+0000 7f0932000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 0x7f091c03ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.776+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f092004bd10 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.776+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0934063890 con 0x7f093419e580 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.777+0000 7f0939600700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 0x7f091c03ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.777+0000 7f0939600700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 0x7f091c03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e60 tx=0x7f0928005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:32.782+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0920018750 con 0x7f093419e580 2024-04-21T22:24:33.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.049+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f09341ab560 con 0x7f093419e580 2024-04-21T22:24:33.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.050+0000 7f0932000700 1 -- 172.21.15.18:0/2492402529 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f09200193a0 con 0x7f093419e580 2024-04-21T22:24:33.050 INFO:teuthology.orchestra.run.smithi018.stdout:# minimal ceph.conf for 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:33.050 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-21T22:24:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:24:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: mon_host = [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] 2024-04-21T22:24:33.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.053+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 msgr2=0x7f091c03ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.053+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 0x7f091c03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e60 tx=0x7f0928005040 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.053+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 msgr2=0x7f09341a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.053+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 0x7f09341a2910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f092000b550 tx=0x7f092000b860 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 shutdown_connections 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f091c039580 0x7f091c03ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09341a2e50 0x7f09341a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0934106b70 0x7f093419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 --2- 172.21.15.18:0/2492402529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093419e580 0x7f09341a2910 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 >> 172.21.15.18:0/2492402529 conn(0x7f0934076690 msgr2=0x7f0934101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 shutdown_connections 2024-04-21T22:24:33.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:33.054+0000 7f093c000700 1 -- 172.21.15.18:0/2492402529 wait complete. 2024-04-21T22:24:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:33 smithi018 ceph-mon[26614]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:33 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2492402529' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:33 smithi081 ceph-mon[31692]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:33 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2492402529' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:33 smithi047 ceph-mon[31561]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:33 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2492402529' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:34.293 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-21T22:24:34.293 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:24:34.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T22:24:34.388 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:24:34.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:34.520 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:24:34.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T22:24:34.546 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:24:34.547 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:34.612 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:24:34.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-04-21T22:24:34.643 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:24:34.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:24:34.711 INFO:tasks.cephadm:Adding mgr.x on smithi018 2024-04-21T22:24:34.711 INFO:tasks.cephadm:Adding mgr.y on smithi047 2024-04-21T22:24:34.711 INFO:tasks.cephadm:Adding mgr.z on smithi081 2024-04-21T22:24:34.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi018=x;smithi047=y;smithi081=z' 2024-04-21T22:24:34.985 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:24:35.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: Reconfiguring mon.b (monmap changed)... 2024-04-21T22:24:35.058 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:35.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:35.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:35.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:35.059 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:34 smithi047 ceph-mon[31561]: Reconfiguring daemon mon.b on smithi047 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: Reconfiguring mon.b (monmap changed)... 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:35.202 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:34 smithi081 ceph-mon[31692]: Reconfiguring daemon mon.b on smithi047 2024-04-21T22:24:35.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:35.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: Reconfiguring mon.b (monmap changed)... 2024-04-21T22:24:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:34 smithi018 ceph-mon[26614]: Reconfiguring daemon mon.b on smithi047 2024-04-21T22:24:36.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: Reconfiguring mon.c (monmap changed)... 2024-04-21T22:24:36.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:36.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:36.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:36.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:36 smithi081 ceph-mon[31692]: Reconfiguring daemon mon.c on smithi081 2024-04-21T22:24:36.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: Reconfiguring mon.c (monmap changed)... 2024-04-21T22:24:36.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:36.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:36.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:36.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:36 smithi047 ceph-mon[31561]: Reconfiguring daemon mon.c on smithi081 2024-04-21T22:24:36.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:36.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: Reconfiguring mon.c (monmap changed)... 2024-04-21T22:24:36.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-21T22:24:36.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-21T22:24:36.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:36.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:36 smithi018 ceph-mon[26614]: Reconfiguring daemon mon.c on smithi081 2024-04-21T22:24:37.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 -- 172.21.15.81:0/2558318696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 msgr2=0x7f7a9c100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:37.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/2558318696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c100480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009910 tx=0x7f7a8c009c20 comp rx=0 tx=0).stop 2024-04-21T22:24:37.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 -- 172.21.15.81:0/2558318696 shutdown_connections 2024-04-21T22:24:37.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/2558318696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c100480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 -- 172.21.15.81:0/2558318696 >> 172.21.15.81:0/2558318696 conn(0x7f7a9c0fb9a0 msgr2=0x7f7a9c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 -- 172.21.15.81:0/2558318696 shutdown_connections 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.081+0000 7f7aa0af1700 1 -- 172.21.15.81:0/2558318696 wait complete. 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 Processor -- start 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 -- start start 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 0x7f7a9c19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c107de0 con 0x7f7a9c100060 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c107c60 con 0x7f7a9c197ff0 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.082+0000 7f7aa0af1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c107f60 con 0x7f7a9c197b70 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39356/0 (socket says 172.21.15.81:39356) 2024-04-21T22:24:37.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 -- 172.21.15.81:0/27066974 learned_addr learned my addr 172.21.15.81:0/27066974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a9ad9d700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 0x7f7a9c19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a9a59c700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 -- 172.21.15.81:0/27066974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 msgr2=0x7f7a9c19f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 0x7f7a9c19f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 -- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 msgr2=0x7f7a9c197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 -- 172.21.15.81:0/27066974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c19fa40 con 0x7f7a9c197b70 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a9ad9d700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 0x7f7a9c19f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a99d9b700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b780 tx=0x7f7a9000bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90004230 con 0x7f7a9c197b70 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a900043d0 con 0x7f7a9c197b70 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90011c60 con 0x7f7a9c197b70 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c19fd30 con 0x7f7a9c197b70 2024-04-21T22:24:37.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.083+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c1a0290 con 0x7f7a9c197b70 2024-04-21T22:24:37.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.084+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7a9001a400 con 0x7f7a9c197b70 2024-04-21T22:24:37.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.084+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c063890 con 0x7f7a9c197b70 2024-04-21T22:24:37.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.084+0000 7f7a8b7fe700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 0x7f7a8403ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:37.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.084+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7a9004bfc0 con 0x7f7a9c197b70 2024-04-21T22:24:37.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.085+0000 7f7a9a59c700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 0x7f7a8403ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:37.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.086+0000 7f7a9a59c700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 0x7f7a8403ba40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009750 tx=0x7f7a8c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.089+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7a9001a840 con 0x7f7a9c197b70 2024-04-21T22:24:37.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.304+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi047=y;smithi081=z", "target": ["mon-mgr", ""]}) -- 0x7f7a9c062700 con 0x7f7a84039580 2024-04-21T22:24:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.317+0000 7f7a8b7fe700 1 -- 172.21.15.81:0/27066974 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7a9c062700 con 0x7f7a84039580 2024-04-21T22:24:37.317 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mgr update... 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 msgr2=0x7f7a8403ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 0x7f7a8403ba40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009750 tx=0x7f7a8c005fb0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 msgr2=0x7f7a9c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000b780 tx=0x7f7a9000bb40 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 shutdown_connections 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a84039580 0x7f7a8403ba40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a9c197ff0 0x7f7a9c19f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a9c100060 0x7f7a9c197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 --2- 172.21.15.81:0/27066974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a9c197b70 0x7f7a9c19cbe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 >> 172.21.15.81:0/27066974 conn(0x7f7a9c0fb9a0 msgr2=0x7f7a9c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 shutdown_connections 2024-04-21T22:24:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:24:37.320+0000 7f7aa0af1700 1 -- 172.21.15.81:0/27066974 wait complete. 2024-04-21T22:24:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:37 smithi081 ceph-mon[31692]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:37 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:37 smithi047 ceph-mon[31561]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:37 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:37 smithi018 ceph-mon[26614]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.067 DEBUG:teuthology.orchestra.run.smithi047:mgr.y> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y.service 2024-04-21T22:24:38.071 DEBUG:teuthology.orchestra.run.smithi081:mgr.z> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.z.service 2024-04-21T22:24:38.073 INFO:tasks.cephadm:Deploying OSDs... 2024-04-21T22:24:38.073 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:24:38.073 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T22:24:38.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T22:24:38.137 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-04-21T22:24:38.192 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-21 22:23:33.036685868 +0000 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-21 22:18:35.617265689 +0000 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-21 22:18:35.617265689 +0000 2024-04-21T22:24:38.193 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-21 22:18:35.617265689 +0000 2024-04-21T22:24:38.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T22:24:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-21T22:24:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-21T22:24:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000262602 s, 1.9 MB/s 2024-04-21T22:24:38.275 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T22:24:38.334 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-21 22:23:33.125684863 +0000 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-21 22:18:36.224258852 +0000 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-21 22:18:36.224258852 +0000 2024-04-21T22:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-21 22:18:36.224258852 +0000 2024-04-21T22:24:38.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T22:24:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-21T22:24:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-21T22:24:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000285313 s, 1.8 MB/s 2024-04-21T22:24:38.472 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T22:24:38.533 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-21 22:23:33.192684106 +0000 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-21 22:18:36.825252083 +0000 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-21 22:18:36.825252083 +0000 2024-04-21T22:24:38.586 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-21 22:18:36.825252083 +0000 2024-04-21T22:24:38.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi047=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: Saving service mgr spec with placement smithi018=x;smithi047=y;smithi081=z;count:3 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:38.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:38 smithi081 ceph-mon[31692]: Deploying daemon mgr.z on smithi081 2024-04-21T22:24:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-21T22:24:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-21T22:24:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000286119 s, 1.8 MB/s 2024-04-21T22:24:38.664 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T22:24:38.718 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-04-21T22:24:38.770 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T22:24:38.770 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-21 22:23:33.255683394 +0000 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-21 22:18:37.429245280 +0000 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-21 22:18:37.429245280 +0000 2024-04-21T22:24:38.771 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-21 22:18:37.429245280 +0000 2024-04-21T22:24:38.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T22:24:38.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi047=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: Saving service mgr spec with placement smithi018=x;smithi047=y;smithi081=z;count:3 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:38 smithi018 ceph-mon[26614]: Deploying daemon mgr.z on smithi081 2024-04-21T22:24:38.855 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-21T22:24:38.855 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-21T22:24:38.855 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000256698 s, 2.0 MB/s 2024-04-21T22:24:38.860 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T22:24:38.918 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-21T22:24:38.919 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T22:24:38.938 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T22:24:38.938 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-21T22:24:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi018=x;smithi047=y;smithi081=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: Saving service mgr spec with placement smithi018=x;smithi047=y;smithi081=z;count:3 2024-04-21T22:24:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:38.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:38 smithi047 ceph-mon[31561]: Deploying daemon mgr.z on smithi081 2024-04-21T22:24:38.962 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T22:24:38.962 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:38.962 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-21T22:24:38.962 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:38.963 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:38.963 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-21 22:24:21.764994482 +0000 2024-04-21T22:24:38.963 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-21 22:17:24.254336639 +0000 2024-04-21T22:24:38.963 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-21 22:17:24.254336639 +0000 2024-04-21T22:24:38.963 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-21 22:17:24.254336639 +0000 2024-04-21T22:24:38.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T22:24:39.030 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-21T22:24:39.030 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-21T22:24:39.031 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00013018 s, 3.9 MB/s 2024-04-21T22:24:39.032 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T22:24:39.091 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:39.149 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-21 22:24:21.765994462 +0000 2024-04-21T22:24:39.150 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-21 22:17:24.586329614 +0000 2024-04-21T22:24:39.150 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-21 22:17:24.586329614 +0000 2024-04-21T22:24:39.150 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-21 22:17:24.586329614 +0000 2024-04-21T22:24:39.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T22:24:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-21T22:24:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-21T22:24:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000112286 s, 4.6 MB/s 2024-04-21T22:24:39.217 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T22:24:39.276 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-21 22:24:21.765994462 +0000 2024-04-21T22:24:39.334 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-21 22:17:24.914322673 +0000 2024-04-21T22:24:39.335 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-21 22:17:24.914322673 +0000 2024-04-21T22:24:39.335 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-21 22:17:24.914322673 +0000 2024-04-21T22:24:39.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T22:24:39.400 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-21T22:24:39.401 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-21T22:24:39.401 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000101671 s, 5.0 MB/s 2024-04-21T22:24:39.402 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T22:24:39.460 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-21T22:24:39.517 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-21 22:24:21.765994462 +0000 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-21 22:17:25.262315308 +0000 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-21 22:17:25.262315308 +0000 2024-04-21T22:24:39.518 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-21 22:17:25.262315308 +0000 2024-04-21T22:24:39.518 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T22:24:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-21T22:24:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-21T22:24:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111112 s, 4.6 MB/s 2024-04-21T22:24:39.583 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T22:24:39.592 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 systemd[1]: Starting Ceph mgr.z for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:24:39.641 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-04-21T22:24:39.641 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T22:24:39.657 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T22:24:39.657 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-04-21T22:24:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:39 smithi047 ceph-mon[31561]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:39.711 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T22:24:39.711 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-21 22:24:39.369407754 +0000 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-21 22:17:36.134649218 +0000 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-21 22:17:36.134649218 +0000 2024-04-21T22:24:39.712 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-21 22:17:36.134649218 +0000 2024-04-21T22:24:39.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T22:24:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-21T22:24:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-21T22:24:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000207227 s, 2.5 MB/s 2024-04-21T22:24:39.784 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T22:24:39.840 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-04-21T22:24:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:39 smithi018 ceph-mon[26614]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:39.853 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:39 smithi081 ceph-mon[31692]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:39.854 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 podman[33469]: 2024-04-21 22:24:39.627133378 +0000 UTC m=+0.099934155 container create 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-21T22:24:39.854 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 podman[33469]: 2024-04-21 22:24:39.545113298 +0000 UTC m=+0.017914088 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:24:39.854 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 podman[33469]: 2024-04-21 22:24:39.854772144 +0000 UTC m=+0.327572936 container init 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=) 2024-04-21T22:24:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T22:24:39.868 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:39.868 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-21 22:24:39.369407754 +0000 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-21 22:17:36.474642780 +0000 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-21 22:17:36.474642780 +0000 2024-04-21T22:24:39.869 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-21 22:17:36.474642780 +0000 2024-04-21T22:24:39.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T22:24:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-21T22:24:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-21T22:24:39.931 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00018853 s, 2.7 MB/s 2024-04-21T22:24:39.932 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T22:24:39.988 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-21 22:24:39.370407735 +0000 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-21 22:17:36.821636210 +0000 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-21 22:17:36.821636210 +0000 2024-04-21T22:24:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-21 22:17:36.821636210 +0000 2024-04-21T22:24:40.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T22:24:40.105 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 podman[33469]: 2024-04-21 22:24:39.857868769 +0000 UTC m=+0.330669549 container start 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-21T22:24:40.105 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 ceph-mgr[33559]: -- 172.21.15.81:0/3762671437 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c6ceac5a0 con 0x558c6ce80c00 2024-04-21T22:24:40.105 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 bash[33469]: 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 2024-04-21T22:24:40.105 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:39 smithi081 systemd[1]: Started Ceph mgr.z for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:24:40.105 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:40.019+0000 7fc9f2fcc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:24:40.106 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-21T22:24:40.106 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-21T22:24:40.106 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000230838 s, 2.2 MB/s 2024-04-21T22:24:40.107 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T22:24:40.163 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-04-21 22:24:39.370407735 +0000 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-04-21 22:17:37.150629981 +0000 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-04-21 22:17:37.150629981 +0000 2024-04-21T22:24:40.217 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-04-21 22:17:37.150629981 +0000 2024-04-21T22:24:40.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T22:24:40.279 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-04-21T22:24:40.279 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-04-21T22:24:40.280 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000199679 s, 2.6 MB/s 2024-04-21T22:24:40.282 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T22:24:40.337 INFO:tasks.cephadm:Deploying osd.0 on smithi018 with /dev/vg_nvme/lv_4... 2024-04-21T22:24:40.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T22:24:40.388 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:40.209+0000 7fc9f2fcc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:24:40.388 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:40.314+0000 7fc9f2fcc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:24:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:24:40.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:40.621+0000 7fc9f2fcc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:24:40.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:40.703+0000 7fc9f2fcc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:41.268 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:41.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:41.269 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:41 smithi018 ceph-mon[26614]: Deploying daemon mgr.y on smithi047 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:41.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:41.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:41.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-mon[31692]: Deploying daemon mgr.y on smithi047 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:41.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:41.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:41 smithi047 ceph-mon[31561]: Deploying daemon mgr.y on smithi047 2024-04-21T22:24:42.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:41.874+0000 7fc9f2fcc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:24:42.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.039+0000 7fc9f2fcc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:24:42.387 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 systemd[1]: Starting Ceph mgr.y for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:24:42.387 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 podman[32935]: 2024-04-21 22:24:42.290627857 +0000 UTC m=+0.018034623 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:24:42.489 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.207+0000 7fc9f2fcc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:24:42.489 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.489+0000 7fc9f2fcc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:24:42.694 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 podman[32935]: 2024-04-21 22:24:42.417207012 +0000 UTC m=+0.144613762 container create d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-21T22:24:42.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 podman[32935]: 2024-04-21 22:24:42.602887265 +0000 UTC m=+0.330294016 container init d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-21T22:24:42.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 podman[32935]: 2024-04-21 22:24:42.605387864 +0000 UTC m=+0.332794623 container start d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:24:42.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 ceph-mgr[32955]: -- 172.21.15.47:0/4250397253 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55656a0625a0 con 0x55656a037000 2024-04-21T22:24:42.779 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.580+0000 7fc9f2fcc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:24:42.780 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.780+0000 7fc9f2fcc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:24:43.039 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:42.757+0000 7face2371200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:24:43.039 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 bash[32935]: d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 2024-04-21T22:24:43.039 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 systemd[1]: Started Ceph mgr.y for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:24:43.039 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:42.953+0000 7face2371200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:24:43.039 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:42.969+0000 7fc9f2fcc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:24:43.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:43 smithi018 ceph-mon[26614]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:43.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-mon[31692]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:43.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.396 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:43.061+0000 7face2371200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:43.396+0000 7face2371200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-mon[31561]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.397 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0360642 s, 291 MB/s 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 2024-04-21T22:24:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-04-21T22:24:43.694 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:43.486+0000 7face2371200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:24:43.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:43.577+0000 7fc9f2fcc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:24:44.326 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:44.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:44.022+0000 7fc9f2fcc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:24:44.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:44.123+0000 7fc9f2fcc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:24:44.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:44.326+0000 7fc9f2fcc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:24:44.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:44.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:44.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-04-21T22:24:44.991 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:24:45.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:44.855+0000 7fc9f2fcc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:24:45.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:44.946+0000 7fc9f2fcc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:24:45.141 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:44.787+0000 7face2371200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:24:45.141 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:44.964+0000 7face2371200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:24:45.141 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:45.141+0000 7face2371200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:24:45.527 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:45.187+0000 7fc9f2fcc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:24:45.528 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:45.320+0000 7fc9f2fcc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:24:45.528 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:45.413+0000 7fc9f2fcc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:24:45.528 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:45.527+0000 7fc9f2fcc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:24:45.694 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:45.443+0000 7face2371200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:24:45.694 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:45.539+0000 7face2371200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:45.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:45.619+0000 7fc9f2fcc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-21T22:24:45.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:46.194 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:45.750+0000 7face2371200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:24:46.194 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:45.954+0000 7face2371200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:24:46.709 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:46 smithi018 ceph-mon[26614]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T22:24:46.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:46 smithi018 ceph-mon[26614]: Reconfiguring daemon mgr.x on smithi018 2024-04-21T22:24:46.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:46 smithi081 ceph-mon[31692]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T22:24:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:46 smithi081 ceph-mon[31692]: Reconfiguring daemon mgr.x on smithi018 2024-04-21T22:24:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:46.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:46.450+0000 7fc9f2fcc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:24:46.888 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:24:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:24:46.664+0000 7fc9f2fcc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:24:46.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:46.585+0000 7face2371200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:24:46.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:46 smithi047 ceph-mon[31561]: Reconfiguring mgr.x (unknown last config time)... 2024-04-21T22:24:46.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:46 smithi047 ceph-mon[31561]: Reconfiguring daemon mgr.x on smithi018 2024-04-21T22:24:46.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:47.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 -- 172.21.15.18:0/1779662161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 msgr2=0x7ffbc010a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:47.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1779662161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc010a320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b0a0 tx=0x7ffbb800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 -- 172.21.15.18:0/1779662161 shutdown_connections 2024-04-21T22:24:47.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1779662161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc010a320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1779662161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0102c50 0x7ffbc0105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1779662161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0105580 0x7ffbc0107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 -- 172.21.15.18:0/1779662161 >> 172.21.15.18:0/1779662161 conn(0x7ffbc00fc660 msgr2=0x7ffbc00feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:24:47.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 -- 172.21.15.18:0/1779662161 shutdown_connections 2024-04-21T22:24:47.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.027+0000 7ffbc5400700 1 -- 172.21.15.18:0/1779662161 wait complete. 2024-04-21T22:24:47.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.028+0000 7ffbc5400700 1 Processor -- start 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 -- start start 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 0x7ffbc019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc01a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010de20 con 0x7ffbc0105580 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010dca0 con 0x7ffbc0102c50 2024-04-21T22:24:47.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc5400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc010dfa0 con 0x7ffbc0107eb0 2024-04-21T22:24:47.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbbfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:47.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbbfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:46982/0 (socket says 172.21.15.18:46982) 2024-04-21T22:24:47.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbbfe00700 1 -- 172.21.15.18:0/1584509879 learned_addr learned my addr 172.21.15.18:0/1584509879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:24:47.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbc4a00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc01a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:47.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.029+0000 7ffbbf400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 0x7ffbc019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 -- 172.21.15.18:0/1584509879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 msgr2=0x7ffbc019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 -- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 msgr2=0x7ffbc019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 0x7ffbc019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 -- 172.21.15.18:0/1584509879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a2220 con 0x7ffbc0107eb0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbbf400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 0x7ffbc019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbbfe00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc4a00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc01a1b80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fa0 tx=0x7ffbb8004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8021070 con 0x7ffbc0107eb0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb8007b80 con 0x7ffbc0107eb0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004810 con 0x7ffbc0107eb0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a24b0 con 0x7ffbc0107eb0 2024-04-21T22:24:47.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.030+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a29b0 con 0x7ffbc0107eb0 2024-04-21T22:24:47.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.032+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0068f20 con 0x7ffbc0107eb0 2024-04-21T22:24:47.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.032+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ffbb8003a00 con 0x7ffbc0107eb0 2024-04-21T22:24:47.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.032+0000 7ffbbcc00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 0x7ffba403b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:24:47.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.032+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffbb800f020 con 0x7ffbc0107eb0 2024-04-21T22:24:47.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.032+0000 7ffbbfe00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 0x7ffba403b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:24:47.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.033+0000 7ffbbfe00700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 0x7ffba403b7f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0011550 tx=0x7ffbb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:24:47.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.037+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ffbb802a020 con 0x7ffbc0107eb0 2024-04-21T22:24:47.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.285+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffbc0062670 con 0x7ffba4039330 2024-04-21T22:24:47.335 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:47.025+0000 7face2371200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:24:47.335 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:47.126+0000 7face2371200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:24:47.335 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:47.335+0000 7face2371200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:24:47.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:47.574+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7ffbb8005040 con 0x7ffbc0107eb0 2024-04-21T22:24:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: Standby manager daemon z started 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:24:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: Standby manager daemon z started 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:24:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:24:47.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:47 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: Standby manager daemon z started 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/861505600' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:24:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:24:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:47 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:48.194 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:47.883+0000 7face2371200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:24:48.194 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:47.981+0000 7face2371200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:24:48.574 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:48.245+0000 7face2371200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:24:48.575 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:48.389+0000 7face2371200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:24:48.575 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:48.492+0000 7face2371200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:24:48.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: mgrmap e14: x(active, since 91s), standbys: z 2024-04-21T22:24:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:24:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: mgrmap e14: x(active, since 91s), standbys: z 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:48.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:48.616+0000 7face2371200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:24:48.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:48.712+0000 7face2371200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:24:48.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:24:48.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: mgrmap e14: x(active, since 91s), standbys: z 2024-04-21T22:24:48.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:24:48.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:48.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:24:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:49 smithi018 ceph-mon[26614]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:49 smithi081 ceph-mon[31692]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:49.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-mon[31561]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:49.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:24:49.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:24:49.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:24:49.945 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:49.562+0000 7face2371200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:24:49.945 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:24:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:24:49.785+0000 7face2371200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:24:50.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:24:50.597+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mon.1 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ffbb801acc0 con 0x7ffbc0107eb0 2024-04-21T22:24:50.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:50 smithi018 ceph-mon[26614]: Standby manager daemon y started 2024-04-21T22:24:50.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:50 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:24:50.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:50 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:50.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:50 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:24:50.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:50 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:50 smithi081 ceph-mon[31692]: Standby manager daemon y started 2024-04-21T22:24:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:50 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:24:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:50 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:50 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:24:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:50 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:50.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:50 smithi047 ceph-mon[31561]: Standby manager daemon y started 2024-04-21T22:24:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:50 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:24:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:50 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:24:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:50 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:24:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:50 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/3694238828' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:24:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: mgrmap e15: x(active, since 94s), standbys: z, y 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]: dispatch 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]': finished 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T22:24:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: mgrmap e15: x(active, since 94s), standbys: z, y 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]: dispatch 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]': finished 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T22:24:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:51 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:24:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: mgrmap e15: x(active, since 94s), standbys: z, y 2024-04-21T22:24:51.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:24:51.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]: dispatch 2024-04-21T22:24:51.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2473950583' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc"}]': finished 2024-04-21T22:24:51.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: osdmap e5: 1 total, 0 up, 1 in 2024-04-21T22:24:51.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:51 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:24:52.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:52 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/15816822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:24:52.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:52 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/15816822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:24:53.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:52 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/15816822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:24:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:53 smithi081 ceph-mon[31692]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:53.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:53 smithi047 ceph-mon[31561]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:53 smithi018 ceph-mon[26614]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:55.827 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:55 smithi018 ceph-mon[26614]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:55 smithi081 ceph-mon[31692]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:55.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:55 smithi047 ceph-mon[31561]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:57 smithi018 ceph-mon[26614]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:57 smithi081 ceph-mon[31692]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:57.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:57 smithi047 ceph-mon[31561]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:59.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:24:59 smithi018 ceph-mon[26614]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:59.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:24:59 smithi081 ceph-mon[31692]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:24:59.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:24:59 smithi047 ceph-mon[31561]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:00.882 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T22:25:00.882 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:00.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T22:25:00.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-21T22:25:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:01.722 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:01 smithi018 ceph-mon[26614]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:01.723 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:01 smithi018 ceph-mon[26614]: Deploying daemon osd.0 on smithi018 2024-04-21T22:25:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:01 smithi081 ceph-mon[31692]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:01 smithi081 ceph-mon[31692]: Deploying daemon osd.0 on smithi018 2024-04-21T22:25:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:01 smithi047 ceph-mon[31561]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:01 smithi047 ceph-mon[31561]: Deploying daemon osd.0 on smithi018 2024-04-21T22:25:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:03 smithi081 ceph-mon[31692]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:03.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:03 smithi047 ceph-mon[31561]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:03.968 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:03 smithi018 ceph-mon[26614]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:05.836 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:05 smithi018 ceph-mon[26614]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:05.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:05 smithi047 ceph-mon[31561]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:05 smithi081 ceph-mon[31692]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:07 smithi018 ceph-mon[26614]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:07.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:07 smithi047 ceph-mon[31561]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:07 smithi081 ceph-mon[31692]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:09.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:09 smithi018 ceph-mon[26614]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:09.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:09.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:09.916 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:09 smithi047 ceph-mon[31561]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:09 smithi081 ceph-mon[31692]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:11 smithi047 ceph-mon[31561]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:12.011 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:11 smithi018 ceph-mon[26614]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:11 smithi081 ceph-mon[31692]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:13 smithi018 ceph-mon[26614]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:13 smithi081 ceph-mon[31692]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:13.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:13 smithi047 ceph-mon[31561]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-21T22:25:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.707+0000 7ffbbcc00700 1 -- 172.21.15.18:0/1584509879 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffbc0062670 con 0x7ffba4039330 2024-04-21T22:25:13.708 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 0 on host 'smithi018' 2024-04-21T22:25:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 msgr2=0x7ffba403b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 0x7ffba403b7f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0011550 tx=0x7ffbb0009260 comp rx=0 tx=0).stop 2024-04-21T22:25:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 msgr2=0x7ffbc01a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:13.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc01a1b80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fa0 tx=0x7ffbb8004c80 comp rx=0 tx=0).stop 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 shutdown_connections 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbc0107eb0 0x7ffbc01a1b80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffba4039330 0x7ffba403b7f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbc0102c50 0x7ffbc019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 --2- 172.21.15.18:0/1584509879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbc0105580 0x7ffbc019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 >> 172.21.15.18:0/1584509879 conn(0x7ffbc00fc660 msgr2=0x7ffbc0102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.711+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 shutdown_connections 2024-04-21T22:25:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:25:13.712+0000 7ffbc5400700 1 -- 172.21.15.18:0/1584509879 wait complete. 2024-04-21T22:25:14.502 DEBUG:teuthology.orchestra.run.smithi018:osd.0> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.0.service 2024-04-21T22:25:14.507 INFO:tasks.cephadm:Deploying osd.1 on smithi047 with /dev/vg_nvme/lv_4... 2024-04-21T22:25:14.508 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T22:25:14.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T22:25:14.749 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:14.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:14.750 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0[41324]: 2024-04-21T22:25:14.679+0000 7fcf67600700 -1 osd.0 0 waiting for initial osdmap 2024-04-21T22:25:14.750 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:25:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0[41324]: 2024-04-21T22:25:14.683+0000 7fcf62e00700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:25:14.760 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:25:14.880 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T22:25:14.880 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:14.881 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:14 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-21T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: osdmap e6: 1 total, 0 up, 1 in 2024-04-21T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:15.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:25:15.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:15.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:15.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:14 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:15 smithi047 ceph-mon[31561]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:15 smithi047 ceph-mon[31561]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:25:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:15 smithi047 ceph-mon[31561]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T22:25:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:15.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:15 smithi018 ceph-mon[26614]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:15.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:15 smithi018 ceph-mon[26614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:25:15.962 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:15 smithi018 ceph-mon[26614]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T22:25:15.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:15.963 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:15 smithi081 ceph-mon[31692]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:15 smithi081 ceph-mon[31692]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:25:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:15 smithi081 ceph-mon[31692]: osdmap e7: 1 total, 0 up, 1 in 2024-04-21T22:25:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00828347 s, 1.3 GB/s 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 2024-04-21T22:25:16.573 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-21T22:25:16.894 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:16 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:25:16.894 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:16 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:25:16.894 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:16 smithi047 ceph-mon[31561]: osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] boot 2024-04-21T22:25:16.894 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:16 smithi047 ceph-mon[31561]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T22:25:16.894 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:17.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:16 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:25:17.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:16 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:25:17.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:16 smithi018 ceph-mon[26614]: osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] boot 2024-04-21T22:25:17.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:16 smithi018 ceph-mon[26614]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T22:25:17.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:16 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:16 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:16 smithi081 ceph-mon[31692]: osd.0 [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] boot 2024-04-21T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:16 smithi081 ceph-mon[31692]: osdmap e8: 1 total, 1 up, 1 in 2024-04-21T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:25:17.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-04-21T22:25:17.477 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:25:17.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:17 smithi047 ceph-mon[31561]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:17.808 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:17 smithi047 ceph-mon[31561]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T22:25:18.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:17 smithi018 ceph-mon[26614]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:18.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:17 smithi018 ceph-mon[26614]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T22:25:18.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:17 smithi081 ceph-mon[31692]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-21T22:25:18.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:17 smithi081 ceph-mon[31692]: osdmap e9: 1 total, 1 up, 1 in 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 -- 172.21.15.47:0/1324068274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc101470 msgr2=0x7f6cfc1018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 --2- 172.21.15.47:0/1324068274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc101470 0x7f6cfc1018f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009990 tx=0x7f6cec009ca0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 -- 172.21.15.47:0/1324068274 shutdown_connections 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 --2- 172.21.15.47:0/1324068274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc101e30 0x7f6cfc1022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 --2- 172.21.15.47:0/1324068274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc100b10 0x7f6cfc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 --2- 172.21.15.47:0/1324068274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc101470 0x7f6cfc1018f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 -- 172.21.15.47:0/1324068274 >> 172.21.15.47:0/1324068274 conn(0x7f6cfc0fc730 msgr2=0x7f6cfc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 -- 172.21.15.47:0/1324068274 shutdown_connections 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.047+0000 7f6d0400d700 1 -- 172.21.15.47:0/1324068274 wait complete. 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 Processor -- start 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 -- start start 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc101470 0x7f6cfc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc101e30 0x7f6cfc1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc1100e0 con 0x7f6cfc101e30 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc10ff60 con 0x7f6cfc100b10 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d0400d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc110260 con 0x7f6cfc101470 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46928/0 (socket says 172.21.15.47:46928) 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 -- 172.21.15.47:0/2733276154 learned_addr learned my addr 172.21.15.47:0/2733276154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-21T22:25:19.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d015a8700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc101470 0x7f6cfc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 -- 172.21.15.47:0/2733276154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc101470 msgr2=0x7f6cfc19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc101470 0x7f6cfc19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 -- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc101e30 msgr2=0x7f6cfc1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc101e30 0x7f6cfc1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.048+0000 7f6d01da9700 1 -- 172.21.15.47:0/2733276154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc1a2350 con 0x7f6cfc100b10 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6d01da9700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800d980 tx=0x7f6cf800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8017070 con 0x7f6cfc100b10 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf8005020 con 0x7f6cfc100b10 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8009bf0 con 0x7f6cfc100b10 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1a2640 con 0x7f6cfc100b10 2024-04-21T22:25:19.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.049+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1a2c00 con 0x7f6cfc100b10 2024-04-21T22:25:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.050+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc068f20 con 0x7f6cfc100b10 2024-04-21T22:25:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.051+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f6cf80051d0 con 0x7f6cfc100b10 2024-04-21T22:25:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.052+0000 7f6cf2ffd700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 0x7f6ce80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.052+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f6cf80cd4b0 con 0x7f6cfc100b10 2024-04-21T22:25:19.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.052+0000 7f6d015a8700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 0x7f6ce80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:19.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.053+0000 7f6d015a8700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 0x7f6ce80a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b5c0 tx=0x7f6cec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:25:19.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.056+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6cf8020020 con 0x7f6cfc100b10 2024-04-21T22:25:19.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:19.272+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6cfc062670 con 0x7f6ce80a2c10 2024-04-21T22:25:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:20.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:20.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:20.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:20.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:20.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:20.887 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:20 smithi047 ceph-mon[31561]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:20.887 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:20 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi018 2024-04-21T22:25:20.887 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:20 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 17094M 2024-04-21T22:25:21.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:20 smithi018 ceph-mon[26614]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:21.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:20 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi018 2024-04-21T22:25:21.051 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:20 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 17094M 2024-04-21T22:25:21.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:20 smithi081 ceph-mon[31692]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:21.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:20 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi018 2024-04-21T22:25:21.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:20 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 17094M 2024-04-21T22:25:22.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:21 smithi018 ceph-mon[26614]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:22.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:21 smithi081 ceph-mon[31692]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:22.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:21 smithi047 ceph-mon[31561]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:23.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/1097252051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]': finished 2024-04-21T22:25:23.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T22:25:23.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:23.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:22 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/2203697190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/1097252051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]': finished 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:22 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/2203697190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:23.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/1097252051' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]: dispatch 2024-04-21T22:25:23.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43"}]': finished 2024-04-21T22:25:23.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: osdmap e10: 2 total, 1 up, 2 in 2024-04-21T22:25:23.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:23.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/2203697190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:24.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:23 smithi018 ceph-mon[26614]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:24.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:23 smithi081 ceph-mon[31692]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:24.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:23 smithi047 ceph-mon[31561]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:25 smithi047 ceph-mon[31561]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:25 smithi018 ceph-mon[26614]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:25 smithi081 ceph-mon[31692]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:28.008 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:27 smithi047 ceph-mon[31561]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:28.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:27 smithi018 ceph-mon[26614]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:27 smithi081 ceph-mon[31692]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:30.067 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:29 smithi047 ceph-mon[31561]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:30.067 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T22:25:30.067 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:30.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:29 smithi018 ceph-mon[26614]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:30.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T22:25:30.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:30.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:29 smithi081 ceph-mon[31692]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:30.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-21T22:25:30.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:31.022 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:30 smithi047 ceph-mon[31561]: Deploying daemon osd.1 on smithi047 2024-04-21T22:25:31.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:30 smithi018 ceph-mon[26614]: Deploying daemon osd.1 on smithi047 2024-04-21T22:25:31.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:30 smithi081 ceph-mon[31692]: Deploying daemon osd.1 on smithi047 2024-04-21T22:25:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:31 smithi047 ceph-mon[31561]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:32.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:31 smithi018 ceph-mon[26614]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:32.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:31 smithi081 ceph-mon[31692]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:34.036 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:33 smithi047 ceph-mon[31561]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:34.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:33 smithi018 ceph-mon[26614]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:33 smithi081 ceph-mon[31692]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:36.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:35 smithi018 ceph-mon[26614]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:36.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:36.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:35 smithi081 ceph-mon[31692]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:36.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:35 smithi047 ceph-mon[31561]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:38.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:37 smithi018 ceph-mon[26614]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:38.119 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:37 smithi047 ceph-mon[31561]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:38.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:37 smithi081 ceph-mon[31692]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:38.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.863+0000 7f6cf2ffd700 1 -- 172.21.15.47:0/2733276154 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6cfc062670 con 0x7f6ce80a2c10 2024-04-21T22:25:38.863 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 1 on host 'smithi047' 2024-04-21T22:25:38.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 msgr2=0x7f6ce80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:38.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 0x7f6ce80a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b5c0 tx=0x7f6cec005fd0 comp rx=0 tx=0).stop 2024-04-21T22:25:38.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 msgr2=0x7f6cfc19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800d980 tx=0x7f6cf800dc90 comp rx=0 tx=0).stop 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 shutdown_connections 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cfc101e30 0x7f6cfc1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ce80a2c10 0x7f6ce80a50d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cfc100b10 0x7f6cfc19a6f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 --2- 172.21.15.47:0/2733276154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cfc101470 0x7f6cfc19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 >> 172.21.15.47:0/2733276154 conn(0x7f6cfc0fc730 msgr2=0x7f6cfc0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 shutdown_connections 2024-04-21T22:25:38.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:25:38.865+0000 7f6d0400d700 1 -- 172.21.15.47:0/2733276154 wait complete. 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:39.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:39.176 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.176 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.176 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.176 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.176 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:39.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:25:39.494 DEBUG:teuthology.orchestra.run.smithi047:osd.1> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.1.service 2024-04-21T22:25:39.496 INFO:tasks.cephadm:Deploying osd.2 on smithi081 with /dev/vg_nvme/lv_4... 2024-04-21T22:25:39.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-21T22:25:39.735 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:25:40.906 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-mon[31561]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T22:25:40.907 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-mon[31561]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:40.907 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-mon[31561]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T22:25:40.907 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:40.907 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-mon[31561]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:40.907 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1[36169]: 2024-04-21T22:25:40.826+0000 7f20fa5c5700 -1 osd.1 0 waiting for initial osdmap 2024-04-21T22:25:40.907 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:25:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1[36169]: 2024-04-21T22:25:40.831+0000 7f20f6bb9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:25:40.941 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:40 smithi081 ceph-mon[31692]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T22:25:40.941 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:40 smithi081 ceph-mon[31692]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:40.941 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:40 smithi081 ceph-mon[31692]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T22:25:40.941 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:40 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:40.941 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:40 smithi081 ceph-mon[31692]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:41.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:40 smithi018 ceph-mon[26614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-21T22:25:41.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:40 smithi018 ceph-mon[26614]: from='osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:41.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:40 smithi018 ceph-mon[26614]: osdmap e11: 2 total, 1 up, 2 in 2024-04-21T22:25:41.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:40 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:41.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:40 smithi018 ceph-mon[26614]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:25:41.520 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-21T22:25:41.520 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-21T22:25:41.520 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-21T22:25:41.520 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-21T22:25:41.521 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114805 s, 913 MB/s 2024-04-21T22:25:41.521 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-21T22:25:42.020 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.021 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:25:42.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:25:42.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:42.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:25:42.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T22:25:42.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: osdmap e12: 2 total, 1 up, 2 in 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.118 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:42.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-04-21T22:25:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] boot 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi047 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 17093M 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:43.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] boot 2024-04-21T22:25:43.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T22:25:43.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi047 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 17093M 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:43.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: osd.1 [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] boot 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: osdmap e13: 2 total, 2 up, 2 in 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi047 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 17093M 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:25:43.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 -- 172.21.15.81:0/124893105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f81056f0 msgr2=0x7f87f8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 --2- 172.21.15.81:0/124893105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f81056f0 0x7f87f8107ae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009990 tx=0x7f87e0009ca0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 -- 172.21.15.81:0/124893105 shutdown_connections 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 --2- 172.21.15.81:0/124893105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8108020 0x7f87f810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 --2- 172.21.15.81:0/124893105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87f8102dc0 0x7f87f81051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 --2- 172.21.15.81:0/124893105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f81056f0 0x7f87f8107ae0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 -- 172.21.15.81:0/124893105 >> 172.21.15.81:0/124893105 conn(0x7f87f80fc730 msgr2=0x7f87f80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 -- 172.21.15.81:0/124893105 shutdown_connections 2024-04-21T22:25:43.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.837+0000 7f87fcec6700 1 -- 172.21.15.81:0/124893105 wait complete. 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 Processor -- start 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 -- start start 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87f8102dc0 0x7f87f8198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f81056f0 0x7f87f8198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87f810df60 con 0x7f87f8102dc0 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87f810dde0 con 0x7f87f81056f0 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87fcec6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87f810e0e0 con 0x7f87f8108020 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 -- 172.21.15.81:0/713506758 learned_addr learned my addr 172.21.15.81:0/713506758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87edd9b700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f81056f0 0x7f87f8198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 -- 172.21.15.81:0/713506758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f81056f0 msgr2=0x7f87f8198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f81056f0 0x7f87f8198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 -- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87f8102dc0 msgr2=0x7f87f8198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87f8102dc0 0x7f87f8198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.838+0000 7f87f6d9d700 1 -- 172.21.15.81:0/713506758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f81a02c0 con 0x7f87f8108020 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87f6d9d700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f87f000ba10 tx=0x7f87f000bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0019070 con 0x7f87f8108020 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f000ce10 con 0x7f87f8108020 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f81a05b0 con 0x7f87f8108020 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0012360 con 0x7f87f8108020 2024-04-21T22:25:43.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.839+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f81a0b70 con 0x7f87f8108020 2024-04-21T22:25:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.840+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f8068f20 con 0x7f87f8108020 2024-04-21T22:25:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.841+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f87f001c070 con 0x7f87f8108020 2024-04-21T22:25:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.842+0000 7f87effff700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 0x7f87e40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:25:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.842+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f87f00ccd00 con 0x7f87f8108020 2024-04-21T22:25:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.842+0000 7f87f659c700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 0x7f87e40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:25:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.843+0000 7f87f659c700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 0x7f87e40a5050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87e80097b0 tx=0x7f87e8006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:25:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:43.846+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f87f009b4b0 con 0x7f87f8108020 2024-04-21T22:25:44.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:25:44.049+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f87f8062670 con 0x7f87e40a2b90 2024-04-21T22:25:44.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:43 smithi081 ceph-mon[31692]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T22:25:44.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:43 smithi047 ceph-mon[31561]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T22:25:44.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:43 smithi018 ceph-mon[26614]: osdmap e14: 2 total, 2 up, 2 in 2024-04-21T22:25:44.946 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:44 smithi081 ceph-mon[31692]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:44.946 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:44 smithi081 ceph-mon[31692]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:44.946 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:44.947 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:44.947 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:44 smithi047 ceph-mon[31561]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:44 smithi047 ceph-mon[31561]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:45.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:44 smithi018 ceph-mon[26614]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:45.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:44 smithi018 ceph-mon[26614]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:25:45.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:25:45.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:25:45.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:47.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:47.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/480773722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]': finished 2024-04-21T22:25:47.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T22:25:47.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:47 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/480773722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]': finished 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T22:25:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:47 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:25:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/480773722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]: dispatch 2024-04-21T22:25:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49058d27-4b5c-4142-b287-4036d3c90a24"}]': finished 2024-04-21T22:25:47.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: osdmap e15: 3 total, 2 up, 3 in 2024-04-21T22:25:47.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:47 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:25:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:48 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/1958717711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:48.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:48 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/1958717711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:48.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:48 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/1958717711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:25:49.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:49 smithi018 ceph-mon[26614]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:49.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:49 smithi081 ceph-mon[31692]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:49.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:49 smithi047 ceph-mon[31561]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:51.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:51 smithi081 ceph-mon[31692]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:51.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:51 smithi018 ceph-mon[26614]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:51.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:51 smithi047 ceph-mon[31561]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:53.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:53 smithi018 ceph-mon[26614]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:53.349 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:53 smithi081 ceph-mon[31692]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:53.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:53 smithi047 ceph-mon[31561]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:54 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T22:25:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:54 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:54.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:54 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T22:25:54.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:54 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:54.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:54 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-21T22:25:54.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:54 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:25:55.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:55 smithi081 ceph-mon[31692]: Deploying daemon osd.2 on smithi081 2024-04-21T22:25:55.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:55 smithi081 ceph-mon[31692]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:55.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:55 smithi018 ceph-mon[26614]: Deploying daemon osd.2 on smithi081 2024-04-21T22:25:55.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:55 smithi018 ceph-mon[26614]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:55 smithi047 ceph-mon[31561]: Deploying daemon osd.2 on smithi081 2024-04-21T22:25:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:55 smithi047 ceph-mon[31561]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:57.238 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:57 smithi081 ceph-mon[31692]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:57.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:57 smithi018 ceph-mon[26614]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:57.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:57 smithi047 ceph-mon[31561]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:59.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:25:59 smithi018 ceph-mon[26614]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:59.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:25:59 smithi081 ceph-mon[31692]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:25:59.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:25:59 smithi047 ceph-mon[31561]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:00.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:00.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:00.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:00.354 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:00.354 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:00.354 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:00.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:00.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:00.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:01 smithi081 ceph-mon[31692]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:01 smithi047 ceph-mon[31561]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:01 smithi018 ceph-mon[26614]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.146+0000 7f87effff700 1 -- 172.21.15.81:0/713506758 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f87f8062670 con 0x7f87e40a2b90 2024-04-21T22:26:03.148 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 2 on host 'smithi081' 2024-04-21T22:26:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 msgr2=0x7f87e40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 0x7f87e40a5050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f87e80097b0 tx=0x7f87e8006d20 comp rx=0 tx=0).stop 2024-04-21T22:26:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 msgr2=0x7f87f819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f87f000ba10 tx=0x7f87f000bd20 comp rx=0 tx=0).stop 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 shutdown_connections 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8108020 0x7f87f819fc20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87f8102dc0 0x7f87f8198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f87e40a2b90 0x7f87e40a5050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 --2- 172.21.15.81:0/713506758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f81056f0 0x7f87f8198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 >> 172.21.15.81:0/713506758 conn(0x7f87f80fc730 msgr2=0x7f87f8104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 shutdown_connections 2024-04-21T22:26:03.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:26:03.149+0000 7f87fcec6700 1 -- 172.21.15.81:0/713506758 wait complete. 2024-04-21T22:26:03.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:03.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:03.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:03 smithi081 ceph-mon[31692]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:03 smithi018 ceph-mon[26614]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:03 smithi047 ceph-mon[31561]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-21T22:26:03.789 DEBUG:teuthology.orchestra.run.smithi081:osd.2> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.2.service 2024-04-21T22:26:03.791 INFO:tasks.cephadm:Deploying osd.3 on smithi018 with /dev/vg_nvme/lv_3... 2024-04-21T22:26:03.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T22:26:04.273 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:26:05.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:05.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T22:26:05.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T22:26:05.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:05.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:05.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:05 smithi018 ceph-mon[26614]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:05.355 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-mon[31692]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-21T22:26:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: osdmap e16: 3 total, 2 up, 3 in 2024-04-21T22:26:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: from='osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:05 smithi047 ceph-mon[31561]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:26:06.323 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:06 smithi018 ceph-mon[26614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:26:06.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:06 smithi018 ceph-mon[26614]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T22:26:06.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.324 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:06 smithi018 ceph-mon[26614]: from='osd.2 ' entity='osd.2' 2024-04-21T22:26:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:06 smithi081 ceph-mon[31692]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:26:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:06 smithi081 ceph-mon[31692]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T22:26:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:06 smithi081 ceph-mon[31692]: from='osd.2 ' entity='osd.2' 2024-04-21T22:26:06.389 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2[37006]: 2024-04-21T22:26:05.951+0000 7f4b1907d700 -1 osd.2 0 waiting for initial osdmap 2024-04-21T22:26:06.389 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2[37006]: 2024-04-21T22:26:05.960+0000 7f4b11669700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:26:06.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:06 smithi047 ceph-mon[31561]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:26:06.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:06 smithi047 ceph-mon[31561]: osdmap e17: 3 total, 2 up, 3 in 2024-04-21T22:26:06.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:06.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:06 smithi047 ceph-mon[31561]: from='osd.2 ' entity='osd.2' 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.038556 s, 272 MB/s 2024-04-21T22:26:07.261 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-04-21T22:26:07.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] boot 2024-04-21T22:26:07.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T22:26:07.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:07.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] boot 2024-04-21T22:26:07.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T22:26:07.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:26:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:26:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-21T22:26:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: osd.2 [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] boot 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: osdmap e18: 3 total, 3 up, 3 in 2024-04-21T22:26:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:26:08.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-04-21T22:26:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:26:08.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:08 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi081 2024-04-21T22:26:08.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:08 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 17088M 2024-04-21T22:26:09.008 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:08 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi081 2024-04-21T22:26:09.009 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:08 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 17088M 2024-04-21T22:26:09.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:08 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi081 2024-04-21T22:26:09.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:08 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 17088M 2024-04-21T22:26:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:09 smithi047 ceph-mon[31561]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:09 smithi047 ceph-mon[31561]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T22:26:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:10.031 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:09 smithi018 ceph-mon[26614]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:10.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:10.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:10.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:09 smithi018 ceph-mon[26614]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T22:26:10.032 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:09 smithi081 ceph-mon[31692]: pgmap v94: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:09 smithi081 ceph-mon[31692]: osdmap e19: 3 total, 3 up, 3 in 2024-04-21T22:26:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:26:10.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:10.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:10 smithi047 ceph-mon[31561]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T22:26:10.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 -- 172.21.15.18:0/4105873211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 msgr2=0x7ffa641062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:10.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 --2- 172.21.15.18:0/4105873211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641062c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b0a0 tx=0x7ffa5c00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 -- 172.21.15.18:0/4105873211 shutdown_connections 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 --2- 172.21.15.18:0/4105873211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641062c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 --2- 172.21.15.18:0/4105873211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64100b00 0x7ffa64102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 --2- 172.21.15.18:0/4105873211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64103470 0x7ffa64105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 -- 172.21.15.18:0/4105873211 >> 172.21.15.18:0/4105873211 conn(0x7ffa640fc720 msgr2=0x7ffa640feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.949+0000 7ffa6b800700 1 -- 172.21.15.18:0/4105873211 shutdown_connections 2024-04-21T22:26:10.951 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:10.951 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:10 smithi018 ceph-mon[26614]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T22:26:10.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.950+0000 7ffa6b800700 1 -- 172.21.15.18:0/4105873211 wait complete. 2024-04-21T22:26:10.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.951+0000 7ffa6b800700 1 Processor -- start 2024-04-21T22:26:10.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.951+0000 7ffa6b800700 1 -- start start 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 0x7ffa6419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 0x7ffa6419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64114430 con 0x7ffa64100b00 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641142b0 con 0x7ffa64105e40 2024-04-21T22:26:10.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa6b800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641145b0 con 0x7ffa64103470 2024-04-21T22:26:10.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa68e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 0x7ffa6419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:10.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa68e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 0x7ffa6419ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42686/0 (socket says 172.21.15.18:42686) 2024-04-21T22:26:10.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa68e00700 1 -- 172.21.15.18:0/2625931583 learned_addr learned my addr 172.21.15.18:0/2625931583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:26:10.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa63e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 0x7ffa6419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:10.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.952+0000 7ffa69800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 -- 172.21.15.18:0/2625931583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 msgr2=0x7ffa641a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 -- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 msgr2=0x7ffa6419ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 0x7ffa6419ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 -- 172.21.15.18:0/2625931583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa641a6670 con 0x7ffa64103470 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa63e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 0x7ffa6419ef50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000ea20 tx=0x7ffa5000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.953+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000cbd0 con 0x7ffa64103470 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.954+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa5000ee60 con 0x7ffa64103470 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.954+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa641a6960 con 0x7ffa64103470 2024-04-21T22:26:10.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.954+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50018680 con 0x7ffa64103470 2024-04-21T22:26:10.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.954+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa641a6ef0 con 0x7ffa64103470 2024-04-21T22:26:10.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.955+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa64068f20 con 0x7ffa64103470 2024-04-21T22:26:10.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.957+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ffa50018820 con 0x7ffa64103470 2024-04-21T22:26:10.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.958+0000 7ffa61600700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 0x7ffa4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:10.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.958+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7ffa500cdc60 con 0x7ffa64103470 2024-04-21T22:26:10.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.959+0000 7ffa68e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 0x7ffa4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:10.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.959+0000 7ffa68e00700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 0x7ffa4c0a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009d60 tx=0x7ffa58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:26:10.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:10.962+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ffa5009bfd0 con 0x7ffa64103470 2024-04-21T22:26:11.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:26:11.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:10 smithi081 ceph-mon[31692]: osdmap e20: 3 total, 3 up, 3 in 2024-04-21T22:26:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:11.199+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ffa64062670 con 0x7ffa4c0a2c10 2024-04-21T22:26:11.201 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:10 smithi018 sudo[46006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:11.201 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:10 smithi018 sudo[46006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:11.201 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:10 smithi018 sudo[46006]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:11.201 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:10 smithi018 sudo[46006]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:11.845 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:11 smithi018 sudo[46094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:11.845 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:11 smithi018 sudo[46094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:11.845 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:11 smithi018 sudo[46094]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:11.845 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:26:11 smithi018 sudo[46094]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T22:26:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T22:26:11.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:11.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:11.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:11.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: osdmap e21: 3 total, 3 up, 3 in 2024-04-21T22:26:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:12.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:12.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:12.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:12.444 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40119]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:12.444 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40119]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:12.444 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40119]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:12.444 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40119]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:12.710+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffa50097f40 con 0x7ffa64103470 2024-04-21T22:26:12.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:12 smithi047 ceph-mon[31561]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:12.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:12 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:12.945 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40122]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:12.945 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40122]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:12.945 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40122]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:12.945 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:26:12 smithi047 sudo[40122]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:12.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:12 smithi018 ceph-mon[26614]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:12.986 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:12 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:13.049 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:12 smithi081 ceph-mon[31692]: from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:13.049 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:12 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:13.049 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:12 smithi081 sudo[41097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:13.049 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:12 smithi081 sudo[41097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:13.049 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:12 smithi081 sudo[41097]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:13.049 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:12 smithi081 sudo[41097]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:13.388 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:13 smithi081 sudo[41100]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:13.388 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:13 smithi081 sudo[41100]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:13.388 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:13 smithi081 sudo[41100]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:13.388 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:26:13 smithi081 sudo[41100]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:13.966 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:13 smithi018 sudo[46195]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:13.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:13 smithi018 sudo[46195]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:13.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:13 smithi018 sudo[46195]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:13.967 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:13 smithi018 sudo[46195]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 ceph-mon[31692]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 ceph-mon[31692]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41103]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41103]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:14.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41103]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:14.524 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41103]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:14.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 sudo[46207]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 sudo[46207]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 sudo[46207]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 sudo[46207]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 ceph-mon[26614]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 ceph-mon[26614]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:14.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:14 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:14.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:14 smithi047 ceph-mon[31561]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:14.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:14 smithi047 ceph-mon[31561]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-21T22:26:14.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:14 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:14.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:14 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41106]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41106]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41106]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:14 smithi081 sudo[41106]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:15.664 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40125]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-21T22:26:15.664 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40125]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:15.664 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40125]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:15.665 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40125]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:15.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40128]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40128]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40128]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 sudo[40128]: pam_unix(sudo:session): session closed for user root 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:15.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:15.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:26:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:26:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2296741724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]': finished 2024-04-21T22:26:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T22:26:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:16.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2296741724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]': finished 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T22:26:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-21T22:26:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-21T22:26:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2296741724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:17.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]: dispatch 2024-04-21T22:26:17.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1c370c5-aee2-453e-af57-9defb8842429"}]': finished 2024-04-21T22:26:17.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: osdmap e22: 4 total, 3 up, 4 in 2024-04-21T22:26:17.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:17 smithi047 ceph-mon[31561]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:17 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/259659240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:18.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:17 smithi018 ceph-mon[26614]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:18.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:17 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/259659240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:18.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:17 smithi081 ceph-mon[31692]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:18.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:17 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/259659240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:19 smithi047 ceph-mon[31561]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-04-21T22:26:20.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:19 smithi018 ceph-mon[26614]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-04-21T22:26:20.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:19 smithi081 ceph-mon[31692]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-04-21T22:26:21.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:21 smithi047 ceph-mon[31561]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-21T22:26:21.952 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:21 smithi018 ceph-mon[26614]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-21T22:26:22.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:21 smithi081 ceph-mon[31692]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-21T22:26:23.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:23 smithi047 ceph-mon[31561]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-04-21T22:26:23.982 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:23 smithi018 ceph-mon[26614]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-04-21T22:26:24.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:23 smithi081 ceph-mon[31692]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-04-21T22:26:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:25 smithi018 ceph-mon[26614]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T22:26:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:25 smithi081 ceph-mon[31692]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T22:26:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:26.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:25 smithi047 ceph-mon[31561]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:26.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-21T22:26:26.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:27.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:26 smithi018 ceph-mon[26614]: Deploying daemon osd.3 on smithi018 2024-04-21T22:26:27.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:26 smithi081 ceph-mon[31692]: Deploying daemon osd.3 on smithi018 2024-04-21T22:26:27.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:26 smithi047 ceph-mon[31561]: Deploying daemon osd.3 on smithi018 2024-04-21T22:26:28.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:27 smithi018 ceph-mon[26614]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:27 smithi081 ceph-mon[31692]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:28.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:27 smithi047 ceph-mon[31561]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-21T22:26:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:29 smithi018 ceph-mon[26614]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-21T22:26:30.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:29 smithi081 ceph-mon[31692]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-21T22:26:30.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:29 smithi047 ceph-mon[31561]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-21T22:26:32.063 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:31 smithi018 ceph-mon[26614]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:32.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:31 smithi081 ceph-mon[31692]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:31 smithi047 ceph-mon[31561]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:34.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:33 smithi018 ceph-mon[26614]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:33 smithi081 ceph-mon[31692]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:34.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:33 smithi047 ceph-mon[31561]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:34 smithi018 ceph-mon[26614]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:35.096 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.097 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:34 smithi047 ceph-mon[31561]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:34 smithi081 ceph-mon[31692]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:37.302 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:37 smithi018 ceph-mon[26614]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:37.398 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:37 smithi081 ceph-mon[31692]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:37.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:37 smithi047 ceph-mon[31561]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:38 smithi018 ceph-mon[26614]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:38 smithi018 ceph-mon[26614]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:38 smithi047 ceph-mon[31561]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:38 smithi047 ceph-mon[31561]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:38 smithi081 ceph-mon[31692]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:38 smithi081 ceph-mon[31692]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-21T22:26:38.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.958+0000 7ffa61600700 1 -- 172.21.15.18:0/2625931583 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffa64062670 con 0x7ffa4c0a2c10 2024-04-21T22:26:38.959 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 3 on host 'smithi018' 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 msgr2=0x7ffa4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 0x7ffa4c0a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009d60 tx=0x7ffa58009260 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 msgr2=0x7ffa6419ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 0x7ffa6419ef50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000ea20 tx=0x7ffa5000ed30 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 shutdown_connections 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ffa4c0a2c10 0x7ffa4c0a50d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa64105e40 0x7ffa641a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa64100b00 0x7ffa6419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 --2- 172.21.15.18:0/2625931583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa64103470 0x7ffa6419ef50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.962+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 >> 172.21.15.18:0/2625931583 conn(0x7ffa640fc720 msgr2=0x7ffa641017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.963+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 shutdown_connections 2024-04-21T22:26:38.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:26:38.963+0000 7ffa6b800700 1 -- 172.21.15.18:0/2625931583 wait complete. 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:39 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T22:26:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T22:26:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:39 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: osdmap e23: 4 total, 3 up, 4 in 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:39 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:26:39.789 DEBUG:teuthology.orchestra.run.smithi018:osd.3> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.3.service 2024-04-21T22:26:39.796 INFO:tasks.cephadm:Deploying osd.4 on smithi047 with /dev/vg_nvme/lv_3... 2024-04-21T22:26:39.796 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T22:26:40.051 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:26:40.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:40 smithi018 ceph-mon[26614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:26:40.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:40 smithi018 ceph-mon[26614]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T22:26:40.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:40 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:40.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:40 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:40.426 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:40 smithi047 ceph-mon[31561]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:26:40.426 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:40 smithi047 ceph-mon[31561]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T22:26:40.426 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:40 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:40.426 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:40 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:40.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:40 smithi081 ceph-mon[31692]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:26:40.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:40 smithi081 ceph-mon[31692]: osdmap e24: 4 total, 3 up, 4 in 2024-04-21T22:26:40.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:40 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:40.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:40 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:41.509 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] boot 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:41.510 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:41 smithi047 ceph-mon[31561]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T22:26:41.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:26:41.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:26:41.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:41.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] boot 2024-04-21T22:26:41.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T22:26:41.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:41.582 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:41 smithi018 ceph-mon[26614]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T22:26:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:26:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:26:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-21T22:26:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: osd.3 [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] boot 2024-04-21T22:26:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: osdmap e25: 4 total, 4 up, 4 in 2024-04-21T22:26:41.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:26:41.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:41 smithi081 ceph-mon[31692]: osdmap e26: 4 total, 4 up, 4 in 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00833545 s, 1.3 GB/s 2024-04-21T22:26:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-21T22:26:42.685 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-04-21T22:26:42.935 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:26:43.388 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:43 smithi047 ceph-mon[31561]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:43.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:43 smithi047 ceph-mon[31561]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T22:26:43.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:43 smithi047 ceph-mon[31561]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T22:26:43.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:43 smithi018 ceph-mon[26614]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:43.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:43 smithi018 ceph-mon[26614]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T22:26:43.577 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:43 smithi018 ceph-mon[26614]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T22:26:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:43 smithi081 ceph-mon[31692]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:43 smithi081 ceph-mon[31692]: osdmap e27: 4 total, 4 up, 4 in 2024-04-21T22:26:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:43 smithi081 ceph-mon[31692]: osdmap e28: 4 total, 4 up, 4 in 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- 172.21.15.47:0/3418237170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c1038c0 msgr2=0x7f642c103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 --2- 172.21.15.47:0/3418237170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c1038c0 0x7f642c103ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6420009990 tx=0x7f6420009ca0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- 172.21.15.47:0/3418237170 shutdown_connections 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 --2- 172.21.15.47:0/3418237170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c100ce0 0x7f642c10a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 --2- 172.21.15.47:0/3418237170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c1038c0 0x7f642c103ce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 --2- 172.21.15.47:0/3418237170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f642c100340 0x7f642c1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- 172.21.15.47:0/3418237170 >> 172.21.15.47:0/3418237170 conn(0x7f642c0fbf00 msgr2=0x7f642c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- 172.21.15.47:0/3418237170 shutdown_connections 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- 172.21.15.47:0/3418237170 wait complete. 2024-04-21T22:26:44.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 Processor -- start 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.523+0000 7f64330a2700 1 -- start start 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f642c100340 0x7f642c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c1038c0 0x7f642c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10df40 con 0x7f642c100340 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10ddc0 con 0x7f642c100ce0 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10e0c0 con 0x7f642c1038c0 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59702/0 (socket says 172.21.15.47:59702) 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 -- 172.21.15.47:0/1909076197 learned_addr learned my addr 172.21.15.47:0/1909076197 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f643163f700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c1038c0 0x7f642c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 -- 172.21.15.47:0/1909076197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c1038c0 msgr2=0x7f642c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:44.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c1038c0 0x7f642c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 -- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f642c100340 msgr2=0x7f642c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f642c100340 0x7f642c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 -- 172.21.15.47:0/1909076197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c1a0180 con 0x7f642c100ce0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f642bfff700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f641800b530 tx=0x7f641800b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418015020 con 0x7f642c100ce0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6418011d10 con 0x7f642c100ce0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641800f2e0 con 0x7f642c100ce0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.524+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c1a0470 con 0x7f642c100ce0 2024-04-21T22:26:44.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.525+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1a0a30 con 0x7f642c100ce0 2024-04-21T22:26:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.526+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c068f20 con 0x7f642c100ce0 2024-04-21T22:26:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.527+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6418018020 con 0x7f642c100ce0 2024-04-21T22:26:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.527+0000 7f6429ffb700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 0x7f641c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:26:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.528+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f64180cd670 con 0x7f642c100ce0 2024-04-21T22:26:44.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.528+0000 7f6430e3e700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 0x7f641c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:26:44.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.529+0000 7f6430e3e700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 0x7f641c0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6420003950 tx=0x7f6420005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:26:44.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.532+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f641801f020 con 0x7f642c100ce0 2024-04-21T22:26:44.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:26:44.748+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f642c062670 con 0x7f641c0a2c20 2024-04-21T22:26:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T22:26:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi018 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 8547M 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:45.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:44 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:45.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T22:26:45.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-21T22:26:45.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi018 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 8547M 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:45.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:44 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:45.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: osdmap e29: 4 total, 4 up, 4 in 2024-04-21T22:26:45.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-21T22:26:45.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi018 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 8547M 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:26:45.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:44 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:47.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:47 smithi018 ceph-mon[26614]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-21T22:26:47.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:47 smithi081 ceph-mon[31692]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-21T22:26:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:47 smithi047 ceph-mon[31561]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-21T22:26:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:48 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/556185800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:48 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:48 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]': finished 2024-04-21T22:26:48.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:48 smithi018 ceph-mon[26614]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T22:26:48.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:26:48.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:48 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/556185800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:48 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:48 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]': finished 2024-04-21T22:26:48.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:48 smithi081 ceph-mon[31692]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T22:26:48.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:26:48.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:48 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/556185800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:48 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]: dispatch 2024-04-21T22:26:48.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:48 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "feeccde7-a47e-468e-b3d5-9aa13e0ac807"}]': finished 2024-04-21T22:26:48.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:48 smithi047 ceph-mon[31561]: osdmap e30: 5 total, 4 up, 5 in 2024-04-21T22:26:48.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:26:49.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:49 smithi018 ceph-mon[26614]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-04-21T22:26:49.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/1202670976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:49.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:49 smithi081 ceph-mon[31692]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-04-21T22:26:49.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/1202670976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:49.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:49 smithi047 ceph-mon[31561]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-04-21T22:26:49.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/1202670976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:26:51.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:51 smithi018 ceph-mon[26614]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:51.320 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:51 smithi047 ceph-mon[31561]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:51.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:51 smithi081 ceph-mon[31692]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:53.303 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:53 smithi047 ceph-mon[31561]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:53.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:53 smithi018 ceph-mon[26614]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:53.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:53 smithi081 ceph-mon[31692]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:55.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:55 smithi018 ceph-mon[26614]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:55.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T22:26:55.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:55 smithi081 ceph-mon[31692]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T22:26:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:55 smithi047 ceph-mon[31561]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-21T22:26:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:26:56.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:56 smithi047 ceph-mon[31561]: Deploying daemon osd.4 on smithi047 2024-04-21T22:26:56.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:56 smithi018 ceph-mon[26614]: Deploying daemon osd.4 on smithi047 2024-04-21T22:26:56.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:56 smithi081 ceph-mon[31692]: Deploying daemon osd.4 on smithi047 2024-04-21T22:26:57.317 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:57 smithi047 ceph-mon[31561]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:57.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:57 smithi018 ceph-mon[26614]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:57.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:57 smithi081 ceph-mon[31692]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:59.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:26:59 smithi018 ceph-mon[26614]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:59.366 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:26:59 smithi047 ceph-mon[31561]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:26:59.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:26:59 smithi081 ceph-mon[31692]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:01 smithi018 ceph-mon[26614]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:01 smithi081 ceph-mon[31692]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:01 smithi047 ceph-mon[31561]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:03.859 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:03 smithi047 ceph-mon[31561]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:03.859 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:03.859 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:03 smithi081 ceph-mon[31692]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:03 smithi018 ceph-mon[26614]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:04.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.287+0000 7f6429ffb700 1 -- 172.21.15.47:0/1909076197 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f642c062670 con 0x7f641c0a2c20 2024-04-21T22:27:04.287 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 4 on host 'smithi047' 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 msgr2=0x7f641c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 0x7f641c0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6420003950 tx=0x7f6420005fb0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 msgr2=0x7f642c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f641800b530 tx=0x7f641800b8f0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 shutdown_connections 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f642c1038c0 0x7f642c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f642c100340 0x7f642c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f641c0a2c20 0x7f641c0a50e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 --2- 172.21.15.47:0/1909076197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c100ce0 0x7f642c198a60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 >> 172.21.15.47:0/1909076197 conn(0x7f642c0fbf00 msgr2=0x7f642c106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 shutdown_connections 2024-04-21T22:27:04.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:27:04.290+0000 7f64330a2700 1 -- 172.21.15.47:0/1909076197 wait complete. 2024-04-21T22:27:04.901 DEBUG:teuthology.orchestra.run.smithi047:osd.4> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.4.service 2024-04-21T22:27:04.909 INFO:tasks.cephadm:Deploying osd.5 on smithi081 with /dev/vg_nvme/lv_3... 2024-04-21T22:27:04.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-21T22:27:05.153 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:27:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:05 smithi047 ceph-mon[31561]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:05 smithi047 ceph-mon[31561]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:05 smithi047 ceph-mon[31561]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:05.569 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:05 smithi081 ceph-mon[31692]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:05.570 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.570 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.570 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:05 smithi081 ceph-mon[31692]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:05.570 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:05 smithi081 ceph-mon[31692]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:05 smithi018 ceph-mon[26614]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:05.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:05.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:05 smithi018 ceph-mon[26614]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:05.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:05 smithi018 ceph-mon[26614]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-21T22:27:06.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-mon[31561]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T22:27:06.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-mon[31561]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:06.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-mon[31561]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T22:27:06.295 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:06.296 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-mon[31561]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:06.296 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:27:06.255+0000 7f5a66e61700 -1 osd.4 0 waiting for initial osdmap 2024-04-21T22:27:06.296 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:27:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:27:06.264+0000 7f5a63455700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:27:06.490 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:06 smithi081 ceph-mon[31692]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T22:27:06.491 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:06 smithi081 ceph-mon[31692]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:06.491 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:06 smithi081 ceph-mon[31692]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T22:27:06.491 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:06.491 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:06 smithi081 ceph-mon[31692]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:06.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:06 smithi018 ceph-mon[26614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-21T22:27:06.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:06 smithi018 ceph-mon[26614]: from='osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:06.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:06 smithi018 ceph-mon[26614]: osdmap e31: 5 total, 4 up, 5 in 2024-04-21T22:27:06.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:06.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:06 smithi018 ceph-mon[26614]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131378 s, 798 MB/s 2024-04-21T22:27:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-21T22:27:07.442 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:07 smithi047 ceph-mon[31561]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:07.442 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:07 smithi047 ceph-mon[31561]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:27:07.442 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:07 smithi047 ceph-mon[31561]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T22:27:07.442 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.442 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:07 smithi018 ceph-mon[26614]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:07 smithi018 ceph-mon[26614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:27:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:07 smithi018 ceph-mon[26614]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T22:27:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:07 smithi081 ceph-mon[31692]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:07 smithi081 ceph-mon[31692]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:27:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:07 smithi081 ceph-mon[31692]: osdmap e32: 5 total, 4 up, 5 in 2024-04-21T22:27:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:07.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-04-21T22:27:07.941 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:27:08.319 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] boot 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi047 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.320 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.321 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] boot 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi047 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: osd.4 [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] boot 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: osdmap e33: 5 total, 5 up, 5 in 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi047 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:08.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:08.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:08.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:08.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:09.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:09 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 8546M 2024-04-21T22:27:09.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:09 smithi081 ceph-mon[31692]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:09.414 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:09 smithi081 ceph-mon[31692]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T22:27:09.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- 172.21.15.81:0/2736276768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 msgr2=0x7ff2ec1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 --2- 172.21.15.81:0/2736276768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec1038f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009990 tx=0x7ff2e0009ca0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- 172.21.15.81:0/2736276768 shutdown_connections 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 --2- 172.21.15.81:0/2736276768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2ec103e30 0x7ff2ec10a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 --2- 172.21.15.81:0/2736276768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec102290 0x7ff2ec1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 --2- 172.21.15.81:0/2736276768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec1038f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- 172.21.15.81:0/2736276768 >> 172.21.15.81:0/2736276768 conn(0x7ff2ec0fd830 msgr2=0x7ff2ec0ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- 172.21.15.81:0/2736276768 shutdown_connections 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- 172.21.15.81:0/2736276768 wait complete. 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 Processor -- start 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.442+0000 7ff2f265f700 1 -- start start 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2ec102290 0x7ff2ec198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 0x7ff2ec19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:09.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec10def0 con 0x7ff2ec102290 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec10dd70 con 0x7ff2ec103e30 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f265f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec10e070 con 0x7ff2ec103490 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47442/0 (socket says 172.21.15.81:47442) 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 -- 172.21.15.81:0/785532892 learned_addr learned my addr 172.21.15.81:0/785532892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f0bfc700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 0x7ff2ec19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 -- 172.21.15.81:0/785532892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 msgr2=0x7ff2ec19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 0x7ff2ec19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 -- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2ec102290 msgr2=0x7ff2ec198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2ec102290 0x7ff2ec198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 -- 172.21.15.81:0/785532892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1a0160 con 0x7ff2ec103490 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2f0bfc700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 0x7ff2ec19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.443+0000 7ff2eb7fe700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0004790 tx=0x7ff2e0009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:27:09.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.444+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0027070 con 0x7ff2ec103490 2024-04-21T22:27:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.444+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec1a03f0 con 0x7ff2ec103490 2024-04-21T22:27:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.444+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2e0004210 con 0x7ff2ec103490 2024-04-21T22:27:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.444+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000f460 con 0x7ff2ec103490 2024-04-21T22:27:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.444+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1a08d0 con 0x7ff2ec103490 2024-04-21T22:27:09.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.445+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec068f20 con 0x7ff2ec103490 2024-04-21T22:27:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.446+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff2e002a070 con 0x7ff2ec103490 2024-04-21T22:27:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.446+0000 7ff2e97fa700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 0x7ff2d40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.446+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7ff2e00cf250 con 0x7ff2ec103490 2024-04-21T22:27:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.447+0000 7ff2ebfff700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 0x7ff2d40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:09.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.448+0000 7ff2ebfff700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 0x7ff2d40a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec1032f0 tx=0x7ff2dc009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:27:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.450+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff2e0013070 con 0x7ff2ec103490 2024-04-21T22:27:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:09 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 8546M 2024-04-21T22:27:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:09 smithi018 ceph-mon[26614]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:09 smithi018 ceph-mon[26614]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T22:27:09.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:09.654+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff2ec062670 con 0x7ff2d40a2c20 2024-04-21T22:27:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:09 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 8546M 2024-04-21T22:27:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:09 smithi047 ceph-mon[31561]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-04-21T22:27:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:09 smithi047 ceph-mon[31561]: osdmap e34: 5 total, 5 up, 5 in 2024-04-21T22:27:10.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:10 smithi018 ceph-mon[26614]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:10.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:10.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:10.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:10.617 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:10 smithi081 ceph-mon[31692]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:10.617 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:10.617 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:10.617 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:10.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:10 smithi047 ceph-mon[31561]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:10.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:10.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:10.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:11.504 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:11 smithi081 ceph-mon[31692]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:11 smithi018 ceph-mon[26614]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:11 smithi047 ceph-mon[31561]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:12.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/2113668543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:12 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:12 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]': finished 2024-04-21T22:27:12.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:12 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/2113668543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:12 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:12 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]': finished 2024-04-21T22:27:12.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:12 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/2113668543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:12 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]: dispatch 2024-04-21T22:27:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:12 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589fe240-12d2-42f3-9a1e-a2aaee0959ca"}]': finished 2024-04-21T22:27:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:13 smithi018 ceph-mon[26614]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:13 smithi018 ceph-mon[26614]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T22:27:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:13 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/2707722329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:13 smithi081 ceph-mon[31692]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:13 smithi081 ceph-mon[31692]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T22:27:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/2707722329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:13 smithi047 ceph-mon[31561]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:13 smithi047 ceph-mon[31561]: osdmap e35: 6 total, 5 up, 6 in 2024-04-21T22:27:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:13 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/2707722329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:15.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:15 smithi018 ceph-mon[26614]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:15 smithi081 ceph-mon[31692]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:15.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:15 smithi047 ceph-mon[31561]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:17 smithi081 ceph-mon[31692]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:17.659 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:17 smithi047 ceph-mon[31561]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:17 smithi018 ceph-mon[26614]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:19.617 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:19 smithi081 ceph-mon[31692]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:19.648 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:19 smithi018 ceph-mon[26614]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:19 smithi047 ceph-mon[31561]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:20 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T22:27:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:20 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:20 smithi081 ceph-mon[31692]: Deploying daemon osd.5 on smithi081 2024-04-21T22:27:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:20 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T22:27:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:20 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:20 smithi047 ceph-mon[31561]: Deploying daemon osd.5 on smithi081 2024-04-21T22:27:20.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:20 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-21T22:27:20.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:20 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:20.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:20 smithi018 ceph-mon[26614]: Deploying daemon osd.5 on smithi081 2024-04-21T22:27:21.561 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:21 smithi081 ceph-mon[31692]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:21 smithi047 ceph-mon[31561]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:21.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:21 smithi018 ceph-mon[26614]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:23 smithi081 ceph-mon[31692]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:23.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:23 smithi047 ceph-mon[31561]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:23 smithi018 ceph-mon[26614]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:25 smithi018 ceph-mon[26614]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:26.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:25 smithi081 ceph-mon[31692]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:26.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:25 smithi047 ceph-mon[31561]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:26.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:26.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:28.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:28.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:28.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:28.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:28.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:28.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:28.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:28.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:28.538 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 5 on host 'smithi081' 2024-04-21T22:27:28.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.538+0000 7ff2e97fa700 1 -- 172.21.15.81:0/785532892 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff2ec062670 con 0x7ff2d40a2c20 2024-04-21T22:27:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 msgr2=0x7ff2d40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 0x7ff2d40a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec1032f0 tx=0x7ff2dc009470 comp rx=0 tx=0).stop 2024-04-21T22:27:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 msgr2=0x7ff2ec198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0004790 tx=0x7ff2e0009580 comp rx=0 tx=0).stop 2024-04-21T22:27:28.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 shutdown_connections 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff2d40a2c20 0x7ff2d40a50e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2ec103e30 0x7ff2ec19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2ec102290 0x7ff2ec198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 --2- 172.21.15.81:0/785532892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2ec103490 0x7ff2ec198a40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 >> 172.21.15.81:0/785532892 conn(0x7ff2ec0fd830 msgr2=0x7ff2ec1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 shutdown_connections 2024-04-21T22:27:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:27:28.540+0000 7ff2f265f700 1 -- 172.21.15.81:0/785532892 wait complete. 2024-04-21T22:27:29.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:29.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:28 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:28 smithi018 ceph-mon[26614]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:28 smithi018 ceph-mon[26614]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:28 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:28 smithi081 ceph-mon[31692]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:28 smithi081 ceph-mon[31692]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.194 DEBUG:teuthology.orchestra.run.smithi081:osd.5> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.5.service 2024-04-21T22:27:29.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:28 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:29.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:28 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:28 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:29.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:28 smithi047 ceph-mon[31561]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:28 smithi047 ceph-mon[31561]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-21T22:27:29.197 INFO:tasks.cephadm:Deploying osd.6 on smithi018 with /dev/vg_nvme/lv_2... 2024-04-21T22:27:29.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T22:27:29.679 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:30.067 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:29 smithi081 ceph-mon[31692]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:30.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:30.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T22:27:30.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T22:27:30.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:30.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:30.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:29 smithi018 ceph-mon[26614]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:30.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:30.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-21T22:27:30.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: osdmap e36: 6 total, 5 up, 6 in 2024-04-21T22:27:30.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:30.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: from='osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:30.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:29 smithi047 ceph-mon[31561]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:27:31.530 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:27:31.366+0000 7fb248c01700 -1 osd.5 0 waiting for initial osdmap 2024-04-21T22:27:31.531 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:27:31.380+0000 7fb2411ed700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:27:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:31 smithi018 ceph-mon[26614]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:31 smithi018 ceph-mon[26614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:27:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:31 smithi018 ceph-mon[26614]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T22:27:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:31 smithi018 ceph-mon[26614]: from='osd.5 ' entity='osd.5' 2024-04-21T22:27:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-mon[31692]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-mon[31692]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:27:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-mon[31692]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T22:27:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:31 smithi081 ceph-mon[31692]: from='osd.5 ' entity='osd.5' 2024-04-21T22:27:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:31 smithi047 ceph-mon[31561]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-04-21T22:27:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:31 smithi047 ceph-mon[31561]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:27:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:31 smithi047 ceph-mon[31561]: osdmap e37: 6 total, 5 up, 6 in 2024-04-21T22:27:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:31 smithi047 ceph-mon[31561]: from='osd.5 ' entity='osd.5' 2024-04-21T22:27:32.533 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] boot 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:32.534 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] boot 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: osd.5 [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] boot 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: osdmap e38: 6 total, 6 up, 6 in 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:27:32.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T22:27:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T22:27:32.980 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-04-21T22:27:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-04-21T22:27:32.980 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0335001 s, 313 MB/s 2024-04-21T22:27:32.981 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-04-21T22:27:33.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:33 smithi018 ceph-mon[26614]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:33.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:33 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi081 2024-04-21T22:27:33.834 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:33 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 8544M 2024-04-21T22:27:33.834 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:33 smithi018 ceph-mon[26614]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T22:27:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:33 smithi081 ceph-mon[31692]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:33 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi081 2024-04-21T22:27:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:33 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 8544M 2024-04-21T22:27:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:33 smithi081 ceph-mon[31692]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T22:27:33.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-04-21T22:27:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:33 smithi047 ceph-mon[31561]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:33 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi081 2024-04-21T22:27:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:33 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 8544M 2024-04-21T22:27:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:33 smithi047 ceph-mon[31561]: osdmap e39: 6 total, 6 up, 6 in 2024-04-21T22:27:34.371 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:27:34.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:34 smithi018 ceph-mon[26614]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T22:27:34.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:34 smithi081 ceph-mon[31692]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T22:27:34.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:34 smithi047 ceph-mon[31561]: osdmap e40: 6 total, 6 up, 6 in 2024-04-21T22:27:35.781 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:35 smithi018 ceph-mon[26614]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:35.781 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:35 smithi018 ceph-mon[26614]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T22:27:35.845 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:35 smithi047 ceph-mon[31561]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:35.845 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:35 smithi047 ceph-mon[31561]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T22:27:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:35 smithi081 ceph-mon[31692]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:35 smithi081 ceph-mon[31692]: osdmap e41: 6 total, 6 up, 6 in 2024-04-21T22:27:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 -- 172.21.15.18:0/1489749859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61741022a0 msgr2=0x7f61741026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 --2- 172.21.15.18:0/1489749859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61741022a0 0x7f61741026c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61640098f0 tx=0x7f6164009c00 comp rx=0 tx=0).stop 2024-04-21T22:27:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 -- 172.21.15.18:0/1489749859 shutdown_connections 2024-04-21T22:27:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 --2- 172.21.15.18:0/1489749859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6174103e40 0x7f617410a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 --2- 172.21.15.18:0/1489749859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61741022a0 0x7f61741026c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:36.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 --2- 172.21.15.18:0/1489749859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f6174103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:36.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 -- 172.21.15.18:0/1489749859 >> 172.21.15.18:0/1489749859 conn(0x7f61740fd840 msgr2=0x7f61740ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:27:36.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 -- 172.21.15.18:0/1489749859 shutdown_connections 2024-04-21T22:27:36.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.562+0000 7f617a400700 1 -- 172.21.15.18:0/1489749859 wait complete. 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 Processor -- start 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 -- start start 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f617419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6174103e40 0x7f61741a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f617410deb0 con 0x7f61741022a0 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f617410dd30 con 0x7f61741034a0 2024-04-21T22:27:36.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.564+0000 7f617a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f617410e030 con 0x7f6174103e40 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6173400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6173400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52684/0 (socket says 172.21.15.18:52684) 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6173400700 1 -- 172.21.15.18:0/3004871694 learned_addr learned my addr 172.21.15.18:0/3004871694 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f617419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6173e00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6174103e40 0x7f61741a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 -- 172.21.15.18:0/3004871694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6174103e40 msgr2=0x7f61741a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6174103e40 0x7f61741a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 -- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 msgr2=0x7f617419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6172a00700 1 -- 172.21.15.18:0/3004871694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741a23d0 con 0x7f61741034a0 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.565+0000 7f6173400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:27:36.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f6172a00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f617419ad00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f616000e7e0 tx=0x7f616000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160004220 con 0x7f61741034a0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6160004d10 con 0x7f61741034a0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160010700 con 0x7f61741034a0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61741a26c0 con 0x7f61741034a0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.566+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61741a2c00 con 0x7f61741034a0 2024-04-21T22:27:36.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.567+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6174068f20 con 0x7f61741034a0 2024-04-21T22:27:36.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.570+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6160004750 con 0x7f61741034a0 2024-04-21T22:27:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.572+0000 7f616be00700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 0x7f61580a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:27:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.572+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f61600cdfe0 con 0x7f61741034a0 2024-04-21T22:27:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.572+0000 7f6173400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 0x7f61580a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:27:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.573+0000 7f6173400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 0x7f61580a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f616400c010 tx=0x7f616401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:27:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.573+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f616009be80 con 0x7f61741034a0 2024-04-21T22:27:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:27:36.810+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6174075b80 con 0x7f61580a2ca0 2024-04-21T22:27:36.811 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:36 smithi018 ceph-mon[26614]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T22:27:36.861 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:36 smithi047 ceph-mon[31561]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T22:27:36.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:36 smithi081 ceph-mon[31692]: osdmap e42: 6 total, 6 up, 6 in 2024-04-21T22:27:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:37 smithi018 ceph-mon[26614]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:37 smithi018 ceph-mon[26614]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:37.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:37.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:37.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:37 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:37 smithi081 ceph-mon[31692]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:37 smithi081 ceph-mon[31692]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:37 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:37 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:37.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:37 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:37.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:37 smithi047 ceph-mon[31561]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 362 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:37.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:37 smithi047 ceph-mon[31561]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:27:37.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:37 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:27:37.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:37 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:27:37.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:37 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:39 smithi018 ceph-mon[26614]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-21T22:27:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:39 smithi081 ceph-mon[31692]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-21T22:27:39.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:39 smithi047 ceph-mon[31561]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-21T22:27:41.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:41 smithi018 ceph-mon[26614]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-21T22:27:41.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:41 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]: dispatch 2024-04-21T22:27:41.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:41 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]': finished 2024-04-21T22:27:41.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:41 smithi018 ceph-mon[26614]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T22:27:41.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:41 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:27:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:41 smithi081 ceph-mon[31692]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-21T22:27:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:41 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]: dispatch 2024-04-21T22:27:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:41 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]': finished 2024-04-21T22:27:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:41 smithi081 ceph-mon[31692]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T22:27:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:41 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:27:41.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:41 smithi047 ceph-mon[31561]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-21T22:27:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:41 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]: dispatch 2024-04-21T22:27:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:41 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1223145952' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e511f2-088a-40f5-b6a1-b95c04890eed"}]': finished 2024-04-21T22:27:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:41 smithi047 ceph-mon[31561]: osdmap e43: 7 total, 6 up, 7 in 2024-04-21T22:27:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:41 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:27:42.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:42 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4213501484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:42 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4213501484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:43.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:42 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4213501484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:27:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:43 smithi081 ceph-mon[31692]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-21T22:27:43.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:43 smithi047 ceph-mon[31561]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-21T22:27:44.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:43 smithi018 ceph-mon[26614]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-21T22:27:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:45 smithi018 ceph-mon[26614]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-21T22:27:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:45 smithi081 ceph-mon[31692]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-21T22:27:45.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:45 smithi047 ceph-mon[31561]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-21T22:27:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:47 smithi018 ceph-mon[26614]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:27:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:47 smithi081 ceph-mon[31692]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:27:47.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:47 smithi047 ceph-mon[31561]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:27:49.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:49 smithi018 ceph-mon[26614]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:49 smithi081 ceph-mon[31692]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:49.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:49 smithi047 ceph-mon[31561]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:50 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T22:27:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:50 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:50 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T22:27:50.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:50 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:51.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:50 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-21T22:27:51.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:50 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:27:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:51 smithi018 ceph-mon[26614]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:51 smithi018 ceph-mon[26614]: Deploying daemon osd.6 on smithi018 2024-04-21T22:27:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:51 smithi081 ceph-mon[31692]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:51 smithi081 ceph-mon[31692]: Deploying daemon osd.6 on smithi018 2024-04-21T22:27:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:51 smithi047 ceph-mon[31561]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:51 smithi047 ceph-mon[31561]: Deploying daemon osd.6 on smithi018 2024-04-21T22:27:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:53 smithi081 ceph-mon[31692]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:53.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:53 smithi047 ceph-mon[31561]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:53 smithi018 ceph-mon[26614]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:55 smithi081 ceph-mon[31692]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:55.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:55 smithi047 ceph-mon[31561]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:56.009 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:55 smithi018 ceph-mon[26614]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:57.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:57 smithi047 ceph-mon[31561]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:58.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:57 smithi018 ceph-mon[26614]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:57 smithi081 ceph-mon[31692]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:59.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:59 smithi018 ceph-mon[26614]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:59.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.938 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:27:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:59.940 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:59 smithi081 ceph-mon[31692]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:59.940 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.940 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.940 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:27:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:27:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:59 smithi047 ceph-mon[31561]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:27:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:27:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:27:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:01.929 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:01 smithi018 ceph-mon[26614]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:01 smithi047 ceph-mon[31561]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:02.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:01 smithi081 ceph-mon[31692]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:03 smithi018 ceph-mon[26614]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:03 smithi018 ceph-mon[26614]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:03 smithi018 ceph-mon[26614]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:03.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:03 smithi047 ceph-mon[31561]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:03 smithi047 ceph-mon[31561]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:03 smithi047 ceph-mon[31561]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:04.073 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 6 on host 'smithi018' 2024-04-21T22:28:04.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.072+0000 7f616be00700 1 -- 172.21.15.18:0/3004871694 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6174075b80 con 0x7f61580a2ca0 2024-04-21T22:28:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 msgr2=0x7f61580a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 0x7f61580a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f616400c010 tx=0x7f616401a040 comp rx=0 tx=0).stop 2024-04-21T22:28:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 msgr2=0x7f617419ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f617419ad00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f616000e7e0 tx=0x7f616000eaf0 comp rx=0 tx=0).stop 2024-04-21T22:28:04.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 shutdown_connections 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6174103e40 0x7f61741a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61741022a0 0x7f617419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f61580a2ca0 0x7f61580a5160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 --2- 172.21.15.18:0/3004871694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f61741034a0 0x7f617419ad00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 >> 172.21.15.18:0/3004871694 conn(0x7f61740fd840 msgr2=0x7f6174074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 shutdown_connections 2024-04-21T22:28:04.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:28:04.076+0000 7f617a400700 1 -- 172.21.15.18:0/3004871694 wait complete. 2024-04-21T22:28:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:03 smithi081 ceph-mon[31692]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:03 smithi081 ceph-mon[31692]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:03 smithi081 ceph-mon[31692]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:04.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:04.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:04 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:05.005 DEBUG:teuthology.orchestra.run.smithi018:osd.6> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.6.service 2024-04-21T22:28:05.010 INFO:tasks.cephadm:Deploying osd.7 on smithi047 with /dev/vg_nvme/lv_2... 2024-04-21T22:28:05.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T22:28:05.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-21T22:28:05.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:05.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: osdmap e44: 7 total, 6 up, 7 in 2024-04-21T22:28:05.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:05.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:28:05.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:05.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:04 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:05.269 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:28:05.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-mon[26614]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:05.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-mon[26614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:28:05.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-mon[26614]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T22:28:05.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:05.790 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:05.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:05 smithi047 ceph-mon[31561]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:05 smithi047 ceph-mon[31561]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:28:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:05 smithi047 ceph-mon[31561]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T22:28:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:06.095 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:28:05.789+0000 7f45b3400700 -1 osd.6 0 waiting for initial osdmap 2024-04-21T22:28:06.096 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:28:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:28:05.828+0000 7f45a9c00700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:28:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:05 smithi081 ceph-mon[31692]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:05 smithi081 ceph-mon[31692]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:28:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:05 smithi081 ceph-mon[31692]: osdmap e45: 7 total, 6 up, 7 in 2024-04-21T22:28:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:06.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:06.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:06 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:28:06.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:06 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:28:06.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:06.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:06 smithi018 ceph-mon[26614]: from='osd.6 ' entity='osd.6' 2024-04-21T22:28:06.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:06 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:28:06.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:06 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:28:06.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:06.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:06 smithi047 ceph-mon[31561]: from='osd.6 ' entity='osd.6' 2024-04-21T22:28:07.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:06 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:28:07.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:06 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:28:07.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:07.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:06 smithi081 ceph-mon[31692]: from='osd.6 ' entity='osd.6' 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00861935 s, 1.2 GB/s 2024-04-21T22:28:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-21T22:28:07.836 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:07 smithi047 ceph-mon[31561]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:07.836 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:07.836 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:07 smithi047 ceph-mon[31561]: osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] boot 2024-04-21T22:28:07.836 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:07 smithi047 ceph-mon[31561]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T22:28:07.836 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:07 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:07.863 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-04-21T22:28:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:07 smithi018 ceph-mon[26614]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:07 smithi018 ceph-mon[26614]: osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] boot 2024-04-21T22:28:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:07 smithi018 ceph-mon[26614]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T22:28:08.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:07 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:28:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:07 smithi081 ceph-mon[31692]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-04-21T22:28:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:07 smithi081 ceph-mon[31692]: osd.6 [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] boot 2024-04-21T22:28:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:07 smithi081 ceph-mon[31692]: osdmap e46: 7 total, 7 up, 7 in 2024-04-21T22:28:08.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:07 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:28:09.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:08 smithi018 ceph-mon[26614]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T22:28:09.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:08 smithi081 ceph-mon[31692]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T22:28:09.175 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:08 smithi047 ceph-mon[31561]: osdmap e47: 7 total, 7 up, 7 in 2024-04-21T22:28:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.669+0000 7f9058337700 1 -- 172.21.15.47:0/1361251934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050107fa0 msgr2=0x7f905010a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:09.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.669+0000 7f9058337700 1 --2- 172.21.15.47:0/1361251934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050107fa0 0x7f905010a410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f904800b0a0 tx=0x7f904800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 -- 172.21.15.47:0/1361251934 shutdown_connections 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 --2- 172.21.15.47:0/1361251934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050107fa0 0x7f905010a410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 --2- 172.21.15.47:0/1361251934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050102d40 0x7f9050105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 --2- 172.21.15.47:0/1361251934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9050105670 0x7f9050107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 -- 172.21.15.47:0/1361251934 >> 172.21.15.47:0/1361251934 conn(0x7f90500fc750 msgr2=0x7f90500feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 -- 172.21.15.47:0/1361251934 shutdown_connections 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 -- 172.21.15.47:0/1361251934 wait complete. 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 Processor -- start 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.670+0000 7f9058337700 1 -- start start 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9050102d40 0x7f9050198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050107fa0 0x7f905019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f905010dfb0 con 0x7f9050102d40 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f905010de30 con 0x7f9050105670 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f9058337700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f905010e130 con 0x7f9050107fa0 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:39090/0 (socket says 172.21.15.47:39090) 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 -- 172.21.15.47:0/1288936010 learned_addr learned my addr 172.21.15.47:0/1288936010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90568d4700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050107fa0 0x7f905019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 -- 172.21.15.47:0/1288936010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050107fa0 msgr2=0x7f905019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050107fa0 0x7f905019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 -- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9050102d40 msgr2=0x7f9050198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9050102d40 0x7f9050198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 -- 172.21.15.47:0/1288936010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90501a01c0 con 0x7f9050105670 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90558d2700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f904000b530 tx=0x7f904000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:28:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.671+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9040015020 con 0x7f9050105670 2024-04-21T22:28:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.672+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9040011d10 con 0x7f9050105670 2024-04-21T22:28:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.672+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90501a04b0 con 0x7f9050105670 2024-04-21T22:28:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.672+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904000f2e0 con 0x7f9050105670 2024-04-21T22:28:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.672+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90501a0a70 con 0x7f9050105670 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.673+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9050068f20 con 0x7f9050105670 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.674+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9040018020 con 0x7f9050105670 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.674+0000 7f90477fe700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 0x7f903c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.675+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f90400cdbe0 con 0x7f9050105670 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.675+0000 7f90560d3700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 0x7f903c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.676+0000 7f90560d3700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 0x7f903c0a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f904c0097b0 tx=0x7f904c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:28:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.679+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f904001f020 con 0x7f9050105670 2024-04-21T22:28:09.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:09.893+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9050062670 con 0x7f903c0a2c20 2024-04-21T22:28:10.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:09 smithi018 ceph-mon[26614]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:09 smithi081 ceph-mon[31692]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:10.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:09 smithi047 ceph-mon[31561]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:11.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi018 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 5698M 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:11.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:10 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:11.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi018 2024-04-21T22:28:11.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 5698M 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:11.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:11.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:10 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi018 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:11.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 5698M 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:11.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:10 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:12.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:12.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:12.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:12.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:12.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:12.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:12.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/525546414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]': finished 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T22:28:13.209 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:12 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/525546414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]': finished 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T22:28:13.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:12 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/525546414' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]: dispatch 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2fcb5522-f12d-4b28-8765-a40c88b42ae1"}]': finished 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: osdmap e48: 8 total, 7 up, 8 in 2024-04-21T22:28:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:12 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:14.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:13 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/2125374367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:14.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/2125374367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:14.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:13 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/2125374367' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:15.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:14 smithi018 ceph-mon[26614]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:15.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:14 smithi081 ceph-mon[31692]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:15.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:14 smithi047 ceph-mon[31561]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:17.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:17 smithi018 ceph-mon[26614]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:17.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:17 smithi081 ceph-mon[31692]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:17.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:17 smithi047 ceph-mon[31561]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:19.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:19 smithi047 ceph-mon[31561]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:19.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:19 smithi018 ceph-mon[26614]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:19.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:19 smithi081 ceph-mon[31692]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:21.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:21 smithi018 ceph-mon[26614]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:21.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T22:28:21.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:21.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:21 smithi018 ceph-mon[26614]: Deploying daemon osd.7 on smithi047 2024-04-21T22:28:21.382 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:21 smithi047 ceph-mon[31561]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:21.383 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T22:28:21.383 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:21.383 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:21 smithi047 ceph-mon[31561]: Deploying daemon osd.7 on smithi047 2024-04-21T22:28:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:21 smithi081 ceph-mon[31692]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-21T22:28:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:21 smithi081 ceph-mon[31692]: Deploying daemon osd.7 on smithi047 2024-04-21T22:28:23.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:23 smithi018 ceph-mon[26614]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:23 smithi081 ceph-mon[31692]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:23.433 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:23 smithi047 ceph-mon[31561]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:25.325 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:25 smithi047 ceph-mon[31561]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:25 smithi081 ceph-mon[31692]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:25 smithi018 ceph-mon[26614]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:27.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:27.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:26 smithi047 ceph-mon[31561]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:27.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:27.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:26 smithi018 ceph-mon[26614]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:26 smithi081 ceph-mon[31692]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:29.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:29.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:29.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:29.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.889+0000 7f90477fe700 1 -- 172.21.15.47:0/1288936010 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9050062670 con 0x7f903c0a2c20 2024-04-21T22:28:29.889 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 7 on host 'smithi047' 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.891+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 msgr2=0x7f903c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.891+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 0x7f903c0a50e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f904c0097b0 tx=0x7f904c006d20 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.891+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 msgr2=0x7f9050198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.891+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f904000b530 tx=0x7f904000b840 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 shutdown_connections 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9050107fa0 0x7f905019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9050102d40 0x7f9050198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f903c0a2c20 0x7f903c0a50e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 --2- 172.21.15.47:0/1288936010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9050105670 0x7f9050198aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 >> 172.21.15.47:0/1288936010 conn(0x7f90500fc750 msgr2=0x7f9050103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 shutdown_connections 2024-04-21T22:28:29.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:28:29.892+0000 7f9058337700 1 -- 172.21.15.47:0/1288936010 wait complete. 2024-04-21T22:28:30.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:30 smithi018 ceph-mon[26614]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:30 smithi018 ceph-mon[26614]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:30.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:30 smithi081 ceph-mon[31692]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:30 smithi081 ceph-mon[31692]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:30.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:30 smithi047 ceph-mon[31561]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:30 smithi047 ceph-mon[31561]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-21T22:28:30.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:30.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:30.496 DEBUG:teuthology.orchestra.run.smithi047:osd.7> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.7.service 2024-04-21T22:28:30.498 INFO:tasks.cephadm:Deploying osd.8 on smithi081 with /dev/vg_nvme/lv_2... 2024-04-21T22:28:30.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-21T22:28:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:28:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T22:28:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T22:28:31.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:31.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:31 smithi081 ceph-mon[31692]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:31.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-mon[31561]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:31.446 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:28:31.102+0000 7f2f69322700 -1 osd.7 0 waiting for initial osdmap 2024-04-21T22:28:31.446 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:28:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:28:31.113+0000 7f2f65916700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: from='osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: osdmap e49: 8 total, 7 up, 8 in 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:31.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:31 smithi018 ceph-mon[26614]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:28:32.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:32 smithi018 ceph-mon[26614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:28:32.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:32 smithi018 ceph-mon[26614]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T22:28:32.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:32 smithi081 ceph-mon[31692]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:28:32.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:32 smithi081 ceph-mon[31692]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T22:28:32.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:32 smithi047 ceph-mon[31561]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:28:32.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:32 smithi047 ceph-mon[31561]: osdmap e50: 8 total, 7 up, 8 in 2024-04-21T22:28:32.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011539 s, 909 MB/s 2024-04-21T22:28:32.632 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] boot 2024-04-21T22:28:33.244 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T22:28:33.245 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:33.245 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:33 smithi081 ceph-mon[31692]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T22:28:33.268 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:28:33.268 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:28:33.268 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:33.268 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-21T22:28:33.269 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] boot 2024-04-21T22:28:33.269 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T22:28:33.269 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:33.269 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:33 smithi047 ceph-mon[31561]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T22:28:33.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-04-21T22:28:33.504 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: osd.7 [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] boot 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: osdmap e51: 8 total, 8 up, 8 in 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:28:33.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:33 smithi018 ceph-mon[26614]: osdmap e52: 8 total, 8 up, 8 in 2024-04-21T22:28:34.551 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi047 2024-04-21T22:28:34.551 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.551 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.551 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.551 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 5697M 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.552 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:34 smithi081 ceph-mon[31692]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T22:28:34.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi047 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 5697M 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:34 smithi018 ceph-mon[26614]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T22:28:34.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi047 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 5697M 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:34.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:34 smithi047 ceph-mon[31561]: osdmap e53: 8 total, 8 up, 8 in 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 -- 172.21.15.81:0/2476053028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298102d30 msgr2=0x7fb2981095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/2476053028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298102d30 0x7fb2981095e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb29000b0a0 tx=0x7fb29000b3b0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 -- 172.21.15.81:0/2476053028 shutdown_connections 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/2476053028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298102d30 0x7fb2981095e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/2476053028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298101190 0x7fb2981015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/2476053028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb298102390 0x7fb2981027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 -- 172.21.15.81:0/2476053028 >> 172.21.15.81:0/2476053028 conn(0x7fb2980fc730 msgr2=0x7fb2980feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:28:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 -- 172.21.15.81:0/2476053028 shutdown_connections 2024-04-21T22:28:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.065+0000 7fb29d0d3700 1 -- 172.21.15.81:0/2476053028 wait complete. 2024-04-21T22:28:35.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 Processor -- start 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 -- start start 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb298102390 0x7fb2981979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298102d30 0x7fb29819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810ce70 con 0x7fb298102390 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810ccf0 con 0x7fb298102d30 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29d0d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810cff0 con 0x7fb298101190 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34854/0 (socket says 172.21.15.81:34854) 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 -- 172.21.15.81:0/3564496010 learned_addr learned my addr 172.21.15.81:0/3564496010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb29759e700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298102d30 0x7fb29819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 -- 172.21.15.81:0/3564496010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298102d30 msgr2=0x7fb29819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298102d30 0x7fb29819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 -- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb298102390 msgr2=0x7fb2981979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb298102390 0x7fb2981979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.066+0000 7fb296d9d700 1 -- 172.21.15.81:0/3564496010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29819f0c0 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb296d9d700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb28800d9e0 tx=0x7fb28800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28801b070 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb28800ebd0 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2880145e0 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29806a9c0 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.067+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29806af30 con 0x7fb298101190 2024-04-21T22:28:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.068+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb298068f20 con 0x7fb298101190 2024-04-21T22:28:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.069+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb28801e070 con 0x7fb298101190 2024-04-21T22:28:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.070+0000 7fb27ffff700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 0x7fb2800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:28:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.070+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7fb2880cff60 con 0x7fb298101190 2024-04-21T22:28:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.070+0000 7fb29659c700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 0x7fb2800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:28:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.071+0000 7fb29659c700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 0x7fb2800a50e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097b0 tx=0x7fb28c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:28:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.074+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb28809da20 con 0x7fb298101190 2024-04-21T22:28:35.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:35.285+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb29806b250 con 0x7fb2800a2c20 2024-04-21T22:28:35.595 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:35 smithi047 ceph-mon[31561]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:35.595 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:35 smithi047 ceph-mon[31561]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T22:28:35.595 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:35.595 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:35.595 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:35 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:35.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:35 smithi018 ceph-mon[26614]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:35.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:35 smithi018 ceph-mon[26614]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T22:28:35.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:35.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:35.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:35 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:35 smithi081 ceph-mon[31692]: pgmap v202: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:35 smithi081 ceph-mon[31692]: osdmap e54: 8 total, 8 up, 8 in 2024-04-21T22:28:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:28:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:28:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:35 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:36.577 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:36 smithi081 ceph-mon[31692]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:36.577 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:36 smithi081 ceph-mon[31692]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T22:28:36.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:36 smithi018 ceph-mon[26614]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:36.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:36 smithi018 ceph-mon[26614]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T22:28:36.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:36 smithi047 ceph-mon[31561]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:28:36.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:36 smithi047 ceph-mon[31561]: osdmap e55: 8 total, 8 up, 8 in 2024-04-21T22:28:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:37 smithi018 ceph-mon[26614]: pgmap v205: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:37 smithi081 ceph-mon[31692]: pgmap v205: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:37.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:37 smithi047 ceph-mon[31561]: pgmap v205: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:38.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:38 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/3446202822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:38 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:38 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]': finished 2024-04-21T22:28:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:38 smithi018 ceph-mon[26614]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T22:28:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:38 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/3446202822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:38 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:38 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]': finished 2024-04-21T22:28:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:38 smithi081 ceph-mon[31692]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T22:28:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:38.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:38 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/3446202822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:38 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]: dispatch 2024-04-21T22:28:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:38 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7046706c-9c23-47c7-bda8-4225a7b15865"}]': finished 2024-04-21T22:28:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:38 smithi047 ceph-mon[31561]: osdmap e56: 9 total, 8 up, 9 in 2024-04-21T22:28:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:39 smithi018 ceph-mon[26614]: pgmap v207: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/2569916249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:39 smithi081 ceph-mon[31692]: pgmap v207: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/2569916249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:39 smithi047 ceph-mon[31561]: pgmap v207: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/2569916249' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:28:40.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:40 smithi047 ceph-mon[31561]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-21T22:28:40.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:40 smithi047 ceph-mon[31561]: Cluster is now healthy 2024-04-21T22:28:40.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:40 smithi018 ceph-mon[26614]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-21T22:28:40.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:40 smithi018 ceph-mon[26614]: Cluster is now healthy 2024-04-21T22:28:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:40 smithi081 ceph-mon[31692]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-21T22:28:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:40 smithi081 ceph-mon[31692]: Cluster is now healthy 2024-04-21T22:28:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:41 smithi047 ceph-mon[31561]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:41 smithi018 ceph-mon[26614]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:41 smithi081 ceph-mon[31692]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:43.523 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:43 smithi081 ceph-mon[31692]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:43 smithi047 ceph-mon[31561]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:43 smithi018 ceph-mon[26614]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:45.508 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:45 smithi081 ceph-mon[31692]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:45 smithi047 ceph-mon[31561]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:45 smithi018 ceph-mon[26614]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:46.494 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T22:28:46.494 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:46.494 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:46 smithi081 ceph-mon[31692]: Deploying daemon osd.8 on smithi081 2024-04-21T22:28:46.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T22:28:46.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:46.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:46 smithi047 ceph-mon[31561]: Deploying daemon osd.8 on smithi081 2024-04-21T22:28:46.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-21T22:28:46.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:46.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:46 smithi018 ceph-mon[26614]: Deploying daemon osd.8 on smithi081 2024-04-21T22:28:47.559 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:47 smithi081 ceph-mon[31692]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:47 smithi047 ceph-mon[31561]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:47 smithi018 ceph-mon[26614]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:49 smithi081 ceph-mon[31692]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:49 smithi047 ceph-mon[31561]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:49 smithi018 ceph-mon[26614]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:51.689 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:51 smithi081 ceph-mon[31692]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:51.689 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:51 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.689 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:51 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.689 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:51 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:51 smithi047 ceph-mon[31561]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:51 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:51 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:51 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:51 smithi018 ceph-mon[26614]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:51 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:53 smithi081 ceph-mon[31692]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:53 smithi047 ceph-mon[31561]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:53 smithi018 ceph-mon[26614]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.178+0000 7fb27ffff700 1 -- 172.21.15.81:0/3564496010 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb29806b250 con 0x7fb2800a2c20 2024-04-21T22:28:55.178 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 8 on host 'smithi081' 2024-04-21T22:28:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 msgr2=0x7fb2800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 0x7fb2800a50e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097b0 tx=0x7fb28c006d20 comp rx=0 tx=0).stop 2024-04-21T22:28:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 msgr2=0x7fb298197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:28:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb28800d9e0 tx=0x7fb28800dcf0 comp rx=0 tx=0).stop 2024-04-21T22:28:55.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 shutdown_connections 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2800a2c20 0x7fb2800a50e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb298102d30 0x7fb29819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb298101190 0x7fb298197460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 --2- 172.21.15.81:0/3564496010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb298102390 0x7fb2981979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.180+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 >> 172.21.15.81:0/3564496010 conn(0x7fb2980fc730 msgr2=0x7fb298105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.181+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 shutdown_connections 2024-04-21T22:28:55.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:28:55.181+0000 7fb29d0d3700 1 -- 172.21.15.81:0/3564496010 wait complete. 2024-04-21T22:28:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:55 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:55.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:55 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:28:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:55 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:28:55.822 DEBUG:teuthology.orchestra.run.smithi081:osd.8> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.8.service 2024-04-21T22:28:55.824 INFO:tasks.cephadm:Deploying osd.9 on smithi018 with /dev/vg_nvme/lv_1... 2024-04-21T22:28:55.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T22:28:56.283 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:28:56.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:56 smithi018 ceph-mon[26614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T22:28:56.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:56 smithi018 ceph-mon[26614]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:56.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:56 smithi018 ceph-mon[26614]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T22:28:56.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:56 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:56.730 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:56 smithi018 ceph-mon[26614]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:56.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-mon[31692]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T22:28:56.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-mon[31692]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:56.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-mon[31692]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T22:28:56.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:56.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-mon[31692]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:56.889 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:28:56.453+0000 7f1e559c3700 -1 osd.8 0 waiting for initial osdmap 2024-04-21T22:28:56.889 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:28:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:28:56.463+0000 7f1e51fb7700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:28:56.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:56 smithi047 ceph-mon[31561]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-21T22:28:56.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:56 smithi047 ceph-mon[31561]: from='osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:56.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:56 smithi047 ceph-mon[31561]: osdmap e57: 9 total, 8 up, 9 in 2024-04-21T22:28:56.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:56 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:56.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:56 smithi047 ceph-mon[31561]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:28:57.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:57 smithi018 ceph-mon[26614]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:57.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:57 smithi018 ceph-mon[26614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:28:57.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:57 smithi018 ceph-mon[26614]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T22:28:57.791 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:57.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:57 smithi081 ceph-mon[31692]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:57.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:57 smithi081 ceph-mon[31692]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:28:57.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:57 smithi081 ceph-mon[31692]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T22:28:57.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:57.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:57 smithi047 ceph-mon[31561]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-04-21T22:28:57.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:57 smithi047 ceph-mon[31561]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:28:57.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:57 smithi047 ceph-mon[31561]: osdmap e58: 9 total, 8 up, 9 in 2024-04-21T22:28:57.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:58.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:28:58.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:28:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] boot 2024-04-21T22:28:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T22:28:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:58 smithi081 ceph-mon[31692]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T22:28:58.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:28:58.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:28:58.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] boot 2024-04-21T22:28:58.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T22:28:58.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:58.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:58 smithi018 ceph-mon[26614]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T22:28:58.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:28:58.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:28:58.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: osd.8 [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] boot 2024-04-21T22:28:58.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: osdmap e59: 9 total, 9 up, 9 in 2024-04-21T22:28:58.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:28:58.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:58 smithi047 ceph-mon[31561]: osdmap e60: 9 total, 9 up, 9 in 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10+0 records in 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr:10+0 records out 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0319748 s, 328 MB/s 2024-04-21T22:28:59.428 INFO:teuthology.orchestra.run.smithi018.stderr:--> Zapping successful for: 2024-04-21T22:29:00.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:00.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi081 2024-04-21T22:29:00.026 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 5696M 2024-04-21T22:29:00.027 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:00.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:00.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.028 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:28:59 smithi018 ceph-mon[26614]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T22:29:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi081 2024-04-21T22:29:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 5696M 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:28:59 smithi081 ceph-mon[31692]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi081 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 5696M 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:00.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:00.197 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:28:59 smithi047 ceph-mon[31561]: osdmap e61: 9 total, 9 up, 9 in 2024-04-21T22:29:00.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-04-21T22:29:00.981 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:29:01.312 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:00 smithi018 ceph-mon[26614]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T22:29:01.313 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:00 smithi018 ceph-mon[26614]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:01.338 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:00 smithi081 ceph-mon[31692]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T22:29:01.338 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:00 smithi081 ceph-mon[31692]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:01.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:00 smithi047 ceph-mon[31561]: osdmap e62: 9 total, 9 up, 9 in 2024-04-21T22:29:01.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:00 smithi047 ceph-mon[31561]: pgmap v224: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:02.176 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:01 smithi018 ceph-mon[26614]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T22:29:02.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:01 smithi081 ceph-mon[31692]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T22:29:02.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:01 smithi047 ceph-mon[31561]: osdmap e63: 9 total, 9 up, 9 in 2024-04-21T22:29:03.074 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:02 smithi018 ceph-mon[26614]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.130+0000 7f10ee600700 1 -- 172.21.15.18:0/1101880708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e810a470 msgr2=0x7f10e8110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.130+0000 7f10ee600700 1 --2- 172.21.15.18:0/1101880708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e810a470 0x7f10e8110d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009f90 tx=0x7f10e000b330 comp rx=0 tx=0).stop 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 -- 172.21.15.18:0/1101880708 shutdown_connections 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 --2- 172.21.15.18:0/1101880708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e810a470 0x7f10e8110d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 --2- 172.21.15.18:0/1101880708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e81088d0 0x7f10e8108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 --2- 172.21.15.18:0/1101880708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e8109ad0 0x7f10e8109f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 -- 172.21.15.18:0/1101880708 >> 172.21.15.18:0/1101880708 conn(0x7f10e80778a0 msgr2=0x7f10e8079ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 -- 172.21.15.18:0/1101880708 shutdown_connections 2024-04-21T22:29:03.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.131+0000 7f10ee600700 1 -- 172.21.15.18:0/1101880708 wait complete. 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.132+0000 7f10ee600700 1 Processor -- start 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.132+0000 7f10ee600700 1 -- start start 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.132+0000 7f10ee600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.132+0000 7f10ee600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e8109ad0 0x7f10e819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.132+0000 7f10ee600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10ee600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10e81144f0 con 0x7f10e810a470 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10ee600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8114370 con 0x7f10e8109ad0 2024-04-21T22:29:03.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10ee600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8114670 con 0x7f10e81088d0 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33638/0 (socket says 172.21.15.18:33638) 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 -- 172.21.15.18:0/2265061599 learned_addr learned my addr 172.21.15.18:0/2265061599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55938/0 (socket says 172.21.15.18:55938) 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e6a00700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e8109ad0 0x7f10e819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 -- 172.21.15.18:0/2265061599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e8109ad0 msgr2=0x7f10e819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e8109ad0 0x7f10e819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 -- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 msgr2=0x7f10e81a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7400700 1 -- 172.21.15.18:0/2265061599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e81a66a0 con 0x7f10e81088d0 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.133+0000 7f10e7e00700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:29:03.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10e7400700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10d800ea20 tx=0x7f10d800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8004220 con 0x7f10e81088d0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e81a6990 con 0x7f10e81088d0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10d80043c0 con 0x7f10e81088d0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8003c70 con 0x7f10e81088d0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.134+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81a6f20 con 0x7f10e81088d0 2024-04-21T22:29:03.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.135+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e8068f20 con 0x7f10e81088d0 2024-04-21T22:29:03.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.137+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f10d800cd30 con 0x7f10e81088d0 2024-04-21T22:29:03.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.139+0000 7f10dfe00700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 0x7f10cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:03.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.139+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7f10d80ce8a0 con 0x7f10e81088d0 2024-04-21T22:29:03.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.139+0000 7f10e6a00700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 0x7f10cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:03.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.140+0000 7f10e6a00700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 0x7f10cc0a50e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009680 tx=0x7f10d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:29:03.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.144+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f10d809c110 con 0x7f10e81088d0 2024-04-21T22:29:03.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:02 smithi081 ceph-mon[31692]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:03.391+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f10e8062670 con 0x7f10cc0a2c20 2024-04-21T22:29:03.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:02 smithi047 ceph-mon[31561]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:04.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:03 smithi018 ceph-mon[26614]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:04.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:04.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:04.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:04.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:03 smithi081 ceph-mon[31692]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:04.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:04.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:04.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:04.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:03 smithi047 ceph-mon[31561]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:04.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:04.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:04.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:05.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:04 smithi018 ceph-mon[26614]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:29:05.345 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:04 smithi047 ceph-mon[31561]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:29:05.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:04 smithi081 ceph-mon[31692]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:29:07.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:07 smithi018 ceph-mon[26614]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:29:07.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:07 smithi081 ceph-mon[31692]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:29:07.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:07 smithi047 ceph-mon[31561]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:29:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:08 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2055435975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:08 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:08 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]': finished 2024-04-21T22:29:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:08 smithi018 ceph-mon[26614]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T22:29:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:08 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:08 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2055435975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:08 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:08 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]': finished 2024-04-21T22:29:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:08 smithi081 ceph-mon[31692]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T22:29:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:08 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:08.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:08 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2055435975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:08 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]: dispatch 2024-04-21T22:29:08.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:08 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5876c45c-6319-41bd-9555-8b327bc0f71b"}]': finished 2024-04-21T22:29:08.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:08 smithi047 ceph-mon[31561]: osdmap e64: 10 total, 9 up, 10 in 2024-04-21T22:29:08.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:08 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:09.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:09 smithi081 ceph-mon[31692]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T22:29:09.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:09 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2344162258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:09.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:09 smithi018 ceph-mon[26614]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T22:29:09.413 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2344162258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:09.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:09 smithi047 ceph-mon[31561]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-21T22:29:09.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:09 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2344162258' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:11.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:11 smithi081 ceph-mon[31692]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T22:29:11.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:11 smithi047 ceph-mon[31561]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T22:29:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:11 smithi018 ceph-mon[26614]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-21T22:29:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:13 smithi081 ceph-mon[31692]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:29:13.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:13 smithi047 ceph-mon[31561]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:29:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:13 smithi018 ceph-mon[26614]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-21T22:29:15.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:15 smithi018 ceph-mon[26614]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:15.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:15 smithi081 ceph-mon[31692]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:15.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:15 smithi047 ceph-mon[31561]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:17.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:17 smithi018 ceph-mon[26614]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:17.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T22:29:17.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:17.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:17 smithi081 ceph-mon[31692]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:17.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T22:29:17.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:17.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:17 smithi047 ceph-mon[31561]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:17.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-21T22:29:17.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:18.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:18 smithi081 ceph-mon[31692]: Deploying daemon osd.9 on smithi018 2024-04-21T22:29:18.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:18 smithi047 ceph-mon[31561]: Deploying daemon osd.9 on smithi018 2024-04-21T22:29:18.481 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:18 smithi018 ceph-mon[26614]: Deploying daemon osd.9 on smithi018 2024-04-21T22:29:19.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:19 smithi018 ceph-mon[26614]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:19.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:19 smithi081 ceph-mon[31692]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:19.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:19 smithi047 ceph-mon[31561]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:21.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:21 smithi018 ceph-mon[26614]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:21 smithi081 ceph-mon[31692]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:21.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:21 smithi047 ceph-mon[31561]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:23.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:23 smithi018 ceph-mon[26614]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:23 smithi081 ceph-mon[31692]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:23 smithi047 ceph-mon[31561]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:25.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:25 smithi018 ceph-mon[26614]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:25 smithi047 ceph-mon[31561]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:25 smithi081 ceph-mon[31692]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:27.178 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.178 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:27.178 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.178 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:26 smithi018 ceph-mon[26614]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:26 smithi081 ceph-mon[31692]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:26 smithi047 ceph-mon[31561]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:29.375 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:29 smithi018 ceph-mon[26614]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:29 smithi081 ceph-mon[31692]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:29.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:29 smithi047 ceph-mon[31561]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:31.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.089+0000 7f10dfe00700 1 -- 172.21.15.18:0/2265061599 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10e8062670 con 0x7f10cc0a2c20 2024-04-21T22:29:31.090 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 9 on host 'smithi018' 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 msgr2=0x7f10cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 0x7f10cc0a50e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009680 tx=0x7f10d4009260 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 msgr2=0x7f10e819ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10d800ea20 tx=0x7f10d800ed30 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 shutdown_connections 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10e810a470 0x7f10e81a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10e81088d0 0x7f10e819ea40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f10cc0a2c20 0x7f10cc0a50e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 --2- 172.21.15.18:0/2265061599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e8109ad0 0x7f10e819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:31.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 >> 172.21.15.18:0/2265061599 conn(0x7f10e80778a0 msgr2=0x7f10e810cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:29:31.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:30 smithi018 ceph-mon[26614]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.094 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:30 smithi018 ceph-mon[26614]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.093+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 shutdown_connections 2024-04-21T22:29:31.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:29:31.094+0000 7f10ee600700 1 -- 172.21.15.18:0/2265061599 wait complete. 2024-04-21T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:30 smithi081 ceph-mon[31692]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:30 smithi081 ceph-mon[31692]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:31.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:30 smithi047 ceph-mon[31561]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:30 smithi047 ceph-mon[31561]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-21T22:29:31.892 DEBUG:teuthology.orchestra.run.smithi018:osd.9> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.9.service 2024-04-21T22:29:31.897 INFO:tasks.cephadm:Deploying osd.10 on smithi047 with /dev/vg_nvme/lv_1... 2024-04-21T22:29:31.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T22:29:32.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:32.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T22:29:32.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T22:29:32.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:32.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:32.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:31 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:32.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:31 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:32.153 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:29:32.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: osdmap e65: 10 total, 9 up, 10 in 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]: dispatch 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:32.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:31 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:33.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:32 smithi018 ceph-mon[26614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:29:33.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:32 smithi018 ceph-mon[26614]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T22:29:33.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:32 smithi081 ceph-mon[31692]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:29:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:32 smithi081 ceph-mon[31692]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T22:29:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:32 smithi047 ceph-mon[31561]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-04-21T22:29:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:32 smithi047 ceph-mon[31561]: osdmap e66: 10 total, 9 up, 10 in 2024-04-21T22:29:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] boot 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T22:29:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:33 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:34.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:29:34.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:29:34.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:34.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] boot 2024-04-21T22:29:34.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T22:29:34.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:33 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: osd.9 [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] boot 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: osdmap e67: 10 total, 10 up, 10 in 2024-04-21T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:33 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:29:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T22:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T22:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10+0 records in 2024-04-21T22:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:10+0 records out 2024-04-21T22:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00839468 s, 1.2 GB/s 2024-04-21T22:29:34.224 INFO:teuthology.orchestra.run.smithi047.stderr:--> Zapping successful for: 2024-04-21T22:29:34.951 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_1 2024-04-21T22:29:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:34 smithi047 ceph-mon[31561]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T22:29:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:34 smithi047 ceph-mon[31561]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:29:35.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:34 smithi018 ceph-mon[26614]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T22:29:35.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:34 smithi018 ceph-mon[26614]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:34 smithi081 ceph-mon[31692]: osdmap e68: 10 total, 10 up, 10 in 2024-04-21T22:29:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:34 smithi081 ceph-mon[31692]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3347537081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 msgr2=0x7fd0b8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3347537081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b8107a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009990 tx=0x7fd0b4009ca0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3347537081 shutdown_connections 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3347537081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8107f80 0x7fd0b810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3347537081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b8102d20 0x7fd0b8105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3347537081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b8107a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3347537081 >> 172.21.15.47:0/3347537081 conn(0x7fd0b80fc730 msgr2=0x7fd0b80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3347537081 shutdown_connections 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3347537081 wait complete. 2024-04-21T22:29:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 Processor -- start 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 -- start start 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.040+0000 7fd0bfbac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8102d20 0x7fd0b819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b8107f80 0x7fd0b81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b810df00 con 0x7fd0b8107f80 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b810dd80 con 0x7fd0b8105650 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b810e080 con 0x7fd0b8102d20 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51782/0 (socket says 172.21.15.47:51782) 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 -- 172.21.15.47:0/3492677626 learned_addr learned my addr 172.21.15.47:0/3492677626 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd948700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8102d20 0x7fd0b819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 -- 172.21.15.47:0/3492677626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8102d20 msgr2=0x7fd0b819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8102d20 0x7fd0b819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 -- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b8107f80 msgr2=0x7fd0b81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b8107f80 0x7fd0b81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 -- 172.21.15.47:0/3492677626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b81a2360 con 0x7fd0b8105650 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bd147700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005910 tx=0x7fd0b4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4027070 con 0x7fd0b8105650 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0b4004150 con 0x7fd0b8105650 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b81a25f0 con 0x7fd0b8105650 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b400f460 con 0x7fd0b8105650 2024-04-21T22:29:37.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.041+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b81a2ac0 con 0x7fd0b8105650 2024-04-21T22:29:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.042+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b802db30 con 0x7fd0b8105650 2024-04-21T22:29:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.043+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd0b402a070 con 0x7fd0b8105650 2024-04-21T22:29:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.044+0000 7fd0aeffd700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 0x7fd0a40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:29:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.044+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7fd0b40cf710 con 0x7fd0b8105650 2024-04-21T22:29:37.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.045+0000 7fd0bd948700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 0x7fd0a40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:29:37.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.046+0000 7fd0bd948700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 0x7fd0a40a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009a10 tx=0x7fd0a8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:29:37.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.049+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd0b405e6f0 con 0x7fd0b8105650 2024-04-21T22:29:37.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:37.266+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd0b8062670 con 0x7fd0a40a2c20 2024-04-21T22:29:37.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:37 smithi018 ceph-mon[26614]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:37 smithi081 ceph-mon[31692]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:37.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:37 smithi047 ceph-mon[31561]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi018 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 4273M 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:38 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi018 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 4273M 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:38 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi018 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 4273M 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:29:38.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:38 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:39.523 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:39 smithi047 ceph-mon[31561]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:39 smithi018 ceph-mon[26614]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:39 smithi081 ceph-mon[31692]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:40.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:40 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/4153799873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:40 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:40 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]': finished 2024-04-21T22:29:40.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:40 smithi018 ceph-mon[26614]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T22:29:40.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:40 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:40 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/4153799873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:40 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:40 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]': finished 2024-04-21T22:29:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:40 smithi081 ceph-mon[31692]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T22:29:40.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:40 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:40.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:40 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/4153799873' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:40 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]: dispatch 2024-04-21T22:29:40.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:40 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffe5b328-b599-4eda-9a41-a022b00456df"}]': finished 2024-04-21T22:29:40.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:40 smithi047 ceph-mon[31561]: osdmap e69: 11 total, 10 up, 11 in 2024-04-21T22:29:40.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:40 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:41 smithi018 ceph-mon[26614]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:41 smithi018 ceph-mon[26614]: from='client.? 172.21.15.47:0/1680295128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:41 smithi081 ceph-mon[31692]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:41 smithi081 ceph-mon[31692]: from='client.? 172.21.15.47:0/1680295128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:41.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:41 smithi047 ceph-mon[31561]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:41 smithi047 ceph-mon[31561]: from='client.? 172.21.15.47:0/1680295128' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:29:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:43 smithi018 ceph-mon[26614]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:43.879 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:43 smithi047 ceph-mon[31561]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:43 smithi081 ceph-mon[31692]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:45.640 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:45 smithi047 ceph-mon[31561]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:45 smithi018 ceph-mon[26614]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:45 smithi081 ceph-mon[31692]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:47 smithi047 ceph-mon[31561]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:47 smithi018 ceph-mon[26614]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:47 smithi081 ceph-mon[31692]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:48.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T22:29:48.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:48 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:48.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:48 smithi047 ceph-mon[31561]: Deploying daemon osd.10 on smithi047 2024-04-21T22:29:48.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T22:29:48.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:48 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:48.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:48 smithi018 ceph-mon[26614]: Deploying daemon osd.10 on smithi047 2024-04-21T22:29:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-21T22:29:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:48 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:29:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:48 smithi081 ceph-mon[31692]: Deploying daemon osd.10 on smithi047 2024-04-21T22:29:49.815 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:49 smithi047 ceph-mon[31561]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:49 smithi018 ceph-mon[26614]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:49 smithi081 ceph-mon[31692]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:51.792 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:51 smithi047 ceph-mon[31561]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:51 smithi018 ceph-mon[26614]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:51 smithi081 ceph-mon[31692]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:53 smithi018 ceph-mon[26614]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:53.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:53 smithi081 ceph-mon[31692]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:53.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:53 smithi047 ceph-mon[31561]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:53.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:53.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:29:53.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:55.642 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:55 smithi047 ceph-mon[31561]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:55 smithi018 ceph-mon[26614]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:55 smithi081 ceph-mon[31692]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:57.000 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 10 on host 'smithi047' 2024-04-21T22:29:57.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:56.999+0000 7fd0aeffd700 1 -- 172.21.15.47:0/3492677626 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd0b8062670 con 0x7fd0a40a2c20 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 msgr2=0x7fd0a40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 0x7fd0a40a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009a10 tx=0x7fd0a8009190 comp rx=0 tx=0).stop 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 msgr2=0x7fd0b819ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005910 tx=0x7fd0b4009580 comp rx=0 tx=0).stop 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 shutdown_connections 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0b8107f80 0x7fd0b81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b8102d20 0x7fd0b819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd0a40a2c20 0x7fd0a40a50e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:57.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 --2- 172.21.15.47:0/3492677626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0b8105650 0x7fd0b819ac40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:29:57.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 >> 172.21.15.47:0/3492677626 conn(0x7fd0b80fc730 msgr2=0x7fd0b8102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:29:57.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 shutdown_connections 2024-04-21T22:29:57.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-21T22:29:57.002+0000 7fd0bfbac700 1 -- 172.21.15.47:0/3492677626 wait complete. 2024-04-21T22:29:57.594 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:57 smithi047 ceph-mon[31561]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:57.594 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.594 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.594 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:57 smithi047 ceph-mon[31561]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:57.594 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:57 smithi047 ceph-mon[31561]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:57.623 DEBUG:teuthology.orchestra.run.smithi047:osd.10> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.10.service 2024-04-21T22:29:57.625 INFO:tasks.cephadm:Deploying osd.11 on smithi081 with /dev/vg_nvme/lv_1... 2024-04-21T22:29:57.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-21T22:29:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:57 smithi018 ceph-mon[26614]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:57 smithi018 ceph-mon[26614]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:57 smithi018 ceph-mon[26614]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:57.873 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:29:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:57 smithi081 ceph-mon[31692]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:29:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:57 smithi081 ceph-mon[31692]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:57 smithi081 ceph-mon[31692]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:59.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:58 smithi018 ceph-mon[26614]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T22:29:59.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:59.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:58 smithi081 ceph-mon[31692]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: osdmap e70: 11 total, 10 up, 11 in 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:29:59.144 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:58 smithi047 ceph-mon[31561]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114041 s, 919 MB/s 2024-04-21T22:29:59.886 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-04-21T22:30:00.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:00.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:30:00.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T22:30:00.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:29:59 smithi018 ceph-mon[26614]: from='osd.10 ' entity='osd.10' 2024-04-21T22:30:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:30:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T22:30:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:29:59 smithi081 ceph-mon[31692]: from='osd.10 ' entity='osd.10' 2024-04-21T22:30:00.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:00.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-04-21T22:30:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: osdmap e71: 11 total, 10 up, 11 in 2024-04-21T22:30:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-mon[31561]: from='osd.10 ' entity='osd.10' 2024-04-21T22:30:00.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:29:59.722+0000 7f58ea123700 -1 osd.10 0 waiting for initial osdmap 2024-04-21T22:30:00.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:29:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:29:59.737+0000 7f58e270f700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:30:00.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-04-21T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: overall HEALTH_OK 2024-04-21T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.804 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] boot 2024-04-21T22:30:00.805 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T22:30:00.805 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:00 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.842 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: overall HEALTH_OK 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] boot 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T22:30:00.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:00 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:30:01.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:30:01.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: overall HEALTH_OK 2024-04-21T22:30:01.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:01.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: osd.10 [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] boot 2024-04-21T22:30:01.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: osdmap e72: 11 total, 11 up, 11 in 2024-04-21T22:30:01.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:00 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:30:02.073 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.074 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.075 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:02.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: osdmap e73: 11 total, 11 up, 11 in 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:02.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:02.196 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.468+0000 7f483f8c5700 1 -- 172.21.15.81:0/692996607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838102390 msgr2=0x7f48381027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- 172.21.15.81:0/692996607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838102390 0x7f48381027f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4834009990 tx=0x7f4834009ca0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- 172.21.15.81:0/692996607 shutdown_connections 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- 172.21.15.81:0/692996607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102d30 0x7f48381095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- 172.21.15.81:0/692996607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4838101190 0x7f48381015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- 172.21.15.81:0/692996607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838102390 0x7f48381027f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- 172.21.15.81:0/692996607 >> 172.21.15.81:0/692996607 conn(0x7f48380fc750 msgr2=0x7f48380feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- 172.21.15.81:0/692996607 shutdown_connections 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- 172.21.15.81:0/692996607 wait complete. 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 Processor -- start 2024-04-21T22:30:02.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- start start 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102390 0x7f483819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4838102d30 0x7f48381a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f483810ce70 con 0x7f4838102d30 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f483810ccf0 con 0x7f4838102390 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.469+0000 7f483f8c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f483810cff0 con 0x7f4838101190 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40816/0 (socket says 172.21.15.81:40816) 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 -- 172.21.15.81:0/253459065 learned_addr learned my addr 172.21.15.81:0/253459065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483ce60700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102390 0x7f483819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 -- 172.21.15.81:0/253459065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102390 msgr2=0x7f483819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102390 0x7f483819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 -- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4838102d30 msgr2=0x7f48381a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4838102d30 0x7f48381a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 -- 172.21.15.81:0/253459065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48381a2460 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483d661700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f482800b530 tx=0x7f482800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828015020 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48381a2750 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4828011d10 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482800f2e0 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.470+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48381a2d10 con 0x7f4838101190 2024-04-21T22:30:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.471+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4838068f20 con 0x7f4838101190 2024-04-21T22:30:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.472+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4828018020 con 0x7f4838101190 2024-04-21T22:30:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.473+0000 7f482e7fc700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 0x7f48240a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.473+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7f48280ce170 con 0x7f4838101190 2024-04-21T22:30:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.473+0000 7f483ce60700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 0x7f48240a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.474+0000 7f483ce60700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 0x7f48240a50e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f483400b5c0 tx=0x7f4834005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.477+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f482801f020 con 0x7f4838101190 2024-04-21T22:30:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:02.683+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f483806b0b0 con 0x7f48240a2c20 2024-04-21T22:30:03.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi047 2024-04-21T22:30:03.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 4273M 2024-04-21T22:30:03.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T22:30:03.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:30:03.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:30:03.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:02 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi047 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 4273M 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:30:03.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:02 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:03.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi047 2024-04-21T22:30:03.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 4273M 2024-04-21T22:30:03.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: osdmap e74: 11 total, 11 up, 11 in 2024-04-21T22:30:03.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-21T22:30:03.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-21T22:30:03.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:02 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:03 smithi018 ceph-mon[26614]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:03 smithi018 ceph-mon[26614]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:03 smithi018 ceph-mon[26614]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T22:30:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:03 smithi081 ceph-mon[31692]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:03 smithi081 ceph-mon[31692]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:04.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:03 smithi081 ceph-mon[31692]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T22:30:04.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:03 smithi047 ceph-mon[31561]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:04.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:03 smithi047 ceph-mon[31561]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:04.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:03 smithi047 ceph-mon[31561]: osdmap e75: 11 total, 11 up, 11 in 2024-04-21T22:30:05.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:04 smithi018 ceph-mon[26614]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T22:30:05.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:04 smithi018 ceph-mon[26614]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-21T22:30:05.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:04 smithi081 ceph-mon[31692]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T22:30:05.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:04 smithi081 ceph-mon[31692]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-21T22:30:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:04 smithi047 ceph-mon[31561]: osdmap e76: 11 total, 11 up, 11 in 2024-04-21T22:30:05.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:04 smithi047 ceph-mon[31561]: pgmap v270: 1 pgs: 1 peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-21T22:30:06.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/1285156926' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:05 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:05 smithi018 ceph-mon[26614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]': finished 2024-04-21T22:30:06.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:05 smithi018 ceph-mon[26614]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T22:30:06.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:05 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:05 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/1285156926' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:05 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:05 smithi081 ceph-mon[31692]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]': finished 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:05 smithi081 ceph-mon[31692]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:05 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:05 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/1285156926' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:05 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]: dispatch 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:05 smithi047 ceph-mon[31561]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4039a314-53cb-4831-bb48-ece414ca7950"}]': finished 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:05 smithi047 ceph-mon[31561]: osdmap e77: 12 total, 11 up, 12 in 2024-04-21T22:30:06.389 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:05 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:07.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.81:0/3094199958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:30:07.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:07 smithi018 ceph-mon[26614]: pgmap v272: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-21T22:30:07.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.81:0/3094199958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:30:07.354 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:07 smithi047 ceph-mon[31561]: pgmap v272: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-21T22:30:07.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.81:0/3094199958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-21T22:30:07.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:07 smithi081 ceph-mon[31692]: pgmap v272: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-21T22:30:09.265 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:08 smithi081 ceph-mon[31692]: pgmap v273: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:30:09.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:08 smithi018 ceph-mon[26614]: pgmap v273: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:30:09.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:08 smithi047 ceph-mon[31561]: pgmap v273: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-21T22:30:11.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:11 smithi081 ceph-mon[31692]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:30:11.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:11 smithi047 ceph-mon[31561]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:30:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:11 smithi018 ceph-mon[26614]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-21T22:30:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:13 smithi081 ceph-mon[31692]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T22:30:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:13 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:13.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:13 smithi081 ceph-mon[31692]: Deploying daemon osd.11 on smithi081 2024-04-21T22:30:13.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:13 smithi047 ceph-mon[31561]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:13.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T22:30:13.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:13 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:13.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:13 smithi047 ceph-mon[31561]: Deploying daemon osd.11 on smithi081 2024-04-21T22:30:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:13 smithi018 ceph-mon[26614]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-21T22:30:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:13 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:13 smithi018 ceph-mon[26614]: Deploying daemon osd.11 on smithi081 2024-04-21T22:30:15.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:15 smithi081 ceph-mon[31692]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:15.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:15 smithi047 ceph-mon[31561]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:15.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:15 smithi018 ceph-mon[26614]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:17.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:17 smithi081 ceph-mon[31692]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:17.427 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:17 smithi047 ceph-mon[31561]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:17.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:17 smithi018 ceph-mon[26614]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:19 smithi018 ceph-mon[26614]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:19 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:19 smithi081 ceph-mon[31692]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:19 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:19 smithi047 ceph-mon[31561]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:19 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:21.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:21.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:21.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:21.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:22.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.071+0000 7f482e7fc700 1 -- 172.21.15.81:0/253459065 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f483806b0b0 con 0x7f48240a2c20 2024-04-21T22:30:22.072 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 11 on host 'smithi081' 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 msgr2=0x7f48240a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 0x7f48240a50e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f483400b5c0 tx=0x7f4834005fd0 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 msgr2=0x7f483819a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f482800b530 tx=0x7f482800b840 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 shutdown_connections 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4838102d30 0x7f48381a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4838101190 0x7f483819a850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f48240a2c20 0x7f48240a50e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 --2- 172.21.15.81:0/253459065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4838102390 0x7f483819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 >> 172.21.15.81:0/253459065 conn(0x7f48380fc750 msgr2=0x7f483806a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:22.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 shutdown_connections 2024-04-21T22:30:22.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:22.074+0000 7f483f8c5700 1 -- 172.21.15.81:0/253459065 wait complete. 2024-04-21T22:30:22.704 DEBUG:teuthology.orchestra.run.smithi081:osd.11> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.11.service 2024-04-21T22:30:22.706 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-21T22:30:22.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-21T22:30:23.166 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:23.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:23 smithi018 ceph-mon[26614]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:23 smithi081 ceph-mon[31692]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:23.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:23.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:23.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:23 smithi047 ceph-mon[31561]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-21T22:30:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:24 smithi018 ceph-mon[26614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T22:30:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:24 smithi018 ceph-mon[26614]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:24 smithi018 ceph-mon[26614]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T22:30:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:24 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:24.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:24 smithi018 ceph-mon[26614]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:24.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-mon[31692]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T22:30:24.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-mon[31692]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:24.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-mon[31692]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T22:30:24.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:24.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-mon[31692]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:24.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:24 smithi047 ceph-mon[31561]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-21T22:30:24.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:24 smithi047 ceph-mon[31561]: from='osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:24.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:24 smithi047 ceph-mon[31561]: osdmap e78: 12 total, 11 up, 12 in 2024-04-21T22:30:24.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:24 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:24.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:24 smithi047 ceph-mon[31561]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-04-21T22:30:25.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:25.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:30:25.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T22:30:25.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: from='osd.11 ' entity='osd.11' 2024-04-21T22:30:25.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.139 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:30:24.884+0000 7f17b58ce700 -1 osd.11 0 waiting for initial osdmap 2024-04-21T22:30:25.139 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:30:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:30:24.904+0000 7f17adeba700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T22:30:25.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:25.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:30:25.342 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T22:30:25.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: from='osd.11 ' entity='osd.11' 2024-04-21T22:30:25.343 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-04-21T22:30:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: osdmap e79: 12 total, 11 up, 12 in 2024-04-21T22:30:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: from='osd.11 ' entity='osd.11' 2024-04-21T22:30:25.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:25.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 -- 172.21.15.18:0/3428797936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4105650 msgr2=0x7f6db4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 --2- 172.21.15.18:0/3428797936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4105650 0x7f6db4107a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009990 tx=0x7f6da0009ca0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 -- 172.21.15.18:0/3428797936 shutdown_connections 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 --2- 172.21.15.18:0/3428797936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4107f80 0x7f6db410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 --2- 172.21.15.18:0/3428797936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4102d20 0x7f6db4105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 --2- 172.21.15.18:0/3428797936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4105650 0x7f6db4107a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 -- 172.21.15.18:0/3428797936 >> 172.21.15.18:0/3428797936 conn(0x7f6db40fc730 msgr2=0x7f6db40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 -- 172.21.15.18:0/3428797936 shutdown_connections 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.615+0000 7f6dbc200700 1 -- 172.21.15.18:0/3428797936 wait complete. 2024-04-21T22:30:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 Processor -- start 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 -- start start 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4105650 0x7f6db419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 0x7f6db41a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6db410de70 con 0x7f6db4105650 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6db410dcf0 con 0x7f6db4102d20 2024-04-21T22:30:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.617+0000 7f6dbc200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6db410dff0 con 0x7f6db4107f80 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:47584/0 (socket says 172.21.15.18:47584) 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 -- 172.21.15.18:0/1897747771 learned_addr learned my addr 172.21.15.18:0/1897747771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db8e00700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4105650 0x7f6db419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6dba200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 0x7f6db41a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 -- 172.21.15.18:0/1897747771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 msgr2=0x7f6db41a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 0x7f6db41a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 -- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4105650 msgr2=0x7f6db419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4105650 0x7f6db419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6db9800700 1 -- 172.21.15.18:0/1897747771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db41a2350 con 0x7f6db4102d20 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.618+0000 7f6dba200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 0x7f6db41a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6db9800700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6da800e9a0 tx=0x7f6da800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da800ca10 con 0x7f6db4102d20 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db41a2640 con 0x7f6db4102d20 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da800cbb0 con 0x7f6db4102d20 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8018710 con 0x7f6db4102d20 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.619+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a2bd0 con 0x7f6db4102d20 2024-04-21T22:30:25.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.620+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db4109b00 con 0x7f6db4102d20 2024-04-21T22:30:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.623+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6da80188b0 con 0x7f6db4102d20 2024-04-21T22:30:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.624+0000 7f6db2000700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 0x7f6d9c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.624+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f6da80cee90 con 0x7f6db4102d20 2024-04-21T22:30:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.624+0000 7f6db8e00700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 0x7f6d9c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.625+0000 7f6db8e00700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 0x7f6d9c0a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6da000b7b0 tx=0x7f6da000b880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:25.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.626+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6da809c310 con 0x7f6db4102d20 2024-04-21T22:30:25.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.877+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6db402dbd0 con 0x7f6db4102d20 2024-04-21T22:30:25.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.878+0000 7f6db2000700 1 -- 172.21.15.18:0/1897747771 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f6da809bc10 con 0x7f6db4102d20 2024-04-21T22:30:25.879 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:25.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.881+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 msgr2=0x7f6d9c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:25.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.881+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 0x7f6d9c0a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6da000b7b0 tx=0x7f6da000b880 comp rx=0 tx=0).stop 2024-04-21T22:30:25.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.881+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 msgr2=0x7f6db419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:25.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.881+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6da800e9a0 tx=0x7f6da800ecb0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 shutdown_connections 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db4107f80 0x7f6db41a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d9c0a2ca0 0x7f6d9c0a5160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6db4102d20 0x7f6db419a6f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 --2- 172.21.15.18:0/1897747771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6db4105650 0x7f6db419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 >> 172.21.15.18:0/1897747771 conn(0x7f6db40fc730 msgr2=0x7f6db4102420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 shutdown_connections 2024-04-21T22:30:25.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:25.882+0000 7f6dbc200700 1 -- 172.21.15.18:0/1897747771 wait complete. 2024-04-21T22:30:26.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: purged_snaps scrub starts 2024-04-21T22:30:26.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: purged_snaps scrub ok 2024-04-21T22:30:26.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: Detected new or changed devices on smithi081 2024-04-21T22:30:26.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.316 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 4272M 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1897747771' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] boot 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T22:30:26.317 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:26.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: purged_snaps scrub starts 2024-04-21T22:30:26.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: purged_snaps scrub ok 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: Detected new or changed devices on smithi081 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 4272M 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1897747771' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] boot 2024-04-21T22:30:26.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T22:30:26.390 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: purged_snaps scrub starts 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: purged_snaps scrub ok 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: Detected new or changed devices on smithi081 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:30:26.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 4272M 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1897747771' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: osd.11 [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] boot 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: osdmap e80: 12 total, 12 up, 12 in 2024-04-21T22:30:26.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:30:26.745 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1713738600,"num_in_osds":12,"osd_in_since":1713738605,"num_remapped_pgs":0} 2024-04-21T22:30:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:27 smithi081 ceph-mon[31692]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:27 smithi047 ceph-mon[31561]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:27.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:27 smithi018 ceph-mon[26614]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-04-21T22:30:27.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-21T22:30:28.210 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:30:28.363 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:28 smithi018 ceph-mon[26614]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T22:30:28.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:28 smithi081 ceph-mon[31692]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T22:30:28.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:28 smithi047 ceph-mon[31561]: osdmap e81: 12 total, 12 up, 12 in 2024-04-21T22:30:29.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:29 smithi018 ceph-mon[26614]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:29 smithi081 ceph-mon[31692]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:29.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:29 smithi047 ceph-mon[31561]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 -- 172.21.15.18:0/2771115666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241034e0 msgr2=0x7fbc24103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 --2- 172.21.15.18:0/2771115666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241034e0 0x7fbc24103940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc100098f0 tx=0x7fbc10009c00 comp rx=0 tx=0).stop 2024-04-21T22:30:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 -- 172.21.15.18:0/2771115666 shutdown_connections 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 --2- 172.21.15.18:0/2771115666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 0x7fbc2410a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 --2- 172.21.15.18:0/2771115666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241022e0 0x7fbc24102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 --2- 172.21.15.18:0/2771115666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241034e0 0x7fbc24103940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.693+0000 7fbc2c600700 1 -- 172.21.15.18:0/2771115666 >> 172.21.15.18:0/2771115666 conn(0x7fbc240fd880 msgr2=0x7fbc240ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.694+0000 7fbc2c600700 1 -- 172.21.15.18:0/2771115666 shutdown_connections 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.694+0000 7fbc2c600700 1 -- 172.21.15.18:0/2771115666 wait complete. 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 Processor -- start 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 -- start start 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241034e0 0x7fbc24198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 0x7fbc2419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2410ded0 con 0x7fbc241034e0 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2410dd50 con 0x7fbc24103e80 2024-04-21T22:30:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc2c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2410e050 con 0x7fbc241022e0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc29c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc29c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:38444/0 (socket says 172.21.15.18:38444) 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc29c00700 1 -- 172.21.15.18:0/817800684 learned_addr learned my addr 172.21.15.18:0/817800684 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.695+0000 7fbc29200700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241034e0 0x7fbc24198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc2a600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 0x7fbc2419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 -- 172.21.15.18:0/817800684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 msgr2=0x7fbc2419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 0x7fbc2419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 -- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241034e0 msgr2=0x7fbc24198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241034e0 0x7fbc24198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 -- 172.21.15.18:0/817800684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc241a0120 con 0x7fbc241022e0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc29c00700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c0c0 tx=0x7fbc1400c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140092e0 con 0x7fbc241022e0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc241a03b0 con 0x7fbc241022e0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.696+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc14003a00 con 0x7fbc241022e0 2024-04-21T22:30:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.697+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140047b0 con 0x7fbc241022e0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.697+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc241a0940 con 0x7fbc241022e0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.698+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc24068f20 con 0x7fbc241022e0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.700+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbc1401b030 con 0x7fbc241022e0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.701+0000 7fbc22000700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 0x7fbc080a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.701+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fbc140ceb90 con 0x7fbc241022e0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.701+0000 7fbc29200700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 0x7fbc080a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.702+0000 7fbc29200700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 0x7fbc080a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009fd0 tx=0x7fbc1001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:30.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.705+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fbc14022020 con 0x7fbc241022e0 2024-04-21T22:30:30.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.935+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbc2402db30 con 0x7fbc241022e0 2024-04-21T22:30:30.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.936+0000 7fbc22000700 1 -- 172.21.15.18:0/817800684 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7fbc14010040 con 0x7fbc241022e0 2024-04-21T22:30:30.937 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 msgr2=0x7fbc080a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 0x7fbc080a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009fd0 tx=0x7fbc1001a040 comp rx=0 tx=0).stop 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 msgr2=0x7fbc241984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c0c0 tx=0x7fbc1400c3d0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 shutdown_connections 2024-04-21T22:30:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fbc080a2c20 0x7fbc080a50e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc24103e80 0x7fbc2419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc241022e0 0x7fbc241984c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 --2- 172.21.15.18:0/817800684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc241034e0 0x7fbc24198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 >> 172.21.15.18:0/817800684 conn(0x7fbc240fd880 msgr2=0x7fbc241067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.939+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 shutdown_connections 2024-04-21T22:30:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:30.940+0000 7fbc2c600700 1 -- 172.21.15.18:0/817800684 wait complete. 2024-04-21T22:30:31.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:31 smithi018 ceph-mon[26614]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:31.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:31 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/817800684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:31 smithi081 ceph-mon[31692]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:31 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/817800684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:31.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:31 smithi047 ceph-mon[31561]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:31.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:31 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/817800684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-21T22:30:31.909 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1713738625,"num_in_osds":12,"osd_in_since":1713738605,"num_remapped_pgs":0} 2024-04-21T22:30:31.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T22:30:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:30:33.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:33 smithi081 ceph-mon[31692]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:33.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:33 smithi047 ceph-mon[31561]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:33.539 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:33 smithi018 ceph-mon[26614]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:34.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 -- 172.21.15.18:0/3536723807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006b2a0 msgr2=0x7f6a0010f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 --2- 172.21.15.18:0/3536723807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006b2a0 0x7f6a0010f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009f90 tx=0x7f69f800b330 comp rx=0 tx=0).stop 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 -- 172.21.15.18:0/3536723807 shutdown_connections 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 --2- 172.21.15.18:0/3536723807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006b2a0 0x7f6a0010f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 --2- 172.21.15.18:0/3536723807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a001082d0 0x7f6a001086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 --2- 172.21.15.18:0/3536723807 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a0006a900 0x7f6a0006ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 -- 172.21.15.18:0/3536723807 >> 172.21.15.18:0/3536723807 conn(0x7f6a000780e0 msgr2=0x7f6a000784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 -- 172.21.15.18:0/3536723807 shutdown_connections 2024-04-21T22:30:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.820+0000 7f6a08200700 1 -- 172.21.15.18:0/3536723807 wait complete. 2024-04-21T22:30:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.822+0000 7f6a08200700 1 Processor -- start 2024-04-21T22:30:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.822+0000 7f6a08200700 1 -- start start 2024-04-21T22:30:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006a900 0x7f6a001015e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 0x7f6a00101b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 0x7f6a00102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00112570 con 0x7f6a0006b2a0 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a001123f0 con 0x7f6a001082d0 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a08200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a001126f0 con 0x7f6a0006a900 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a04e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 0x7f6a00101b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a04e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 0x7f6a00101b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47450/0 (socket says 172.21.15.18:47450) 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a06200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 0x7f6a00102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a04e00700 1 -- 172.21.15.18:0/3419687127 learned_addr learned my addr 172.21.15.18:0/3419687127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.823+0000 7f6a05800700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006a900 0x7f6a001015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:34.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 -- 172.21.15.18:0/3419687127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006a900 msgr2=0x7f6a001015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006a900 0x7f6a001015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 -- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 msgr2=0x7f6a00101b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 0x7f6a00101b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 -- 172.21.15.18:0/3419687127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a001a6fb0 con 0x7f6a001082d0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f6a06200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 0x7f6a00102060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009f90 tx=0x7f69f800cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.824+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8021070 con 0x7f6a001082d0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.825+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a001a7240 con 0x7f6a001082d0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.825+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69f8007ac0 con 0x7f6a001082d0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.825+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80052a0 con 0x7f6a001082d0 2024-04-21T22:30:34.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.825+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a001a76f0 con 0x7f6a001082d0 2024-04-21T22:30:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.826+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a00103980 con 0x7f6a001082d0 2024-04-21T22:30:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.828+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f69f8024070 con 0x7f6a001082d0 2024-04-21T22:30:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.829+0000 7f69fe000700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 0x7f69e80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.830+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f69f800f020 con 0x7f6a001082d0 2024-04-21T22:30:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.830+0000 7f6a05800700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 0x7f69e80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.830+0000 7f6a05800700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 0x7f69e80a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009be0 tx=0x7f69f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:34.832+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f69f802b020 con 0x7f6a001082d0 2024-04-21T22:30:35.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.063+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a0002db30 con 0x7f6a001082d0 2024-04-21T22:30:35.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.064+0000 7f69fe000700 1 -- 172.21.15.18:0/3419687127 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18349 (secure 0 0 0) 0x7f69f8007c70 con 0x7f6a001082d0 2024-04-21T22:30:35.065 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:35.066 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:30:27.090993+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 msgr2=0x7f69e80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 0x7f69e80a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009be0 tx=0x7f69f4009260 comp rx=0 tx=0).stop 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 msgr2=0x7f6a00102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 0x7f6a00102060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009f90 tx=0x7f69f800cfa0 comp rx=0 tx=0).stop 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 shutdown_connections 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f69e80a2c20 0x7f69e80a50e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a001082d0 0x7f6a00102060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0006a900 0x7f6a001015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 --2- 172.21.15.18:0/3419687127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a0006b2a0 0x7f6a00101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 >> 172.21.15.18:0/3419687127 conn(0x7f6a000780e0 msgr2=0x7f6a001002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.068+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 shutdown_connections 2024-04-21T22:30:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:35.069+0000 7f6a08200700 1 -- 172.21.15.18:0/3419687127 wait complete. 2024-04-21T22:30:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:35 smithi018 ceph-mon[26614]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:35 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3419687127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:35 smithi081 ceph-mon[31692]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:35 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3419687127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:35.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:35 smithi047 ceph-mon[31561]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:35.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:35 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3419687127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:35.941 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:30:35.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-21T22:30:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:30:37.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:37 smithi018 ceph-mon[26614]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:37 smithi081 ceph-mon[31692]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:37.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:37 smithi047 ceph-mon[31561]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.644+0000 7f25ea000700 1 -- 172.21.15.18:0/4075784638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e4107570 msgr2=0x7f25e410f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.644+0000 7f25ea000700 1 --2- 172.21.15.18:0/4075784638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e4107570 0x7f25e410f140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00b0a0 tx=0x7f25dc00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 -- 172.21.15.18:0/4075784638 shutdown_connections 2024-04-21T22:30:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 --2- 172.21.15.18:0/4075784638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e4107570 0x7f25e410f140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 --2- 172.21.15.18:0/4075784638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e41024e0 0x7f25e41028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 --2- 172.21.15.18:0/4075784638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4102e90 0x7f25e4106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 -- 172.21.15.18:0/4075784638 >> 172.21.15.18:0/4075784638 conn(0x7f25e4079390 msgr2=0x7f25e40797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 -- 172.21.15.18:0/4075784638 shutdown_connections 2024-04-21T22:30:38.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.645+0000 7f25ea000700 1 -- 172.21.15.18:0/4075784638 wait complete. 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.646+0000 7f25ea000700 1 Processor -- start 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.646+0000 7f25ea000700 1 -- start start 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 0x7f25e41a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 0x7f25e419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25e41125a0 con 0x7f25e4102e90 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4112420 con 0x7f25e41024e0 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25ea000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e4112720 con 0x7f25e4107570 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25daa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25daa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53148/0 (socket says 172.21.15.18:53148) 2024-04-21T22:30:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25daa00700 1 -- 172.21.15.18:0/1226504328 learned_addr learned my addr 172.21.15.18:0/1226504328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25e3400700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 0x7f25e41a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.647+0000 7f25e3e00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 0x7f25e419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 -- 172.21.15.18:0/1226504328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 msgr2=0x7f25e419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 0x7f25e419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 -- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 msgr2=0x7f25e41a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 -- 172.21.15.18:0/1226504328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e419b180 con 0x7f25e41024e0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25daa00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3e00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 0x7f25e419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e3400700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 0x7f25e41a0860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25d400e9f0 tx=0x7f25d400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d400c9c0 con 0x7f25e41024e0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d400cb60 con 0x7f25e41024e0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4018680 con 0x7f25e41024e0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.648+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e419b470 con 0x7f25e41024e0 2024-04-21T22:30:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.649+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e41a7730 con 0x7f25e41024e0 2024-04-21T22:30:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.650+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e4068f20 con 0x7f25e41024e0 2024-04-21T22:30:38.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.652+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f25d4010430 con 0x7f25e41024e0 2024-04-21T22:30:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.653+0000 7f25e0c00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 0x7f25c40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.653+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f25d40cecc0 con 0x7f25e41024e0 2024-04-21T22:30:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.653+0000 7f25daa00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 0x7f25c40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.654+0000 7f25daa00700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 0x7f25c40a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25e410f4f0 tx=0x7f25cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.657+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f25d40d5080 con 0x7f25e41024e0 2024-04-21T22:30:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.885+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f25e41a7900 con 0x7f25e41024e0 2024-04-21T22:30:38.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.886+0000 7f25e0c00700 1 -- 172.21.15.18:0/1226504328 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f25d409c020 con 0x7f25e41024e0 2024-04-21T22:30:38.887 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 msgr2=0x7f25c40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 0x7f25c40a5160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25e410f4f0 tx=0x7f25cc009260 comp rx=0 tx=0).stop 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 msgr2=0x7f25e41a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 0x7f25e41a0860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25d400e9f0 tx=0x7f25d400ed00 comp rx=0 tx=0).stop 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 shutdown_connections 2024-04-21T22:30:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4107570 0x7f25e419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25c40a2ca0 0x7f25c40a5160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e41024e0 0x7f25e41a0860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 --2- 172.21.15.18:0/1226504328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25e4102e90 0x7f25e41a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 >> 172.21.15.18:0/1226504328 conn(0x7f25e4079390 msgr2=0x7f25e4100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 shutdown_connections 2024-04-21T22:30:38.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:38.890+0000 7f25ea000700 1 -- 172.21.15.18:0/1226504328 wait complete. 2024-04-21T22:30:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:39 smithi081 ceph-mon[31692]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1226504328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:39.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:39 smithi047 ceph-mon[31561]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:39.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1226504328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:39 smithi018 ceph-mon[26614]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1226504328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.a on smithi018 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.d on smithi018 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.g on smithi018 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.j on smithi018 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.b on smithi047 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.e on smithi047 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.h on smithi047 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.k on smithi047 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.c on smithi081 2024-04-21T22:30:39.656 INFO:tasks.cephadm:Adding mds.f on smithi081 2024-04-21T22:30:39.657 INFO:tasks.cephadm:Adding mds.i on smithi081 2024-04-21T22:30:39.657 INFO:tasks.cephadm:Adding mds.l on smithi081 2024-04-21T22:30:39.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l' 2024-04-21T22:30:39.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:30:41.354 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:41 smithi081 ceph-mon[31692]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:41.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:41 smithi047 ceph-mon[31561]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 -- 172.21.15.81:0/729638442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 msgr2=0x7f8d24107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/729638442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24107ae0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009990 tx=0x7f8d14009ca0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 -- 172.21.15.81:0/729638442 shutdown_connections 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/729638442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d24108020 0x7f8d2410a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/729638442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 0x7f8d241051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/729638442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24107ae0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 -- 172.21.15.81:0/729638442 >> 172.21.15.81:0/729638442 conn(0x7f8d240fc730 msgr2=0x7f8d240feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 -- 172.21.15.81:0/729638442 shutdown_connections 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.562+0000 7f8d2bae6700 1 -- 172.21.15.81:0/729638442 wait complete. 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 Processor -- start 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 -- start start 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 0x7f8d24198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d24108020 0x7f8d2419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2410dee0 con 0x7f8d24108020 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2410dd60 con 0x7f8d24102dc0 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d2bae6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2410e060 con 0x7f8d241056f0 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55052/0 (socket says 172.21.15.81:55052) 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 -- 172.21.15.81:0/3215295932 learned_addr learned my addr 172.21.15.81:0/3215295932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29882700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 0x7f8d24198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 -- 172.21.15.81:0/3215295932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 msgr2=0x7f8d24198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 0x7f8d24198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 -- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d24108020 msgr2=0x7f8d2419fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d24108020 0x7f8d2419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.563+0000 7f8d29081700 1 -- 172.21.15.81:0/3215295932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d241a01b0 con 0x7f8d241056f0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d29081700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d140095b0 tx=0x7f8d14005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14027070 con 0x7f8d241056f0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d14004150 con 0x7f8d241056f0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d241a0440 con 0x7f8d241056f0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14022e10 con 0x7f8d241056f0 2024-04-21T22:30:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.564+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d241a08f0 con 0x7f8d241056f0 2024-04-21T22:30:41.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.565+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d24068f20 con 0x7f8d241056f0 2024-04-21T22:30:41.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.566+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8d1402a070 con 0x7f8d241056f0 2024-04-21T22:30:41.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.566+0000 7f8d1affd700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 0x7f8d100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.566+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8d140d03a0 con 0x7f8d241056f0 2024-04-21T22:30:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.567+0000 7f8d29882700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 0x7f8d100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.568+0000 7f8d29882700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 0x7f8d100a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009550 tx=0x7f8d200091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:41.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.570+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8d14031070 con 0x7f8d241056f0 2024-04-21T22:30:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:41 smithi018 ceph-mon[26614]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.776+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}) -- 0x7f8d24062930 con 0x7f8d100a2ca0 2024-04-21T22:30:41.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.793+0000 7f8d1affd700 1 -- 172.21.15.81:0/3215295932 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8d24062930 con 0x7f8d100a2ca0 2024-04-21T22:30:41.793 INFO:teuthology.orchestra.run.smithi081.stdout:Scheduled mds.all update... 2024-04-21T22:30:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 msgr2=0x7f8d100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 0x7f8d100a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009550 tx=0x7f8d200091f0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 msgr2=0x7f8d24198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d140095b0 tx=0x7f8d14005e80 comp rx=0 tx=0).stop 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 shutdown_connections 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d24108020 0x7f8d2419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8d100a2ca0 0x7f8d100a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d24102dc0 0x7f8d24198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 --2- 172.21.15.81:0/3215295932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d241056f0 0x7f8d24198a90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 >> 172.21.15.81:0/3215295932 conn(0x7f8d240fc730 msgr2=0x7f8d241037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 shutdown_connections 2024-04-21T22:30:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-04-21T22:30:41.795+0000 7f8d2bae6700 1 -- 172.21.15.81:0/3215295932 wait complete. 2024-04-21T22:30:42.489 DEBUG:teuthology.orchestra.run.smithi018:mds.a> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.a.service 2024-04-21T22:30:42.500 DEBUG:teuthology.orchestra.run.smithi018:mds.d> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.d.service 2024-04-21T22:30:42.545 DEBUG:teuthology.orchestra.run.smithi018:mds.g> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.g.service 2024-04-21T22:30:42.590 DEBUG:teuthology.orchestra.run.smithi018:mds.j> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.j.service 2024-04-21T22:30:42.637 DEBUG:teuthology.orchestra.run.smithi047:mds.b> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.b.service 2024-04-21T22:30:42.640 DEBUG:teuthology.orchestra.run.smithi047:mds.e> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.e.service 2024-04-21T22:30:42.682 DEBUG:teuthology.orchestra.run.smithi047:mds.h> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.h.service 2024-04-21T22:30:42.725 DEBUG:teuthology.orchestra.run.smithi047:mds.k> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.k.service 2024-04-21T22:30:42.768 DEBUG:teuthology.orchestra.run.smithi081:mds.c> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.c.service 2024-04-21T22:30:42.771 DEBUG:teuthology.orchestra.run.smithi081:mds.f> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.f.service 2024-04-21T22:30:42.813 DEBUG:teuthology.orchestra.run.smithi081:mds.i> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.i.service 2024-04-21T22:30:42.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:42 smithi018 ceph-mon[26614]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:42.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:42 smithi018 ceph-mon[26614]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-04-21T22:30:42.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:42.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:42 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:42.856 DEBUG:teuthology.orchestra.run.smithi081:mds.l> sudo journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.l.service 2024-04-21T22:30:42.899 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-21T22:30:42.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:30:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:42 smithi047 ceph-mon[31561]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:42 smithi047 ceph-mon[31561]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-04-21T22:30:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:42 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 -- 172.21.15.18:0/3701328499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 msgr2=0x7fee8c0745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 --2- 172.21.15.18:0/3701328499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c0745a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee78009900 tx=0x7fee7802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 -- 172.21.15.18:0/3701328499 shutdown_connections 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 --2- 172.21.15.18:0/3701328499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 --2- 172.21.15.18:0/3701328499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c0745a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 --2- 172.21.15.18:0/3701328499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 0x7fee8c073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 -- 172.21.15.18:0/3701328499 >> 172.21.15.18:0/3701328499 conn(0x7fee8c0fcd70 msgr2=0x7fee8c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 -- 172.21.15.18:0/3701328499 shutdown_connections 2024-04-21T22:30:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.123+0000 7fee94000640 1 -- 172.21.15.18:0/3701328499 wait complete. 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.124+0000 7fee94000640 1 Processor -- start 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.124+0000 7fee94000640 1 -- start start 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 0x7fee8c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c10f680 con 0x7fee8c075720 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c10f500 con 0x7fee8c109690 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee94000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c10f800 con 0x7fee8c074140 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 0x7fee8c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:32814/0 (socket says 172.21.15.18:32814) 2024-04-21T22:30:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:50416/0 (socket says 172.21.15.18:50416) 2024-04-21T22:30:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 -- 172.21.15.18:0/4229017763 learned_addr learned my addr 172.21.15.18:0/4229017763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 -- 172.21.15.18:0/4229017763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 msgr2=0x7fee8c1a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 -- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 msgr2=0x7fee8c19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.125+0000 7fee91600640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 0x7fee8c19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee91600640 1 -- 172.21.15.18:0/4229017763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c1a18b0 con 0x7fee8c074140 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee92000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee91600640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee8000eb90 tx=0x7fee8000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80004d20 con 0x7fee8c074140 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8000ee90 con 0x7fee8c074140 2024-04-21T22:30:43.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8c1a1ba0 con 0x7fee8c074140 2024-04-21T22:30:43.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80010830 con 0x7fee8c074140 2024-04-21T22:30:43.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.126+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8c1a2070 con 0x7fee8c074140 2024-04-21T22:30:43.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.128+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8c108450 con 0x7fee8c074140 2024-04-21T22:30:43.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.130+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fee80005020 con 0x7fee8c074140 2024-04-21T22:30:43.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.131+0000 7fee8a000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 0x7fee740a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.132+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fee800cf270 con 0x7fee8c074140 2024-04-21T22:30:43.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.132+0000 7fee90c00640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 0x7fee740a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.132+0000 7fee90c00640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 0x7fee740a5050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee7802c2d0 tx=0x7fee7802c910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:42 smithi081 ceph-mon[31692]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:30:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:42 smithi081 ceph-mon[31692]: Saving service mds.all spec with placement smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-04-21T22:30:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:43.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:42 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:30:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.138+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fee8009c5d0 con 0x7fee8c074140 2024-04-21T22:30:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.346+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee8c0623e0 con 0x7fee8c074140 2024-04-21T22:30:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.347+0000 7fee8a000640 1 -- 172.21.15.18:0/4229017763 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18349 (secure 0 0 0) 0x7fee8009bed0 con 0x7fee8c074140 2024-04-21T22:30:43.349 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:43.349 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:30:27.090993+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.350+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 msgr2=0x7fee740a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.350+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 0x7fee740a5050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee7802c2d0 tx=0x7fee7802c910 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.350+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 msgr2=0x7fee8c199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.350+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee8000eb90 tx=0x7fee8000c6a0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 shutdown_connections 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fee740a2b90 0x7fee740a5050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee8c109690 0x7fee8c1a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c075720 0x7fee8c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 --2- 172.21.15.18:0/4229017763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee8c074140 0x7fee8c199c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 >> 172.21.15.18:0/4229017763 conn(0x7fee8c0fcd70 msgr2=0x7fee8c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 shutdown_connections 2024-04-21T22:30:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.351+0000 7fee94000640 1 -- 172.21.15.18:0/4229017763 wait complete. 2024-04-21T22:30:43.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:30:43.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 -- 172.21.15.18:0/2920627868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 msgr2=0x7fe450103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 --2- 172.21.15.18:0/2920627868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450103be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe440009900 tx=0x7fe44002bc30 comp rx=0 tx=0).stop 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 -- 172.21.15.18:0/2920627868 shutdown_connections 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 --2- 172.21.15.18:0/2920627868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe450105370 0x7fe45010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 --2- 172.21.15.18:0/2920627868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4501049b0 0x7fe450104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 --2- 172.21.15.18:0/2920627868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450103be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 -- 172.21.15.18:0/2920627868 >> 172.21.15.18:0/2920627868 conn(0x7fe4500fed50 msgr2=0x7fe450101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 -- 172.21.15.18:0/2920627868 shutdown_connections 2024-04-21T22:30:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.593+0000 7fe455600640 1 -- 172.21.15.18:0/2920627868 wait complete. 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.594+0000 7fe455600640 1 Processor -- start 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.594+0000 7fe455600640 1 -- start start 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe450105370 0x7fe4501a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe45010f490 con 0x7fe4501037c0 2024-04-21T22:30:43.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe45010f310 con 0x7fe450105370 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe455600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe45010f610 con 0x7fe4501049b0 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe447400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe44fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe447400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:32834/0 (socket says 172.21.15.18:32834) 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe454c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe450105370 0x7fe4501a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.595+0000 7fe447400640 1 -- 172.21.15.18:0/1408491058 learned_addr learned my addr 172.21.15.18:0/1408491058 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 -- 172.21.15.18:0/1408491058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 msgr2=0x7fe45019a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 -- 172.21.15.18:0/1408491058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe450105370 msgr2=0x7fe4501a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe450105370 0x7fe4501a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 -- 172.21.15.18:0/1408491058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4501a1720 con 0x7fe4501037c0 2024-04-21T22:30:43.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe447400640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44fe00640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450199b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe440009230 tx=0x7fe44002c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440043020 con 0x7fe4501037c0 2024-04-21T22:30:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4400054e0 con 0x7fe4501037c0 2024-04-21T22:30:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4501a19b0 con 0x7fe4501037c0 2024-04-21T22:30:43.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440003b60 con 0x7fe4501037c0 2024-04-21T22:30:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.596+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4501a1ed0 con 0x7fe4501037c0 2024-04-21T22:30:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.598+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45004f500 con 0x7fe4501037c0 2024-04-21T22:30:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.599+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe440046020 con 0x7fe4501037c0 2024-04-21T22:30:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.601+0000 7fe44d600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 0x7fe4340a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:43.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.601+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe4400f0bd0 con 0x7fe4501037c0 2024-04-21T22:30:43.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.601+0000 7fe447400640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 0x7fe4340a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:43.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.602+0000 7fe447400640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 0x7fe4340a5050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe4380095f0 tx=0x7fe438005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.606+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe44004d020 con 0x7fe4501037c0 2024-04-21T22:30:43.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.814+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe450062340 con 0x7fe4501037c0 2024-04-21T22:30:43.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.815+0000 7fe44d600640 1 -- 172.21.15.18:0/1408491058 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fe4400bdf30 con 0x7fe4501037c0 2024-04-21T22:30:43.816 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:30:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.818+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 msgr2=0x7fe4340a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.818+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 0x7fe4340a5050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe4380095f0 tx=0x7fe438005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.818+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 msgr2=0x7fe450199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:43.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.818+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450199b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe440009230 tx=0x7fe44002c5d0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 shutdown_connections 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe4340a2b90 0x7fe4340a5050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe450105370 0x7fe4501a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4501049b0 0x7fe45019a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 --2- 172.21.15.18:0/1408491058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4501037c0 0x7fe450199b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 >> 172.21.15.18:0/1408491058 conn(0x7fe4500fed50 msgr2=0x7fe450107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 shutdown_connections 2024-04-21T22:30:43.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:43.819+0000 7fe455600640 1 -- 172.21.15.18:0/1408491058 wait complete. 2024-04-21T22:30:43.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:43.956 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:43 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4229017763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.052+0000 7f75d2600640 1 -- 172.21.15.18:0/311335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc101670 msgr2=0x7f75cc101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.052+0000 7f75d2600640 1 --2- 172.21.15.18:0/311335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc101670 0x7f75cc101a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009900 tx=0x7f75c002bc30 comp rx=0 tx=0).stop 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 -- 172.21.15.18:0/311335943 shutdown_connections 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 --2- 172.21.15.18:0/311335943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 0x7f75cc109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 --2- 172.21.15.18:0/311335943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc102860 0x7f75cc102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 --2- 172.21.15.18:0/311335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc101670 0x7f75cc101a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 -- 172.21.15.18:0/311335943 >> 172.21.15.18:0/311335943 conn(0x7f75cc0fcc00 msgr2=0x7f75cc0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:44.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 -- 172.21.15.18:0/311335943 shutdown_connections 2024-04-21T22:30:44.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.053+0000 7f75d2600640 1 -- 172.21.15.18:0/311335943 wait complete. 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 Processor -- start 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 -- start start 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc102860 0x7f75cc073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 0x7f75cc074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc10d340 con 0x7f75cc101670 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc10d1c0 con 0x7f75cc103220 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.054+0000 7f75d2600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc10d4c0 con 0x7f75cc102860 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53208/0 (socket says 172.21.15.18:53208) 2024-04-21T22:30:44.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 -- 172.21.15.18:0/21901888 learned_addr learned my addr 172.21.15.18:0/21901888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75cbe00640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc102860 0x7f75cc073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1c00640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 0x7f75cc074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 -- 172.21.15.18:0/21901888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc102860 msgr2=0x7f75cc073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc102860 0x7f75cc073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 -- 172.21.15.18:0/21901888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 msgr2=0x7f75cc074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 0x7f75cc074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 -- 172.21.15.18:0/21901888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc074900 con 0x7f75cc101670 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.055+0000 7f75d1200640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000c00 tx=0x7f75c002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.056+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0043020 con 0x7f75cc101670 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.056+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc1a1ad0 con 0x7f75cc101670 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.056+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75c00054e0 con 0x7f75cc101670 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.056+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0003c40 con 0x7f75cc101670 2024-04-21T22:30:44.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.056+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc1a2070 con 0x7f75cc101670 2024-04-21T22:30:44.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.057+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc108990 con 0x7f75cc101670 2024-04-21T22:30:44.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.059+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f75c0046020 con 0x7f75cc101670 2024-04-21T22:30:44.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.060+0000 7f75c9600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 0x7f75b40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:44.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.061+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f75c00f0b40 con 0x7f75cc101670 2024-04-21T22:30:44.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.061+0000 7f75cbe00640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 0x7f75b40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:44.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.062+0000 7f75cbe00640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 0x7f75b40a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75cc075260 tx=0x7f75b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:44.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.065+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f75c004d020 con 0x7f75cc101670 2024-04-21T22:30:44.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:43 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4229017763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:44.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:44.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:43 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4229017763' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:30:44.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.314+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75cc02d390 con 0x7f75cc101670 2024-04-21T22:30:44.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.315+0000 7f75c9600640 1 -- 172.21.15.18:0/21901888 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f75c00bdea0 con 0x7f75cc101670 2024-04-21T22:30:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:44.317 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-21T22:30:44.317 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 1 2024-04-21T22:30:44.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 msgr2=0x7f75b40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:44.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 0x7f75b40a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75cc075260 tx=0x7f75b8005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:44.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 msgr2=0x7f75cc0754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:44.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000c00 tx=0x7f75c002c650 comp rx=0 tx=0).stop 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 shutdown_connections 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f75b40a2c00 0x7f75b40a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75cc103220 0x7f75cc074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75cc102860 0x7f75cc073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 --2- 172.21.15.18:0/21901888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75cc101670 0x7f75cc0754f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.318+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 >> 172.21.15.18:0/21901888 conn(0x7f75cc0fcc00 msgr2=0x7f75cc105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.319+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 shutdown_connections 2024-04-21T22:30:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:44.319+0000 7f75d2600640 1 -- 172.21.15.18:0/21901888 wait complete. 2024-04-21T22:30:45.050 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:44 smithi081 ceph-mon[31692]: Deploying daemon mds.l on smithi081 2024-04-21T22:30:45.050 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:44 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1408491058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:45.050 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:44 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/21901888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:44 smithi018 ceph-mon[26614]: Deploying daemon mds.l on smithi081 2024-04-21T22:30:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:44 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1408491058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:44 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/21901888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:44 smithi047 ceph-mon[31561]: Deploying daemon mds.l on smithi081 2024-04-21T22:30:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:44 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1408491058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:30:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:44 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/21901888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:45.388 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 systemd[1]: Starting Ceph mds.l for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:30:45.710 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 podman[62043]: 2024-04-21 22:30:45.346593799 +0000 UTC m=+0.018024224 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:30:45.710 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 podman[62043]: 2024-04-21 22:30:45.448156759 +0000 UTC m=+0.119587173 container create dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8) 2024-04-21T22:30:45.710 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 podman[62043]: 2024-04-21 22:30:45.684395988 +0000 UTC m=+0.355826399 container init dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-21T22:30:45.710 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 podman[62043]: 2024-04-21 22:30:45.686821014 +0000 UTC m=+0.358251427 container start dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-21T22:30:46.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:45 smithi018 ceph-mon[26614]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:46.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:45 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6832/2486302783,v1:172.21.15.81:6833/2486302783] up:boot 2024-04-21T22:30:46.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:45 smithi018 ceph-mon[26614]: fsmap 1 up:standby 2024-04-21T22:30:46.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:45 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:30:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-mon[31692]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6832/2486302783,v1:172.21.15.81:6833/2486302783] up:boot 2024-04-21T22:30:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-mon[31692]: fsmap 1 up:standby 2024-04-21T22:30:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:30:46.139 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-mds[62062]: -- 172.21.15.81:0/2179521666 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563537cc9a40 con 0x563537c9cc00 2024-04-21T22:30:46.139 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: starting mds.l at 2024-04-21T22:30:46.139 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 bash[62043]: dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 2024-04-21T22:30:46.139 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:30:45 smithi081 systemd[1]: Started Ceph mds.l for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:30:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:45 smithi047 ceph-mon[31561]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:45 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6832/2486302783,v1:172.21.15.81:6833/2486302783] up:boot 2024-04-21T22:30:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:45 smithi047 ceph-mon[31561]: fsmap 1 up:standby 2024-04-21T22:30:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:45 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:30:46.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:46.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3602032548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b010dde0 msgr2=0x7fb0b01101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3602032548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b010dde0 0x7fb0b01101d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009900 tx=0x7fb0a802bc40 comp rx=0 tx=0).stop 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3602032548 shutdown_connections 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3602032548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b010dde0 0x7fb0b01101d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3602032548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 0x7fb0b0074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3602032548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b0075780 0x7fb0b0073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.562+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3602032548 >> 172.21.15.18:0/3602032548 conn(0x7fb0b00fcd60 msgr2=0x7fb0b00ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.563+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3602032548 shutdown_connections 2024-04-21T22:30:46.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.563+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3602032548 wait complete. 2024-04-21T22:30:46.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 Processor -- start 2024-04-21T22:30:46.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 -- start start 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 0x7fb0b019e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0075780 0x7fb0b019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0113a60 con 0x7fb0b010dde0 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b01138e0 con 0x7fb0b00741a0 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b6c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0113be0 con 0x7fb0b0075780 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34614/0 (socket says 172.21.15.18:34614) 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0b4c00640 1 -- 172.21.15.18:0/3028085053 learned_addr learned my addr 172.21.15.18:0/3028085053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0afe00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 0x7fb0b019e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.564+0000 7fb0a7400640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0075780 0x7fb0b019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 -- 172.21.15.18:0/3028085053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0075780 msgr2=0x7fb0b019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:46.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0075780 0x7fb0b019e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 -- 172.21.15.18:0/3028085053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 msgr2=0x7fb0b019e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 0x7fb0b019e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 -- 172.21.15.18:0/3028085053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b01a5c70 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b4c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8036040 tx=0x7fb0a802c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8041070 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a8004450 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003d40 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.565+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b01a5f00 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.566+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b01a6360 con 0x7fb0b010dde0 2024-04-21T22:30:46.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.567+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b0103fb0 con 0x7fb0b010dde0 2024-04-21T22:30:46.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.569+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb0a8044070 con 0x7fb0b010dde0 2024-04-21T22:30:46.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.570+0000 7fb0ad600640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 0x7fb0940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:46.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.570+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb0a80f0730 con 0x7fb0b010dde0 2024-04-21T22:30:46.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.570+0000 7fb0afe00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 0x7fb0940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:46.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.571+0000 7fb0afe00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 0x7fb0940a5050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009bd0 tx=0x7fb0a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:46.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.575+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb0a80bd440 con 0x7fb0b010dde0 2024-04-21T22:30:46.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.823+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0b002d170 con 0x7fb0b010dde0 2024-04-21T22:30:46.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.824+0000 7fb0ad600640 1 -- 172.21.15.18:0/3028085053 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7fb0a80c1740 con 0x7fb0b010dde0 2024-04-21T22:30:46.825 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T22:30:46.825 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-04-21T22:30:46.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 msgr2=0x7fb0940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 0x7fb0940a5050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009bd0 tx=0x7fb0a0005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 msgr2=0x7fb0b01a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8036040 tx=0x7fb0a802c5e0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 shutdown_connections 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb0940a2b90 0x7fb0940a5050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0b010dde0 0x7fb0b01a5600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b0075780 0x7fb0b019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 --2- 172.21.15.18:0/3028085053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0b00741a0 0x7fb0b019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 >> 172.21.15.18:0/3028085053 conn(0x7fb0b00fcd60 msgr2=0x7fb0b0101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 shutdown_connections 2024-04-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:46.827+0000 7fb0b6c00640 1 -- 172.21.15.18:0/3028085053 wait complete. 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:47.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:46 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3028085053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:47.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:47.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:47.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:47.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:46 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3028085053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:47.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:46 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3028085053' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:47.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:47 smithi047 ceph-mon[31561]: Deploying daemon mds.k on smithi047 2024-04-21T22:30:47.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:47 smithi047 ceph-mon[31561]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:48.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:47 smithi081 ceph-mon[31692]: Deploying daemon mds.k on smithi047 2024-04-21T22:30:48.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:47 smithi081 ceph-mon[31692]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:47 smithi018 ceph-mon[26614]: Deploying daemon mds.k on smithi047 2024-04-21T22:30:48.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:47 smithi018 ceph-mon[26614]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:48.364 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 systemd[1]: Starting Ceph mds.k for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:30:48.628 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 podman[60945]: 2024-04-21 22:30:48.267568156 +0000 UTC m=+0.018291462 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:30:48.628 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 podman[60945]: 2024-04-21 22:30:48.392766948 +0000 UTC m=+0.143490231 container create d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:30:48.628 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 podman[60945]: 2024-04-21 22:30:48.628721939 +0000 UTC m=+0.379445228 container init d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-21T22:30:48.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:48.945 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 podman[60945]: 2024-04-21 22:30:48.631595097 +0000 UTC m=+0.382318390 container start d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:30:48.945 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 ceph-mds[60964]: -- 172.21.15.47:0/665227742 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b73f617a40 con 0x55b73f5ea800 2024-04-21T22:30:48.945 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: starting mds.k at 2024-04-21T22:30:48.945 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 bash[60945]: d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa 2024-04-21T22:30:48.945 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:30:48 smithi047 systemd[1]: Started Ceph mds.k for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 -- 172.21.15.18:0/3009606978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 msgr2=0x7fdccc101ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 --2- 172.21.15.18:0/3009606978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc101ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009900 tx=0x7fdcbc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 -- 172.21.15.18:0/3009606978 shutdown_connections 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 --2- 172.21.15.18:0/3009606978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 0x7fdccc109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 --2- 172.21.15.18:0/3009606978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 0x7fdccc102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 --2- 172.21.15.18:0/3009606978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc101ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 -- 172.21.15.18:0/3009606978 >> 172.21.15.18:0/3009606978 conn(0x7fdccc0fcc00 msgr2=0x7fdccc0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 -- 172.21.15.18:0/3009606978 shutdown_connections 2024-04-21T22:30:49.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.051+0000 7fdcd1200640 1 -- 172.21.15.18:0/3009606978 wait complete. 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.052+0000 7fdcd1200640 1 Processor -- start 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.052+0000 7fdcd1200640 1 -- start start 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 0x7fdccc19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 0x7fdccc1a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10d330 con 0x7fdccc102880 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10d1b0 con 0x7fdccc101690 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdcd1200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc10d4b0 con 0x7fdccc103240 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 0x7fdccc19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37734/0 (socket says 172.21.15.18:37734) 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccb400640 1 -- 172.21.15.18:0/1676969203 learned_addr learned my addr 172.21.15.18:0/1676969203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccbe00640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 0x7fdccc1a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccb400640 1 -- 172.21.15.18:0/1676969203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 msgr2=0x7fdccc1a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.053+0000 7fdccb400640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 0x7fdccc1a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdccb400640 1 -- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 msgr2=0x7fdccc19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdccb400640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 0x7fdccc19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdccb400640 1 -- 172.21.15.18:0/1676969203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1a1810 con 0x7fdccc101690 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdccb400640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc02c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc043020 con 0x7fdccc101690 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcbc0054e0 con 0x7fdccc101690 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc003c40 con 0x7fdccc101690 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc1a1aa0 con 0x7fdccc101690 2024-04-21T22:30:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.054+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1a1fa0 con 0x7fdccc101690 2024-04-21T22:30:49.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.056+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc1a2170 con 0x7fdccc101690 2024-04-21T22:30:49.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.057+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdcbc046020 con 0x7fdccc101690 2024-04-21T22:30:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.059+0000 7fdcc3e00640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.059+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fdcbc0f0b40 con 0x7fdccc101690 2024-04-21T22:30:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.059+0000 7fdccaa00640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.060+0000 7fdccaa00640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdccc19b100 tx=0x7fdcb8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.063+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fdcbc04d020 con 0x7fdccc101690 2024-04-21T22:30:49.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.310+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdccc1a2500 con 0x7fdccc101690 2024-04-21T22:30:49.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.312+0000 7fdcc3e00640 1 -- 172.21.15.18:0/1676969203 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7fdcbc0bdea0 con 0x7fdccc101690 2024-04-21T22:30:49.313 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:49.313 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T22:30:49.313 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 msgr2=0x7fdcb00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdccc19b100 tx=0x7fdcb8005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 msgr2=0x7fdccc199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc02c650 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 shutdown_connections 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdccc103240 0x7fdccc1a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdccc102880 0x7fdccc19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 --2- 172.21.15.18:0/1676969203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdccc101690 0x7fdccc199bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 >> 172.21.15.18:0/1676969203 conn(0x7fdccc0fcc00 msgr2=0x7fdccc073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:49.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 shutdown_connections 2024-04-21T22:30:49.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:49.315+0000 7fdcd1200640 1 -- 172.21.15.18:0/1676969203 wait complete. 2024-04-21T22:30:50.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:50.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: Deploying daemon mds.j on smithi018 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6832/3754896489,v1:172.21.15.47:6833/3754896489] up:boot 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: fsmap 2 up:standby 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:30:50.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1676969203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: Deploying daemon mds.j on smithi018 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6832/3754896489,v1:172.21.15.47:6833/3754896489] up:boot 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: fsmap 2 up:standby 2024-04-21T22:30:50.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:30:50.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1676969203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:50.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: Deploying daemon mds.j on smithi018 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6832/3754896489,v1:172.21.15.47:6833/3754896489] up:boot 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: fsmap 2 up:standby 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:30:50.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1676969203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:51.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 -- 172.21.15.18:0/3981879250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c100050 msgr2=0x7f116c100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 --2- 172.21.15.18:0/3981879250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c100050 0x7f116c100470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f115c009900 tx=0x7f115c02bc80 comp rx=0 tx=0).stop 2024-04-21T22:30:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 -- 172.21.15.18:0/3981879250 shutdown_connections 2024-04-21T22:30:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 --2- 172.21.15.18:0/3981879250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c101350 0x7f116c1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:51.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 --2- 172.21.15.18:0/3981879250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c1009b0 0x7f116c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:51.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 --2- 172.21.15.18:0/3981879250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c100050 0x7f116c100470 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f115c009900 tx=0x7f115c02bc80 comp rx=0 tx=0).stop 2024-04-21T22:30:51.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 -- 172.21.15.18:0/3981879250 >> 172.21.15.18:0/3981879250 conn(0x7f116c0fbc50 msgr2=0x7f116c0fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:51.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 -- 172.21.15.18:0/3981879250 shutdown_connections 2024-04-21T22:30:51.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.744+0000 7f1171e00640 1 -- 172.21.15.18:0/3981879250 wait complete. 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.746+0000 7f1171e00640 1 Processor -- start 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.746+0000 7f1171e00640 1 -- start start 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c101350 0x7f116c070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c196d50 0x7f116c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10f660 con 0x7f116c196d50 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10f4e0 con 0x7f116c1009b0 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f1171e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f116c10f7e0 con 0x7f116c101350 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c101350 0x7f116c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37748/0 (socket says 172.21.15.18:37748) 2024-04-21T22:30:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116aa00640 1 -- 172.21.15.18:0/1289072952 learned_addr learned my addr 172.21.15.18:0/1289072952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116b400640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c196d50 0x7f116c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116aa00640 1 -- 172.21.15.18:0/1289072952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c101350 msgr2=0x7f116c070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.747+0000 7f116aa00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c101350 0x7f116c070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.748+0000 7f116aa00640 1 -- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c196d50 msgr2=0x7f116c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.748+0000 7f116aa00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c196d50 0x7f116c1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.748+0000 7f116aa00640 1 -- 172.21.15.18:0/1289072952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c199720 con 0x7f116c1009b0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.748+0000 7f116aa00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f115c02c290 tx=0x7f115c02ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.749+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c043020 con 0x7f116c1009b0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.749+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115c0054e0 con 0x7f116c1009b0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.749+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c003b90 con 0x7f116c1009b0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.749+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c1999b0 con 0x7f116c1009b0 2024-04-21T22:30:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.749+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c199e80 con 0x7f116c1009b0 2024-04-21T22:30:51.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.752+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116c068a40 con 0x7f116c1009b0 2024-04-21T22:30:51.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.755+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f115c046020 con 0x7f116c1009b0 2024-04-21T22:30:51.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.757+0000 7f1170a00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 0x7f11500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:51.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.758+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f115c0bb930 con 0x7f116c1009b0 2024-04-21T22:30:51.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.760+0000 7f116a000640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 0x7f11500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:51.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.762+0000 7f116a000640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 0x7f11500a50d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f116c073940 tx=0x7f1158005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:51.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:51.765+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f115c0a6e20 con 0x7f116c1009b0 2024-04-21T22:30:52.002 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:51 smithi018 ceph-mon[26614]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:52.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.017+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f116c02d490 con 0x7f116c1009b0 2024-04-21T22:30:52.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.018+0000 7f1170a00640 1 -- 172.21.15.18:0/1289072952 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f115c04d020 con 0x7f116c1009b0 2024-04-21T22:30:52.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:52.019 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T22:30:52.019 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 msgr2=0x7f11500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 0x7f11500a50d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f116c073940 tx=0x7f1158005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 msgr2=0x7f116c0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f115c02c290 tx=0x7f115c02ce40 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 shutdown_connections 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11500a2c10 0x7f11500a50d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f116c196d50 0x7f116c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f116c101350 0x7f116c070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 --2- 172.21.15.18:0/1289072952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f116c1009b0 0x7f116c0702d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 >> 172.21.15.18:0/1289072952 conn(0x7f116c0fbc50 msgr2=0x7f116c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 shutdown_connections 2024-04-21T22:30:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:52.021+0000 7f1171e00640 1 -- 172.21.15.18:0/1289072952 wait complete. 2024-04-21T22:30:52.049 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:51 smithi047 ceph-mon[31561]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:52.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:51 smithi081 ceph-mon[31692]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:52.629 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 podman[67299]: 2024-04-21 22:30:52.374604935 +0000 UTC m=+0.153524343 container create a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-21T22:30:52.630 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 podman[67299]: 2024-04-21 22:30:52.628653301 +0000 UTC m=+0.407572716 container init a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-21T22:30:53.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:52 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1289072952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:53.096 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 podman[67299]: 2024-04-21 22:30:52.63817797 +0000 UTC m=+0.417097351 container start a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-21T22:30:53.096 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 ceph-mds[67318]: -- 172.21.15.18:0/3604071971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562575e0ba40 con 0x562575ddec00 2024-04-21T22:30:53.096 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: starting mds.j at 2024-04-21T22:30:53.096 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 bash[67299]: a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 2024-04-21T22:30:53.096 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:30:52 smithi018 systemd[1]: Started Ceph mds.j for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:30:53.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:52 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1289072952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:53.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:52 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1289072952' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:54.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:boot 2024-04-21T22:30:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: fsmap 3 up:standby 2024-04-21T22:30:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:30:54.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:54.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:54.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:53 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:boot 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: fsmap 3 up:standby 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:54.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:54.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:53 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:54.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:54.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:boot 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: fsmap 3 up:standby 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:54.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:53 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.256+0000 7f9579000640 1 -- 172.21.15.18:0/3737959084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 msgr2=0x7f957410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.256+0000 7f9579000640 1 --2- 172.21.15.18:0/3737959084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f957410be50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f956c009ca0 tx=0x7f956c02c100 comp rx=0 tx=0).stop 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 -- 172.21.15.18:0/3737959084 shutdown_connections 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 --2- 172.21.15.18:0/3737959084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f957410be50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 --2- 172.21.15.18:0/3737959084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f9574105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 --2- 172.21.15.18:0/3737959084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 -- 172.21.15.18:0/3737959084 >> 172.21.15.18:0/3737959084 conn(0x7f95740fefc0 msgr2=0x7f95741013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 -- 172.21.15.18:0/3737959084 shutdown_connections 2024-04-21T22:30:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.257+0000 7f9579000640 1 -- 172.21.15.18:0/3737959084 wait complete. 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.258+0000 7f9579000640 1 Processor -- start 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.258+0000 7f9579000640 1 -- start start 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f95741a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f957410f600 con 0x7f9574104c00 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f957410f480 con 0x7f9574103a10 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9579000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f957410f780 con 0x7f95741055c0 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9571e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9571400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f95741a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9571e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37780/0 (socket says 172.21.15.18:37780) 2024-04-21T22:30:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9571e00640 1 -- 172.21.15.18:0/4236617374 learned_addr learned my addr 172.21.15.18:0/4236617374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9571400640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34676/0 (socket says 172.21.15.18:34676) 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 -- 172.21.15.18:0/4236617374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 msgr2=0x7f9574199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 -- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 msgr2=0x7f957419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.259+0000 7f9572800640 1 -- 172.21.15.18:0/4236617374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741a1870 con 0x7f95741055c0 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f9571400640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f9572800640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f95741a11d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f956c037040 tx=0x7f956c035d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c039040 con 0x7f95741055c0 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f956c044070 con 0x7f95741055c0 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95741a1b00 con 0x7f95741055c0 2024-04-21T22:30:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c004350 con 0x7f95741055c0 2024-04-21T22:30:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.260+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741a1fc0 con 0x7f95741055c0 2024-04-21T22:30:54.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.261+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957410acd0 con 0x7f95741055c0 2024-04-21T22:30:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.264+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f956c0044f0 con 0x7f95741055c0 2024-04-21T22:30:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.265+0000 7f956aa00640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 0x7f95580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.265+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f956c0f1240 con 0x7f95741055c0 2024-04-21T22:30:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.265+0000 7f9571e00640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 0x7f95580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.266+0000 7f9571e00640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 0x7f95580a50d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f957419b130 tx=0x7f9564005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:54.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.270+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f956c0be5a0 con 0x7f95741055c0 2024-04-21T22:30:54.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.531+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f957402d170 con 0x7f95741055c0 2024-04-21T22:30:54.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.532+0000 7f956aa00640 1 -- 172.21.15.18:0/4236617374 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f956c0098b0 con 0x7f95741055c0 2024-04-21T22:30:54.532 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:54.532 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-21T22:30:54.532 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 msgr2=0x7f95580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 0x7f95580a50d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f957419b130 tx=0x7f9564005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 msgr2=0x7f95741a11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f95741a11d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f956c037040 tx=0x7f956c035d10 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 shutdown_connections 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f95580a2c10 0x7f95580a50d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95741055c0 0x7f95741a11d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9574104c00 0x7f957419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 --2- 172.21.15.18:0/4236617374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9574103a10 0x7f9574199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 >> 172.21.15.18:0/4236617374 conn(0x7f95740fefc0 msgr2=0x7f9574107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 shutdown_connections 2024-04-21T22:30:54.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:54.535+0000 7f9579000640 1 -- 172.21.15.18:0/4236617374 wait complete. 2024-04-21T22:30:55.076 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:54 smithi018 ceph-mon[26614]: Deploying daemon mds.d on smithi018 2024-04-21T22:30:55.077 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:54 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4236617374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:55.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:54 smithi081 ceph-mon[31692]: Deploying daemon mds.d on smithi018 2024-04-21T22:30:55.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:54 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4236617374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:55.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:54 smithi047 ceph-mon[31561]: Deploying daemon mds.d on smithi018 2024-04-21T22:30:55.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:54 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4236617374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:56.020 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:55 smithi018 ceph-mon[26614]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:56.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:55 smithi081 ceph-mon[31692]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:56.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:55 smithi047 ceph-mon[31561]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:56.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:56.595 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:56 smithi018 systemd[1]: Starting Ceph mds.d for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 -- 172.21.15.18:0/1942012661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc8075780 msgr2=0x7febc8073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 --2- 172.21.15.18:0/1942012661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc8075780 0x7febc8073bd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7febb8009900 tx=0x7febb802bc30 comp rx=0 tx=0).stop 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 -- 172.21.15.18:0/1942012661 shutdown_connections 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 --2- 172.21.15.18:0/1942012661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc81096c0 0x7febc810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 --2- 172.21.15.18:0/1942012661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 --2- 172.21.15.18:0/1942012661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc8075780 0x7febc8073bd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 -- 172.21.15.18:0/1942012661 >> 172.21.15.18:0/1942012661 conn(0x7febc80fcd70 msgr2=0x7febc80ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 -- 172.21.15.18:0/1942012661 shutdown_connections 2024-04-21T22:30:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.748+0000 7febcd400640 1 -- 172.21.15.18:0/1942012661 wait complete. 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.749+0000 7febcd400640 1 Processor -- start 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.749+0000 7febcd400640 1 -- start start 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc8075780 0x7febc819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7febc810f620 con 0x7febc81096c0 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7febc810f4a0 con 0x7febc80741a0 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febcd400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febc810f7a0 con 0x7febc8075780 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45496/0 (socket says 172.21.15.18:45496) 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc7200640 1 -- 172.21.15.18:0/188246287 learned_addr learned my addr 172.21.15.18:0/188246287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc5e00640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc8075780 0x7febc819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 -- 172.21.15.18:0/188246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc8075780 msgr2=0x7febc819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc8075780 0x7febc819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 -- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 msgr2=0x7febc81a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc6800640 1 -- 172.21.15.18:0/188246287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc81a1880 con 0x7febc80741a0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.750+0000 7febc7200640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febc6800640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8199c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febb8036040 tx=0x7febb802c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8043020 con 0x7febc80741a0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febb80054e0 con 0x7febc80741a0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc81a1b10 con 0x7febc80741a0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8003c10 con 0x7febc80741a0 2024-04-21T22:30:56.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.751+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc81a2080 con 0x7febc80741a0 2024-04-21T22:30:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.752+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc81083f0 con 0x7febc80741a0 2024-04-21T22:30:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.755+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7febb8046020 con 0x7febc80741a0 2024-04-21T22:30:56.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.756+0000 7febbf400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 0x7febac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:56.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.756+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7febb80f0c00 con 0x7febc80741a0 2024-04-21T22:30:56.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.756+0000 7febc5e00640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 0x7febac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:56.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.757+0000 7febc5e00640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 0x7febac0a50d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febb40095f0 tx=0x7febb4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:56.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:56.761+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7febb804d020 con 0x7febc80741a0 2024-04-21T22:30:56.971 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:56 smithi018 podman[67641]: 2024-04-21 22:30:56.623305006 +0000 UTC m=+0.039570930 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:30:56.971 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:56 smithi018 podman[67641]: 2024-04-21 22:30:56.76264076 +0000 UTC m=+0.178906691 container create 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-21T22:30:57.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.016+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febc802d170 con 0x7febc80741a0 2024-04-21T22:30:57.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.017+0000 7febbf400640 1 -- 172.21.15.18:0/188246287 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7febb80bdf60 con 0x7febc80741a0 2024-04-21T22:30:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:57.017 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-21T22:30:57.018 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 4 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.020+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 msgr2=0x7febac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.020+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 0x7febac0a50d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febb40095f0 tx=0x7febb4005f90 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.020+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 msgr2=0x7febc8199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.020+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8199c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febb8036040 tx=0x7febb802c650 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 shutdown_connections 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7febac0a2c10 0x7febac0a50d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7febc81096c0 0x7febc81a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc8075780 0x7febc819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 --2- 172.21.15.18:0/188246287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febc80741a0 0x7febc8199c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 >> 172.21.15.18:0/188246287 conn(0x7febc80fcd70 msgr2=0x7febc81055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 shutdown_connections 2024-04-21T22:30:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:57.021+0000 7febcd400640 1 -- 172.21.15.18:0/188246287 wait complete. 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 podman[67641]: 2024-04-21 22:30:57.084020765 +0000 UTC m=+0.500286720 container init 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 podman[67641]: 2024-04-21 22:30:57.094970727 +0000 UTC m=+0.511236649 container start 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8) 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mds[67698]: -- 172.21.15.18:0/1947866876 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555fc71c1a40 con 0x555fc7194800 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d[67692]: starting mds.d at 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 bash[67641]: 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d 2024-04-21T22:30:57.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:30:57 smithi018 systemd[1]: Started Ceph mds.d for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/188246287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:58.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:57 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:58.120 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:58.120 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/188246287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:58.120 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.120 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.121 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.121 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:58.121 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:58.121 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:57 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/188246287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:30:58.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:30:58.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:30:58.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:57 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:30:59.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:30:59.101 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:58 smithi047 ceph-mon[31561]: Deploying daemon mds.e on smithi047 2024-04-21T22:30:59.101 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:58 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6836/260606364,v1:172.21.15.18:6837/260606364] up:boot 2024-04-21T22:30:59.101 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:58 smithi047 ceph-mon[31561]: fsmap 4 up:standby 2024-04-21T22:30:59.101 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:30:59.124 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:58 smithi018 ceph-mon[26614]: Deploying daemon mds.e on smithi047 2024-04-21T22:30:59.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:58 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6836/260606364,v1:172.21.15.18:6837/260606364] up:boot 2024-04-21T22:30:59.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:58 smithi018 ceph-mon[26614]: fsmap 4 up:standby 2024-04-21T22:30:59.125 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:30:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:58 smithi081 ceph-mon[31692]: Deploying daemon mds.e on smithi047 2024-04-21T22:30:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:58 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6836/260606364,v1:172.21.15.18:6837/260606364] up:boot 2024-04-21T22:30:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:58 smithi081 ceph-mon[31692]: fsmap 4 up:standby 2024-04-21T22:30:59.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:30:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.268+0000 7fb635e00640 1 -- 172.21.15.18:0/723695544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 msgr2=0x7fb63010be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.268+0000 7fb635e00640 1 --2- 172.21.15.18:0/723695544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb63010be50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb620009900 tx=0x7fb62002bc30 comp rx=0 tx=0).stop 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 -- 172.21.15.18:0/723695544 shutdown_connections 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 --2- 172.21.15.18:0/723695544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb63010be50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 --2- 172.21.15.18:0/723695544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630104c00 0x7fb630105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 --2- 172.21.15.18:0/723695544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630103a10 0x7fb630103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 -- 172.21.15.18:0/723695544 >> 172.21.15.18:0/723695544 conn(0x7fb6300fefc0 msgr2=0x7fb6301013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 -- 172.21.15.18:0/723695544 shutdown_connections 2024-04-21T22:30:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.269+0000 7fb635e00640 1 -- 172.21.15.18:0/723695544 wait complete. 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 Processor -- start 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 -- start start 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 0x7fb6300794f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 0x7fb630079a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb63010f650 con 0x7fb630103a10 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb63010f4d0 con 0x7fb6301055c0 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb635e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb63010f7d0 con 0x7fb630104c00 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.270+0000 7fb62ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 0x7fb6300794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 0x7fb630079a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:59.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52178/0 (socket says 172.21.15.18:52178) 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 -- 172.21.15.18:0/4069013253 learned_addr learned my addr 172.21.15.18:0/4069013253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 0x7fb630079a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51998/0 (socket says 172.21.15.18:51998) 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 0x7fb6300794f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45528/0 (socket says 172.21.15.18:45528) 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 -- 172.21.15.18:0/4069013253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 msgr2=0x7fb630079a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 0x7fb630079a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 -- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 msgr2=0x7fb6300794f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 0x7fb6300794f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 -- 172.21.15.18:0/4069013253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb630076920 con 0x7fb6301055c0 2024-04-21T22:30:59.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.271+0000 7fb62f400640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62002c8e0 tx=0x7fb62002c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.272+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620043020 con 0x7fb6301055c0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.272+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6200054e0 con 0x7fb6301055c0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.272+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620003ce0 con 0x7fb6301055c0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.272+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6301a6090 con 0x7fb6301055c0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.272+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6301a6440 con 0x7fb6301055c0 2024-04-21T22:30:59.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.273+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63010acd0 con 0x7fb6301055c0 2024-04-21T22:30:59.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.275+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb620046020 con 0x7fb6301055c0 2024-04-21T22:30:59.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.276+0000 7fb634a00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 0x7fb6140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:30:59.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.276+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb6200f0c50 con 0x7fb6301055c0 2024-04-21T22:30:59.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.276+0000 7fb62ea00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 0x7fb6140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:30:59.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.277+0000 7fb62ea00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 0x7fb6140a50d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb630104a60 tx=0x7fb628009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:30:59.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.280+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb62004d020 con 0x7fb6301055c0 2024-04-21T22:30:59.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.530+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb63002d170 con 0x7fb6301055c0 2024-04-21T22:30:59.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.531+0000 7fb634a00640 1 -- 172.21.15.18:0/4069013253 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3865 (secure 0 0 0) 0x7fb6200bdfb0 con 0x7fb6301055c0 2024-04-21T22:30:59.531 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:30:59.531 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-21T22:30:59.531 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 5 2024-04-21T22:30:59.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.533+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 msgr2=0x7fb6140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.533+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 0x7fb6140a50d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb630104a60 tx=0x7fb628009500 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 msgr2=0x7fb630076060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb62002c8e0 tx=0x7fb62002c6a0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 shutdown_connections 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb6140a2c10 0x7fb6140a50d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6301055c0 0x7fb630076060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb630104c00 0x7fb630079a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 --2- 172.21.15.18:0/4069013253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb630103a10 0x7fb6300794f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 >> 172.21.15.18:0/4069013253 conn(0x7fb6300fefc0 msgr2=0x7fb630107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 shutdown_connections 2024-04-21T22:30:59.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:30:59.534+0000 7fb635e00640 1 -- 172.21.15.18:0/4069013253 wait complete. 2024-04-21T22:30:59.694 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:30:59 smithi047 systemd[1]: Starting Ceph mds.e for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:00.123 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:59 smithi047 ceph-mon[31561]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:00.123 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:30:59 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4069013253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:00.124 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:30:59 smithi047 podman[61263]: 2024-04-21 22:30:59.714201823 +0000 UTC m=+0.018601489 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:00.124 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:30:59 smithi047 podman[61263]: 2024-04-21 22:30:59.829122346 +0000 UTC m=+0.133522012 container create 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-21T22:31:00.124 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 podman[61263]: 2024-04-21 22:31:00.124495629 +0000 UTC m=+0.428895295 container init 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-21T22:31:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:59 smithi081 ceph-mon[31692]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:00.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:30:59 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4069013253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:00.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:59 smithi018 ceph-mon[26614]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:00.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:30:59 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4069013253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:00.444 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 podman[61263]: 2024-04-21 22:31:00.127447514 +0000 UTC m=+0.431847180 container start 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-21T22:31:00.445 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 ceph-mds[61283]: -- 172.21.15.47:0/305363910 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555783f5da40 con 0x555783f31000 2024-04-21T22:31:00.445 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: starting mds.e at 2024-04-21T22:31:00.445 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 bash[61263]: 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 2024-04-21T22:31:00.445 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:31:00 smithi047 systemd[1]: Started Ceph mds.e for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:01.530 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:01.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.608 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: Deploying daemon mds.f on smithi081 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:boot 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: fsmap 5 up:standby 2024-04-21T22:31:01.609 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:01 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:31:01.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: Deploying daemon mds.f on smithi081 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:boot 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: fsmap 5 up:standby 2024-04-21T22:31:01.611 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:01 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:31:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: Deploying daemon mds.f on smithi081 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:boot 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: fsmap 5 up:standby 2024-04-21T22:31:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:01 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 -- 172.21.15.18:0/4172486799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 msgr2=0x7ff918100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 --2- 172.21.15.18:0/4172486799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff918100ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff908009900 tx=0x7ff90802bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 -- 172.21.15.18:0/4172486799 shutdown_connections 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 --2- 172.21.15.18:0/4172486799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918102250 0x7ff918108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 --2- 172.21.15.18:0/4172486799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918101890 0x7ff918101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 --2- 172.21.15.18:0/4172486799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff918100ac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 -- 172.21.15.18:0/4172486799 >> 172.21.15.18:0/4172486799 conn(0x7ff9180fbc10 msgr2=0x7ff9180fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 -- 172.21.15.18:0/4172486799 shutdown_connections 2024-04-21T22:31:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.833+0000 7ff91d800640 1 -- 172.21.15.18:0/4172486799 wait complete. 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 Processor -- start 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 -- start start 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 0x7ff918109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918102250 0x7ff918109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810d4a0 con 0x7ff9181006a0 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810d320 con 0x7ff918101890 2024-04-21T22:31:01.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.834+0000 7ff91d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff91810d620 con 0x7ff918102250 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45550/0 (socket says 172.21.15.18:45550) 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 -- 172.21.15.18:0/2197375476 learned_addr learned my addr 172.21.15.18:0/2197375476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff917400640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918102250 0x7ff918109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916000640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 0x7ff918109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 -- 172.21.15.18:0/2197375476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918102250 msgr2=0x7ff918109ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918102250 0x7ff918109ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 -- 172.21.15.18:0/2197375476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 msgr2=0x7ff918109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 0x7ff918109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 -- 172.21.15.18:0/2197375476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91810a430 con 0x7ff9181006a0 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916000640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 0x7ff918109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.835+0000 7ff916a00640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c00 tx=0x7ff90802c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:01.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.836+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908043020 con 0x7ff9181006a0 2024-04-21T22:31:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.836+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9080054e0 con 0x7ff9181006a0 2024-04-21T22:31:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.836+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908003ce0 con 0x7ff9181006a0 2024-04-21T22:31:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.836+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9181a1bd0 con 0x7ff9181006a0 2024-04-21T22:31:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.836+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181a20f0 con 0x7ff9181006a0 2024-04-21T22:31:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.837+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9181079c0 con 0x7ff9181006a0 2024-04-21T22:31:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.839+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff908046020 con 0x7ff9181006a0 2024-04-21T22:31:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.841+0000 7ff90f400640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 0x7ff8f80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.841+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff9080f0da0 con 0x7ff9181006a0 2024-04-21T22:31:01.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.841+0000 7ff916000640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 0x7ff8f80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:01.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.842+0000 7ff916000640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 0x7ff8f80a5050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff91810ad90 tx=0x7ff900009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:01.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:01.845+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff90804d020 con 0x7ff9181006a0 2024-04-21T22:31:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.100+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff91802d390 con 0x7ff9181006a0 2024-04-21T22:31:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.101+0000 7ff90f400640 1 -- 172.21.15.18:0/2197375476 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4687 (secure 0 0 0) 0x7ff9080be100 con 0x7ff9181006a0 2024-04-21T22:31:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:02.101 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-21T22:31:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 msgr2=0x7ff8f80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 0x7ff8f80a5050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff91810ad90 tx=0x7ff900009500 comp rx=0 tx=0).stop 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 msgr2=0x7ff91810b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c00 tx=0x7ff90802c6c0 comp rx=0 tx=0).stop 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 shutdown_connections 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8f80a2b90 0x7ff8f80a5050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff918102250 0x7ff918109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff918101890 0x7ff918109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 --2- 172.21.15.18:0/2197375476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9181006a0 0x7ff91810b020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 >> 172.21.15.18:0/2197375476 conn(0x7ff9180fbc10 msgr2=0x7ff918104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 shutdown_connections 2024-04-21T22:31:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:02.104+0000 7ff91d800640 1 -- 172.21.15.18:0/2197375476 wait complete. 2024-04-21T22:31:02.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:02 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2197375476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:02.578 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:02 smithi081 systemd[1]: Starting Ceph mds.f for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:02.578 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:02 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2197375476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:02.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:02 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2197375476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:02.888 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:02 smithi081 podman[62362]: 2024-04-21 22:31:02.697103662 +0000 UTC m=+0.018357787 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:02.888 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:02 smithi081 podman[62362]: 2024-04-21 22:31:02.819219325 +0000 UTC m=+0.140473438 container create a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True) 2024-04-21T22:31:03.284 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 podman[62362]: 2024-04-21 22:31:03.063403167 +0000 UTC m=+0.384657280 container init a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=) 2024-04-21T22:31:03.285 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 podman[62362]: 2024-04-21 22:31:03.065906389 +0000 UTC m=+0.387160503 container start a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-21T22:31:03.285 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mds[62381]: -- 172.21.15.81:0/2885869063 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d24421a40 con 0x560d243f4800 2024-04-21T22:31:03.285 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: starting mds.f at 2024-04-21T22:31:03.285 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 bash[62362]: a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f 2024-04-21T22:31:03.285 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:31:03 smithi081 systemd[1]: Started Ceph mds.f for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:03.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:03 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:03 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:03 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:04.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:04.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 -- 172.21.15.18:0/3775050357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 msgr2=0x7f3de81044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:04.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 --2- 172.21.15.18:0/3775050357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de81044f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009900 tx=0x7f3dd802bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:04.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 -- 172.21.15.18:0/3775050357 shutdown_connections 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 --2- 172.21.15.18:0/3775050357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 0x7f3de81097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 --2- 172.21.15.18:0/3775050357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de8106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 --2- 172.21.15.18:0/3775050357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de81044f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 -- 172.21.15.18:0/3775050357 >> 172.21.15.18:0/3775050357 conn(0x7f3de80fbb10 msgr2=0x7f3de80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 -- 172.21.15.18:0/3775050357 shutdown_connections 2024-04-21T22:31:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.350+0000 7f3de7200640 1 -- 172.21.15.18:0/3775050357 wait complete. 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.351+0000 7f3de7200640 1 Processor -- start 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.351+0000 7f3de7200640 1 -- start start 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de8101a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de81000b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 0x7f3de81005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3de810d360 con 0x7f3de8104a30 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3de810d1e0 con 0x7f3de8107360 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3de810d4e0 con 0x7f3de8102100 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3ddd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de81000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3ddd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de81000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45564/0 (socket says 172.21.15.18:45564) 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3ddd400640 1 -- 172.21.15.18:0/3386150537 learned_addr learned my addr 172.21.15.18:0/3386150537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de8101a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de6800640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 0x7f3de81005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 -- 172.21.15.18:0/3386150537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 msgr2=0x7f3de81005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 0x7f3de81005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 -- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 msgr2=0x7f3de81000b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de81000b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.352+0000 7f3de5e00640 1 -- 172.21.15.18:0/3386150537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de8100e80 con 0x7f3de8102100 2024-04-21T22:31:04.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3de5e00640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de8101a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8036040 tx=0x7f3dd802c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8043020 con 0x7f3de8102100 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de81a1ad0 con 0x7f3de8102100 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd80054e0 con 0x7f3de8102100 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8003ca0 con 0x7f3de8102100 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.353+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de81a2040 con 0x7f3de8102100 2024-04-21T22:31:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.355+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de80fd600 con 0x7f3de8102100 2024-04-21T22:31:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.356+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3dd8046020 con 0x7f3de8102100 2024-04-21T22:31:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.358+0000 7f3ddf400640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 0x7f3dcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.358+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3dd80f0ce0 con 0x7f3de8102100 2024-04-21T22:31:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.358+0000 7f3ddd400640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 0x7f3dcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:04.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.359+0000 7f3ddd400640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 0x7f3dcc0a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3de81017e0 tx=0x7f3dd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:04.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.362+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3dd804d020 con 0x7f3de8102100 2024-04-21T22:31:04.436 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:04 smithi081 ceph-mon[31692]: Deploying daemon mds.c on smithi081 2024-04-21T22:31:04.436 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:04 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:boot 2024-04-21T22:31:04.436 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:04 smithi081 ceph-mon[31692]: fsmap 6 up:standby 2024-04-21T22:31:04.436 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:04 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:31:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:04 smithi018 ceph-mon[26614]: Deploying daemon mds.c on smithi081 2024-04-21T22:31:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:04 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:boot 2024-04-21T22:31:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:04 smithi018 ceph-mon[26614]: fsmap 6 up:standby 2024-04-21T22:31:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:04 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:31:04.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.609+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3de802d390 con 0x7f3de8102100 2024-04-21T22:31:04.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.610+0000 7f3ddf400640 1 -- 172.21.15.18:0/3386150537 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5512 (secure 0 0 0) 0x7f3dd80be040 con 0x7f3de8102100 2024-04-21T22:31:04.610 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:04.610 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-21T22:31:04.610 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 msgr2=0x7f3dcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 0x7f3dcc0a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3de81017e0 tx=0x7f3dd0005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 msgr2=0x7f3de8101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de8101a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8036040 tx=0x7f3dd802c6c0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 shutdown_connections 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3dcc0a2b80 0x7f3dcc0a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de8107360 0x7f3de81005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de8104a30 0x7f3de81000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 --2- 172.21.15.18:0/3386150537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de8102100 0x7f3de8101a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:04.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 >> 172.21.15.18:0/3386150537 conn(0x7f3de80fbb10 msgr2=0x7f3de8102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:04.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 shutdown_connections 2024-04-21T22:31:04.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:04.613+0000 7f3de7200640 1 -- 172.21.15.18:0/3386150537 wait complete. 2024-04-21T22:31:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:04 smithi047 ceph-mon[31561]: Deploying daemon mds.c on smithi081 2024-04-21T22:31:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:04 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:boot 2024-04-21T22:31:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:04 smithi047 ceph-mon[31561]: fsmap 6 up:standby 2024-04-21T22:31:04.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:04 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:31:05.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:05 smithi081 ceph-mon[31692]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:05.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:05 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3386150537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:05 smithi018 ceph-mon[26614]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3386150537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:05.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:05 smithi047 ceph-mon[31561]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:05.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:05 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3386150537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:06.138 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:31:05 smithi081 systemd[1]: Started Ceph mds.c for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:06.634 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.869+0000 7fb803e00640 1 -- 172.21.15.18:0/1911064211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804105450 msgr2=0x7fb80410bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.869+0000 7fb803e00640 1 --2- 172.21.15.18:0/1911064211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804105450 0x7fb80410bce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009ca0 tx=0x7fb7fc02c100 comp rx=0 tx=0).stop 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 -- 172.21.15.18:0/1911064211 shutdown_connections 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 --2- 172.21.15.18:0/1911064211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804105450 0x7fb80410bce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 --2- 172.21.15.18:0/1911064211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb804104a90 0x7fb804104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 --2- 172.21.15.18:0/1911064211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8041038a0 0x7fb804103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 -- 172.21.15.18:0/1911064211 >> 172.21.15.18:0/1911064211 conn(0x7fb8040fee10 msgr2=0x7fb804101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 -- 172.21.15.18:0/1911064211 shutdown_connections 2024-04-21T22:31:06.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.870+0000 7fb803e00640 1 -- 172.21.15.18:0/1911064211 wait complete. 2024-04-21T22:31:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.871+0000 7fb803e00640 1 Processor -- start 2024-04-21T22:31:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.871+0000 7fb803e00640 1 -- start start 2024-04-21T22:31:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.871+0000 7fb803e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8041038a0 0x7fb804199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 0x7fb8041a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb80410f500 con 0x7fb804105450 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb80410f380 con 0x7fb804104a90 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb80410f680 con 0x7fb8041038a0 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb802000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb802a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8041038a0 0x7fb804199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 0x7fb8041a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb802000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48066/0 (socket says 172.21.15.18:48066) 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb802000640 1 -- 172.21.15.18:0/761111220 learned_addr learned my addr 172.21.15.18:0/761111220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 -- 172.21.15.18:0/761111220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8041038a0 msgr2=0x7fb804199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8041038a0 0x7fb804199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 -- 172.21.15.18:0/761111220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 msgr2=0x7fb80419a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb803400640 1 -- 172.21.15.18:0/761111220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8041a1700 con 0x7fb804105450 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.872+0000 7fb802000640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb803400640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 0x7fb8041a1090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc037040 tx=0x7fb7fc035d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc039040 con 0x7fb804105450 2024-04-21T22:31:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7fc044070 con 0x7fb804105450 2024-04-21T22:31:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8041a1990 con 0x7fb804105450 2024-04-21T22:31:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc004450 con 0x7fb804105450 2024-04-21T22:31:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.873+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8041a1e50 con 0x7fb804105450 2024-04-21T22:31:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.874+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80410ab60 con 0x7fb804105450 2024-04-21T22:31:06.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.876+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb7fc0045f0 con 0x7fb804105450 2024-04-21T22:31:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.878+0000 7fb7fb400640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 0x7fb7e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.878+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb7fc0f1cc0 con 0x7fb804105450 2024-04-21T22:31:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.878+0000 7fb802a00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 0x7fb7e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.879+0000 7fb802a00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 0x7fb7e80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8041048f0 tx=0x7fb7f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:06.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:06.881+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb7fc0bf020 con 0x7fb804105450 2024-04-21T22:31:06.952 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: Deploying daemon mds.h on smithi047 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6836/2293229120,v1:172.21.15.81:6837/2293229120] up:boot 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: fsmap 7 up:standby 2024-04-21T22:31:06.953 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:06 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: Deploying daemon mds.h on smithi047 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:07.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6836/2293229120,v1:172.21.15.81:6837/2293229120] up:boot 2024-04-21T22:31:07.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: fsmap 7 up:standby 2024-04-21T22:31:07.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:06 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:31:07.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.129+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb80402d330 con 0x7fb804105450 2024-04-21T22:31:07.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.131+0000 7fb7fb400640 1 -- 172.21.15.18:0/761111220 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6337 (secure 0 0 0) 0x7fb80402d330 con 0x7fb804105450 2024-04-21T22:31:07.131 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:07.131 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-21T22:31:07.131 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 8 2024-04-21T22:31:07.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.133+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 msgr2=0x7fb7e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:07.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.133+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 0x7fb7e80a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb8041048f0 tx=0x7fb7f4005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:07.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.133+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 msgr2=0x7fb8041a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:07.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.133+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 0x7fb8041a1090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc037040 tx=0x7fb7fc035d10 comp rx=0 tx=0).stop 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 shutdown_connections 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb7e80a2b80 0x7fb7e80a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb804105450 0x7fb8041a1090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb804104a90 0x7fb80419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 --2- 172.21.15.18:0/761111220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8041038a0 0x7fb804199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 >> 172.21.15.18:0/761111220 conn(0x7fb8040fee10 msgr2=0x7fb804107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:07.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 shutdown_connections 2024-04-21T22:31:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:07.134+0000 7fb803e00640 1 -- 172.21.15.18:0/761111220 wait complete. 2024-04-21T22:31:07.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: Deploying daemon mds.h on smithi047 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6836/2293229120,v1:172.21.15.81:6837/2293229120] up:boot 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: fsmap 7 up:standby 2024-04-21T22:31:07.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:06 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:31:08.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/761111220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:08.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/761111220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:08.433 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/761111220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:08.433 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 systemd[1]: Starting Ceph mds.h for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:08.693 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 podman[61583]: 2024-04-21 22:31:08.336767384 +0000 UTC m=+0.018626340 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:08.693 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 podman[61583]: 2024-04-21 22:31:08.475197077 +0000 UTC m=+0.157056030 container create e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:31:08.693 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 podman[61583]: 2024-04-21 22:31:08.694197347 +0000 UTC m=+0.376056301 container init e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, ceph=True, org.label-schema.schema-version=1.0) 2024-04-21T22:31:08.944 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 podman[61583]: 2024-04-21 22:31:08.696857513 +0000 UTC m=+0.378716469 container start e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-21T22:31:08.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 ceph-mds[61602]: -- 172.21.15.47:0/1944367 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ba3db3a40 con 0x555ba3d86800 2024-04-21T22:31:08.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: starting mds.h at 2024-04-21T22:31:08.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 bash[61583]: e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d 2024-04-21T22:31:08.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:31:08 smithi047 systemd[1]: Started Ceph mds.h for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:09.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 -- 172.21.15.18:0/3617947386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c103220 msgr2=0x7fb16c109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:09.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 --2- 172.21.15.18:0/3617947386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c103220 0x7fb16c109ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb164009ca0 tx=0x7fb16402c100 comp rx=0 tx=0).stop 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 -- 172.21.15.18:0/3617947386 shutdown_connections 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 --2- 172.21.15.18:0/3617947386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c103220 0x7fb16c109ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 --2- 172.21.15.18:0/3617947386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c102860 0x7fb16c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 --2- 172.21.15.18:0/3617947386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c101670 0x7fb16c101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.381+0000 7fb172400640 1 -- 172.21.15.18:0/3617947386 >> 172.21.15.18:0/3617947386 conn(0x7fb16c0fcc00 msgr2=0x7fb16c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.382+0000 7fb172400640 1 -- 172.21.15.18:0/3617947386 shutdown_connections 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.382+0000 7fb172400640 1 -- 172.21.15.18:0/3617947386 wait complete. 2024-04-21T22:31:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 Processor -- start 2024-04-21T22:31:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 -- start start 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c101670 0x7fb16c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c103220 0x7fb16c1a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d2d0 con 0x7fb16c101670 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d150 con 0x7fb16c103220 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.383+0000 7fb172400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10d450 con 0x7fb16c102860 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb171000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c101670 0x7fb16c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:37488/0 (socket says 172.21.15.18:37488) 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 -- 172.21.15.18:0/2134536459 learned_addr learned my addr 172.21.15.18:0/2134536459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb171a00640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c103220 0x7fb16c1a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 -- 172.21.15.18:0/2134536459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c103220 msgr2=0x7fb16c1a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c103220 0x7fb16c1a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 -- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c101670 msgr2=0x7fb16c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c101670 0x7fb16c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 -- 172.21.15.18:0/2134536459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c1a1730 con 0x7fb16c102860 2024-04-21T22:31:09.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.384+0000 7fb16be00640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb15800e9f0 tx=0x7fb15800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.385+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15800cd80 con 0x7fb16c102860 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.385+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb158010910 con 0x7fb16c102860 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.385+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c1a1a20 con 0x7fb16c102860 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.385+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158018990 con 0x7fb16c102860 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.385+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a1f70 con 0x7fb16c102860 2024-04-21T22:31:09.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.386+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c1a21a0 con 0x7fb16c102860 2024-04-21T22:31:09.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.389+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb158010ac0 con 0x7fb16c102860 2024-04-21T22:31:09.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.390+0000 7fb169600640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 0x7fb1540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:09.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.390+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb1580cef50 con 0x7fb16c102860 2024-04-21T22:31:09.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.391+0000 7fb171000640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 0x7fb1540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:09.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.391+0000 7fb171000640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 0x7fb1540a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb1600095f0 tx=0x7fb160005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.395+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb15809bc60 con 0x7fb16c102860 2024-04-21T22:31:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.640+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16c1a2370 con 0x7fb16c102860 2024-04-21T22:31:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.641+0000 7fb169600640 1 -- 172.21.15.18:0/2134536459 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7159 (secure 0 0 0) 0x7fb15809ff60 con 0x7fb16c102860 2024-04-21T22:31:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:09.641 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-21T22:31:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-21T22:31:09.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.643+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 msgr2=0x7fb1540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:09.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.643+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 0x7fb1540a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb1600095f0 tx=0x7fb160005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:09.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.643+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 msgr2=0x7fb16c19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:09.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.643+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb15800e9f0 tx=0x7fb15800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 shutdown_connections 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb1540a2b80 0x7fb1540a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb16c103220 0x7fb16c1a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb16c102860 0x7fb16c19a050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 --2- 172.21.15.18:0/2134536459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb16c101670 0x7fb16c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 >> 172.21.15.18:0/2134536459 conn(0x7fb16c0fcc00 msgr2=0x7fb16c073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 shutdown_connections 2024-04-21T22:31:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:09.644+0000 7fb172400640 1 -- 172.21.15.18:0/2134536459 wait complete. 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6836/639724797,v1:172.21.15.47:6837/639724797] up:boot 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: fsmap 8 up:standby 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:31:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2134536459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6836/639724797,v1:172.21.15.47:6837/639724797] up:boot 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: fsmap 8 up:standby 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:31:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:09 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2134536459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:10.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:10.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6836/639724797,v1:172.21.15.47:6837/639724797] up:boot 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: fsmap 8 up:standby 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:31:10.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:09 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2134536459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:11.138 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 systemd[1]: Starting Ceph mds.i for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:10 smithi081 ceph-mon[31692]: Deploying daemon mds.i on smithi081 2024-04-21T22:31:11.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:10 smithi047 ceph-mon[31561]: Deploying daemon mds.i on smithi081 2024-04-21T22:31:11.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:10 smithi018 ceph-mon[26614]: Deploying daemon mds.i on smithi081 2024-04-21T22:31:11.579 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 podman[62979]: 2024-04-21 22:31:11.220493598 +0000 UTC m=+0.018021699 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:11.580 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 podman[62979]: 2024-04-21 22:31:11.343844432 +0000 UTC m=+0.141372517 container create ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:31:11.580 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 podman[62979]: 2024-04-21 22:31:11.55461427 +0000 UTC m=+0.352142355 container init ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-21T22:31:11.580 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 podman[62979]: 2024-04-21 22:31:11.557327385 +0000 UTC m=+0.354855471 container start ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-04-21T22:31:11.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:11.862 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mds[62998]: -- 172.21.15.81:0/1133584082 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56309a795a40 con 0x56309a768c00 2024-04-21T22:31:11.863 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: starting mds.i at 2024-04-21T22:31:11.863 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 bash[62979]: ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 2024-04-21T22:31:11.863 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:31:11 smithi081 systemd[1]: Started Ceph mds.i for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 -- 172.21.15.18:0/4225679359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c103a10 msgr2=0x7efc6c103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 --2- 172.21.15.18:0/4225679359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c103a10 0x7efc6c103e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009860 tx=0x7efc5c02bb70 comp rx=0 tx=0).stop 2024-04-21T22:31:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 -- 172.21.15.18:0/4225679359 shutdown_connections 2024-04-21T22:31:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 --2- 172.21.15.18:0/4225679359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c1055c0 0x7efc6c10be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 --2- 172.21.15.18:0/4225679359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c104c00 0x7efc6c105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 --2- 172.21.15.18:0/4225679359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c103a10 0x7efc6c103e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 -- 172.21.15.18:0/4225679359 >> 172.21.15.18:0/4225679359 conn(0x7efc6c0fefc0 msgr2=0x7efc6c1013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 -- 172.21.15.18:0/4225679359 shutdown_connections 2024-04-21T22:31:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.885+0000 7efc72200640 1 -- 172.21.15.18:0/4225679359 wait complete. 2024-04-21T22:31:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.886+0000 7efc72200640 1 Processor -- start 2024-04-21T22:31:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.886+0000 7efc72200640 1 -- start start 2024-04-21T22:31:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 0x7efc6c199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1055c0 0x7efc6c1a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c10f5f0 con 0x7efc6c103a10 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c10f470 con 0x7efc6c1055c0 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc72200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c10f770 con 0x7efc6c104c00 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 0x7efc6c199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:37518/0 (socket says 172.21.15.18:37518) 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 -- 172.21.15.18:0/3280657499 learned_addr learned my addr 172.21.15.18:0/3280657499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6be00640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1055c0 0x7efc6c1a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 -- 172.21.15.18:0/3280657499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1055c0 msgr2=0x7efc6c1a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1055c0 0x7efc6c1a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 -- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 msgr2=0x7efc6c199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 0x7efc6c199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6aa00640 1 -- 172.21.15.18:0/3280657499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c1a18e0 con 0x7efc6c104c00 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.887+0000 7efc6b400640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 0x7efc6c199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc6aa00640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e9f0 tx=0x7efc5800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5800cd80 con 0x7efc6c104c00 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc58010910 con 0x7efc6c104c00 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c1a1bd0 con 0x7efc6c104c00 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58018990 con 0x7efc6c104c00 2024-04-21T22:31:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.888+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c1a2140 con 0x7efc6c104c00 2024-04-21T22:31:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.889+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6c10ad30 con 0x7efc6c104c00 2024-04-21T22:31:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.891+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efc58010ac0 con 0x7efc6c104c00 2024-04-21T22:31:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.893+0000 7efc63e00640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 0x7efc500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.893+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7efc580ceeb0 con 0x7efc6c104c00 2024-04-21T22:31:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.893+0000 7efc6b400640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 0x7efc500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.894+0000 7efc6b400640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 0x7efc500a50d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0349e0 tx=0x7efc5c02e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:11.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:11.896+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7efc5809bbc0 con 0x7efc6c104c00 2024-04-21T22:31:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:12.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:12.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:11 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:12.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:12.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:11 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:12.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.145+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc6c0623e0 con 0x7efc6c104c00 2024-04-21T22:31:12.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.146+0000 7efc63e00640 1 -- 172.21.15.18:0/3280657499 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7986 (secure 0 0 0) 0x7efc5809fec0 con 0x7efc6c104c00 2024-04-21T22:31:12.147 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:12.147 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T22:31:12.147 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-04-21T22:31:12.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 msgr2=0x7efc500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:12.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 0x7efc500a50d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0349e0 tx=0x7efc5c02e040 comp rx=0 tx=0).stop 2024-04-21T22:31:12.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 msgr2=0x7efc6c19a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:12.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e9f0 tx=0x7efc5800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 shutdown_connections 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc500a2c10 0x7efc500a50d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1055c0 0x7efc6c1a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc6c104c00 0x7efc6c19a1e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 --2- 172.21.15.18:0/3280657499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc6c103a10 0x7efc6c199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.149+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 >> 172.21.15.18:0/3280657499 conn(0x7efc6c0fefc0 msgr2=0x7efc6c107f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.150+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 shutdown_connections 2024-04-21T22:31:12.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:12.150+0000 7efc72200640 1 -- 172.21.15.18:0/3280657499 wait complete. 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:12.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:11 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:13.006 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:12 smithi018 ceph-mon[26614]: Deploying daemon mds.g on smithi018 2024-04-21T22:31:13.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:12 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:boot 2024-04-21T22:31:13.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:12 smithi018 ceph-mon[26614]: fsmap 9 up:standby 2024-04-21T22:31:13.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:12 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:31:13.007 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3280657499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:13.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:12 smithi081 ceph-mon[31692]: Deploying daemon mds.g on smithi018 2024-04-21T22:31:13.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:12 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:boot 2024-04-21T22:31:13.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:12 smithi081 ceph-mon[31692]: fsmap 9 up:standby 2024-04-21T22:31:13.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:12 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:31:13.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:12 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3280657499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:13.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:12 smithi047 ceph-mon[31561]: Deploying daemon mds.g on smithi018 2024-04-21T22:31:13.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:12 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:boot 2024-04-21T22:31:13.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:12 smithi047 ceph-mon[31561]: fsmap 9 up:standby 2024-04-21T22:31:13.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:12 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:31:13.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:12 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3280657499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:13.994 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:13 smithi081 ceph-mon[31692]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:14.083 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:13 smithi018 ceph-mon[26614]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:14.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:14.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:13 smithi047 ceph-mon[31561]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 -- 172.21.15.18:0/3677766494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c101800 msgr2=0x7f2c2c101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 --2- 172.21.15.18:0/3677766494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c101800 0x7f2c2c101c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009900 tx=0x7f2c2002bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 -- 172.21.15.18:0/3677766494 shutdown_connections 2024-04-21T22:31:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 --2- 172.21.15.18:0/3677766494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 --2- 172.21.15.18:0/3677766494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c1029f0 0x7f2c2c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 --2- 172.21.15.18:0/3677766494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c101800 0x7f2c2c101c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 -- 172.21.15.18:0/3677766494 >> 172.21.15.18:0/3677766494 conn(0x7f2c2c0fcd70 msgr2=0x7f2c2c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:14.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 -- 172.21.15.18:0/3677766494 shutdown_connections 2024-04-21T22:31:14.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.402+0000 7f2c33400640 1 -- 172.21.15.18:0/3677766494 wait complete. 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.403+0000 7f2c33400640 1 Processor -- start 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.403+0000 7f2c33400640 1 -- start start 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c101800 0x7f2c2c199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1029f0 0x7f2c2c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c10d430 con 0x7f2c2c101800 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c10d2b0 con 0x7f2c2c1029f0 2024-04-21T22:31:14.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c33400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c10d5b0 con 0x7f2c2c1033b0 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c30a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c101800 0x7f2c2c199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:37534/0 (socket says 172.21.15.18:37534) 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 -- 172.21.15.18:0/1314528782 learned_addr learned my addr 172.21.15.18:0/1314528782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c2be00640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1029f0 0x7f2c2c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 -- 172.21.15.18:0/1314528782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1029f0 msgr2=0x7f2c2c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1029f0 0x7f2c2c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 -- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c101800 msgr2=0x7f2c2c199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c101800 0x7f2c2c199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.404+0000 7f2c31400640 1 -- 172.21.15.18:0/1314528782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c1a18f0 con 0x7f2c2c1033b0 2024-04-21T22:31:14.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c31400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400eaa0 tx=0x7f2c2400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400cdb0 con 0x7f2c2c1033b0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c24005020 con 0x7f2c2c1033b0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c240116b0 con 0x7f2c2c1033b0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c1a1be0 con 0x7f2c2c1033b0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.405+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c1a2100 con 0x7f2c2c1033b0 2024-04-21T22:31:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.406+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c1a2330 con 0x7f2c2c1033b0 2024-04-21T22:31:14.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.408+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2c24005560 con 0x7f2c2c1033b0 2024-04-21T22:31:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.409+0000 7f2c29600640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 0x7f2c140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.410+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f2c240ced80 con 0x7f2c2c1033b0 2024-04-21T22:31:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.410+0000 7f2c30a00640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 0x7f2c140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:14.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.410+0000 7f2c30a00640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 0x7f2c140a50d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c2002c170 tx=0x7f2c2002df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:14.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.413+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2c24016030 con 0x7f2c2c1033b0 2024-04-21T22:31:14.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.666+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c2c1a2500 con 0x7f2c2c1033b0 2024-04-21T22:31:14.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.667+0000 7f2c29600640 1 -- 172.21.15.18:0/1314528782 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7986 (secure 0 0 0) 0x7f2c2409ba90 con 0x7f2c2c1033b0 2024-04-21T22:31:14.667 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:14.667 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T22:31:14.667 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 10 2024-04-21T22:31:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 msgr2=0x7f2c140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 0x7f2c140a50d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c2002c170 tx=0x7f2c2002df90 comp rx=0 tx=0).stop 2024-04-21T22:31:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 msgr2=0x7f2c2c1a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400eaa0 tx=0x7f2c2400ef60 comp rx=0 tx=0).stop 2024-04-21T22:31:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 shutdown_connections 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c140a2c10 0x7f2c140a50d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c2c1033b0 0x7f2c2c1a1250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c2c1029f0 0x7f2c2c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 --2- 172.21.15.18:0/1314528782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2c101800 0x7f2c2c199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 >> 172.21.15.18:0/1314528782 conn(0x7f2c2c0fcd70 msgr2=0x7f2c2c073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 shutdown_connections 2024-04-21T22:31:14.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:14.670+0000 7f2c33400640 1 -- 172.21.15.18:0/1314528782 wait complete. 2024-04-21T22:31:15.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:14 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1314528782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:15.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:14 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1314528782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:15.312 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:14 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1314528782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:15.312 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:14 smithi018 systemd[1]: Starting Ceph mds.g for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:15.596 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 podman[68271]: 2024-04-21 22:31:15.216914052 +0000 UTC m=+0.037274086 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:15.596 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 podman[68271]: 2024-04-21 22:31:15.345139935 +0000 UTC m=+0.165499998 container create 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:31:15.887 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 podman[68271]: 2024-04-21 22:31:15.624664298 +0000 UTC m=+0.445024384 container init 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:31:15.887 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 podman[68271]: 2024-04-21 22:31:15.635834076 +0000 UTC m=+0.456194122 container start 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:31:15.888 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mds[68290]: -- 172.21.15.18:0/1458163857 <== mon.0 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e081fba40 con 0x564e081ce800 2024-04-21T22:31:15.888 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g[68286]: starting mds.g at 2024-04-21T22:31:15.888 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 bash[68271]: 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b 2024-04-21T22:31:15.888 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:31:15 smithi018 systemd[1]: Started Ceph mds.g for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:16.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:15 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:16.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:16.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:16.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:16.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:15 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:16.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:16.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:15 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:16.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:16.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.895+0000 7f41f6e00640 1 -- 172.21.15.18:0/3689529079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0102100 msgr2=0x7f41f01044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.895+0000 7f41f6e00640 1 --2- 172.21.15.18:0/3689529079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0102100 0x7f41f01044f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009be0 tx=0x7f41e002bef0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 -- 172.21.15.18:0/3689529079 shutdown_connections 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 --2- 172.21.15.18:0/3689529079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0107360 0x7f41f01097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 --2- 172.21.15.18:0/3689529079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0104a30 0x7f41f0106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 --2- 172.21.15.18:0/3689529079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0102100 0x7f41f01044f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 -- 172.21.15.18:0/3689529079 >> 172.21.15.18:0/3689529079 conn(0x7f41f00fbb10 msgr2=0x7f41f00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 -- 172.21.15.18:0/3689529079 shutdown_connections 2024-04-21T22:31:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.896+0000 7f41f6e00640 1 -- 172.21.15.18:0/3689529079 wait complete. 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 Processor -- start 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 -- start start 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 0x7f41f0199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 0x7f41f01a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d370 con 0x7f41f0104a30 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d1f0 con 0x7f41f0102100 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f6e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d4f0 con 0x7f41f0107360 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43050/0 (socket says 172.21.15.18:43050) 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.897+0000 7f41f5000640 1 -- 172.21.15.18:0/1948336089 learned_addr learned my addr 172.21.15.18:0/1948336089 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 0x7f41f0199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f6400640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 0x7f41f01a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 -- 172.21.15.18:0/1948336089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 msgr2=0x7f41f01a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 0x7f41f01a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 -- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 msgr2=0x7f41f019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 -- 172.21.15.18:0/1948336089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f01a1830 con 0x7f41f0102100 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5000640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f6400640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 0x7f41f01a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.898+0000 7f41f5a00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 0x7f41f0199c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41e002c500 tx=0x7f41e0033580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.899+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0043020 con 0x7f41f0102100 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.899+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41e0003e50 con 0x7f41f0102100 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.899+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0034690 con 0x7f41f0102100 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.899+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f01a1ac0 con 0x7f41f0102100 2024-04-21T22:31:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.899+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f01a1fc0 con 0x7f41f0102100 2024-04-21T22:31:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.900+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f004f570 con 0x7f41f0102100 2024-04-21T22:31:16.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.903+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f41e0046020 con 0x7f41f0102100 2024-04-21T22:31:16.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.904+0000 7f41ee000640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 0x7f41d40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:16.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.904+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f41e00f11c0 con 0x7f41f0102100 2024-04-21T22:31:16.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.905+0000 7f41f5000640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 0x7f41d40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:16.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.905+0000 7f41f5000640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 0x7f41d40a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41dc011550 tx=0x7f41dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:16.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:16.909+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f41e004d020 con 0x7f41f0102100 2024-04-21T22:31:17.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:16 smithi018 ceph-mon[26614]: Deploying daemon mds.a on smithi018 2024-04-21T22:31:17.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:16 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6838/1438768551,v1:172.21.15.18:6839/1438768551] up:boot 2024-04-21T22:31:17.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:16 smithi018 ceph-mon[26614]: fsmap 10 up:standby 2024-04-21T22:31:17.024 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:31:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:16 smithi081 ceph-mon[31692]: Deploying daemon mds.a on smithi018 2024-04-21T22:31:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:16 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6838/1438768551,v1:172.21.15.18:6839/1438768551] up:boot 2024-04-21T22:31:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:16 smithi081 ceph-mon[31692]: fsmap 10 up:standby 2024-04-21T22:31:17.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:31:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.162+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41f002d170 con 0x7f41f0102100 2024-04-21T22:31:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.163+0000 7f41ee000640 1 -- 172.21.15.18:0/1948336089 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8812 (secure 0 0 0) 0x7f41e00be5c0 con 0x7f41f0102100 2024-04-21T22:31:17.163 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:17.163 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T22:31:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 11 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 msgr2=0x7f41d40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 0x7f41d40a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41dc011550 tx=0x7f41dc005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 msgr2=0x7f41f0199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 0x7f41f0199c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41e002c500 tx=0x7f41e0033580 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 shutdown_connections 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f41d40a2c00 0x7f41d40a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41f0107360 0x7f41f01a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41f0104a30 0x7f41f019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 --2- 172.21.15.18:0/1948336089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f0102100 0x7f41f0199c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 >> 172.21.15.18:0/1948336089 conn(0x7f41f00fbb10 msgr2=0x7f41f01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 shutdown_connections 2024-04-21T22:31:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:17.166+0000 7f41f6e00640 1 -- 172.21.15.18:0/1948336089 wait complete. 2024-04-21T22:31:17.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:16 smithi047 ceph-mon[31561]: Deploying daemon mds.a on smithi018 2024-04-21T22:31:17.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:16 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6838/1438768551,v1:172.21.15.18:6839/1438768551] up:boot 2024-04-21T22:31:17.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:16 smithi047 ceph-mon[31561]: fsmap 10 up:standby 2024-04-21T22:31:17.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:31:18.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:17 smithi047 ceph-mon[31561]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:18.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:17 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1948336089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:18.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:17 smithi018 ceph-mon[26614]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:18.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:17 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1948336089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:18.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:17 smithi081 ceph-mon[31692]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:18.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:17 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1948336089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:19.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:19.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:18 smithi047 ceph-mon[31561]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:19.244 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:18 smithi018 ceph-mon[26614]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:19.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:18 smithi081 ceph-mon[31692]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.389+0000 7f5e89600640 1 -- 172.21.15.18:0/4188441391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 msgr2=0x7f5e84101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:19.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.389+0000 7f5e89600640 1 --2- 172.21.15.18:0/4188441391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e84101c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009ca0 tx=0x7f5e7402c0f0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 -- 172.21.15.18:0/4188441391 shutdown_connections 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 --2- 172.21.15.18:0/4188441391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 --2- 172.21.15.18:0/4188441391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 0x7f5e84102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 --2- 172.21.15.18:0/4188441391 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e84101c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 -- 172.21.15.18:0/4188441391 >> 172.21.15.18:0/4188441391 conn(0x7f5e840fcd70 msgr2=0x7f5e840ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 -- 172.21.15.18:0/4188441391 shutdown_connections 2024-04-21T22:31:19.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.390+0000 7f5e89600640 1 -- 172.21.15.18:0/4188441391 wait complete. 2024-04-21T22:31:19.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 Processor -- start 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 -- start start 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e840754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 0x7f5e84073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8410d3e0 con 0x7f5e841033b0 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8410d260 con 0x7f5e84101800 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e89600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8410d560 con 0x7f5e841029f0 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.391+0000 7f5e83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43060/0 (socket says 172.21.15.18:43060) 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 -- 172.21.15.18:0/3070707492 learned_addr learned my addr 172.21.15.18:0/3070707492 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e82a00640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e840754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e7a000640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 0x7f5e84073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 -- 172.21.15.18:0/3070707492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 msgr2=0x7f5e84073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:19.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 0x7f5e84073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 -- 172.21.15.18:0/3070707492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 msgr2=0x7f5e840754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e840754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 -- 172.21.15.18:0/3070707492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e84074900 con 0x7f5e841033b0 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.392+0000 7f5e83400640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e970 tx=0x7f5e7c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.393+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00ccc0 con 0x7f5e841033b0 2024-04-21T22:31:19.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.393+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841a1bf0 con 0x7f5e841033b0 2024-04-21T22:31:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.393+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e7c00ce60 con 0x7f5e841033b0 2024-04-21T22:31:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.393+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c010490 con 0x7f5e841033b0 2024-04-21T22:31:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.393+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e841a2140 con 0x7f5e841033b0 2024-04-21T22:31:19.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.394+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e60005290 con 0x7f5e841033b0 2024-04-21T22:31:19.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.397+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5e7c0046c0 con 0x7f5e841033b0 2024-04-21T22:31:19.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.398+0000 7f5e7be00640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 0x7f5e680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:19.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.398+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5e7c0cf140 con 0x7f5e841033b0 2024-04-21T22:31:19.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.398+0000 7f5e82a00640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 0x7f5e680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:19.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.399+0000 7f5e82a00640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 0x7f5e680a50d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402c630 tx=0x7f5e74009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:19.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.401+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5e7c0536f0 con 0x7f5e841033b0 2024-04-21T22:31:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.658+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e60005580 con 0x7f5e841033b0 2024-04-21T22:31:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.660+0000 7f5e7be00640 1 -- 172.21.15.18:0/3070707492 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8812 (secure 0 0 0) 0x7f5e7c09c540 con 0x7f5e841033b0 2024-04-21T22:31:19.660 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:19.660 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T22:31:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 11 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.662+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 msgr2=0x7f5e680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.662+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 0x7f5e680a50d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5e7402c630 tx=0x7f5e74009360 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.662+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 msgr2=0x7f5e84074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.662+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e970 tx=0x7f5e7c00ed70 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 shutdown_connections 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e680a2c10 0x7f5e680a50d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841033b0 0x7f5e84074070 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e841029f0 0x7f5e84073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 --2- 172.21.15.18:0/3070707492 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e84101800 0x7f5e840754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 >> 172.21.15.18:0/3070707492 conn(0x7f5e840fcd70 msgr2=0x7f5e84105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 shutdown_connections 2024-04-21T22:31:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:19.663+0000 7f5e89600640 1 -- 172.21.15.18:0/3070707492 wait complete. 2024-04-21T22:31:20.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:19 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3070707492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:20.346 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:31:20 smithi018 systemd[1]: Started Ceph mds.a for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:20.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:19 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3070707492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:20.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:19 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3070707492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:21.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:21.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.230 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: Deploying daemon mds.b on smithi047 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6840/2953480850,v1:172.21.15.18:6841/2953480850] up:boot 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: fsmap 11 up:standby 2024-04-21T22:31:21.231 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:21 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:31:21.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:21.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: Deploying daemon mds.b on smithi047 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6840/2953480850,v1:172.21.15.18:6841/2953480850] up:boot 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: fsmap 11 up:standby 2024-04-21T22:31:21.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:21 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:31:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: Deploying daemon mds.b on smithi047 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6840/2953480850,v1:172.21.15.18:6841/2953480850] up:boot 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: fsmap 11 up:standby 2024-04-21T22:31:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:21 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:31:21.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 -- 172.21.15.18:0/3611303067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 msgr2=0x7fca9c1099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 --2- 172.21.15.18:0/3611303067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c1099b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca94009be0 tx=0x7fca9402bef0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 -- 172.21.15.18:0/3611303067 shutdown_connections 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 --2- 172.21.15.18:0/3611303067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c1099b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 --2- 172.21.15.18:0/3611303067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c104c30 0x7fca9c107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 --2- 172.21.15.18:0/3611303067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c102300 0x7fca9c1046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 -- 172.21.15.18:0/3611303067 >> 172.21.15.18:0/3611303067 conn(0x7fca9c0fbd10 msgr2=0x7fca9c0fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 -- 172.21.15.18:0/3611303067 shutdown_connections 2024-04-21T22:31:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.900+0000 7fcaa4600640 1 -- 172.21.15.18:0/3611303067 wait complete. 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.901+0000 7fcaa4600640 1 Processor -- start 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.901+0000 7fcaa4600640 1 -- start start 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c102300 0x7fca9c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c10d470 con 0x7fca9c102300 2024-04-21T22:31:21.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c10d2f0 con 0x7fca9c107560 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa4600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c10d5f0 con 0x7fca9c104c30 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c102300 0x7fca9c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51348/0 (socket says 172.21.15.18:51348) 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa1200640 1 -- 172.21.15.18:0/419209027 learned_addr learned my addr 172.21.15.18:0/419209027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.902+0000 7fcaa2600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 -- 172.21.15.18:0/419209027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 msgr2=0x7fca9c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 -- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c102300 msgr2=0x7fca9c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c102300 0x7fca9c197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 -- 172.21.15.18:0/419209027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c19f630 con 0x7fca9c104c30 2024-04-21T22:31:21.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa1200640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca8800e9a0 tx=0x7fca8800ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:21.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8800cd80 con 0x7fca9c104c30 2024-04-21T22:31:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca880035f0 con 0x7fca9c104c30 2024-04-21T22:31:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88010670 con 0x7fca9c104c30 2024-04-21T22:31:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c19f920 con 0x7fca9c104c30 2024-04-21T22:31:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.903+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c19fe20 con 0x7fca9c104c30 2024-04-21T22:31:21.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.905+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9c0fd800 con 0x7fca9c104c30 2024-04-21T22:31:21.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.908+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fca880037a0 con 0x7fca9c104c30 2024-04-21T22:31:21.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.909+0000 7fca9a000640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 0x7fca840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:21.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.909+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fca880cee00 con 0x7fca9c104c30 2024-04-21T22:31:21.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.909+0000 7fcaa1c00640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 0x7fca840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:21.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.910+0000 7fcaa1c00640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 0x7fca840a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca90009bd0 tx=0x7fca90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:21.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:21.911+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fca8809c160 con 0x7fca9c104c30 2024-04-21T22:31:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.155+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca9c02d170 con 0x7fca9c104c30 2024-04-21T22:31:22.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.156+0000 7fca9a000640 1 -- 172.21.15.18:0/419209027 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9638 (secure 0 0 0) 0x7fca8809ba60 con 0x7fca9c104c30 2024-04-21T22:31:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:22.156 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14475,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-21T22:31:22.156 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 12 2024-04-21T22:31:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.158+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 msgr2=0x7fca840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.158+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 0x7fca840a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca90009bd0 tx=0x7fca90005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.158+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 msgr2=0x7fca9c197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.158+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca8800e9a0 tx=0x7fca8800ee60 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 shutdown_connections 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca840a2c10 0x7fca840a50d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca9c107560 0x7fca9c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca9c104c30 0x7fca9c197f50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 --2- 172.21.15.18:0/419209027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca9c102300 0x7fca9c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 >> 172.21.15.18:0/419209027 conn(0x7fca9c0fbd10 msgr2=0x7fca9c102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 shutdown_connections 2024-04-21T22:31:22.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:22.159+0000 7fcaa4600640 1 -- 172.21.15.18:0/419209027 wait complete. 2024-04-21T22:31:22.302 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/419209027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:22.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:22 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/419209027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:22.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:22 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/419209027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:22.694 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 systemd[1]: Starting Ceph mds.b for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:31:22.983 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 podman[61893]: 2024-04-21 22:31:22.616374665 +0000 UTC m=+0.018347032 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:31:22.983 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 podman[61893]: 2024-04-21 22:31:22.728913204 +0000 UTC m=+0.130885559 container create 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:31:22.983 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 podman[61893]: 2024-04-21 22:31:22.956270096 +0000 UTC m=+0.358242443 container init 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:31:22.983 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 podman[61893]: 2024-04-21 22:31:22.959830073 +0000 UTC m=+0.361802413 container start 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:23 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 ceph-mds[61912]: -- 172.21.15.47:0/2448830008 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e46ed07a40 con 0x55e46ecdb000 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: starting mds.b at 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:23 smithi047 bash[61893]: 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb 2024-04-21T22:31:23.445 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:23 smithi047 systemd[1]: Started Ceph mds.b for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:31:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:23 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:23 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:24.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:24.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 -- 172.21.15.18:0/4091083884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 msgr2=0x7f125c106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 --2- 172.21.15.18:0/4091083884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c106e20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1244009ca0 tx=0x7f124402c0f0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 -- 172.21.15.18:0/4091083884 shutdown_connections 2024-04-21T22:31:24.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 --2- 172.21.15.18:0/4091083884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c1097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 --2- 172.21.15.18:0/4091083884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c106e20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 --2- 172.21.15.18:0/4091083884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 0x7f125c1044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 -- 172.21.15.18:0/4091083884 >> 172.21.15.18:0/4091083884 conn(0x7f125c0fbb10 msgr2=0x7f125c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:24.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 -- 172.21.15.18:0/4091083884 shutdown_connections 2024-04-21T22:31:24.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.378+0000 7f1261000640 1 -- 172.21.15.18:0/4091083884 wait complete. 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.379+0000 7f1261000640 1 Processor -- start 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.379+0000 7f1261000640 1 -- start start 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 0x7f125c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10d300 con 0x7f125c107360 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10d180 con 0x7f125c104a30 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f1261000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10d480 con 0x7f125c102100 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 0x7f125c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57490/0 (socket says 172.21.15.18:57490) 2024-04-21T22:31:24.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 -- 172.21.15.18:0/540919704 learned_addr learned my addr 172.21.15.18:0/540919704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125be00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 -- 172.21.15.18:0/540919704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 msgr2=0x7f125c1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 0x7f125c1979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 -- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 msgr2=0x7f125c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125aa00640 1 -- 172.21.15.18:0/540919704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c19f5d0 con 0x7f125c104a30 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.380+0000 7f125be00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f125aa00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1244000f80 tx=0x7f1244032ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1244041020 con 0x7f125c104a30 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1244034cd0 con 0x7f125c104a30 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125c19f860 con 0x7f125c104a30 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1244039040 con 0x7f125c104a30 2024-04-21T22:31:24.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.381+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125c19fd70 con 0x7f125c104a30 2024-04-21T22:31:24.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.382+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125c0fd600 con 0x7f125c104a30 2024-04-21T22:31:24.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.384+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1244044020 con 0x7f125c104a30 2024-04-21T22:31:24.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.386+0000 7f1253e00640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 0x7f123c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.386+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f12440f09d0 con 0x7f125c104a30 2024-04-21T22:31:24.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.386+0000 7f125b400640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 0x7f123c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.387+0000 7f125b400640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 0x7f123c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f124c009bd0 tx=0x7f124c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:24.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.390+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f124404b020 con 0x7f125c104a30 2024-04-21T22:31:24.480 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:24 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:boot 2024-04-21T22:31:24.480 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:24 smithi081 ceph-mon[31692]: fsmap 12 up:standby 2024-04-21T22:31:24.481 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:24 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:31:24.481 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:24 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:24.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:24 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:boot 2024-04-21T22:31:24.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:24 smithi018 ceph-mon[26614]: fsmap 12 up:standby 2024-04-21T22:31:24.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:24 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:31:24.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:24 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:24.612 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:24 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:boot 2024-04-21T22:31:24.612 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:24 smithi047 ceph-mon[31561]: fsmap 12 up:standby 2024-04-21T22:31:24.612 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:24 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:31:24.612 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:24 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:24.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.655+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f125c02d170 con 0x7f125c104a30 2024-04-21T22:31:24.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.656+0000 7f1253e00640 1 -- 172.21.15.18:0/540919704 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10464 (secure 0 0 0) 0x7f12440348f0 con 0x7f125c104a30 2024-04-21T22:31:24.656 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:24.656 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14475,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24469,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24509,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-21T22:31:24.656 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 msgr2=0x7f123c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 0x7f123c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f124c009bd0 tx=0x7f124c005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 msgr2=0x7f125c197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1244000f80 tx=0x7f1244032ec0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 shutdown_connections 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f123c0a2c00 0x7f123c0a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f125c107360 0x7f125c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f125c104a30 0x7f125c197ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 --2- 172.21.15.18:0/540919704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f125c102100 0x7f125c1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 >> 172.21.15.18:0/540919704 conn(0x7f125c0fbb10 msgr2=0x7f125c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 shutdown_connections 2024-04-21T22:31:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.660+0000 7f1261000640 1 -- 172.21.15.18:0/540919704 wait complete. 2024-04-21T22:31:24.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:31:24.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.884+0000 7fd5a3a00640 1 -- 172.21.15.18:0/3747873713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c075720 msgr2=0x7fd59c073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.884+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/3747873713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c075720 0x7fd59c073b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd590009900 tx=0x7fd59002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 -- 172.21.15.18:0/3747873713 shutdown_connections 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/3747873713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c109690 0x7fd59c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/3747873713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 0x7fd59c0745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/3747873713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c075720 0x7fd59c073b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 -- 172.21.15.18:0/3747873713 >> 172.21.15.18:0/3747873713 conn(0x7fd59c0fcd70 msgr2=0x7fd59c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 -- 172.21.15.18:0/3747873713 shutdown_connections 2024-04-21T22:31:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.885+0000 7fd5a3a00640 1 -- 172.21.15.18:0/3747873713 wait complete. 2024-04-21T22:31:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 Processor -- start 2024-04-21T22:31:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 -- start start 2024-04-21T22:31:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 0x7fd59c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c109690 0x7fd59c1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10f630 con 0x7fd59c074140 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10f4b0 con 0x7fd59c109690 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a3a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10f7b0 con 0x7fd59c075720 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd59be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 0x7fd59c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd59be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51398/0 (socket says 172.21.15.18:51398) 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd5a1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c109690 0x7fd59c1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.886+0000 7fd59be00640 1 -- 172.21.15.18:0/2509169798 learned_addr learned my addr 172.21.15.18:0/2509169798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 -- 172.21.15.18:0/2509169798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c109690 msgr2=0x7fd59c1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c109690 0x7fd59c1a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 -- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 msgr2=0x7fd59c199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 0x7fd59c199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 -- 172.21.15.18:0/2509169798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c1a1880 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd59be00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e9f0 tx=0x7fd58800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58800cd80 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd588010910 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588018990 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.887+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c1a1b70 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.888+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1a20e0 con 0x7fd59c075720 2024-04-21T22:31:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.889+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c108450 con 0x7fd59c075720 2024-04-21T22:31:24.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.890+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd588010ac0 con 0x7fd59c075720 2024-04-21T22:31:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.892+0000 7fd599600640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 0x7fd5840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.893+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd5880cef40 con 0x7fd59c075720 2024-04-21T22:31:24.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.893+0000 7fd5a1000640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 0x7fd5840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:24.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.894+0000 7fd5a1000640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 0x7fd5840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd59002c2e0 tx=0x7fd59002c920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:24.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:24.896+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd58809bc50 con 0x7fd59c075720 2024-04-21T22:31:25.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.108+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd59c062340 con 0x7fd59c075720 2024-04-21T22:31:25.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.109+0000 7fd599600640 1 -- 172.21.15.18:0/2509169798 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18349 (secure 0 0 0) 0x7fd58809ff50 con 0x7fd59c075720 2024-04-21T22:31:25.109 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:30:27.090993+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 msgr2=0x7fd5840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 0x7fd5840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd59002c2e0 tx=0x7fd59002c920 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 msgr2=0x7fd59c19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e9f0 tx=0x7fd58800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 shutdown_connections 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5840a2c10 0x7fd5840a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd59c109690 0x7fd59c1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd59c075720 0x7fd59c19a1b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 --2- 172.21.15.18:0/2509169798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd59c074140 0x7fd59c199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 >> 172.21.15.18:0/2509169798 conn(0x7fd59c0fcd70 msgr2=0x7fd59c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 shutdown_connections 2024-04-21T22:31:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.112+0000 7fd5a3a00640 1 -- 172.21.15.18:0/2509169798 wait complete. 2024-04-21T22:31:25.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:31:25.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:31:25.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:25 smithi018 ceph-mon[26614]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:25.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:25 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/540919704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:25 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2509169798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:25 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.350+0000 7efd4aa00640 1 -- 172.21.15.18:0/2304775940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102030 msgr2=0x7efd44104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.350+0000 7efd4aa00640 1 --2- 172.21.15.18:0/2304775940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102030 0x7efd44104420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd38009900 tx=0x7efd3802bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 -- 172.21.15.18:0/2304775940 shutdown_connections 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 --2- 172.21.15.18:0/2304775940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 0x7efd441096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 --2- 172.21.15.18:0/2304775940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44104960 0x7efd44106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 --2- 172.21.15.18:0/2304775940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44102030 0x7efd44104420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 -- 172.21.15.18:0/2304775940 >> 172.21.15.18:0/2304775940 conn(0x7efd440fba20 msgr2=0x7efd440fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 -- 172.21.15.18:0/2304775940 shutdown_connections 2024-04-21T22:31:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.351+0000 7efd4aa00640 1 -- 172.21.15.18:0/2304775940 wait complete. 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 Processor -- start 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 -- start start 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 0x7efd4419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 0x7efd441a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd4410d270 con 0x7efd44102030 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd4410d0f0 con 0x7efd44104960 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.352+0000 7efd4aa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd4410d3f0 con 0x7efd44107290 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd49600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 0x7efd4419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd49600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43156/0 (socket says 172.21.15.18:43156) 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd49600640 1 -- 172.21.15.18:0/900658992 learned_addr learned my addr 172.21.15.18:0/900658992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd4a000640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 0x7efd441a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 -- 172.21.15.18:0/900658992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 msgr2=0x7efd441a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 0x7efd441a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 -- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 msgr2=0x7efd44199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 -- 172.21.15.18:0/900658992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd441a1710 con 0x7efd44104960 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd49600640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.353+0000 7efd48c00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 0x7efd4419a0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd30005fd0 tx=0x7efd3000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.354+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30009c00 con 0x7efd44104960 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.354+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd30009da0 con 0x7efd44104960 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.354+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30010460 con 0x7efd44104960 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.354+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd441a1a00 con 0x7efd44104960 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.354+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd441a1f00 con 0x7efd44104960 2024-04-21T22:31:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.355+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd44108de0 con 0x7efd44104960 2024-04-21T22:31:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.357+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efd30003eb0 con 0x7efd44104960 2024-04-21T22:31:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.359+0000 7efd42000640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 0x7efd2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.359+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7efd300ce6d0 con 0x7efd44104960 2024-04-21T22:31:25.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.359+0000 7efd49600640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 0x7efd2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.360+0000 7efd49600640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 0x7efd2c0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efd3802c8e0 tx=0x7efd3802df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.363+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7efd30017020 con 0x7efd44104960 2024-04-21T22:31:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:25 smithi081 ceph-mon[31692]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:25 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/540919704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:25 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2509169798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:25 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.599+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efd44062370 con 0x7efd44104960 2024-04-21T22:31:25.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.599+0000 7efd42000640 1 -- 172.21.15.18:0/900658992 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7efd3009b3e0 con 0x7efd44104960 2024-04-21T22:31:25.599 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:31:25.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 msgr2=0x7efd2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 0x7efd2c0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efd3802c8e0 tx=0x7efd3802df90 comp rx=0 tx=0).stop 2024-04-21T22:31:25.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 msgr2=0x7efd4419a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 0x7efd4419a0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd30005fd0 tx=0x7efd3000dde0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 shutdown_connections 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd2c0a2c10 0x7efd2c0a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd44107290 0x7efd441a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd44104960 0x7efd4419a0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 --2- 172.21.15.18:0/900658992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd44102030 0x7efd44199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.602+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 >> 172.21.15.18:0/900658992 conn(0x7efd440fba20 msgr2=0x7efd44101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.603+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 shutdown_connections 2024-04-21T22:31:25.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.603+0000 7efd4aa00640 1 -- 172.21.15.18:0/900658992 wait complete. 2024-04-21T22:31:25.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-21T22:31:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:25 smithi047 ceph-mon[31561]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:25 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/540919704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:25 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2509169798' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:25.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:25 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 -- 172.21.15.18:0/2542188114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8101670 msgr2=0x7f57c8101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 --2- 172.21.15.18:0/2542188114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8101670 0x7f57c8101a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009900 tx=0x7f57b802bc50 comp rx=0 tx=0).stop 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 -- 172.21.15.18:0/2542188114 shutdown_connections 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 --2- 172.21.15.18:0/2542188114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8103220 0x7f57c8109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 --2- 172.21.15.18:0/2542188114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8102860 0x7f57c8102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 --2- 172.21.15.18:0/2542188114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8101670 0x7f57c8101a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 -- 172.21.15.18:0/2542188114 >> 172.21.15.18:0/2542188114 conn(0x7f57c80fcc00 msgr2=0x7f57c80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 -- 172.21.15.18:0/2542188114 shutdown_connections 2024-04-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.817+0000 7f57cce00640 1 -- 172.21.15.18:0/2542188114 wait complete. 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.818+0000 7f57cce00640 1 Processor -- start 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.818+0000 7f57cce00640 1 -- start start 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.818+0000 7f57cce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8101670 0x7f57c8199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.818+0000 7f57cce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102860 0x7f57c819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57cce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57cce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d310 con 0x7f57c8102860 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57cce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d190 con 0x7f57c8103220 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57cce00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57c810d490 con 0x7f57c8101670 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102860 0x7f57c819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42412/0 (socket says 172.21.15.18:42412) 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 -- 172.21.15.18:0/3490249406 learned_addr learned my addr 172.21.15.18:0/3490249406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7400640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8101670 0x7f57c8199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 -- 172.21.15.18:0/3490249406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8101670 msgr2=0x7f57c8199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8101670 0x7f57c8199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 -- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102860 msgr2=0x7f57c819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102860 0x7f57c819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.819+0000 7f57c7e00640 1 -- 172.21.15.18:0/3490249406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c81a17f0 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57c7e00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009fd0 tx=0x7f57c000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0017070 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57c0003e50 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c81a1ae0 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00106c0 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.820+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c81a1fe0 con 0x7f57c8103220 2024-04-21T22:31:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.821+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c81a2270 con 0x7f57c8103220 2024-04-21T22:31:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.823+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f57c0003970 con 0x7f57c8103220 2024-04-21T22:31:25.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.824+0000 7f57c4c00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 0x7f57ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:25.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.824+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f57c00ce950 con 0x7f57c8103220 2024-04-21T22:31:25.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.825+0000 7f57c7400640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 0x7f57ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:25.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.825+0000 7f57c7400640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 0x7f57ac0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57b802c190 tx=0x7f57b8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:25.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:25.828+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f57c009b660 con 0x7f57c8103220 2024-04-21T22:31:26.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.048+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f57c81a2440 con 0x7f57c8103220 2024-04-21T22:31:26.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.049+0000 7f57c4c00640 1 -- 172.21.15.18:0/3490249406 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f57c009f960 con 0x7f57c8103220 2024-04-21T22:31:26.048 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:26.048 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-21T22:31:26.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:31:26.049 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-21T22:31:26.049 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-21T22:31:26.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:31:26.049 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 msgr2=0x7f57ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 0x7f57ac0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57b802c190 tx=0x7f57b8000bc0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 msgr2=0x7f57c81a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009fd0 tx=0x7f57c000b260 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 shutdown_connections 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f57ac0a2b80 0x7f57ac0a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c8103220 0x7f57c81a1180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c8102860 0x7f57c819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 --2- 172.21.15.18:0/3490249406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57c8101670 0x7f57c8199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.051+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 >> 172.21.15.18:0/3490249406 conn(0x7f57c80fcc00 msgr2=0x7f57c8073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:26.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.052+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 shutdown_connections 2024-04-21T22:31:26.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.052+0000 7f57cce00640 1 -- 172.21.15.18:0/3490249406 wait complete. 2024-04-21T22:31:26.071 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-21T22:31:26.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 -- 172.21.15.18:0/3332862418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 msgr2=0x7f6bf4100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/3332862418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf4100be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009900 tx=0x7f6bdc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 -- 172.21.15.18:0/3332862418 shutdown_connections 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/3332862418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/3332862418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf4100be0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/3332862418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 -- 172.21.15.18:0/3332862418 >> 172.21.15.18:0/3332862418 conn(0x7f6bf40fba20 msgr2=0x7f6bf40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 -- 172.21.15.18:0/3332862418 shutdown_connections 2024-04-21T22:31:26.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.264+0000 7f6bf3e00640 1 -- 172.21.15.18:0/3332862418 wait complete. 2024-04-21T22:31:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.265+0000 7f6bf3e00640 1 Processor -- start 2024-04-21T22:31:26.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 -- start start 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf410f490 con 0x7f6bf4101120 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf410f310 con 0x7f6bf4100780 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf410f610 con 0x7f6bf40ffe20 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42428/0 (socket says 172.21.15.18:42428) 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf2000640 1 -- 172.21.15.18:0/2447626558 learned_addr learned my addr 172.21.15.18:0/2447626558 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf3400640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.266+0000 7f6bf2a00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 -- 172.21.15.18:0/2447626558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 msgr2=0x7f6bf4199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 -- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 msgr2=0x7f6bf41a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 -- 172.21.15.18:0/2447626558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf41a16f0 con 0x7f6bf4100780 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2a00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf3400640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf2000640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000c00 tx=0x7f6bdc02c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc043020 con 0x7f6bf4100780 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bdc0054e0 con 0x7f6bf4100780 2024-04-21T22:31:26.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc003c40 con 0x7f6bf4100780 2024-04-21T22:31:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.267+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf41a1980 con 0x7f6bf4100780 2024-04-21T22:31:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.268+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41a1f20 con 0x7f6bf4100780 2024-04-21T22:31:26.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.269+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf410ab70 con 0x7f6bf4100780 2024-04-21T22:31:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.270+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6bdc046020 con 0x7f6bf4100780 2024-04-21T22:31:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.272+0000 7f6beb400640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 0x7f6bd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.272+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f6bdc0f0d30 con 0x7f6bf4100780 2024-04-21T22:31:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.272+0000 7f6bf2a00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 0x7f6bd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:26.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.273+0000 7f6bf2a00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 0x7f6bd80a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6be4005fd0 tx=0x7f6be4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:26.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.276+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6bdc04d020 con 0x7f6bf4100780 2024-04-21T22:31:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:26 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/900658992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:31:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:26 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3490249406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T22:31:26.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:26 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:26.514+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6bf402d170 con 0x7f6bf4100780 2024-04-21T22:31:26.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:26 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/900658992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:31:26.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:26 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3490249406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T22:31:26.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:26 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:26.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:26 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/900658992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:31:26.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:26 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3490249406' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-21T22:31:26.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:26 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.458+0000 7f6beb400640 1 -- 172.21.15.18:0/2447626558 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f6bdc03c350 con 0x7f6bf4100780 2024-04-21T22:31:27.459 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-21T22:31:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.465+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 msgr2=0x7f6bd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.465+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 0x7f6bd80a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6be4005fd0 tx=0x7f6be4009500 comp rx=0 tx=0).stop 2024-04-21T22:31:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 msgr2=0x7f6bf419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:27.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000c00 tx=0x7f6bdc02c650 comp rx=0 tx=0).stop 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 shutdown_connections 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6bd80a2c10 0x7f6bd80a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bf4101120 0x7f6bf41a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bf4100780 0x7f6bf419a010 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000c00 tx=0x7f6bdc02c650 comp rx=0 tx=0).stop 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 --2- 172.21.15.18:0/2447626558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf40ffe20 0x7f6bf4199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.466+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 >> 172.21.15.18:0/2447626558 conn(0x7f6bf40fba20 msgr2=0x7f6bf40fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:27.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.467+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 shutdown_connections 2024-04-21T22:31:27.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.467+0000 7f6bf3e00640 1 -- 172.21.15.18:0/2447626558 wait complete. 2024-04-21T22:31:27.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 -- 172.21.15.18:0/2974485117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c010dba0 msgr2=0x7f38c010ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 --2- 172.21.15.18:0/2974485117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c010dba0 0x7f38c010ff90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009930 tx=0x7f38b002bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 -- 172.21.15.18:0/2974485117 shutdown_connections 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 --2- 172.21.15.18:0/2974485117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c010dba0 0x7f38c010ff90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 --2- 172.21.15.18:0/2974485117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c00741a0 0x7f38c0074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 --2- 172.21.15.18:0/2974485117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c0075780 0x7f38c0073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 -- 172.21.15.18:0/2974485117 >> 172.21.15.18:0/2974485117 conn(0x7f38c00fcb40 msgr2=0x7f38c00fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 -- 172.21.15.18:0/2974485117 shutdown_connections 2024-04-21T22:31:27.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.678+0000 7f38bfe00640 1 -- 172.21.15.18:0/2974485117 wait complete. 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 Processor -- start 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 -- start start 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 0x7f38c019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 0x7f38c01a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0113840 con 0x7f38c00741a0 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01136c0 con 0x7f38c0075780 2024-04-21T22:31:27.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.679+0000 7f38bfe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01139c0 con 0x7f38c010dba0 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38bea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 0x7f38c019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42450/0 (socket says 172.21.15.18:42450) 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 -- 172.21.15.18:0/3519860746 learned_addr learned my addr 172.21.15.18:0/3519860746 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38bf400640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 0x7f38c01a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 -- 172.21.15.18:0/3519860746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 msgr2=0x7f38c01a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 0x7f38c01a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 -- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 msgr2=0x7f38c019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 0x7f38c019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 -- 172.21.15.18:0/3519860746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c01a5ae0 con 0x7f38c0075780 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38bf400640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 0x7f38c01a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:27.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38bea00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 0x7f38c019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.680+0000 7f38be000640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e9f0 tx=0x7f38a800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.681+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800cd80 con 0x7f38c0075780 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.681+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a8005500 con 0x7f38c0075780 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.681+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8010690 con 0x7f38c0075780 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.681+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c01a5dd0 con 0x7f38c0075780 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.681+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a6240 con 0x7f38c0075780 2024-04-21T22:31:27.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.682+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c0103d70 con 0x7f38c0075780 2024-04-21T22:31:27.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.684+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f38a80046c0 con 0x7f38c0075780 2024-04-21T22:31:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.685+0000 7f38c4a00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 0x7f38a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.685+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f38a80cf100 con 0x7f38c0075780 2024-04-21T22:31:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.685+0000 7f38bea00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 0x7f38a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:27.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.686+0000 7f38bea00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 0x7f38a40a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009fd0 tx=0x7f38b8009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:27.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.689+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f38a809c2f0 con 0x7f38c0075780 2024-04-21T22:31:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2447626558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:27 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2447626558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:27 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2447626558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-21T22:31:27.860 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:27 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:31:27.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:27.902+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f38c002d170 con 0x7f38c0075780 2024-04-21T22:31:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.485+0000 7f38c4a00640 1 -- 172.21.15.18:0/3519860746 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f38a809bbf0 con 0x7f38c0075780 2024-04-21T22:31:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-21T22:31:28.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.501+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 msgr2=0x7f38a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:28.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.501+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 0x7f38a40a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009fd0 tx=0x7f38b8009680 comp rx=0 tx=0).stop 2024-04-21T22:31:28.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.501+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 msgr2=0x7f38c019e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:28.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.501+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38a800e9f0 tx=0x7f38a800edf0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 shutdown_connections 2024-04-21T22:31:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38a40a2c10 0x7f38a40a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c010dba0 0x7f38c01a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38c0075780 0x7f38c019e400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 --2- 172.21.15.18:0/3519860746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38c00741a0 0x7f38c019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.502+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 >> 172.21.15.18:0/3519860746 conn(0x7f38c00fcb40 msgr2=0x7f38c0100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:28.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.506+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 shutdown_connections 2024-04-21T22:31:28.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.507+0000 7f38bfe00640 1 -- 172.21.15.18:0/3519860746 wait complete. 2024-04-21T22:31:28.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-21T22:31:28.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:28 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T22:31:28.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:28 smithi018 ceph-mon[26614]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T22:31:28.581 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:28 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3519860746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 -- 172.21.15.18:0/1294219375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec8105390 msgr2=0x7f8ec810bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 --2- 172.21.15.18:0/1294219375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec8105390 0x7f8ec810bc20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009ca0 tx=0x7f8ec002c100 comp rx=0 tx=0).stop 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 -- 172.21.15.18:0/1294219375 shutdown_connections 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 --2- 172.21.15.18:0/1294219375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec8105390 0x7f8ec810bc20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 --2- 172.21.15.18:0/1294219375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec81049d0 0x7f8ec8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 --2- 172.21.15.18:0/1294219375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 0x7f8ec8103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 -- 172.21.15.18:0/1294219375 >> 172.21.15.18:0/1294219375 conn(0x7f8ec80fed50 msgr2=0x7f8ec8101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 -- 172.21.15.18:0/1294219375 shutdown_connections 2024-04-21T22:31:28.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.710+0000 7f8ece800640 1 -- 172.21.15.18:0/1294219375 wait complete. 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 Processor -- start 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 -- start start 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 0x7f8ec8199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec8105390 0x7f8ec81a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec810f440 con 0x7f8ec8105390 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec810f2c0 con 0x7f8ec81049d0 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.711+0000 7f8ece800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec810f5c0 con 0x7f8ec81037e0 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 0x7f8ec8199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42472/0 (socket says 172.21.15.18:42472) 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 -- 172.21.15.18:0/1130158344 learned_addr learned my addr 172.21.15.18:0/1130158344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecde00640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec8105390 0x7f8ec81a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 -- 172.21.15.18:0/1130158344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 msgr2=0x7f8ec8199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 0x7f8ec8199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 -- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec8105390 msgr2=0x7f8ec81a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec8105390 0x7f8ec81a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 -- 172.21.15.18:0/1130158344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec81a1710 con 0x7f8ec81049d0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.712+0000 7f8ecca00640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400e9f0 tx=0x7f8eb400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.713+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400cd80 con 0x7f8ec81049d0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.713+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb4010910 con 0x7f8ec81049d0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.713+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec81a1a00 con 0x7f8ec81049d0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.713+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4018990 con 0x7f8ec81049d0 2024-04-21T22:31:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.713+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec81a1fa0 con 0x7f8ec81049d0 2024-04-21T22:31:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.714+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec810aaa0 con 0x7f8ec81049d0 2024-04-21T22:31:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.719+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8eb4010ac0 con 0x7f8ec81049d0 2024-04-21T22:31:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.720+0000 7f8ec6000640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 0x7f8eb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.720+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f8eb40cf100 con 0x7f8ec81049d0 2024-04-21T22:31:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.720+0000 7f8ecd400640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 0x7f8eb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.721+0000 7f8ecd400640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 0x7f8eb00a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8104830 tx=0x7f8ebc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:28.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.724+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8eb409bbc0 con 0x7f8ec81049d0 2024-04-21T22:31:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:28 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T22:31:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:28 smithi081 ceph-mon[31692]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T22:31:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:28 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3519860746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:28 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-21T22:31:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:28 smithi047 ceph-mon[31561]: osdmap e82: 12 total, 12 up, 12 in 2024-04-21T22:31:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:28 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3519860746' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:28.982+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8ec802d170 con 0x7f8ec81049d0 2024-04-21T22:31:29.790 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: pgmap v318: 33 pgs: 13 creating+peering, 1 active+clean, 19 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1130158344' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.792 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:29 smithi081 ceph-mon[31692]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-21T22:31:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: pgmap v318: 33 pgs: 13 creating+peering, 1 active+clean, 19 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1130158344' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:29 smithi018 ceph-mon[26614]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-21T22:31:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.852+0000 7f8ec6000640 1 -- 172.21.15.18:0/1130158344 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8eb409fec0 con 0x7f8ec81049d0 2024-04-21T22:31:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-04-21T22:31:29.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.857+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 msgr2=0x7f8eb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:29.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.857+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 0x7f8eb00a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8104830 tx=0x7f8ebc00b390 comp rx=0 tx=0).stop 2024-04-21T22:31:29.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.857+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 msgr2=0x7f8ec819a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:29.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.857+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400e9f0 tx=0x7f8eb400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 shutdown_connections 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f8eb00a2c10 0x7f8eb00a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ec8105390 0x7f8ec81a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ec81049d0 0x7f8ec819a030 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 --2- 172.21.15.18:0/1130158344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ec81037e0 0x7f8ec8199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 >> 172.21.15.18:0/1130158344 conn(0x7f8ec80fed50 msgr2=0x7f8ec8107c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 shutdown_connections 2024-04-21T22:31:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:29.858+0000 7f8ece800640 1 -- 172.21.15.18:0/1130158344 wait complete. 2024-04-21T22:31:29.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:31:29.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: pgmap v318: 33 pgs: 13 creating+peering, 1 active+clean, 19 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: osdmap e83: 12 total, 12 up, 12 in 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1130158344' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-21T22:31:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:29 smithi047 ceph-mon[31561]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-21T22:31:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.068+0000 7f2557000640 1 -- 172.21.15.18:0/1064216241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2550075780 msgr2=0x7f2550073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.068+0000 7f2557000640 1 --2- 172.21.15.18:0/1064216241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2550075780 0x7f2550073bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2544009930 tx=0x7f254402bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:30.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 -- 172.21.15.18:0/1064216241 shutdown_connections 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 --2- 172.21.15.18:0/1064216241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 0x7f2550110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 --2- 172.21.15.18:0/1064216241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25500741a0 0x7f2550074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 --2- 172.21.15.18:0/1064216241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2550075780 0x7f2550073bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 -- 172.21.15.18:0/1064216241 >> 172.21.15.18:0/1064216241 conn(0x7f25500fcc00 msgr2=0x7f25500ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 -- 172.21.15.18:0/1064216241 shutdown_connections 2024-04-21T22:31:30.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.069+0000 7f2557000640 1 -- 172.21.15.18:0/1064216241 wait complete. 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.070+0000 7f2557000640 1 Processor -- start 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.070+0000 7f2557000640 1 -- start start 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2550075780 0x7f255019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 0x7f25501a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2550113910 con 0x7f2550075780 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2550113790 con 0x7f25500741a0 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2557000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2550113a90 con 0x7f255010dc40 2024-04-21T22:31:30.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2550075780 0x7f255019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2556600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 0x7f25501a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42502/0 (socket says 172.21.15.18:42502) 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 -- 172.21.15.18:0/2335426306 learned_addr learned my addr 172.21.15.18:0/2335426306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 -- 172.21.15.18:0/2335426306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 msgr2=0x7f25501a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 0x7f25501a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 -- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2550075780 msgr2=0x7f255019e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2550075780 0x7f255019e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.071+0000 7f2555c00640 1 -- 172.21.15.18:0/2335426306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25501a5bd0 con 0x7f25500741a0 2024-04-21T22:31:30.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f2555c00640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f254402c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544043020 con 0x7f25500741a0 2024-04-21T22:31:30.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25440054e0 con 0x7f25500741a0 2024-04-21T22:31:30.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544003bd0 con 0x7f25500741a0 2024-04-21T22:31:30.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25501a5e60 con 0x7f25500741a0 2024-04-21T22:31:30.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.072+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25501a62c0 con 0x7f25500741a0 2024-04-21T22:31:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.074+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255004f5a0 con 0x7f25500741a0 2024-04-21T22:31:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.075+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2544046020 con 0x7f25500741a0 2024-04-21T22:31:30.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.077+0000 7f254e000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 0x7f25380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.077+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f25440f0fa0 con 0x7f25500741a0 2024-04-21T22:31:30.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.077+0000 7f2555200640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 0x7f25380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.078+0000 7f2555200640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 0x7f25380a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f255019f4c0 tx=0x7f253c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.081+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f255004f5a0 con 0x7f25500741a0 2024-04-21T22:31:30.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.284+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2550062370 con 0x7f25500741a0 2024-04-21T22:31:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.287+0000 7f254e000640 1 -- 172.21.15.18:0/2335426306 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22125 (secure 0 0 0) 0x7f254404d020 con 0x7f25500741a0 2024-04-21T22:31:30.287 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:30.287 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:31:28.984230+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 msgr2=0x7f25380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 0x7f25380a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f255019f4c0 tx=0x7f253c005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 msgr2=0x7f255019dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f254402c650 comp rx=0 tx=0).stop 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 shutdown_connections 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f25380a2b80 0x7f25380a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255010dc40 0x7f25501a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2550075780 0x7f255019e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 --2- 172.21.15.18:0/2335426306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25500741a0 0x7f255019dfb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 >> 172.21.15.18:0/2335426306 conn(0x7f25500fcc00 msgr2=0x7f2550100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:30.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 shutdown_connections 2024-04-21T22:31:30.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.289+0000 7f2557000640 1 -- 172.21.15.18:0/2335426306 wait complete. 2024-04-21T22:31:30.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:31:30.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 -- 172.21.15.18:0/570890968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd94102340 msgr2=0x7efd94104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 --2- 172.21.15.18:0/570890968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd94102340 0x7efd94104730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd84009900 tx=0x7efd8402bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 -- 172.21.15.18:0/570890968 shutdown_connections 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 --2- 172.21.15.18:0/570890968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd941075a0 0x7efd94109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 --2- 172.21.15.18:0/570890968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd94107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 --2- 172.21.15.18:0/570890968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd94102340 0x7efd94104730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 -- 172.21.15.18:0/570890968 >> 172.21.15.18:0/570890968 conn(0x7efd940fbcb0 msgr2=0x7efd940fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 -- 172.21.15.18:0/570890968 shutdown_connections 2024-04-21T22:31:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.518+0000 7efd98e00640 1 -- 172.21.15.18:0/570890968 wait complete. 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.519+0000 7efd98e00640 1 Processor -- start 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 -- start start 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 0x7efd94199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd9419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 0x7efd941a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd9410d460 con 0x7efd94102340 2024-04-21T22:31:30.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd9410d2e0 con 0x7efd941075a0 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd98e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd9410d5e0 con 0x7efd94104c70 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd91e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 0x7efd94199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd92800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 0x7efd941a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd91400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd9419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd92800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 0x7efd941a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42520/0 (socket says 172.21.15.18:42520) 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd91400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd9419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44824/0 (socket says 172.21.15.18:44824) 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.520+0000 7efd92800640 1 -- 172.21.15.18:0/2128167505 learned_addr learned my addr 172.21.15.18:0/2128167505 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 -- 172.21.15.18:0/2128167505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 msgr2=0x7efd9419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd9419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 -- 172.21.15.18:0/2128167505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 msgr2=0x7efd941a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 0x7efd941a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 -- 172.21.15.18:0/2128167505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd941a1920 con 0x7efd94102340 2024-04-21T22:31:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd91e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 0x7efd94199d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd84036040 tx=0x7efd8402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84043020 con 0x7efd94102340 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd840054e0 con 0x7efd94102340 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd941a1bb0 con 0x7efd94102340 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.521+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84003c30 con 0x7efd94102340 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.522+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd941a20d0 con 0x7efd94102340 2024-04-21T22:31:30.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.523+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd94068a40 con 0x7efd94102340 2024-04-21T22:31:30.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.525+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efd84046020 con 0x7efd94102340 2024-04-21T22:31:30.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.526+0000 7efd8aa00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 0x7efd780a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.526+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7efd840f0ff0 con 0x7efd94102340 2024-04-21T22:31:30.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.526+0000 7efd91400640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 0x7efd780a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.527+0000 7efd91400640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 0x7efd780a5050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd9406a890 tx=0x7efd7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.531+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7efd8404d020 con 0x7efd94102340 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-21T22:31:30.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:30 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2335426306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.737+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd94062340 con 0x7efd94102340 2024-04-21T22:31:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.740+0000 7efd8aa00640 1 -- 172.21.15.18:0/2128167505 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22112 (secure 0 0 0) 0x7efd840be000 con 0x7efd94102340 2024-04-21T22:31:30.740 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:30.740 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":85,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:31:30.502357+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 msgr2=0x7efd780a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 0x7efd780a5050 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd9406a890 tx=0x7efd7c005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 msgr2=0x7efd94199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 0x7efd94199d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd84036040 tx=0x7efd8402c650 comp rx=0 tx=0).stop 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 shutdown_connections 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd780a2b90 0x7efd780a5050 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd941075a0 0x7efd941a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94104c70 0x7efd9419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 --2- 172.21.15.18:0/2128167505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd94102340 0x7efd94199d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 >> 172.21.15.18:0/2128167505 conn(0x7efd940fbcb0 msgr2=0x7efd94101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 shutdown_connections 2024-04-21T22:31:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.743+0000 7efd98e00640 1 -- 172.21.15.18:0/2128167505 wait complete. 2024-04-21T22:31:30.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T22:31:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-21T22:31:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-21T22:31:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:30 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2335426306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:30.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: osdmap e84: 12 total, 12 up, 12 in 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-21T22:31:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:30 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2335426306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 -- 172.21.15.18:0/2695153598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 msgr2=0x7fcbe8073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 --2- 172.21.15.18:0/2695153598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe8073bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009900 tx=0x7fcbdc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 -- 172.21.15.18:0/2695153598 shutdown_connections 2024-04-21T22:31:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 --2- 172.21.15.18:0/2695153598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe810dd60 0x7fcbe8110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 --2- 172.21.15.18:0/2695153598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe80741a0 0x7fcbe8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 --2- 172.21.15.18:0/2695153598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe8073bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 -- 172.21.15.18:0/2695153598 >> 172.21.15.18:0/2695153598 conn(0x7fcbe80fcd00 msgr2=0x7fcbe80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 -- 172.21.15.18:0/2695153598 shutdown_connections 2024-04-21T22:31:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.974+0000 7fcbf0000640 1 -- 172.21.15.18:0/2695153598 wait complete. 2024-04-21T22:31:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.975+0000 7fcbf0000640 1 Processor -- start 2024-04-21T22:31:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 -- start start 2024-04-21T22:31:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe80741a0 0x7fcbe819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 0x7fcbe81a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8113a50 con 0x7fcbe80741a0 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81138d0 con 0x7fcbe810dd60 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbf0000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8113bd0 con 0x7fcbe8075780 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbecc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbecc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44850/0 (socket says 172.21.15.18:44850) 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbecc00640 1 -- 172.21.15.18:0/1009820935 learned_addr learned my addr 172.21.15.18:0/1009820935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbed600640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe80741a0 0x7fcbe819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.976+0000 7fcbee000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 0x7fcbe81a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 -- 172.21.15.18:0/1009820935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 msgr2=0x7fcbe81a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 0x7fcbe81a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 -- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe80741a0 msgr2=0x7fcbe819e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe80741a0 0x7fcbe819e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 -- 172.21.15.18:0/1009820935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81a5d30 con 0x7fcbe8075780 2024-04-21T22:31:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbee000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 0x7fcbe81a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbecc00640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400e9f0 tx=0x7fcbd400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400cd80 con 0x7fcbe8075780 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd4005500 con 0x7fcbe8075780 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe81a5fc0 con 0x7fcbe8075780 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4010690 con 0x7fcbe8075780 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.977+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81a6490 con 0x7fcbe8075780 2024-04-21T22:31:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.978+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8103f30 con 0x7fcbe8075780 2024-04-21T22:31:30.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.982+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcbd40046c0 con 0x7fcbe8075780 2024-04-21T22:31:30.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.983+0000 7fcbe6000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 0x7fcbd00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:30.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.983+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fcbd40cf3e0 con 0x7fcbe8075780 2024-04-21T22:31:30.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.983+0000 7fcbed600640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 0x7fcbd00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:30.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.984+0000 7fcbed600640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 0x7fcbd00a5050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02c240 tx=0x7fcbdc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:30.988+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fcbd409c3f0 con 0x7fcbe8075780 2024-04-21T22:31:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.238+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcbe802d170 con 0x7fcbe8075780 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: pgmap v321: 97 pgs: 1 active+clean, 19 creating+peering, 77 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2128167505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: Cluster is now healthy 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:active 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1009820935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:31 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:31.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.870+0000 7fcbe6000640 1 -- 172.21.15.18:0/1009820935 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fcbd409bcf0 con 0x7fcbe8075780 2024-04-21T22:31:31.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 msgr2=0x7fcbd00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:31.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 0x7fcbd00a5050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc02c240 tx=0x7fcbdc000bc0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 msgr2=0x7fcbe819e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400e9f0 tx=0x7fcbd400edf0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 shutdown_connections 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fcbd00a2b90 0x7fcbd00a5050 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe810dd60 0x7fcbe81a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe8075780 0x7fcbe819e650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 --2- 172.21.15.18:0/1009820935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe80741a0 0x7fcbe819e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:31.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 >> 172.21.15.18:0/1009820935 conn(0x7fcbe80fcd00 msgr2=0x7fcbe8101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:31.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 shutdown_connections 2024-04-21T22:31:31.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:31.874+0000 7fcbf0000640 1 -- 172.21.15.18:0/1009820935 wait complete. 2024-04-21T22:31:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: pgmap v321: 97 pgs: 1 active+clean, 19 creating+peering, 77 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T22:31:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2128167505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: Cluster is now healthy 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:active 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1009820935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:31.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:31 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:31.897 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-21T22:31:31.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-21T22:31:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: pgmap v321: 97 pgs: 1 active+clean, 19 creating+peering, 77 unknown; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: osdmap e85: 12 total, 12 up, 12 in 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2128167505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: Cluster is now healthy 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] up:active 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1009820935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:31 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-21T22:31:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 -- 172.21.15.18:0/1226244322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 msgr2=0x7fb32c104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 --2- 172.21.15.18:0/1226244322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c104420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009ca0 tx=0x7fb31c02c100 comp rx=0 tx=0).stop 2024-04-21T22:31:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 -- 172.21.15.18:0/1226244322 shutdown_connections 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 --2- 172.21.15.18:0/1226244322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c107290 0x7fb32c1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 --2- 172.21.15.18:0/1226244322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c104960 0x7fb32c106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 --2- 172.21.15.18:0/1226244322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c104420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 -- 172.21.15.18:0/1226244322 >> 172.21.15.18:0/1226244322 conn(0x7fb32c0fba20 msgr2=0x7fb32c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 -- 172.21.15.18:0/1226244322 shutdown_connections 2024-04-21T22:31:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.118+0000 7fb331000640 1 -- 172.21.15.18:0/1226244322 wait complete. 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 Processor -- start 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 -- start start 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c107290 0x7fb32c1a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10d240 con 0x7fb32c107290 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10d0c0 con 0x7fb32c104960 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.120+0000 7fb331000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10d3c0 con 0x7fb32c102030 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb322a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c107290 0x7fb32c1a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb322a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42550/0 (socket says 172.21.15.18:42550) 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb322a00640 1 -- 172.21.15.18:0/936658415 learned_addr learned my addr 172.21.15.18:0/936658415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 -- 172.21.15.18:0/936658415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 msgr2=0x7fb32c19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 -- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c107290 msgr2=0x7fb32c1a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c107290 0x7fb32c1a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 -- 172.21.15.18:0/936658415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c1a1730 con 0x7fb32c102030 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb322a00640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.121+0000 7fb32b400640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c199b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009bf0 tx=0x7fb31c035d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.122+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c039040 con 0x7fb32c102030 2024-04-21T22:31:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.122+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c1a19c0 con 0x7fb32c102030 2024-04-21T22:31:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.122+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb31c003970 con 0x7fb32c102030 2024-04-21T22:31:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.122+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c004360 con 0x7fb32c102030 2024-04-21T22:31:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.122+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c1a1ed0 con 0x7fb32c102030 2024-04-21T22:31:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.123+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c108de0 con 0x7fb32c102030 2024-04-21T22:31:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.125+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb31c046030 con 0x7fb32c102030 2024-04-21T22:31:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.126+0000 7fb328c00640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 0x7fb3100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.127+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fb31c0f0af0 con 0x7fb32c102030 2024-04-21T22:31:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.127+0000 7fb322a00640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 0x7fb3100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.128+0000 7fb322a00640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 0x7fb3100a5050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb32c19b020 tx=0x7fb314005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.131+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb31c04d060 con 0x7fb32c102030 2024-04-21T22:31:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.375+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fb32c062340 con 0x7fb32c102030 2024-04-21T22:31:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.882+0000 7fb328c00640 1 -- 172.21.15.18:0/936658415 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fb31c0bdb90 con 0x7fb32c102030 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 msgr2=0x7fb3100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 0x7fb3100a5050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb32c19b020 tx=0x7fb314005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 msgr2=0x7fb32c199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c199b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009bf0 tx=0x7fb31c035d10 comp rx=0 tx=0).stop 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 shutdown_connections 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb3100a2b90 0x7fb3100a5050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb32c107290 0x7fb32c1a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb32c104960 0x7fb32c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 --2- 172.21.15.18:0/936658415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb32c102030 0x7fb32c199b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:32.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 >> 172.21.15.18:0/936658415 conn(0x7fb32c0fba20 msgr2=0x7fb32c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:32.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 shutdown_connections 2024-04-21T22:31:32.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:32.887+0000 7fb331000640 1 -- 172.21.15.18:0/936658415 wait complete. 2024-04-21T22:31:32.914 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-21T22:31:33.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 -- 172.21.15.18:0/3216073155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1049d0 msgr2=0x7fadac104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 --2- 172.21.15.18:0/3216073155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1049d0 0x7fadac104e50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fad98009900 tx=0x7fad9802bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:33.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 -- 172.21.15.18:0/3216073155 shutdown_connections 2024-04-21T22:31:33.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 --2- 172.21.15.18:0/3216073155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac105390 0x7fadac10bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 --2- 172.21.15.18:0/3216073155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1049d0 0x7fadac104e50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 --2- 172.21.15.18:0/3216073155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac1037e0 0x7fadac103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 -- 172.21.15.18:0/3216073155 >> 172.21.15.18:0/3216073155 conn(0x7fadac0fed50 msgr2=0x7fadac101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:33.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 -- 172.21.15.18:0/3216073155 shutdown_connections 2024-04-21T22:31:33.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.105+0000 7fadabe00640 1 -- 172.21.15.18:0/3216073155 wait complete. 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.106+0000 7fadabe00640 1 Processor -- start 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.106+0000 7fadabe00640 1 -- start start 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac1049d0 0x7fadac19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 0x7fadac1a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fadac10f440 con 0x7fadac105390 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadac10f2c0 con 0x7fadac1037e0 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadabe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadac10f5c0 con 0x7fadac1049d0 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 0x7fadac1a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42560/0 (socket says 172.21.15.18:42560) 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac1049d0 0x7fadac19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 -- 172.21.15.18:0/375623874 learned_addr learned my addr 172.21.15.18:0/375623874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 -- 172.21.15.18:0/375623874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac1049d0 msgr2=0x7fadac19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac1049d0 0x7fadac19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 -- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 msgr2=0x7fadac1a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 0x7fadac1a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadaaa00640 1 -- 172.21.15.18:0/375623874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac1a1730 con 0x7fadac1037e0 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.107+0000 7fadab400640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 0x7fadac1a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fadaaa00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00e9c0 tx=0x7fad9c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cd80 con 0x7fadac1037e0 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad9c0035f0 con 0x7fadac1037e0 2024-04-21T22:31:33.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac1a1a20 con 0x7fadac1037e0 2024-04-21T22:31:33.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c010690 con 0x7fadac1037e0 2024-04-21T22:31:33.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.108+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac1a1f90 con 0x7fadac1037e0 2024-04-21T22:31:33.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.109+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac10ab80 con 0x7fadac1037e0 2024-04-21T22:31:33.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.111+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fad9c0037a0 con 0x7fadac1037e0 2024-04-21T22:31:33.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.113+0000 7fada3400640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 0x7fad900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.113+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fad9c0cf2f0 con 0x7fadac1037e0 2024-04-21T22:31:33.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.113+0000 7fadaa000640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 0x7fad900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.114+0000 7fadaa000640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 0x7fad900a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad9802c7b0 tx=0x7fad98005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:33.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.117+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fad9c09c300 con 0x7fadac1037e0 2024-04-21T22:31:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:32 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T22:31:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:32 smithi081 ceph-mon[31692]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:32 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/936658415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:32 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:32 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T22:31:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:32 smithi047 ceph-mon[31561]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:33.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:32 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/936658415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:32 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:32 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-21T22:31:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:32 smithi018 ceph-mon[26614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:32 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/936658415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:32 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-21T22:31:33.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.364+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fadac02d170 con 0x7fadac1037e0 2024-04-21T22:31:33.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.489+0000 7fada3400640 1 -- 172.21.15.18:0/375623874 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fad9c09bc00 con 0x7fadac1037e0 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.493+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 msgr2=0x7fad900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.493+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 0x7fad900a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad9802c7b0 tx=0x7fad98005fd0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.493+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 msgr2=0x7fadac199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.493+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00e9c0 tx=0x7fad9c00ee80 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 shutdown_connections 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fad900a2c10 0x7fad900a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadac105390 0x7fadac1a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadac1049d0 0x7fadac19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 --2- 172.21.15.18:0/375623874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadac1037e0 0x7fadac199b10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 >> 172.21.15.18:0/375623874 conn(0x7fadac0fed50 msgr2=0x7fadac107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 shutdown_connections 2024-04-21T22:31:33.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.494+0000 7fadabe00640 1 -- 172.21.15.18:0/375623874 wait complete. 2024-04-21T22:31:33.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-21T22:31:33.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 -- 172.21.15.18:0/1238747281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 msgr2=0x7f01cc073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1238747281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc073bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ca0 tx=0x7f01c002c100 comp rx=0 tx=0).stop 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 -- 172.21.15.18:0/1238747281 shutdown_connections 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1238747281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1238747281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1238747281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc073bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.719+0000 7f01d3e00640 1 -- 172.21.15.18:0/1238747281 >> 172.21.15.18:0/1238747281 conn(0x7f01cc0fcd20 msgr2=0x7f01cc0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.720+0000 7f01d3e00640 1 -- 172.21.15.18:0/1238747281 shutdown_connections 2024-04-21T22:31:33.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.720+0000 7f01d3e00640 1 -- 172.21.15.18:0/1238747281 wait complete. 2024-04-21T22:31:33.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 Processor -- start 2024-04-21T22:31:33.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 -- start start 2024-04-21T22:31:33.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc1a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc10f5d0 con 0x7f01cc0741a0 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc10f450 con 0x7f01cc075780 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc10f750 con 0x7f01cc109650 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42586/0 (socket says 172.21.15.18:42586) 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d0a00640 1 -- 172.21.15.18:0/1765603387 learned_addr learned my addr 172.21.15.18:0/1765603387 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41740/0 (socket says 172.21.15.18:41740) 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.721+0000 7f01d1e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc1a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 -- 172.21.15.18:0/1765603387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 msgr2=0x7f01cc1a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc1a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 -- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 msgr2=0x7f01cc199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:33.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 -- 172.21.15.18:0/1765603387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1a1900 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d1400640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d1e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d0a00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01b800ea60 tx=0x7f01b800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b800cde0 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b80035f0 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8010670 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.722+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1a1bf0 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.723+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1a2160 con 0x7f01cc075780 2024-04-21T22:31:33.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.724+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc108380 con 0x7f01cc075780 2024-04-21T22:31:33.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.726+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f01b80037a0 con 0x7f01cc075780 2024-04-21T22:31:33.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.728+0000 7f01ca000640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 0x7f01b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:33.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.728+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f01b80cf300 con 0x7f01cc075780 2024-04-21T22:31:33.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.728+0000 7f01d1400640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 0x7f01b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:33.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.729+0000 7f01d1400640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 0x7f01b40a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01c002c710 tx=0x7f01c0005ef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:33.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.733+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f01b809c310 con 0x7f01cc075780 2024-04-21T22:31:33.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:33.984+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f01cc02d170 con 0x7f01cc075780 2024-04-21T22:31:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: pgmap v323: 97 pgs: 43 active+clean, 19 creating+peering, 35 unknown; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/375623874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:active 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:34.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:33 smithi081 ceph-mon[31692]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-21T22:31:34.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: pgmap v323: 97 pgs: 43 active+clean, 19 creating+peering, 35 unknown; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-04-21T22:31:34.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/375623874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:active 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:34.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:33 smithi047 ceph-mon[31561]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-21T22:31:34.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: pgmap v323: 97 pgs: 43 active+clean, 19 creating+peering, 35 unknown; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-04-21T22:31:34.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/375623874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] up:active 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:creating} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:34.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:33 smithi018 ceph-mon[26614]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-21T22:31:34.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.502+0000 7f01ca000640 1 -- 172.21.15.18:0/1765603387 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f01b809bc10 con 0x7f01cc075780 2024-04-21T22:31:34.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.505+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 msgr2=0x7f01b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.505+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 0x7f01b40a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f01c002c710 tx=0x7f01c0005ef0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.505+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 msgr2=0x7f01cc19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.505+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01b800ea60 tx=0x7f01b800ef20 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 shutdown_connections 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f01b40a2c10 0x7f01b40a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01cc109650 0x7f01cc1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01cc075780 0x7f01cc19a230 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 --2- 172.21.15.18:0/1765603387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01cc0741a0 0x7f01cc199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 >> 172.21.15.18:0/1765603387 conn(0x7f01cc0fcd20 msgr2=0x7f01cc105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 shutdown_connections 2024-04-21T22:31:34.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.506+0000 7f01d3e00640 1 -- 172.21.15.18:0/1765603387 wait complete. 2024-04-21T22:31:34.534 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-21T22:31:34.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-21T22:31:34.694 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: 2024-04-21T22:31:34.226+0000 7f3998b25700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-21T22:31:34.695 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: 2024-04-21T22:31:34.226+0000 7f3998b25700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-21T22:31:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 -- 172.21.15.18:0/696345525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6500741a0 msgr2=0x7fc650074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 --2- 172.21.15.18:0/696345525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6500741a0 0x7fc650074620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc638009cd0 tx=0x7fc63802c0e0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 -- 172.21.15.18:0/696345525 shutdown_connections 2024-04-21T22:31:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 --2- 172.21.15.18:0/696345525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc65010ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 --2- 172.21.15.18:0/696345525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6500741a0 0x7fc650074620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 --2- 172.21.15.18:0/696345525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650075780 0x7fc650073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 -- 172.21.15.18:0/696345525 >> 172.21.15.18:0/696345525 conn(0x7fc6500fcb20 msgr2=0x7fc6500fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 -- 172.21.15.18:0/696345525 shutdown_connections 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.746+0000 7fc655600640 1 -- 172.21.15.18:0/696345525 wait complete. 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.747+0000 7fc655600640 1 Processor -- start 2024-04-21T22:31:34.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 -- start start 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6500741a0 0x7fc65019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc6501a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc650113820 con 0x7fc65010db80 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6501136a0 con 0x7fc650075780 2024-04-21T22:31:34.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc655600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6501139a0 con 0x7fc6500741a0 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42608/0 (socket says 172.21.15.18:42608) 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 -- 172.21.15.18:0/2573157975 learned_addr learned my addr 172.21.15.18:0/2573157975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc654c00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc6501a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64fe00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6500741a0 0x7fc65019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:34.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 -- 172.21.15.18:0/2573157975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6500741a0 msgr2=0x7fc65019df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6500741a0 0x7fc65019df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 -- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 msgr2=0x7fc6501a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc6501a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc64f400640 1 -- 172.21.15.18:0/2573157975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6501a5b40 con 0x7fc650075780 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.748+0000 7fc654c00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc6501a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc64f400640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6380325d0 tx=0x7fc638035d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:34.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638039040 con 0x7fc650075780 2024-04-21T22:31:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc638044070 con 0x7fc650075780 2024-04-21T22:31:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6501a5dd0 con 0x7fc650075780 2024-04-21T22:31:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380045c0 con 0x7fc650075780 2024-04-21T22:31:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.749+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6501a6280 con 0x7fc650075780 2024-04-21T22:31:34.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.750+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650103c40 con 0x7fc650075780 2024-04-21T22:31:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.752+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc638032870 con 0x7fc650075780 2024-04-21T22:31:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.754+0000 7fc64cc00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 0x7fc6300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.754+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fc6380f1660 con 0x7fc650075780 2024-04-21T22:31:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.754+0000 7fc64fe00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 0x7fc6300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:34.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.755+0000 7fc64fe00640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 0x7fc6300a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc640005fd0 tx=0x7fc640005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:34.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:34.762+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc6380be670 con 0x7fc650075780 2024-04-21T22:31:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.019+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc650061b80 con 0x7fc6300a2c10 2024-04-21T22:31:35.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1765603387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:active 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:35.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:34 smithi047 ceph-mon[31561]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1765603387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:active 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:35.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:34 smithi018 ceph-mon[26614]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-04-21T22:31:35.347 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:31:35.033+0000 7f150b600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:31:35.347 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:31:35.033+0000 7f150b600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:31:35.347 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:31:35.033+0000 7f150b600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:31:35.347 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:31:35.033+0000 7f150b600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:31:35.347 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:31:35.033+0000 7f150b600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:31:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1765603387' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-21T22:31:35.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-21T22:31:35.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] up:active 2024-04-21T22:31:35.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-21T22:31:35.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-21T22:31:35.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:35.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:34 smithi081 ceph-mon[31692]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-04-21T22:31:35.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.547+0000 7fc64cc00640 1 -- 172.21.15.18:0/2573157975 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc650061b80 con 0x7fc6300a2c10 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 msgr2=0x7fc6300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 0x7fc6300a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc640005fd0 tx=0x7fc640005850 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 msgr2=0x7fc65019e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6380325d0 tx=0x7fc638035d10 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 shutdown_connections 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc6300a2c10 0x7fc6300a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc65010db80 0x7fc6501a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc650075780 0x7fc65019e460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 --2- 172.21.15.18:0/2573157975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6500741a0 0x7fc65019df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 >> 172.21.15.18:0/2573157975 conn(0x7fc6500fcb20 msgr2=0x7fc650100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 shutdown_connections 2024-04-21T22:31:35.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.551+0000 7fc655600640 1 -- 172.21.15.18:0/2573157975 wait complete. 2024-04-21T22:31:35.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-21T22:31:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 -- 172.21.15.18:0/2951835417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d841027c0 msgr2=0x7f1d84102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 --2- 172.21.15.18:0/2951835417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d841027c0 0x7f1d84102c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009ca0 tx=0x7f1d6c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 -- 172.21.15.18:0/2951835417 shutdown_connections 2024-04-21T22:31:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 --2- 172.21.15.18:0/2951835417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d84103180 0x7f1d84109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 --2- 172.21.15.18:0/2951835417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d841027c0 0x7f1d84102c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 --2- 172.21.15.18:0/2951835417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 0x7f1d841019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 -- 172.21.15.18:0/2951835417 >> 172.21.15.18:0/2951835417 conn(0x7f1d840fcb40 msgr2=0x7f1d840fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 -- 172.21.15.18:0/2951835417 shutdown_connections 2024-04-21T22:31:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.766+0000 7f1d8a400640 1 -- 172.21.15.18:0/2951835417 wait complete. 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.767+0000 7f1d8a400640 1 Processor -- start 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.767+0000 7f1d8a400640 1 -- start start 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 0x7f1d840754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d841027c0 0x7f1d84073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410d230 con 0x7f1d841027c0 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410d0b0 con 0x7f1d84103180 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d8a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410d3b0 con 0x7f1d841015d0 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d841027c0 0x7f1d84073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42652/0 (socket says 172.21.15.18:42652) 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 -- 172.21.15.18:0/610213248 learned_addr learned my addr 172.21.15.18:0/610213248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89000640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 0x7f1d840754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 -- 172.21.15.18:0/610213248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 msgr2=0x7f1d840754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 0x7f1d840754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 -- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d841027c0 msgr2=0x7f1d84073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.768+0000 7f1d89a00640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d841027c0 0x7f1d84073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d89a00640 1 -- 172.21.15.18:0/610213248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d84074900 con 0x7f1d84103180 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d89a00640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00e970 tx=0x7f1d7c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00ccc0 con 0x7f1d84103180 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d7c00ce60 con 0x7f1d84103180 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d841a19f0 con 0x7f1d84103180 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c010490 con 0x7f1d84103180 2024-04-21T22:31:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.769+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d841a1f10 con 0x7f1d84103180 2024-04-21T22:31:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.770+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8404f500 con 0x7f1d84103180 2024-04-21T22:31:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.772+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1d7c005020 con 0x7f1d84103180 2024-04-21T22:31:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.774+0000 7f1d81600640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.774+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f1d7c0cf400 con 0x7f1d84103180 2024-04-21T22:31:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.774+0000 7f1d89000640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.775+0000 7f1d89000640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 0x7f1d640a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d84102620 tx=0x7f1d7400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:35.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:35.782+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1d7c09c410 con 0x7f1d84103180 2024-04-21T22:31:36.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.019+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1d84061b80 con 0x7f1d640a2c10 2024-04-21T22:31:36.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.056+0000 7f1d81600640 1 -- 172.21.15.18:0/610213248 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1d84061b80 con 0x7f1d640a2c10 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 msgr2=0x7f1d640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 0x7f1d640a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d84102620 tx=0x7f1d7400b390 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 msgr2=0x7f1d84074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00e970 tx=0x7f1d7c00ed70 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 shutdown_connections 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d84103180 0x7f1d84074070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d841027c0 0x7f1d84073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 --2- 172.21.15.18:0/610213248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d841015d0 0x7f1d840754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 >> 172.21.15.18:0/610213248 conn(0x7f1d840fcb40 msgr2=0x7f1d84105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 shutdown_connections 2024-04-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.059+0000 7f1d8a400640 1 -- 172.21.15.18:0/610213248 wait complete. 2024-04-21T22:31:36.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 8 op/s 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:active 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: Cluster is now healthy 2024-04-21T22:31:36.149 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:36.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-21T22:31:36.150 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:35 smithi018 ceph-mon[26614]: daemon mds.j is now active in filesystem cephfs as rank 4 2024-04-21T22:31:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 8 op/s 2024-04-21T22:31:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:active 2024-04-21T22:31:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-21T22:31:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T22:31:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: Cluster is now healthy 2024-04-21T22:31:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-21T22:31:36.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:35 smithi047 ceph-mon[31561]: daemon mds.j is now active in filesystem cephfs as rank 4 2024-04-21T22:31:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 -- 172.21.15.18:0/726641851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490108db0 msgr2=0x7fd490109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 --2- 172.21.15.18:0/726641851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490108db0 0x7fd490109230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009900 tx=0x7fd47c02bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 -- 172.21.15.18:0/726641851 shutdown_connections 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 --2- 172.21.15.18:0/726641851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490109770 0x7fd490110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 --2- 172.21.15.18:0/726641851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490108db0 0x7fd490109230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 --2- 172.21.15.18:0/726641851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd490107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 -- 172.21.15.18:0/726641851 >> 172.21.15.18:0/726641851 conn(0x7fd490076b80 msgr2=0x7fd490078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 -- 172.21.15.18:0/726641851 shutdown_connections 2024-04-21T22:31:36.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.298+0000 7fd495e00640 1 -- 172.21.15.18:0/726641851 wait complete. 2024-04-21T22:31:36.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.299+0000 7fd495e00640 1 Processor -- start 2024-04-21T22:31:36.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 -- start start 2024-04-21T22:31:36.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd49019df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490108db0 0x7fd49019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd490113820 con 0x7fd490107bc0 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd4901136a0 con 0x7fd490109770 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4901139a0 con 0x7fd490108db0 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48960/0 (socket says 172.21.15.18:48960) 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd495400640 1 -- 172.21.15.18:0/467427134 learned_addr learned my addr 172.21.15.18:0/467427134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd494a00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd49019df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.300+0000 7fd48fe00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490108db0 0x7fd49019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 -- 172.21.15.18:0/467427134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490108db0 msgr2=0x7fd49019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490108db0 0x7fd49019e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 -- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 msgr2=0x7fd49019df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd49019df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 -- 172.21.15.18:0/467427134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4901a5b10 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd494a00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd49019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495400640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd48800efd0 tx=0x7fd48800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488003b70 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd488003d10 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4901a5e00 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880109f0 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.301+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4901a6270 con 0x7fd490109770 2024-04-21T22:31:36.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.303+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49010ef80 con 0x7fd490109770 2024-04-21T22:31:36.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.305+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd488004020 con 0x7fd490109770 2024-04-21T22:31:36.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.306+0000 7fd48d600640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 0x7fd4780a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.306+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fd4880cf3b0 con 0x7fd490109770 2024-04-21T22:31:36.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.306+0000 7fd494a00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 0x7fd4780a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.307+0000 7fd494a00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 0x7fd4780a5050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd490108c10 tx=0x7fd484005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.314+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd48809c3c0 con 0x7fd490109770 2024-04-21T22:31:36.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s wr, 8 op/s 2024-04-21T22:31:36.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] up:active 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: daemon mds.j assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: Cluster is now healthy 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=f=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2024-04-21T22:31:36.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:35 smithi081 ceph-mon[31692]: daemon mds.j is now active in filesystem cephfs as rank 4 2024-04-21T22:31:36.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.563+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd490061b80 con 0x7fd4780a2b90 2024-04-21T22:31:36.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.569+0000 7fd48d600640 1 -- 172.21.15.18:0/467427134 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd490061b80 con 0x7fd4780a2b90 2024-04-21T22:31:36.569 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_0/907755c5-4624-4c7d-a9d2-ca692d2d4eb9 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 msgr2=0x7fd4780a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 0x7fd4780a5050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd490108c10 tx=0x7fd484005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 msgr2=0x7fd4901a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd48800efd0 tx=0x7fd48800c6a0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 shutdown_connections 2024-04-21T22:31:36.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd4780a2b90 0x7fd4780a5050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd490109770 0x7fd4901a54a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd490108db0 0x7fd49019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 --2- 172.21.15.18:0/467427134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd490107bc0 0x7fd49019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 >> 172.21.15.18:0/467427134 conn(0x7fd490076b80 msgr2=0x7fd49010c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.572+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 shutdown_connections 2024-04-21T22:31:36.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.573+0000 7fd495e00640 1 -- 172.21.15.18:0/467427134 wait complete. 2024-04-21T22:31:36.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-21T22:31:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 -- 172.21.15.18:0/1855807987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e30105370 msgr2=0x7f7e3010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/1855807987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e30105370 0x7f7e3010bc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009ca0 tx=0x7f7e2802c100 comp rx=0 tx=0).stop 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 -- 172.21.15.18:0/1855807987 shutdown_connections 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/1855807987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e30105370 0x7f7e3010bc00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/1855807987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301049b0 0x7f7e30104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/1855807987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e301037c0 0x7f7e30103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.794+0000 7f7e2fe00640 1 -- 172.21.15.18:0/1855807987 >> 172.21.15.18:0/1855807987 conn(0x7f7e300fed50 msgr2=0x7f7e30101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.795+0000 7f7e2fe00640 1 -- 172.21.15.18:0/1855807987 shutdown_connections 2024-04-21T22:31:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.795+0000 7f7e2fe00640 1 -- 172.21.15.18:0/1855807987 wait complete. 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.795+0000 7f7e2fe00640 1 Processor -- start 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 -- start start 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301037c0 0x7f7e30199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e30105370 0x7f7e301a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3010f440 con 0x7f7e301037c0 2024-04-21T22:31:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3010f2c0 con 0x7f7e301049b0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3010f5c0 con 0x7f7e30105370 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301037c0 0x7f7e30199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48972/0 (socket says 172.21.15.18:48972) 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2e000640 1 -- 172.21.15.18:0/3088168226 learned_addr learned my addr 172.21.15.18:0/3088168226 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.796+0000 7f7e2f400640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e30105370 0x7f7e301a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 -- 172.21.15.18:0/3088168226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e30105370 msgr2=0x7f7e301a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e30105370 0x7f7e301a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 -- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301037c0 msgr2=0x7f7e30199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301037c0 0x7f7e30199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 -- 172.21.15.18:0/3088168226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e301a16d0 con 0x7f7e301049b0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2e000640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00e9f0 tx=0x7f7e1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00cd80 con 0x7f7e301049b0 2024-04-21T22:31:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e1c010910 con 0x7f7e301049b0 2024-04-21T22:31:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c018990 con 0x7f7e301049b0 2024-04-21T22:31:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e301a19c0 con 0x7f7e301049b0 2024-04-21T22:31:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.797+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e301a1f10 con 0x7f7e301049b0 2024-04-21T22:31:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.798+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3010aae0 con 0x7f7e301049b0 2024-04-21T22:31:36.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.801+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7e1c010ac0 con 0x7f7e301049b0 2024-04-21T22:31:36.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.803+0000 7f7e27400640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 0x7f7e140a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.803+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f7e1c0cf350 con 0x7f7e301049b0 2024-04-21T22:31:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.803+0000 7f7e2ea00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 0x7f7e140a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.804+0000 7f7e2ea00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 0x7f7e140a5050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e30104810 tx=0x7f7e20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:36.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.811+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7e1c09c360 con 0x7f7e301049b0 2024-04-21T22:31:36.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:36.917+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7e1c0982d0 con 0x7f7e301049b0 2024-04-21T22:31:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.057+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7e30061b80 con 0x7f7e140a2b90 2024-04-21T22:31:37.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.098+0000 7f7e27400640 1 -- 172.21.15.18:0/3088168226 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e30061b80 con 0x7f7e140a2b90 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 msgr2=0x7f7e140a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 0x7f7e140a5050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e30104810 tx=0x7f7e20005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 msgr2=0x7f7e30199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00e9f0 tx=0x7f7e1c00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 shutdown_connections 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e140a2b90 0x7f7e140a5050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e30105370 0x7f7e301a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e301049b0 0x7f7e30199ff0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 --2- 172.21.15.18:0/3088168226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e301037c0 0x7f7e30199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 >> 172.21.15.18:0/3088168226 conn(0x7f7e300fed50 msgr2=0x7f7e30107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 shutdown_connections 2024-04-21T22:31:37.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.101+0000 7f7e2fe00640 1 -- 172.21.15.18:0/3088168226 wait complete. 2024-04-21T22:31:37.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-21T22:31:37.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:36 smithi047 ceph-mon[31561]: from='client.24680 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:37.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:36 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:active 2024-04-21T22:31:37.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:36 smithi047 ceph-mon[31561]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-21T22:31:37.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:36 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:31:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:36 smithi018 ceph-mon[26614]: from='client.24680 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:36 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:active 2024-04-21T22:31:37.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:36 smithi018 ceph-mon[26614]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-21T22:31:37.196 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:36 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.342+0000 7f790be00640 1 -- 172.21.15.18:0/2928596290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 msgr2=0x7f790c102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.342+0000 7f790be00640 1 --2- 172.21.15.18:0/2928596290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c102250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009900 tx=0x7f78fc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 -- 172.21.15.18:0/2928596290 shutdown_connections 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 --2- 172.21.15.18:0/2928596290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 --2- 172.21.15.18:0/2928596290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 0x7f790c104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 --2- 172.21.15.18:0/2928596290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c102250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 -- 172.21.15.18:0/2928596290 >> 172.21.15.18:0/2928596290 conn(0x7f790c0fba20 msgr2=0x7f790c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 -- 172.21.15.18:0/2928596290 shutdown_connections 2024-04-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.343+0000 7f790be00640 1 -- 172.21.15.18:0/2928596290 wait complete. 2024-04-21T22:31:37.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.344+0000 7f790be00640 1 Processor -- start 2024-04-21T22:31:37.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.344+0000 7f790be00640 1 -- start start 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 0x7f790c19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f790c113800 con 0x7f790c102790 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f790c113680 con 0x7f790c0ffe20 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f790c113980 con 0x7f790c105140 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48998/0 (socket says 172.21.15.18:48998) 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 -- 172.21.15.18:0/2089438075 learned_addr learned my addr 172.21.15.18:0/2089438075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 -- 172.21.15.18:0/2089438075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 msgr2=0x7f790c1a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790b400640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790a000640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 0x7f790c19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 -- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 msgr2=0x7f790c19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 0x7f790c19e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790aa00640 1 -- 172.21.15.18:0/2089438075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c1a5ad0 con 0x7f790c0ffe20 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.345+0000 7f790b400640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f790aa00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009230 tx=0x7f78fc005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc041070 con 0x7f790c0ffe20 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc0054e0 con 0x7f790c0ffe20 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c1a5d60 con 0x7f790c0ffe20 2024-04-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc034440 con 0x7f790c0ffe20 2024-04-21T22:31:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.346+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a61e0 con 0x7f790c0ffe20 2024-04-21T22:31:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.347+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c0fd510 con 0x7f790c0ffe20 2024-04-21T22:31:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.349+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f78fc044070 con 0x7f790c0ffe20 2024-04-21T22:31:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.351+0000 7f7910a00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 0x7f78f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.351+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f78fc0f0d10 con 0x7f790c0ffe20 2024-04-21T22:31:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.351+0000 7f790a000640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 0x7f78f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.352+0000 7f790a000640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 0x7f78f00a5160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005fd0 tx=0x7f78f4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.359+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f78fc0f6020 con 0x7f790c0ffe20 2024-04-21T22:31:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:36 smithi081 ceph-mon[31692]: from='client.24680 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:36 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] up:active 2024-04-21T22:31:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:36 smithi081 ceph-mon[31692]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2024-04-21T22:31:37.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:36 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:31:37.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.605+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f790c061c10 con 0x7f78f00a2ca0 2024-04-21T22:31:37.611 INFO:teuthology.orchestra.run.smithi018.stdout:/volumes/qa/sv_1/d6410d01-5098-4c61-a72a-04923b90ffe5 2024-04-21T22:31:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.611+0000 7f7910a00640 1 -- 172.21.15.18:0/2089438075 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f790c061c10 con 0x7f78f00a2ca0 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 msgr2=0x7f78f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 0x7f78f00a5160 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005fd0 tx=0x7f78f4005850 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 msgr2=0x7f790c19deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009230 tx=0x7f78fc005dd0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 shutdown_connections 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78f00a2ca0 0x7f78f00a5160 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c105140 0x7f790c1a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f790c102790 0x7f790c19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 --2- 172.21.15.18:0/2089438075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790c0ffe20 0x7f790c19deb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.614+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 >> 172.21.15.18:0/2089438075 conn(0x7f790c0fba20 msgr2=0x7f790c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.615+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 shutdown_connections 2024-04-21T22:31:37.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.615+0000 7f790be00640 1 -- 172.21.15.18:0/2089438075 wait complete. 2024-04-21T22:31:37.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:31:37.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 -- 172.21.15.18:0/55179870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 msgr2=0x7fec5c100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 --2- 172.21.15.18:0/55179870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c100390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009900 tx=0x7fec4c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 -- 172.21.15.18:0/55179870 shutdown_connections 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 --2- 172.21.15.18:0/55179870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 0x7fec5c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 --2- 172.21.15.18:0/55179870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 0x7fec5c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 --2- 172.21.15.18:0/55179870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c100390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 -- 172.21.15.18:0/55179870 >> 172.21.15.18:0/55179870 conn(0x7fec5c0fbb10 msgr2=0x7fec5c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 -- 172.21.15.18:0/55179870 shutdown_connections 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.842+0000 7fec5b200640 1 -- 172.21.15.18:0/55179870 wait complete. 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.843+0000 7fec5b200640 1 Processor -- start 2024-04-21T22:31:37.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.843+0000 7fec5b200640 1 -- start start 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.843+0000 7fec5b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.843+0000 7fec5b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 0x7fec5c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.843+0000 7fec5b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 0x7fec5c1a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec5b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c10f520 con 0x7fec5c101270 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec5b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c10f3a0 con 0x7fec5c0fff70 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec5b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c10f6a0 con 0x7fec5c1008d0 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec5a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 0x7fec5c1a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 0x7fec5c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49014/0 (socket says 172.21.15.18:49014) 2024-04-21T22:31:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 -- 172.21.15.18:0/2374596158 learned_addr learned my addr 172.21.15.18:0/2374596158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 -- 172.21.15.18:0/2374596158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 msgr2=0x7fec5c19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 0x7fec5c19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 -- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 msgr2=0x7fec5c1a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 0x7fec5c1a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.844+0000 7fec59e00640 1 -- 172.21.15.18:0/2374596158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c1a1750 con 0x7fec5c0fff70 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec59e00640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000c00 tx=0x7fec4c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c043020 con 0x7fec5c0fff70 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec4c0054e0 con 0x7fec5c0fff70 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c003d20 con 0x7fec5c0fff70 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c1a19e0 con 0x7fec5c0fff70 2024-04-21T22:31:37.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.845+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c1a1ee0 con 0x7fec5c0fff70 2024-04-21T22:31:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.846+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c10acc0 con 0x7fec5c0fff70 2024-04-21T22:31:37.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.848+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec4c046020 con 0x7fec5c0fff70 2024-04-21T22:31:37.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.849+0000 7fec52a00640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 0x7fec3c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:37.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.850+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fec4c0f10e0 con 0x7fec5c0fff70 2024-04-21T22:31:37.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.850+0000 7fec59400640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 0x7fec3c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:37.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.850+0000 7fec59400640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 0x7fec3c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec5c19b040 tx=0x7fec4400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:37.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:37.854+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fec4c04d020 con 0x7fec5c0fff70 2024-04-21T22:31:38.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.105+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec5c02d170 con 0x7fec5c0fff70 2024-04-21T22:31:38.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.107+0000 7fec52a00640 1 -- 172.21.15.18:0/2374596158 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7fec4c0be0a0 con 0x7fec5c0fff70 2024-04-21T22:31:38.107 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:31:38.107 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:31:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 msgr2=0x7fec3c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 0x7fec3c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec5c19b040 tx=0x7fec4400b390 comp rx=0 tx=0).stop 2024-04-21T22:31:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 msgr2=0x7fec5c199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec4c000c00 tx=0x7fec4c005dd0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 shutdown_connections 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec3c0a2c90 0x7fec3c0a5150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c101270 0x7fec5c1a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5c1008d0 0x7fec5c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 --2- 172.21.15.18:0/2374596158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c0fff70 0x7fec5c199b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.109+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 >> 172.21.15.18:0/2374596158 conn(0x7fec5c0fbb10 msgr2=0x7fec5c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.110+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 shutdown_connections 2024-04-21T22:31:38.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.110+0000 7fec5b200640 1 -- 172.21.15.18:0/2374596158 wait complete. 2024-04-21T22:31:38.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:31:38.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:37 smithi047 ceph-mon[31561]: from='client.24692 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:37 smithi047 ceph-mon[31561]: pgmap v325: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:37 smithi047 ceph-mon[31561]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:37 smithi047 ceph-mon[31561]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:37 smithi018 ceph-mon[26614]: from='client.24692 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:37 smithi018 ceph-mon[26614]: pgmap v325: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:37 smithi018 ceph-mon[26614]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.195 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:37 smithi018 ceph-mon[26614]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 -- 172.21.15.18:0/3141255934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077ce0 msgr2=0x7fd610078580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 --2- 172.21.15.18:0/3141255934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077ce0 0x7fd610078580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd608009900 tx=0x7fd60802bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 -- 172.21.15.18:0/3141255934 shutdown_connections 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 --2- 172.21.15.18:0/3141255934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077ce0 0x7fd610078580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 --2- 172.21.15.18:0/3141255934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610077340 0x7fd6100777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 --2- 172.21.15.18:0/3141255934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610076100 0x7fd610076520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 -- 172.21.15.18:0/3141255934 >> 172.21.15.18:0/3141255934 conn(0x7fd6100fef90 msgr2=0x7fd6101013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 -- 172.21.15.18:0/3141255934 shutdown_connections 2024-04-21T22:31:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.334+0000 7fd617a00640 1 -- 172.21.15.18:0/3141255934 wait complete. 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 Processor -- start 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 -- start start 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 0x7fd61019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610077ce0 0x7fd6101a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd610113a80 con 0x7fd610077340 2024-04-21T22:31:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd610113900 con 0x7fd610076100 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.335+0000 7fd617a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd610113c00 con 0x7fd610077ce0 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 0x7fd61019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd615000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd615000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49034/0 (socket says 172.21.15.18:49034) 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd615000640 1 -- 172.21.15.18:0/3282762736 learned_addr learned my addr 172.21.15.18:0/3282762736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd615a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610077ce0 0x7fd6101a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 -- 172.21.15.18:0/3282762736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610077ce0 msgr2=0x7fd6101a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610077ce0 0x7fd6101a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 -- 172.21.15.18:0/3282762736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 msgr2=0x7fd61019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd60fe00640 1 -- 172.21.15.18:0/3282762736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6101a5c20 con 0x7fd610077340 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.336+0000 7fd615000640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd60fe00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 0x7fd61019e540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8005fd0 tx=0x7fd5f800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8009c30 con 0x7fd610077340 2024-04-21T22:31:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5f8009dd0 con 0x7fd610077340 2024-04-21T22:31:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd617a00640 1 -- 172.21.15.18:0/3282762736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6101a5f10 con 0x7fd610077340 2024-04-21T22:31:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8010460 con 0x7fd610077340 2024-04-21T22:31:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.337+0000 7fd617a00640 1 -- 172.21.15.18:0/3282762736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6101a63d0 con 0x7fd610077340 2024-04-21T22:31:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.338+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd610062340 con 0x7fd610077340 2024-04-21T22:31:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.340+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5f8003f50 con 0x7fd610077340 2024-04-21T22:31:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.342+0000 7fd60d600640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 0x7fd5f40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.342+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fd5f80cebf0 con 0x7fd610077340 2024-04-21T22:31:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.342+0000 7fd615000640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 0x7fd5f40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.343+0000 7fd615000640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 0x7fd5f40a50e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e810 tx=0x7fd600009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.346+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd5f8017020 con 0x7fd610077340 2024-04-21T22:31:38.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:37 smithi081 ceph-mon[31692]: from='client.24692 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:37 smithi081 ceph-mon[31692]: pgmap v325: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-04-21T22:31:38.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:37 smithi081 ceph-mon[31692]: from='client.24698 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:38.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:37 smithi081 ceph-mon[31692]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-21T22:31:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.545+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd610062730 con 0x7fd610077340 2024-04-21T22:31:38.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.549+0000 7fd60d600640 1 -- 172.21.15.18:0/3282762736 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22112 (secure 0 0 0) 0x7fd5f809b450 con 0x7fd610077340 2024-04-21T22:31:38.550 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:38.550 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":85,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:31:30.502357+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 msgr2=0x7fd5f40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 0x7fd5f40a50e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd60000e810 tx=0x7fd600009500 comp rx=0 tx=0).stop 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 msgr2=0x7fd61019e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 0x7fd61019e540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8005fd0 tx=0x7fd5f800dde0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 shutdown_connections 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd5f40a2c20 0x7fd5f40a50e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd610077ce0 0x7fd6101a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd610077340 0x7fd61019e540 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 --2- 172.21.15.18:0/3282762736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd610076100 0x7fd61019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.552+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 >> 172.21.15.18:0/3282762736 conn(0x7fd6100fef90 msgr2=0x7fd610100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:38.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.553+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 shutdown_connections 2024-04-21T22:31:38.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.553+0000 7fd606a00640 1 -- 172.21.15.18:0/3282762736 wait complete. 2024-04-21T22:31:38.571 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-21T22:31:38.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:31:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 -- 172.21.15.18:0/860564716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0ffef0 msgr2=0x7f789c102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 --2- 172.21.15.18:0/860564716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0ffef0 0x7f789c102320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7890009900 tx=0x7f789002bc30 comp rx=0 tx=0).stop 2024-04-21T22:31:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 -- 172.21.15.18:0/860564716 shutdown_connections 2024-04-21T22:31:38.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 --2- 172.21.15.18:0/860564716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c105210 0x7f789c105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 --2- 172.21.15.18:0/860564716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 --2- 172.21.15.18:0/860564716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c0ffef0 0x7f789c102320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 -- 172.21.15.18:0/860564716 >> 172.21.15.18:0/860564716 conn(0x7f789c0fbb10 msgr2=0x7f789c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:38.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 -- 172.21.15.18:0/860564716 shutdown_connections 2024-04-21T22:31:38.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.779+0000 7f78a2e00640 1 -- 172.21.15.18:0/860564716 wait complete. 2024-04-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.780+0000 7f78a2e00640 1 Processor -- start 2024-04-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.780+0000 7f78a2e00640 1 -- start start 2024-04-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f789c113920 con 0x7f789c105210 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f789c1137a0 con 0x7f789c0ffef0 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f789c113aa0 con 0x7f789c102860 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49040/0 (socket says 172.21.15.18:49040) 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a1a00640 1 -- 172.21.15.18:0/362446786 learned_addr learned my addr 172.21.15.18:0/362446786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a1000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54964/0 (socket says 172.21.15.18:54964) 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.781+0000 7f78a2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57160/0 (socket says 172.21.15.18:57160) 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 -- 172.21.15.18:0/362446786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 msgr2=0x7f789c19df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 -- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 msgr2=0x7f789c1a5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:38.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 -- 172.21.15.18:0/362446786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c1a5b70 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1a00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a2400640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a1000640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f788800e9f0 tx=0x7f788800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788800cd80 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789c1a5e60 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78880035f0 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888010670 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.782+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f789c1a6320 con 0x7f789c102860 2024-04-21T22:31:38.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.784+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789c0fd600 con 0x7f789c102860 2024-04-21T22:31:38.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.786+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f78880037a0 con 0x7f789c102860 2024-04-21T22:31:38.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.788+0000 7f789a000640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 0x7f78840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.788+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f78880cf3d0 con 0x7f789c102860 2024-04-21T22:31:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.788+0000 7f78a1a00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 0x7f78840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:38.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.789+0000 7f78a1a00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 0x7f78840a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f789002c8e0 tx=0x7f789002df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.792+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f788809c280 con 0x7f789c102860 2024-04-21T22:31:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:38.996+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f789c061b80 con 0x7f78840a2c10 2024-04-21T22:31:39.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.023+0000 7f789a000640 1 -- 172.21.15.18:0/362446786 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258760 (secure 0 0 0) 0x7f789c061b80 con 0x7f78840a2c10 2024-04-21T22:31:39.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:31:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 msgr2=0x7f78840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 0x7f78840a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f789002c8e0 tx=0x7f789002df90 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 msgr2=0x7f789c19e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f788800e9f0 tx=0x7f788800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 shutdown_connections 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78840a2c10 0x7f78840a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f789c105210 0x7f789c1a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f789c102860 0x7f789c19e490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 --2- 172.21.15.18:0/362446786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f789c0ffef0 0x7f789c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.029+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 >> 172.21.15.18:0/362446786 conn(0x7f789c0fbb10 msgr2=0x7f789c1031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.030+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 shutdown_connections 2024-04-21T22:31:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.030+0000 7f78a2e00640 1 -- 172.21.15.18:0/362446786 wait complete. 2024-04-21T22:31:39.049 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-04-21T22:31:38.081370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":604518,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":370,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366144,"kb_used_data":12820,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575680,"statfs":{"total":1151940427776,"available":1151565496320,"internally_reserved":0,"allocated":13127680,"data_stored":7101436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14150,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":189,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.578869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829737+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:31:30.829737+0000","last_peered":"2024-04-21T22:31:30.829737+0000","last_clean":"2024-04-21T22:31:30.829737+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:31:30.829737+0000","last_undegraded":"2024-04-21T22:31:30.829737+0000","last_fullsized":"2024-04-21T22:31:30.829737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602947+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:31:31.602947+0000","last_peered":"2024-04-21T22:31:31.602947+0000","last_clean":"2024-04-21T22:31:31.602947+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:31:31.602947+0000","last_undegraded":"2024-04-21T22:31:31.602947+0000","last_fullsized":"2024-04-21T22:31:31.602947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603376+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:31:31.603376+0000","last_peered":"2024-04-21T22:31:31.603376+0000","last_clean":"2024-04-21T22:31:31.603376+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:31:31.603376+0000","last_undegraded":"2024-04-21T22:31:31.603376+0000","last_fullsized":"2024-04-21T22:31:31.603376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.560073+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:31:30.560073+0000","last_peered":"2024-04-21T22:31:30.560073+0000","last_clean":"2024-04-21T22:31:30.560073+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:31:30.560073+0000","last_undegraded":"2024-04-21T22:31:30.560073+0000","last_fullsized":"2024-04-21T22:31:30.560073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595368+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:31:31.595368+0000","last_peered":"2024-04-21T22:31:31.595368+0000","last_clean":"2024-04-21T22:31:31.595368+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:31:31.595368+0000","last_undegraded":"2024-04-21T22:31:31.595368+0000","last_fullsized":"2024-04-21T22:31:31.595368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596456+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:31:31.596456+0000","last_peered":"2024-04-21T22:31:31.596456+0000","last_clean":"2024-04-21T22:31:31.596456+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:31:31.596456+0000","last_undegraded":"2024-04-21T22:31:31.596456+0000","last_fullsized":"2024-04-21T22:31:31.596456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596373+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:31:31.596373+0000","last_peered":"2024-04-21T22:31:31.596373+0000","last_clean":"2024-04-21T22:31:31.596373+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:31:31.596373+0000","last_undegraded":"2024-04-21T22:31:31.596373+0000","last_fullsized":"2024-04-21T22:31:31.596373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602221+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:31:31.602221+0000","last_peered":"2024-04-21T22:31:31.602221+0000","last_clean":"2024-04-21T22:31:31.602221+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:31:31.602221+0000","last_undegraded":"2024-04-21T22:31:31.602221+0000","last_fullsized":"2024-04-21T22:31:31.602221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.512004+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:31:30.512004+0000","last_peered":"2024-04-21T22:31:30.512004+0000","last_clean":"2024-04-21T22:31:30.512004+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:31:30.512004+0000","last_undegraded":"2024-04-21T22:31:30.512004+0000","last_fullsized":"2024-04-21T22:31:30.512004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596848+0000","last_change":"2024-04-21T22:31:29.520436+0000","last_active":"2024-04-21T22:31:31.596848+0000","last_peered":"2024-04-21T22:31:31.596848+0000","last_clean":"2024-04-21T22:31:31.596848+0000","last_became_active":"2024-04-21T22:31:29.520048+0000","last_became_peered":"2024-04-21T22:31:29.520048+0000","last_unstale":"2024-04-21T22:31:31.596848+0000","last_undegraded":"2024-04-21T22:31:31.596848+0000","last_fullsized":"2024-04-21T22:31:31.596848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:38.807972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596945+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:31:31.596945+0000","last_peered":"2024-04-21T22:31:31.596945+0000","last_clean":"2024-04-21T22:31:31.596945+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:31:31.596945+0000","last_undegraded":"2024-04-21T22:31:31.596945+0000","last_fullsized":"2024-04-21T22:31:31.596945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.560084+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:31:30.560084+0000","last_peered":"2024-04-21T22:31:30.560084+0000","last_clean":"2024-04-21T22:31:30.560084+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:31:30.560084+0000","last_undegraded":"2024-04-21T22:31:30.560084+0000","last_fullsized":"2024-04-21T22:31:30.560084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603110+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:31:31.603110+0000","last_peered":"2024-04-21T22:31:31.603110+0000","last_clean":"2024-04-21T22:31:31.603110+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:31:31.603110+0000","last_undegraded":"2024-04-21T22:31:31.603110+0000","last_fullsized":"2024-04-21T22:31:31.603110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.604092+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:31:31.604092+0000","last_peered":"2024-04-21T22:31:31.604092+0000","last_clean":"2024-04-21T22:31:31.604092+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:31:31.604092+0000","last_undegraded":"2024-04-21T22:31:31.604092+0000","last_fullsized":"2024-04-21T22:31:31.604092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603615+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:31:31.603615+0000","last_peered":"2024-04-21T22:31:31.603615+0000","last_clean":"2024-04-21T22:31:31.603615+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:31:31.603615+0000","last_undegraded":"2024-04-21T22:31:31.603615+0000","last_fullsized":"2024-04-21T22:31:31.603615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511521+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:31:30.511521+0000","last_peered":"2024-04-21T22:31:30.511521+0000","last_clean":"2024-04-21T22:31:30.511521+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:31:30.511521+0000","last_undegraded":"2024-04-21T22:31:30.511521+0000","last_fullsized":"2024-04-21T22:31:30.511521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829773+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:31:30.829773+0000","last_peered":"2024-04-21T22:31:30.829773+0000","last_clean":"2024-04-21T22:31:30.829773+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:31:30.829773+0000","last_undegraded":"2024-04-21T22:31:30.829773+0000","last_fullsized":"2024-04-21T22:31:30.829773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602215+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:31:31.602215+0000","last_peered":"2024-04-21T22:31:31.602215+0000","last_clean":"2024-04-21T22:31:31.602215+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:31:31.602215+0000","last_undegraded":"2024-04-21T22:31:31.602215+0000","last_fullsized":"2024-04-21T22:31:31.602215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.885151+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:31:30.885151+0000","last_peered":"2024-04-21T22:31:30.885151+0000","last_clean":"2024-04-21T22:31:30.885151+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:31:30.885151+0000","last_undegraded":"2024-04-21T22:31:30.885151+0000","last_fullsized":"2024-04-21T22:31:30.885151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.541767+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:31:36.541767+0000","last_peered":"2024-04-21T22:31:36.541767+0000","last_clean":"2024-04-21T22:31:36.541767+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:31:36.541767+0000","last_undegraded":"2024-04-21T22:31:36.541767+0000","last_fullsized":"2024-04-21T22:31:36.541767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601678+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:31:31.601678+0000","last_peered":"2024-04-21T22:31:31.601678+0000","last_clean":"2024-04-21T22:31:31.601678+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:31:31.601678+0000","last_undegraded":"2024-04-21T22:31:31.601678+0000","last_fullsized":"2024-04-21T22:31:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601663+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:31:31.601663+0000","last_peered":"2024-04-21T22:31:31.601663+0000","last_clean":"2024-04-21T22:31:31.601663+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:31:31.601663+0000","last_undegraded":"2024-04-21T22:31:31.601663+0000","last_fullsized":"2024-04-21T22:31:31.601663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.604171+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:31:31.604171+0000","last_peered":"2024-04-21T22:31:31.604171+0000","last_clean":"2024-04-21T22:31:31.604171+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:31:31.604171+0000","last_undegraded":"2024-04-21T22:31:31.604171+0000","last_fullsized":"2024-04-21T22:31:31.604171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.533922+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:31:36.533922+0000","last_peered":"2024-04-21T22:31:36.533922+0000","last_clean":"2024-04-21T22:31:36.533922+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:31:36.533922+0000","last_undegraded":"2024-04-21T22:31:36.533922+0000","last_fullsized":"2024-04-21T22:31:36.533922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511961+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:31:30.511961+0000","last_peered":"2024-04-21T22:31:30.511961+0000","last_clean":"2024-04-21T22:31:30.511961+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:31:30.511961+0000","last_undegraded":"2024-04-21T22:31:30.511961+0000","last_fullsized":"2024-04-21T22:31:30.511961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.537592+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:31:35.537592+0000","last_peered":"2024-04-21T22:31:35.537592+0000","last_clean":"2024-04-21T22:31:35.537592+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:31:35.537592+0000","last_undegraded":"2024-04-21T22:31:35.537592+0000","last_fullsized":"2024-04-21T22:31:35.537592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511390+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:31:30.511390+0000","last_peered":"2024-04-21T22:31:30.511390+0000","last_clean":"2024-04-21T22:31:30.511390+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:31:30.511390+0000","last_undegraded":"2024-04-21T22:31:30.511390+0000","last_fullsized":"2024-04-21T22:31:30.511390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.498776+0000","last_change":"2024-04-21T22:31:28.496784+0000","last_active":"2024-04-21T22:31:36.498776+0000","last_peered":"2024-04-21T22:31:36.498776+0000","last_clean":"2024-04-21T22:31:36.498776+0000","last_became_active":"2024-04-21T22:31:28.496430+0000","last_became_peered":"2024-04-21T22:31:28.496430+0000","last_unstale":"2024-04-21T22:31:36.498776+0000","last_undegraded":"2024-04-21T22:31:36.498776+0000","last_fullsized":"2024-04-21T22:31:36.498776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:47:00.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595366+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:31:31.595366+0000","last_peered":"2024-04-21T22:31:31.595366+0000","last_clean":"2024-04-21T22:31:31.595366+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:31:31.595366+0000","last_undegraded":"2024-04-21T22:31:31.595366+0000","last_fullsized":"2024-04-21T22:31:31.595366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.518771+0000","last_change":"2024-04-21T22:31:28.502194+0000","last_active":"2024-04-21T22:31:34.518771+0000","last_peered":"2024-04-21T22:31:34.518771+0000","last_clean":"2024-04-21T22:31:34.518771+0000","last_became_active":"2024-04-21T22:31:28.501725+0000","last_became_peered":"2024-04-21T22:31:28.501725+0000","last_unstale":"2024-04-21T22:31:34.518771+0000","last_undegraded":"2024-04-21T22:31:34.518771+0000","last_fullsized":"2024-04-21T22:31:34.518771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:48:44.657909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511181+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:31:30.511181+0000","last_peered":"2024-04-21T22:31:30.511181+0000","last_clean":"2024-04-21T22:31:30.511181+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:31:30.511181+0000","last_undegraded":"2024-04-21T22:31:30.511181+0000","last_fullsized":"2024-04-21T22:31:30.511181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.511974+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:31:33.511974+0000","last_peered":"2024-04-21T22:31:33.511974+0000","last_clean":"2024-04-21T22:31:33.511974+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:31:33.511974+0000","last_undegraded":"2024-04-21T22:31:33.511974+0000","last_fullsized":"2024-04-21T22:31:33.511974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601913+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:31:31.601913+0000","last_peered":"2024-04-21T22:31:31.601913+0000","last_clean":"2024-04-21T22:31:31.601913+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:31:31.601913+0000","last_undegraded":"2024-04-21T22:31:31.601913+0000","last_fullsized":"2024-04-21T22:31:31.601913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.538803+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:31:35.538803+0000","last_peered":"2024-04-21T22:31:35.538803+0000","last_clean":"2024-04-21T22:31:35.538803+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:31:35.538803+0000","last_undegraded":"2024-04-21T22:31:35.538803+0000","last_fullsized":"2024-04-21T22:31:35.538803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.599594+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:31:31.599594+0000","last_peered":"2024-04-21T22:31:31.599594+0000","last_clean":"2024-04-21T22:31:31.599594+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:31:31.599594+0000","last_undegraded":"2024-04-21T22:31:31.599594+0000","last_fullsized":"2024-04-21T22:31:31.599594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.519663+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:31:34.519663+0000","last_peered":"2024-04-21T22:31:34.519663+0000","last_clean":"2024-04-21T22:31:34.519663+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:31:34.519663+0000","last_undegraded":"2024-04-21T22:31:34.519663+0000","last_fullsized":"2024-04-21T22:31:34.519663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511959+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:31:30.511959+0000","last_peered":"2024-04-21T22:31:30.511959+0000","last_clean":"2024-04-21T22:31:30.511959+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:31:30.511959+0000","last_undegraded":"2024-04-21T22:31:30.511959+0000","last_fullsized":"2024-04-21T22:31:30.511959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.899627+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:31:32.899627+0000","last_peered":"2024-04-21T22:31:32.899627+0000","last_clean":"2024-04-21T22:31:32.899627+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:31:32.899627+0000","last_undegraded":"2024-04-21T22:31:32.899627+0000","last_fullsized":"2024-04-21T22:31:32.899627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603781+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:31:31.603781+0000","last_peered":"2024-04-21T22:31:31.603781+0000","last_clean":"2024-04-21T22:31:31.603781+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:31:31.603781+0000","last_undegraded":"2024-04-21T22:31:31.603781+0000","last_fullsized":"2024-04-21T22:31:31.603781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.494072+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:31:33.494072+0000","last_peered":"2024-04-21T22:31:33.494072+0000","last_clean":"2024-04-21T22:31:33.494072+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:31:33.494072+0000","last_undegraded":"2024-04-21T22:31:33.494072+0000","last_fullsized":"2024-04-21T22:31:33.494072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511865+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:31:30.511865+0000","last_peered":"2024-04-21T22:31:30.511865+0000","last_clean":"2024-04-21T22:31:30.511865+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:31:30.511865+0000","last_undegraded":"2024-04-21T22:31:30.511865+0000","last_fullsized":"2024-04-21T22:31:30.511865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'13","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.538497+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:31:35.538497+0000","last_peered":"2024-04-21T22:31:35.538497+0000","last_clean":"2024-04-21T22:31:35.538497+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:31:35.538497+0000","last_undegraded":"2024-04-21T22:31:35.538497+0000","last_fullsized":"2024-04-21T22:31:35.538497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595619+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:31:31.595619+0000","last_peered":"2024-04-21T22:31:31.595619+0000","last_clean":"2024-04-21T22:31:31.595619+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:31:31.595619+0000","last_undegraded":"2024-04-21T22:31:31.595619+0000","last_fullsized":"2024-04-21T22:31:31.595619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.539496+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:31:35.539496+0000","last_peered":"2024-04-21T22:31:35.539496+0000","last_clean":"2024-04-21T22:31:35.539496+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:31:35.539496+0000","last_undegraded":"2024-04-21T22:31:35.539496+0000","last_fullsized":"2024-04-21T22:31:35.539496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601717+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:31:31.601717+0000","last_peered":"2024-04-21T22:31:31.601717+0000","last_clean":"2024-04-21T22:31:31.601717+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:31:31.601717+0000","last_undegraded":"2024-04-21T22:31:31.601717+0000","last_fullsized":"2024-04-21T22:31:31.601717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.543170+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:31:35.543170+0000","last_peered":"2024-04-21T22:31:35.543170+0000","last_clean":"2024-04-21T22:31:35.543170+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:31:35.543170+0000","last_undegraded":"2024-04-21T22:31:35.543170+0000","last_fullsized":"2024-04-21T22:31:35.543170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597227+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:31:31.597227+0000","last_peered":"2024-04-21T22:31:31.597227+0000","last_clean":"2024-04-21T22:31:31.597227+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:31:31.597227+0000","last_undegraded":"2024-04-21T22:31:31.597227+0000","last_fullsized":"2024-04-21T22:31:31.597227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.559586+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:31:30.559586+0000","last_peered":"2024-04-21T22:31:30.559586+0000","last_clean":"2024-04-21T22:31:30.559586+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:31:30.559586+0000","last_undegraded":"2024-04-21T22:31:30.559586+0000","last_fullsized":"2024-04-21T22:31:30.559586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596209+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:31:31.596209+0000","last_peered":"2024-04-21T22:31:31.596209+0000","last_clean":"2024-04-21T22:31:31.596209+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:31:31.596209+0000","last_undegraded":"2024-04-21T22:31:31.596209+0000","last_fullsized":"2024-04-21T22:31:31.596209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.535909+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:31:35.535909+0000","last_peered":"2024-04-21T22:31:35.535909+0000","last_clean":"2024-04-21T22:31:35.535909+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:31:35.535909+0000","last_undegraded":"2024-04-21T22:31:35.535909+0000","last_fullsized":"2024-04-21T22:31:35.535909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510853+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:31:30.510853+0000","last_peered":"2024-04-21T22:31:30.510853+0000","last_clean":"2024-04-21T22:31:30.510853+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:31:30.510853+0000","last_undegraded":"2024-04-21T22:31:30.510853+0000","last_fullsized":"2024-04-21T22:31:30.510853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.491311+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:31:33.491311+0000","last_peered":"2024-04-21T22:31:33.491311+0000","last_clean":"2024-04-21T22:31:33.491311+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:31:33.491311+0000","last_undegraded":"2024-04-21T22:31:33.491311+0000","last_fullsized":"2024-04-21T22:31:33.491311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829611+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:31:30.829611+0000","last_peered":"2024-04-21T22:31:30.829611+0000","last_clean":"2024-04-21T22:31:30.829611+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:31:30.829611+0000","last_undegraded":"2024-04-21T22:31:30.829611+0000","last_fullsized":"2024-04-21T22:31:30.829611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600608+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:31:31.600608+0000","last_peered":"2024-04-21T22:31:31.600608+0000","last_clean":"2024-04-21T22:31:31.600608+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:31:31.600608+0000","last_undegraded":"2024-04-21T22:31:31.600608+0000","last_fullsized":"2024-04-21T22:31:31.600608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597125+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:31:31.597125+0000","last_peered":"2024-04-21T22:31:31.597125+0000","last_clean":"2024-04-21T22:31:31.597125+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:31:31.597125+0000","last_undegraded":"2024-04-21T22:31:31.597125+0000","last_fullsized":"2024-04-21T22:31:31.597125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596621+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:31:31.596621+0000","last_peered":"2024-04-21T22:31:31.596621+0000","last_clean":"2024-04-21T22:31:31.596621+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:31:31.596621+0000","last_undegraded":"2024-04-21T22:31:31.596621+0000","last_fullsized":"2024-04-21T22:31:31.596621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596569+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:31:31.596569+0000","last_peered":"2024-04-21T22:31:31.596569+0000","last_clean":"2024-04-21T22:31:31.596569+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:31:31.596569+0000","last_undegraded":"2024-04-21T22:31:31.596569+0000","last_fullsized":"2024-04-21T22:31:31.596569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510868+0000","last_change":"2024-04-21T22:31:29.526648+0000","last_active":"2024-04-21T22:31:30.510868+0000","last_peered":"2024-04-21T22:31:30.510868+0000","last_clean":"2024-04-21T22:31:30.510868+0000","last_became_active":"2024-04-21T22:31:29.526333+0000","last_became_peered":"2024-04-21T22:31:29.526333+0000","last_unstale":"2024-04-21T22:31:30.510868+0000","last_undegraded":"2024-04-21T22:31:30.510868+0000","last_fullsized":"2024-04-21T22:31:30.510868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.281421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.540554+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:31:36.540554+0000","last_peered":"2024-04-21T22:31:36.540554+0000","last_clean":"2024-04-21T22:31:36.540554+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:31:36.540554+0000","last_undegraded":"2024-04-21T22:31:36.540554+0000","last_fullsized":"2024-04-21T22:31:36.540554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600481+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:31:31.600481+0000","last_peered":"2024-04-21T22:31:31.600481+0000","last_clean":"2024-04-21T22:31:31.600481+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:31:31.600481+0000","last_undegraded":"2024-04-21T22:31:31.600481+0000","last_fullsized":"2024-04-21T22:31:31.600481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.900915+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:31:32.900915+0000","last_peered":"2024-04-21T22:31:32.900915+0000","last_clean":"2024-04-21T22:31:32.900915+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:31:32.900915+0000","last_undegraded":"2024-04-21T22:31:32.900915+0000","last_fullsized":"2024-04-21T22:31:32.900915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596276+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:31:31.596276+0000","last_peered":"2024-04-21T22:31:31.596276+0000","last_clean":"2024-04-21T22:31:31.596276+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:31:31.596276+0000","last_undegraded":"2024-04-21T22:31:31.596276+0000","last_fullsized":"2024-04-21T22:31:31.596276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600354+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:31:31.600354+0000","last_peered":"2024-04-21T22:31:31.600354+0000","last_clean":"2024-04-21T22:31:31.600354+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:31:31.600354+0000","last_undegraded":"2024-04-21T22:31:31.600354+0000","last_fullsized":"2024-04-21T22:31:31.600354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596568+0000","last_change":"2024-04-21T22:31:28.500915+0000","last_active":"2024-04-21T22:31:31.596568+0000","last_peered":"2024-04-21T22:31:31.596568+0000","last_clean":"2024-04-21T22:31:31.596568+0000","last_became_active":"2024-04-21T22:31:28.500612+0000","last_became_peered":"2024-04-21T22:31:28.500612+0000","last_unstale":"2024-04-21T22:31:31.596568+0000","last_undegraded":"2024-04-21T22:31:31.596568+0000","last_fullsized":"2024-04-21T22:31:31.596568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:33.479230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.517698+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:31:34.517698+0000","last_peered":"2024-04-21T22:31:34.517698+0000","last_clean":"2024-04-21T22:31:34.517698+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:31:34.517698+0000","last_undegraded":"2024-04-21T22:31:34.517698+0000","last_fullsized":"2024-04-21T22:31:34.517698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602617+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:31:31.602617+0000","last_peered":"2024-04-21T22:31:31.602617+0000","last_clean":"2024-04-21T22:31:31.602617+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:31:31.602617+0000","last_undegraded":"2024-04-21T22:31:31.602617+0000","last_fullsized":"2024-04-21T22:31:31.602617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.858411+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:31:36.858411+0000","last_peered":"2024-04-21T22:31:36.858411+0000","last_clean":"2024-04-21T22:31:36.858411+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:31:36.858411+0000","last_undegraded":"2024-04-21T22:31:36.858411+0000","last_fullsized":"2024-04-21T22:31:36.858411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600182+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:31:31.600182+0000","last_peered":"2024-04-21T22:31:31.600182+0000","last_clean":"2024-04-21T22:31:31.600182+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:31:31.600182+0000","last_undegraded":"2024-04-21T22:31:31.600182+0000","last_fullsized":"2024-04-21T22:31:31.600182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.900408+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:31:32.900408+0000","last_peered":"2024-04-21T22:31:32.900408+0000","last_clean":"2024-04-21T22:31:32.900408+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:31:32.900408+0000","last_undegraded":"2024-04-21T22:31:32.900408+0000","last_fullsized":"2024-04-21T22:31:32.900408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603380+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:31:31.603380+0000","last_peered":"2024-04-21T22:31:31.603380+0000","last_clean":"2024-04-21T22:31:31.603380+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:31:31.603380+0000","last_undegraded":"2024-04-21T22:31:31.603380+0000","last_fullsized":"2024-04-21T22:31:31.603380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.901418+0000","last_change":"2024-04-21T22:31:28.499758+0000","last_active":"2024-04-21T22:31:32.901418+0000","last_peered":"2024-04-21T22:31:32.901418+0000","last_clean":"2024-04-21T22:31:32.901418+0000","last_became_active":"2024-04-21T22:31:28.499277+0000","last_became_peered":"2024-04-21T22:31:28.499277+0000","last_unstale":"2024-04-21T22:31:32.901418+0000","last_undegraded":"2024-04-21T22:31:32.901418+0000","last_fullsized":"2024-04-21T22:31:32.901418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:03:17.815711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595322+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:31:31.595322+0000","last_peered":"2024-04-21T22:31:31.595322+0000","last_clean":"2024-04-21T22:31:31.595322+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:31:31.595322+0000","last_undegraded":"2024-04-21T22:31:31.595322+0000","last_fullsized":"2024-04-21T22:31:31.595322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.522957+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:31:34.522957+0000","last_peered":"2024-04-21T22:31:34.522957+0000","last_clean":"2024-04-21T22:31:34.522957+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:31:34.522957+0000","last_undegraded":"2024-04-21T22:31:34.522957+0000","last_fullsized":"2024-04-21T22:31:34.522957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829437+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:31:30.829437+0000","last_peered":"2024-04-21T22:31:30.829437+0000","last_clean":"2024-04-21T22:31:30.829437+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:31:30.829437+0000","last_undegraded":"2024-04-21T22:31:30.829437+0000","last_fullsized":"2024-04-21T22:31:30.829437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.520014+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:31:34.520014+0000","last_peered":"2024-04-21T22:31:34.520014+0000","last_clean":"2024-04-21T22:31:34.520014+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:31:34.520014+0000","last_undegraded":"2024-04-21T22:31:34.520014+0000","last_fullsized":"2024-04-21T22:31:34.520014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600890+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:31:31.600890+0000","last_peered":"2024-04-21T22:31:31.600890+0000","last_clean":"2024-04-21T22:31:31.600890+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:31:31.600890+0000","last_undegraded":"2024-04-21T22:31:31.600890+0000","last_fullsized":"2024-04-21T22:31:31.600890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.899721+0000","last_change":"2024-04-21T22:31:28.503459+0000","last_active":"2024-04-21T22:31:32.899721+0000","last_peered":"2024-04-21T22:31:32.899721+0000","last_clean":"2024-04-21T22:31:32.899721+0000","last_became_active":"2024-04-21T22:31:28.502703+0000","last_became_peered":"2024-04-21T22:31:28.502703+0000","last_unstale":"2024-04-21T22:31:32.899721+0000","last_undegraded":"2024-04-21T22:31:32.899721+0000","last_fullsized":"2024-04-21T22:31:32.899721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:13.579668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596948+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:31:31.596948+0000","last_peered":"2024-04-21T22:31:31.596948+0000","last_clean":"2024-04-21T22:31:31.596948+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:31:31.596948+0000","last_undegraded":"2024-04-21T22:31:31.596948+0000","last_fullsized":"2024-04-21T22:31:31.596948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.539114+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:31:36.539114+0000","last_peered":"2024-04-21T22:31:36.539114+0000","last_clean":"2024-04-21T22:31:36.539114+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:31:36.539114+0000","last_undegraded":"2024-04-21T22:31:36.539114+0000","last_fullsized":"2024-04-21T22:31:36.539114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597233+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:31:31.597233+0000","last_peered":"2024-04-21T22:31:31.597233+0000","last_clean":"2024-04-21T22:31:31.597233+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:31:31.597233+0000","last_undegraded":"2024-04-21T22:31:31.597233+0000","last_fullsized":"2024-04-21T22:31:31.597233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.520951+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:31:34.520951+0000","last_peered":"2024-04-21T22:31:34.520951+0000","last_clean":"2024-04-21T22:31:34.520951+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:31:34.520951+0000","last_undegraded":"2024-04-21T22:31:34.520951+0000","last_fullsized":"2024-04-21T22:31:34.520951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596454+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:31:31.596454+0000","last_peered":"2024-04-21T22:31:31.596454+0000","last_clean":"2024-04-21T22:31:31.596454+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:31:31.596454+0000","last_undegraded":"2024-04-21T22:31:31.596454+0000","last_fullsized":"2024-04-21T22:31:31.596454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.541205+0000","last_change":"2024-04-21T22:31:28.514802+0000","last_active":"2024-04-21T22:31:35.541205+0000","last_peered":"2024-04-21T22:31:35.541205+0000","last_clean":"2024-04-21T22:31:35.541205+0000","last_became_active":"2024-04-21T22:31:28.514210+0000","last_became_peered":"2024-04-21T22:31:28.514210+0000","last_unstale":"2024-04-21T22:31:35.541205+0000","last_undegraded":"2024-04-21T22:31:35.541205+0000","last_fullsized":"2024-04-21T22:31:35.541205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:46:29.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597162+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:31:31.597162+0000","last_peered":"2024-04-21T22:31:31.597162+0000","last_clean":"2024-04-21T22:31:31.597162+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:31:31.597162+0000","last_undegraded":"2024-04-21T22:31:31.597162+0000","last_fullsized":"2024-04-21T22:31:31.597162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829511+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:31:30.829511+0000","last_peered":"2024-04-21T22:31:30.829511+0000","last_clean":"2024-04-21T22:31:30.829511+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:31:30.829511+0000","last_undegraded":"2024-04-21T22:31:30.829511+0000","last_fullsized":"2024-04-21T22:31:30.829511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.884966+0000","last_change":"2024-04-21T22:31:29.529192+0000","last_active":"2024-04-21T22:31:30.884966+0000","last_peered":"2024-04-21T22:31:30.884966+0000","last_clean":"2024-04-21T22:31:30.884966+0000","last_became_active":"2024-04-21T22:31:29.528845+0000","last_became_peered":"2024-04-21T22:31:29.528845+0000","last_unstale":"2024-04-21T22:31:30.884966+0000","last_undegraded":"2024-04-21T22:31:30.884966+0000","last_fullsized":"2024-04-21T22:31:30.884966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:13.005408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.884918+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:31:30.884918+0000","last_peered":"2024-04-21T22:31:30.884918+0000","last_clean":"2024-04-21T22:31:30.884918+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:31:30.884918+0000","last_undegraded":"2024-04-21T22:31:30.884918+0000","last_fullsized":"2024-04-21T22:31:30.884918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603684+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:31:31.603684+0000","last_peered":"2024-04-21T22:31:31.603684+0000","last_clean":"2024-04-21T22:31:31.603684+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:31:31.603684+0000","last_undegraded":"2024-04-21T22:31:31.603684+0000","last_fullsized":"2024-04-21T22:31:31.603684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603052+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:31:31.603052+0000","last_peered":"2024-04-21T22:31:31.603052+0000","last_clean":"2024-04-21T22:31:31.603052+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:31:31.603052+0000","last_undegraded":"2024-04-21T22:31:31.603052+0000","last_fullsized":"2024-04-21T22:31:31.603052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829644+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:31:30.829644+0000","last_peered":"2024-04-21T22:31:30.829644+0000","last_clean":"2024-04-21T22:31:30.829644+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:31:30.829644+0000","last_undegraded":"2024-04-21T22:31:30.829644+0000","last_fullsized":"2024-04-21T22:31:30.829644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.885324+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:31:30.885324+0000","last_peered":"2024-04-21T22:31:30.885324+0000","last_clean":"2024-04-21T22:31:30.885324+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:31:30.885324+0000","last_undegraded":"2024-04-21T22:31:30.885324+0000","last_fullsized":"2024-04-21T22:31:30.885324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.599851+0000","last_change":"2024-04-21T22:31:29.534619+0000","last_active":"2024-04-21T22:31:31.599851+0000","last_peered":"2024-04-21T22:31:31.599851+0000","last_clean":"2024-04-21T22:31:31.599851+0000","last_became_active":"2024-04-21T22:31:29.533795+0000","last_became_peered":"2024-04-21T22:31:29.533795+0000","last_unstale":"2024-04-21T22:31:31.599851+0000","last_undegraded":"2024-04-21T22:31:31.599851+0000","last_fullsized":"2024-04-21T22:31:31.599851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:13.611422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510838+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:31:30.510838+0000","last_peered":"2024-04-21T22:31:30.510838+0000","last_clean":"2024-04-21T22:31:30.510838+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:31:30.510838+0000","last_undegraded":"2024-04-21T22:31:30.510838+0000","last_fullsized":"2024-04-21T22:31:30.510838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600905+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:31:31.600905+0000","last_peered":"2024-04-21T22:31:31.600905+0000","last_clean":"2024-04-21T22:31:31.600905+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:31:31.600905+0000","last_undegraded":"2024-04-21T22:31:31.600905+0000","last_fullsized":"2024-04-21T22:31:31.600905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511876+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:31:30.511876+0000","last_peered":"2024-04-21T22:31:30.511876+0000","last_clean":"2024-04-21T22:31:30.511876+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:31:30.511876+0000","last_undegraded":"2024-04-21T22:31:30.511876+0000","last_fullsized":"2024-04-21T22:31:30.511876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602645+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:31:31.602645+0000","last_peered":"2024-04-21T22:31:31.602645+0000","last_clean":"2024-04-21T22:31:31.602645+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:31:31.602645+0000","last_undegraded":"2024-04-21T22:31:31.602645+0000","last_fullsized":"2024-04-21T22:31:31.602645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829501+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:31:30.829501+0000","last_peered":"2024-04-21T22:31:30.829501+0000","last_clean":"2024-04-21T22:31:30.829501+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:31:30.829501+0000","last_undegraded":"2024-04-21T22:31:30.829501+0000","last_fullsized":"2024-04-21T22:31:30.829501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":14150,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":189,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":106442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708284,"statfs":{"total":95995035648,"available":95957282816,"internally_reserved":0,"allocated":1568768,"data_stored":1039228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":439643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":440021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1511424,"data_stored":1029471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495661,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":439360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":461168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":441090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":462170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":438929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757299,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1552384,"data_stored":1032100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":41380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:31:39.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:31:39.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:38 smithi018 ceph-mon[26614]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:38 smithi018 ceph-mon[26614]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:38 smithi018 ceph-mon[26614]: pgmap v326: 97 pgs: 97 active+clean; 590 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-04-21T22:31:39.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:38 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2374596158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.164 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:38 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3282762736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:38 smithi047 ceph-mon[31561]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:38 smithi047 ceph-mon[31561]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:38 smithi047 ceph-mon[31561]: pgmap v326: 97 pgs: 97 active+clean; 590 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-04-21T22:31:39.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:38 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2374596158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:38 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3282762736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.302+0000 7ff753e00640 1 -- 172.21.15.18:0/1505826794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754102860 msgr2=0x7ff754102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.302+0000 7ff753e00640 1 --2- 172.21.15.18:0/1505826794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754102860 0x7ff754102ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009900 tx=0x7ff73c02bc40 comp rx=0 tx=0).stop 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.302+0000 7ff753e00640 1 -- 172.21.15.18:0/1505826794 shutdown_connections 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 --2- 172.21.15.18:0/1505826794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754103220 0x7ff754109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 --2- 172.21.15.18:0/1505826794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754102860 0x7ff754102ce0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 --2- 172.21.15.18:0/1505826794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 0x7ff754101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 -- 172.21.15.18:0/1505826794 >> 172.21.15.18:0/1505826794 conn(0x7ff7540fcc00 msgr2=0x7ff7540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 -- 172.21.15.18:0/1505826794 shutdown_connections 2024-04-21T22:31:39.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.303+0000 7ff753e00640 1 -- 172.21.15.18:0/1505826794 wait complete. 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 Processor -- start 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 -- start start 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 0x7ff754199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 0x7ff75419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff75410d300 con 0x7ff754103220 2024-04-21T22:31:39.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff75410d180 con 0x7ff754101670 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff75410d480 con 0x7ff754102860 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57170/0 (socket says 172.21.15.18:57170) 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.304+0000 7ff753400640 1 -- 172.21.15.18:0/2827488640 learned_addr learned my addr 172.21.15.18:0/2827488640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff74be00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 0x7ff75419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff752a00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 0x7ff754199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 -- 172.21.15.18:0/2827488640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 msgr2=0x7ff75419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 0x7ff75419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 -- 172.21.15.18:0/2827488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 msgr2=0x7ff754199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 0x7ff754199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 -- 172.21.15.18:0/2827488640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7541a17a0 con 0x7ff754103220 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff74be00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 0x7ff75419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753400640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00eb10 tx=0x7ff74c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:39.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c004b20 con 0x7ff754103220 2024-04-21T22:31:39.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7541a1a90 con 0x7ff754103220 2024-04-21T22:31:39.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.305+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff74c004cc0 con 0x7ff754103220 2024-04-21T22:31:39.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.306+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c010760 con 0x7ff754103220 2024-04-21T22:31:39.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.306+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7541a1fb0 con 0x7ff754103220 2024-04-21T22:31:39.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.307+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7541a22a0 con 0x7ff754103220 2024-04-21T22:31:39.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.309+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff74c005020 con 0x7ff754103220 2024-04-21T22:31:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.310+0000 7ff74b400640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 0x7ff7380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.310+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7ff74c0cf870 con 0x7ff754103220 2024-04-21T22:31:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.310+0000 7ff752a00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 0x7ff7380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:39.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.311+0000 7ff752a00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 0x7ff7380a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7541026c0 tx=0x7ff744005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:39.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.315+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff74c09c720 con 0x7ff754103220 2024-04-21T22:31:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:38 smithi081 ceph-mon[31692]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:38 smithi081 ceph-mon[31692]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:31:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:38 smithi081 ceph-mon[31692]: pgmap v326: 97 pgs: 97 active+clean; 590 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8.2 KiB/s wr, 26 op/s 2024-04-21T22:31:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:38 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2374596158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:38 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3282762736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:39.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.513+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7541a2470 con 0x7ff7380a2c10 2024-04-21T22:31:39.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.523+0000 7ff74b400640 1 -- 172.21.15.18:0/2827488640 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258760 (secure 0 0 0) 0x7ff7541a2470 con 0x7ff7380a2c10 2024-04-21T22:31:39.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:39.528 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 msgr2=0x7ff7380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 0x7ff7380a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7541026c0 tx=0x7ff744005f90 comp rx=0 tx=0).stop 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 msgr2=0x7ff7541a1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00eb10 tx=0x7ff74c00c2d0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 shutdown_connections 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff7380a2c10 0x7ff7380a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff754103220 0x7ff7541a1130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff754102860 0x7ff75419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 --2- 172.21.15.18:0/2827488640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff754101670 0x7ff754199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:39.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.528+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 >> 172.21.15.18:0/2827488640 conn(0x7ff7540fcc00 msgr2=0x7ff754073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:39.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.529+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 shutdown_connections 2024-04-21T22:31:39.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:39.529+0000 7ff753e00640 1 -- 172.21.15.18:0/2827488640 wait complete. 2024-04-21T22:31:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-04-21T22:31:38.081370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":604518,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":178,"num_read_kb":153,"num_write":370,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366144,"kb_used_data":12820,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575680,"statfs":{"total":1151940427776,"available":1151565496320,"internally_reserved":0,"allocated":13127680,"data_stored":7101436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14150,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":189,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.578869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829737+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:31:30.829737+0000","last_peered":"2024-04-21T22:31:30.829737+0000","last_clean":"2024-04-21T22:31:30.829737+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:31:30.829737+0000","last_undegraded":"2024-04-21T22:31:30.829737+0000","last_fullsized":"2024-04-21T22:31:30.829737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602947+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:31:31.602947+0000","last_peered":"2024-04-21T22:31:31.602947+0000","last_clean":"2024-04-21T22:31:31.602947+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:31:31.602947+0000","last_undegraded":"2024-04-21T22:31:31.602947+0000","last_fullsized":"2024-04-21T22:31:31.602947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603376+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:31:31.603376+0000","last_peered":"2024-04-21T22:31:31.603376+0000","last_clean":"2024-04-21T22:31:31.603376+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:31:31.603376+0000","last_undegraded":"2024-04-21T22:31:31.603376+0000","last_fullsized":"2024-04-21T22:31:31.603376+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.560073+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:31:30.560073+0000","last_peered":"2024-04-21T22:31:30.560073+0000","last_clean":"2024-04-21T22:31:30.560073+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:31:30.560073+0000","last_undegraded":"2024-04-21T22:31:30.560073+0000","last_fullsized":"2024-04-21T22:31:30.560073+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595368+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:31:31.595368+0000","last_peered":"2024-04-21T22:31:31.595368+0000","last_clean":"2024-04-21T22:31:31.595368+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:31:31.595368+0000","last_undegraded":"2024-04-21T22:31:31.595368+0000","last_fullsized":"2024-04-21T22:31:31.595368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596456+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:31:31.596456+0000","last_peered":"2024-04-21T22:31:31.596456+0000","last_clean":"2024-04-21T22:31:31.596456+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:31:31.596456+0000","last_undegraded":"2024-04-21T22:31:31.596456+0000","last_fullsized":"2024-04-21T22:31:31.596456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596373+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:31:31.596373+0000","last_peered":"2024-04-21T22:31:31.596373+0000","last_clean":"2024-04-21T22:31:31.596373+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:31:31.596373+0000","last_undegraded":"2024-04-21T22:31:31.596373+0000","last_fullsized":"2024-04-21T22:31:31.596373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602221+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:31:31.602221+0000","last_peered":"2024-04-21T22:31:31.602221+0000","last_clean":"2024-04-21T22:31:31.602221+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:31:31.602221+0000","last_undegraded":"2024-04-21T22:31:31.602221+0000","last_fullsized":"2024-04-21T22:31:31.602221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.512004+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:31:30.512004+0000","last_peered":"2024-04-21T22:31:30.512004+0000","last_clean":"2024-04-21T22:31:30.512004+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:31:30.512004+0000","last_undegraded":"2024-04-21T22:31:30.512004+0000","last_fullsized":"2024-04-21T22:31:30.512004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596848+0000","last_change":"2024-04-21T22:31:29.520436+0000","last_active":"2024-04-21T22:31:31.596848+0000","last_peered":"2024-04-21T22:31:31.596848+0000","last_clean":"2024-04-21T22:31:31.596848+0000","last_became_active":"2024-04-21T22:31:29.520048+0000","last_became_peered":"2024-04-21T22:31:29.520048+0000","last_unstale":"2024-04-21T22:31:31.596848+0000","last_undegraded":"2024-04-21T22:31:31.596848+0000","last_fullsized":"2024-04-21T22:31:31.596848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:38.807972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596945+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:31:31.596945+0000","last_peered":"2024-04-21T22:31:31.596945+0000","last_clean":"2024-04-21T22:31:31.596945+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:31:31.596945+0000","last_undegraded":"2024-04-21T22:31:31.596945+0000","last_fullsized":"2024-04-21T22:31:31.596945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.560084+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:31:30.560084+0000","last_peered":"2024-04-21T22:31:30.560084+0000","last_clean":"2024-04-21T22:31:30.560084+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:31:30.560084+0000","last_undegraded":"2024-04-21T22:31:30.560084+0000","last_fullsized":"2024-04-21T22:31:30.560084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603110+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:31:31.603110+0000","last_peered":"2024-04-21T22:31:31.603110+0000","last_clean":"2024-04-21T22:31:31.603110+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:31:31.603110+0000","last_undegraded":"2024-04-21T22:31:31.603110+0000","last_fullsized":"2024-04-21T22:31:31.603110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.604092+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:31:31.604092+0000","last_peered":"2024-04-21T22:31:31.604092+0000","last_clean":"2024-04-21T22:31:31.604092+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:31:31.604092+0000","last_undegraded":"2024-04-21T22:31:31.604092+0000","last_fullsized":"2024-04-21T22:31:31.604092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603615+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:31:31.603615+0000","last_peered":"2024-04-21T22:31:31.603615+0000","last_clean":"2024-04-21T22:31:31.603615+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:31:31.603615+0000","last_undegraded":"2024-04-21T22:31:31.603615+0000","last_fullsized":"2024-04-21T22:31:31.603615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511521+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:31:30.511521+0000","last_peered":"2024-04-21T22:31:30.511521+0000","last_clean":"2024-04-21T22:31:30.511521+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:31:30.511521+0000","last_undegraded":"2024-04-21T22:31:30.511521+0000","last_fullsized":"2024-04-21T22:31:30.511521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829773+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:31:30.829773+0000","last_peered":"2024-04-21T22:31:30.829773+0000","last_clean":"2024-04-21T22:31:30.829773+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:31:30.829773+0000","last_undegraded":"2024-04-21T22:31:30.829773+0000","last_fullsized":"2024-04-21T22:31:30.829773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602215+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:31:31.602215+0000","last_peered":"2024-04-21T22:31:31.602215+0000","last_clean":"2024-04-21T22:31:31.602215+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:31:31.602215+0000","last_undegraded":"2024-04-21T22:31:31.602215+0000","last_fullsized":"2024-04-21T22:31:31.602215+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.885151+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:31:30.885151+0000","last_peered":"2024-04-21T22:31:30.885151+0000","last_clean":"2024-04-21T22:31:30.885151+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:31:30.885151+0000","last_undegraded":"2024-04-21T22:31:30.885151+0000","last_fullsized":"2024-04-21T22:31:30.885151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.541767+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:31:36.541767+0000","last_peered":"2024-04-21T22:31:36.541767+0000","last_clean":"2024-04-21T22:31:36.541767+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:31:36.541767+0000","last_undegraded":"2024-04-21T22:31:36.541767+0000","last_fullsized":"2024-04-21T22:31:36.541767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601678+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:31:31.601678+0000","last_peered":"2024-04-21T22:31:31.601678+0000","last_clean":"2024-04-21T22:31:31.601678+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:31:31.601678+0000","last_undegraded":"2024-04-21T22:31:31.601678+0000","last_fullsized":"2024-04-21T22:31:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601663+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:31:31.601663+0000","last_peered":"2024-04-21T22:31:31.601663+0000","last_clean":"2024-04-21T22:31:31.601663+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:31:31.601663+0000","last_undegraded":"2024-04-21T22:31:31.601663+0000","last_fullsized":"2024-04-21T22:31:31.601663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.604171+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:31:31.604171+0000","last_peered":"2024-04-21T22:31:31.604171+0000","last_clean":"2024-04-21T22:31:31.604171+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:31:31.604171+0000","last_undegraded":"2024-04-21T22:31:31.604171+0000","last_fullsized":"2024-04-21T22:31:31.604171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.533922+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:31:36.533922+0000","last_peered":"2024-04-21T22:31:36.533922+0000","last_clean":"2024-04-21T22:31:36.533922+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:31:36.533922+0000","last_undegraded":"2024-04-21T22:31:36.533922+0000","last_fullsized":"2024-04-21T22:31:36.533922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511961+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:31:30.511961+0000","last_peered":"2024-04-21T22:31:30.511961+0000","last_clean":"2024-04-21T22:31:30.511961+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:31:30.511961+0000","last_undegraded":"2024-04-21T22:31:30.511961+0000","last_fullsized":"2024-04-21T22:31:30.511961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.537592+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:31:35.537592+0000","last_peered":"2024-04-21T22:31:35.537592+0000","last_clean":"2024-04-21T22:31:35.537592+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:31:35.537592+0000","last_undegraded":"2024-04-21T22:31:35.537592+0000","last_fullsized":"2024-04-21T22:31:35.537592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511390+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:31:30.511390+0000","last_peered":"2024-04-21T22:31:30.511390+0000","last_clean":"2024-04-21T22:31:30.511390+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:31:30.511390+0000","last_undegraded":"2024-04-21T22:31:30.511390+0000","last_fullsized":"2024-04-21T22:31:30.511390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.498776+0000","last_change":"2024-04-21T22:31:28.496784+0000","last_active":"2024-04-21T22:31:36.498776+0000","last_peered":"2024-04-21T22:31:36.498776+0000","last_clean":"2024-04-21T22:31:36.498776+0000","last_became_active":"2024-04-21T22:31:28.496430+0000","last_became_peered":"2024-04-21T22:31:28.496430+0000","last_unstale":"2024-04-21T22:31:36.498776+0000","last_undegraded":"2024-04-21T22:31:36.498776+0000","last_fullsized":"2024-04-21T22:31:36.498776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:47:00.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595366+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:31:31.595366+0000","last_peered":"2024-04-21T22:31:31.595366+0000","last_clean":"2024-04-21T22:31:31.595366+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:31:31.595366+0000","last_undegraded":"2024-04-21T22:31:31.595366+0000","last_fullsized":"2024-04-21T22:31:31.595366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.518771+0000","last_change":"2024-04-21T22:31:28.502194+0000","last_active":"2024-04-21T22:31:34.518771+0000","last_peered":"2024-04-21T22:31:34.518771+0000","last_clean":"2024-04-21T22:31:34.518771+0000","last_became_active":"2024-04-21T22:31:28.501725+0000","last_became_peered":"2024-04-21T22:31:28.501725+0000","last_unstale":"2024-04-21T22:31:34.518771+0000","last_undegraded":"2024-04-21T22:31:34.518771+0000","last_fullsized":"2024-04-21T22:31:34.518771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:48:44.657909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511181+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:31:30.511181+0000","last_peered":"2024-04-21T22:31:30.511181+0000","last_clean":"2024-04-21T22:31:30.511181+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:31:30.511181+0000","last_undegraded":"2024-04-21T22:31:30.511181+0000","last_fullsized":"2024-04-21T22:31:30.511181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.511974+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:31:33.511974+0000","last_peered":"2024-04-21T22:31:33.511974+0000","last_clean":"2024-04-21T22:31:33.511974+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:31:33.511974+0000","last_undegraded":"2024-04-21T22:31:33.511974+0000","last_fullsized":"2024-04-21T22:31:33.511974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601913+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:31:31.601913+0000","last_peered":"2024-04-21T22:31:31.601913+0000","last_clean":"2024-04-21T22:31:31.601913+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:31:31.601913+0000","last_undegraded":"2024-04-21T22:31:31.601913+0000","last_fullsized":"2024-04-21T22:31:31.601913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.538803+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:31:35.538803+0000","last_peered":"2024-04-21T22:31:35.538803+0000","last_clean":"2024-04-21T22:31:35.538803+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:31:35.538803+0000","last_undegraded":"2024-04-21T22:31:35.538803+0000","last_fullsized":"2024-04-21T22:31:35.538803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.599594+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:31:31.599594+0000","last_peered":"2024-04-21T22:31:31.599594+0000","last_clean":"2024-04-21T22:31:31.599594+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:31:31.599594+0000","last_undegraded":"2024-04-21T22:31:31.599594+0000","last_fullsized":"2024-04-21T22:31:31.599594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.519663+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:31:34.519663+0000","last_peered":"2024-04-21T22:31:34.519663+0000","last_clean":"2024-04-21T22:31:34.519663+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:31:34.519663+0000","last_undegraded":"2024-04-21T22:31:34.519663+0000","last_fullsized":"2024-04-21T22:31:34.519663+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511959+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:31:30.511959+0000","last_peered":"2024-04-21T22:31:30.511959+0000","last_clean":"2024-04-21T22:31:30.511959+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:31:30.511959+0000","last_undegraded":"2024-04-21T22:31:30.511959+0000","last_fullsized":"2024-04-21T22:31:30.511959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.899627+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:31:32.899627+0000","last_peered":"2024-04-21T22:31:32.899627+0000","last_clean":"2024-04-21T22:31:32.899627+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:31:32.899627+0000","last_undegraded":"2024-04-21T22:31:32.899627+0000","last_fullsized":"2024-04-21T22:31:32.899627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603781+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:31:31.603781+0000","last_peered":"2024-04-21T22:31:31.603781+0000","last_clean":"2024-04-21T22:31:31.603781+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:31:31.603781+0000","last_undegraded":"2024-04-21T22:31:31.603781+0000","last_fullsized":"2024-04-21T22:31:31.603781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.494072+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:31:33.494072+0000","last_peered":"2024-04-21T22:31:33.494072+0000","last_clean":"2024-04-21T22:31:33.494072+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:31:33.494072+0000","last_undegraded":"2024-04-21T22:31:33.494072+0000","last_fullsized":"2024-04-21T22:31:33.494072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511865+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:31:30.511865+0000","last_peered":"2024-04-21T22:31:30.511865+0000","last_clean":"2024-04-21T22:31:30.511865+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:31:30.511865+0000","last_undegraded":"2024-04-21T22:31:30.511865+0000","last_fullsized":"2024-04-21T22:31:30.511865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'13","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.538497+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:31:35.538497+0000","last_peered":"2024-04-21T22:31:35.538497+0000","last_clean":"2024-04-21T22:31:35.538497+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:31:35.538497+0000","last_undegraded":"2024-04-21T22:31:35.538497+0000","last_fullsized":"2024-04-21T22:31:35.538497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595619+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:31:31.595619+0000","last_peered":"2024-04-21T22:31:31.595619+0000","last_clean":"2024-04-21T22:31:31.595619+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:31:31.595619+0000","last_undegraded":"2024-04-21T22:31:31.595619+0000","last_fullsized":"2024-04-21T22:31:31.595619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.539496+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:31:35.539496+0000","last_peered":"2024-04-21T22:31:35.539496+0000","last_clean":"2024-04-21T22:31:35.539496+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:31:35.539496+0000","last_undegraded":"2024-04-21T22:31:35.539496+0000","last_fullsized":"2024-04-21T22:31:35.539496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.601717+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:31:31.601717+0000","last_peered":"2024-04-21T22:31:31.601717+0000","last_clean":"2024-04-21T22:31:31.601717+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:31:31.601717+0000","last_undegraded":"2024-04-21T22:31:31.601717+0000","last_fullsized":"2024-04-21T22:31:31.601717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.543170+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:31:35.543170+0000","last_peered":"2024-04-21T22:31:35.543170+0000","last_clean":"2024-04-21T22:31:35.543170+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:31:35.543170+0000","last_undegraded":"2024-04-21T22:31:35.543170+0000","last_fullsized":"2024-04-21T22:31:35.543170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597227+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:31:31.597227+0000","last_peered":"2024-04-21T22:31:31.597227+0000","last_clean":"2024-04-21T22:31:31.597227+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:31:31.597227+0000","last_undegraded":"2024-04-21T22:31:31.597227+0000","last_fullsized":"2024-04-21T22:31:31.597227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.559586+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:31:30.559586+0000","last_peered":"2024-04-21T22:31:30.559586+0000","last_clean":"2024-04-21T22:31:30.559586+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:31:30.559586+0000","last_undegraded":"2024-04-21T22:31:30.559586+0000","last_fullsized":"2024-04-21T22:31:30.559586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596209+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:31:31.596209+0000","last_peered":"2024-04-21T22:31:31.596209+0000","last_clean":"2024-04-21T22:31:31.596209+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:31:31.596209+0000","last_undegraded":"2024-04-21T22:31:31.596209+0000","last_fullsized":"2024-04-21T22:31:31.596209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.535909+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:31:35.535909+0000","last_peered":"2024-04-21T22:31:35.535909+0000","last_clean":"2024-04-21T22:31:35.535909+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:31:35.535909+0000","last_undegraded":"2024-04-21T22:31:35.535909+0000","last_fullsized":"2024-04-21T22:31:35.535909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510853+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:31:30.510853+0000","last_peered":"2024-04-21T22:31:30.510853+0000","last_clean":"2024-04-21T22:31:30.510853+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:31:30.510853+0000","last_undegraded":"2024-04-21T22:31:30.510853+0000","last_fullsized":"2024-04-21T22:31:30.510853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:33.491311+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:31:33.491311+0000","last_peered":"2024-04-21T22:31:33.491311+0000","last_clean":"2024-04-21T22:31:33.491311+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:31:33.491311+0000","last_undegraded":"2024-04-21T22:31:33.491311+0000","last_fullsized":"2024-04-21T22:31:33.491311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829611+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:31:30.829611+0000","last_peered":"2024-04-21T22:31:30.829611+0000","last_clean":"2024-04-21T22:31:30.829611+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:31:30.829611+0000","last_undegraded":"2024-04-21T22:31:30.829611+0000","last_fullsized":"2024-04-21T22:31:30.829611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600608+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:31:31.600608+0000","last_peered":"2024-04-21T22:31:31.600608+0000","last_clean":"2024-04-21T22:31:31.600608+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:31:31.600608+0000","last_undegraded":"2024-04-21T22:31:31.600608+0000","last_fullsized":"2024-04-21T22:31:31.600608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597125+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:31:31.597125+0000","last_peered":"2024-04-21T22:31:31.597125+0000","last_clean":"2024-04-21T22:31:31.597125+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:31:31.597125+0000","last_undegraded":"2024-04-21T22:31:31.597125+0000","last_fullsized":"2024-04-21T22:31:31.597125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596621+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:31:31.596621+0000","last_peered":"2024-04-21T22:31:31.596621+0000","last_clean":"2024-04-21T22:31:31.596621+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:31:31.596621+0000","last_undegraded":"2024-04-21T22:31:31.596621+0000","last_fullsized":"2024-04-21T22:31:31.596621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596569+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:31:31.596569+0000","last_peered":"2024-04-21T22:31:31.596569+0000","last_clean":"2024-04-21T22:31:31.596569+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:31:31.596569+0000","last_undegraded":"2024-04-21T22:31:31.596569+0000","last_fullsized":"2024-04-21T22:31:31.596569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510868+0000","last_change":"2024-04-21T22:31:29.526648+0000","last_active":"2024-04-21T22:31:30.510868+0000","last_peered":"2024-04-21T22:31:30.510868+0000","last_clean":"2024-04-21T22:31:30.510868+0000","last_became_active":"2024-04-21T22:31:29.526333+0000","last_became_peered":"2024-04-21T22:31:29.526333+0000","last_unstale":"2024-04-21T22:31:30.510868+0000","last_undegraded":"2024-04-21T22:31:30.510868+0000","last_fullsized":"2024-04-21T22:31:30.510868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.281421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.540554+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:31:36.540554+0000","last_peered":"2024-04-21T22:31:36.540554+0000","last_clean":"2024-04-21T22:31:36.540554+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:31:36.540554+0000","last_undegraded":"2024-04-21T22:31:36.540554+0000","last_fullsized":"2024-04-21T22:31:36.540554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600481+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:31:31.600481+0000","last_peered":"2024-04-21T22:31:31.600481+0000","last_clean":"2024-04-21T22:31:31.600481+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:31:31.600481+0000","last_undegraded":"2024-04-21T22:31:31.600481+0000","last_fullsized":"2024-04-21T22:31:31.600481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.900915+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:31:32.900915+0000","last_peered":"2024-04-21T22:31:32.900915+0000","last_clean":"2024-04-21T22:31:32.900915+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:31:32.900915+0000","last_undegraded":"2024-04-21T22:31:32.900915+0000","last_fullsized":"2024-04-21T22:31:32.900915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596276+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:31:31.596276+0000","last_peered":"2024-04-21T22:31:31.596276+0000","last_clean":"2024-04-21T22:31:31.596276+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:31:31.596276+0000","last_undegraded":"2024-04-21T22:31:31.596276+0000","last_fullsized":"2024-04-21T22:31:31.596276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600354+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:31:31.600354+0000","last_peered":"2024-04-21T22:31:31.600354+0000","last_clean":"2024-04-21T22:31:31.600354+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:31:31.600354+0000","last_undegraded":"2024-04-21T22:31:31.600354+0000","last_fullsized":"2024-04-21T22:31:31.600354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596568+0000","last_change":"2024-04-21T22:31:28.500915+0000","last_active":"2024-04-21T22:31:31.596568+0000","last_peered":"2024-04-21T22:31:31.596568+0000","last_clean":"2024-04-21T22:31:31.596568+0000","last_became_active":"2024-04-21T22:31:28.500612+0000","last_became_peered":"2024-04-21T22:31:28.500612+0000","last_unstale":"2024-04-21T22:31:31.596568+0000","last_undegraded":"2024-04-21T22:31:31.596568+0000","last_fullsized":"2024-04-21T22:31:31.596568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:23:33.479230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.517698+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:31:34.517698+0000","last_peered":"2024-04-21T22:31:34.517698+0000","last_clean":"2024-04-21T22:31:34.517698+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:31:34.517698+0000","last_undegraded":"2024-04-21T22:31:34.517698+0000","last_fullsized":"2024-04-21T22:31:34.517698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602617+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:31:31.602617+0000","last_peered":"2024-04-21T22:31:31.602617+0000","last_clean":"2024-04-21T22:31:31.602617+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:31:31.602617+0000","last_undegraded":"2024-04-21T22:31:31.602617+0000","last_fullsized":"2024-04-21T22:31:31.602617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.858411+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:31:36.858411+0000","last_peered":"2024-04-21T22:31:36.858411+0000","last_clean":"2024-04-21T22:31:36.858411+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:31:36.858411+0000","last_undegraded":"2024-04-21T22:31:36.858411+0000","last_fullsized":"2024-04-21T22:31:36.858411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600182+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:31:31.600182+0000","last_peered":"2024-04-21T22:31:31.600182+0000","last_clean":"2024-04-21T22:31:31.600182+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:31:31.600182+0000","last_undegraded":"2024-04-21T22:31:31.600182+0000","last_fullsized":"2024-04-21T22:31:31.600182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.900408+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:31:32.900408+0000","last_peered":"2024-04-21T22:31:32.900408+0000","last_clean":"2024-04-21T22:31:32.900408+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:31:32.900408+0000","last_undegraded":"2024-04-21T22:31:32.900408+0000","last_fullsized":"2024-04-21T22:31:32.900408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603380+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:31:31.603380+0000","last_peered":"2024-04-21T22:31:31.603380+0000","last_clean":"2024-04-21T22:31:31.603380+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:31:31.603380+0000","last_undegraded":"2024-04-21T22:31:31.603380+0000","last_fullsized":"2024-04-21T22:31:31.603380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.901418+0000","last_change":"2024-04-21T22:31:28.499758+0000","last_active":"2024-04-21T22:31:32.901418+0000","last_peered":"2024-04-21T22:31:32.901418+0000","last_clean":"2024-04-21T22:31:32.901418+0000","last_became_active":"2024-04-21T22:31:28.499277+0000","last_became_peered":"2024-04-21T22:31:28.499277+0000","last_unstale":"2024-04-21T22:31:32.901418+0000","last_undegraded":"2024-04-21T22:31:32.901418+0000","last_fullsized":"2024-04-21T22:31:32.901418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:03:17.815711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.595322+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:31:31.595322+0000","last_peered":"2024-04-21T22:31:31.595322+0000","last_clean":"2024-04-21T22:31:31.595322+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:31:31.595322+0000","last_undegraded":"2024-04-21T22:31:31.595322+0000","last_fullsized":"2024-04-21T22:31:31.595322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.522957+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:31:34.522957+0000","last_peered":"2024-04-21T22:31:34.522957+0000","last_clean":"2024-04-21T22:31:34.522957+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:31:34.522957+0000","last_undegraded":"2024-04-21T22:31:34.522957+0000","last_fullsized":"2024-04-21T22:31:34.522957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829437+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:31:30.829437+0000","last_peered":"2024-04-21T22:31:30.829437+0000","last_clean":"2024-04-21T22:31:30.829437+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:31:30.829437+0000","last_undegraded":"2024-04-21T22:31:30.829437+0000","last_fullsized":"2024-04-21T22:31:30.829437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.520014+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:31:34.520014+0000","last_peered":"2024-04-21T22:31:34.520014+0000","last_clean":"2024-04-21T22:31:34.520014+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:31:34.520014+0000","last_undegraded":"2024-04-21T22:31:34.520014+0000","last_fullsized":"2024-04-21T22:31:34.520014+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600890+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:31:31.600890+0000","last_peered":"2024-04-21T22:31:31.600890+0000","last_clean":"2024-04-21T22:31:31.600890+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:31:31.600890+0000","last_undegraded":"2024-04-21T22:31:31.600890+0000","last_fullsized":"2024-04-21T22:31:31.600890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:32.899721+0000","last_change":"2024-04-21T22:31:28.503459+0000","last_active":"2024-04-21T22:31:32.899721+0000","last_peered":"2024-04-21T22:31:32.899721+0000","last_clean":"2024-04-21T22:31:32.899721+0000","last_became_active":"2024-04-21T22:31:28.502703+0000","last_became_peered":"2024-04-21T22:31:28.502703+0000","last_unstale":"2024-04-21T22:31:32.899721+0000","last_undegraded":"2024-04-21T22:31:32.899721+0000","last_fullsized":"2024-04-21T22:31:32.899721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:33:13.579668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596948+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:31:31.596948+0000","last_peered":"2024-04-21T22:31:31.596948+0000","last_clean":"2024-04-21T22:31:31.596948+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:31:31.596948+0000","last_undegraded":"2024-04-21T22:31:31.596948+0000","last_fullsized":"2024-04-21T22:31:31.596948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:36.539114+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:31:36.539114+0000","last_peered":"2024-04-21T22:31:36.539114+0000","last_clean":"2024-04-21T22:31:36.539114+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:31:36.539114+0000","last_undegraded":"2024-04-21T22:31:36.539114+0000","last_fullsized":"2024-04-21T22:31:36.539114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597233+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:31:31.597233+0000","last_peered":"2024-04-21T22:31:31.597233+0000","last_clean":"2024-04-21T22:31:31.597233+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:31:31.597233+0000","last_undegraded":"2024-04-21T22:31:31.597233+0000","last_fullsized":"2024-04-21T22:31:31.597233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:34.520951+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:31:34.520951+0000","last_peered":"2024-04-21T22:31:34.520951+0000","last_clean":"2024-04-21T22:31:34.520951+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:31:34.520951+0000","last_undegraded":"2024-04-21T22:31:34.520951+0000","last_fullsized":"2024-04-21T22:31:34.520951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.596454+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:31:31.596454+0000","last_peered":"2024-04-21T22:31:31.596454+0000","last_clean":"2024-04-21T22:31:31.596454+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:31:31.596454+0000","last_undegraded":"2024-04-21T22:31:31.596454+0000","last_fullsized":"2024-04-21T22:31:31.596454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:35.541205+0000","last_change":"2024-04-21T22:31:28.514802+0000","last_active":"2024-04-21T22:31:35.541205+0000","last_peered":"2024-04-21T22:31:35.541205+0000","last_clean":"2024-04-21T22:31:35.541205+0000","last_became_active":"2024-04-21T22:31:28.514210+0000","last_became_peered":"2024-04-21T22:31:28.514210+0000","last_unstale":"2024-04-21T22:31:35.541205+0000","last_undegraded":"2024-04-21T22:31:35.541205+0000","last_fullsized":"2024-04-21T22:31:35.541205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:46:29.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.597162+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:31:31.597162+0000","last_peered":"2024-04-21T22:31:31.597162+0000","last_clean":"2024-04-21T22:31:31.597162+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:31:31.597162+0000","last_undegraded":"2024-04-21T22:31:31.597162+0000","last_fullsized":"2024-04-21T22:31:31.597162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829511+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:31:30.829511+0000","last_peered":"2024-04-21T22:31:30.829511+0000","last_clean":"2024-04-21T22:31:30.829511+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:31:30.829511+0000","last_undegraded":"2024-04-21T22:31:30.829511+0000","last_fullsized":"2024-04-21T22:31:30.829511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.884966+0000","last_change":"2024-04-21T22:31:29.529192+0000","last_active":"2024-04-21T22:31:30.884966+0000","last_peered":"2024-04-21T22:31:30.884966+0000","last_clean":"2024-04-21T22:31:30.884966+0000","last_became_active":"2024-04-21T22:31:29.528845+0000","last_became_peered":"2024-04-21T22:31:29.528845+0000","last_unstale":"2024-04-21T22:31:30.884966+0000","last_undegraded":"2024-04-21T22:31:30.884966+0000","last_fullsized":"2024-04-21T22:31:30.884966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:42:13.005408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.884918+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:31:30.884918+0000","last_peered":"2024-04-21T22:31:30.884918+0000","last_clean":"2024-04-21T22:31:30.884918+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:31:30.884918+0000","last_undegraded":"2024-04-21T22:31:30.884918+0000","last_fullsized":"2024-04-21T22:31:30.884918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603684+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:31:31.603684+0000","last_peered":"2024-04-21T22:31:31.603684+0000","last_clean":"2024-04-21T22:31:31.603684+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:31:31.603684+0000","last_undegraded":"2024-04-21T22:31:31.603684+0000","last_fullsized":"2024-04-21T22:31:31.603684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.603052+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:31:31.603052+0000","last_peered":"2024-04-21T22:31:31.603052+0000","last_clean":"2024-04-21T22:31:31.603052+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:31:31.603052+0000","last_undegraded":"2024-04-21T22:31:31.603052+0000","last_fullsized":"2024-04-21T22:31:31.603052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829644+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:31:30.829644+0000","last_peered":"2024-04-21T22:31:30.829644+0000","last_clean":"2024-04-21T22:31:30.829644+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:31:30.829644+0000","last_undegraded":"2024-04-21T22:31:30.829644+0000","last_fullsized":"2024-04-21T22:31:30.829644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.885324+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:31:30.885324+0000","last_peered":"2024-04-21T22:31:30.885324+0000","last_clean":"2024-04-21T22:31:30.885324+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:31:30.885324+0000","last_undegraded":"2024-04-21T22:31:30.885324+0000","last_fullsized":"2024-04-21T22:31:30.885324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.599851+0000","last_change":"2024-04-21T22:31:29.534619+0000","last_active":"2024-04-21T22:31:31.599851+0000","last_peered":"2024-04-21T22:31:31.599851+0000","last_clean":"2024-04-21T22:31:31.599851+0000","last_became_active":"2024-04-21T22:31:29.533795+0000","last_became_peered":"2024-04-21T22:31:29.533795+0000","last_unstale":"2024-04-21T22:31:31.599851+0000","last_undegraded":"2024-04-21T22:31:31.599851+0000","last_fullsized":"2024-04-21T22:31:31.599851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:34:13.611422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.510838+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:31:30.510838+0000","last_peered":"2024-04-21T22:31:30.510838+0000","last_clean":"2024-04-21T22:31:30.510838+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:31:30.510838+0000","last_undegraded":"2024-04-21T22:31:30.510838+0000","last_fullsized":"2024-04-21T22:31:30.510838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.600905+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:31:31.600905+0000","last_peered":"2024-04-21T22:31:31.600905+0000","last_clean":"2024-04-21T22:31:31.600905+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:31:31.600905+0000","last_undegraded":"2024-04-21T22:31:31.600905+0000","last_fullsized":"2024-04-21T22:31:31.600905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.511876+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:31:30.511876+0000","last_peered":"2024-04-21T22:31:30.511876+0000","last_clean":"2024-04-21T22:31:30.511876+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:31:30.511876+0000","last_undegraded":"2024-04-21T22:31:30.511876+0000","last_fullsized":"2024-04-21T22:31:30.511876+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:31.602645+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:31:31.602645+0000","last_peered":"2024-04-21T22:31:31.602645+0000","last_clean":"2024-04-21T22:31:31.602645+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:31:31.602645+0000","last_undegraded":"2024-04-21T22:31:31.602645+0000","last_fullsized":"2024-04-21T22:31:31.602645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-21T22:31:30.829501+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:31:30.829501+0000","last_peered":"2024-04-21T22:31:30.829501+0000","last_clean":"2024-04-21T22:31:30.829501+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:31:30.829501+0000","last_undegraded":"2024-04-21T22:31:30.829501+0000","last_fullsized":"2024-04-21T22:31:30.829501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":14150,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":189,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":106442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708284,"statfs":{"total":95995035648,"available":95957282816,"internally_reserved":0,"allocated":1568768,"data_stored":1039228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":439643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":440021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1511424,"data_stored":1029471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495661,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":933888,"data_stored":439360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":461168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":441090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":974848,"data_stored":462170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":438929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757299,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1552384,"data_stored":1032100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":41380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:31:39.556 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-21T22:31:39.556 INFO:tasks.cephadm:Setting up client nodes... 2024-04-21T22:31:39.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-21T22:31:39.694 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:31:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: 2024-04-21T22:31:39.226+0000 7f3998b25700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:40.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:39 smithi018 ceph-mon[26614]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:40.188 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:39 smithi018 ceph-mon[26614]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:40.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:39 smithi047 ceph-mon[31561]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:40.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:39 smithi047 ceph-mon[31561]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:39 smithi081 ceph-mon[31692]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:39 smithi081 ceph-mon[31692]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:31:41.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:40 smithi081 ceph-mon[31692]: pgmap v327: 97 pgs: 97 active+clean; 592 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-04-21T22:31:41.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:40 smithi047 ceph-mon[31561]: pgmap v327: 97 pgs: 97 active+clean; 592 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-04-21T22:31:41.198 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:40 smithi018 ceph-mon[26614]: pgmap v327: 97 pgs: 97 active+clean; 592 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-04-21T22:31:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 -- 172.21.15.18:0/2575183728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414109fe0 msgr2=0x7f341410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 --2- 172.21.15.18:0/2575183728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414109fe0 0x7f341410c470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f340c009f90 tx=0x7f340c00b330 comp rx=0 tx=0).stop 2024-04-21T22:31:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 -- 172.21.15.18:0/2575183728 shutdown_connections 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 --2- 172.21.15.18:0/2575183728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414109fe0 0x7f341410c470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 --2- 172.21.15.18:0/2575183728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f3414074660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 --2- 172.21.15.18:0/2575183728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414074c30 0x7f34140750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.288+0000 7f3418a00700 1 -- 172.21.15.18:0/2575183728 >> 172.21.15.18:0/2575183728 conn(0x7f34140fd6a0 msgr2=0x7f34140ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.289+0000 7f3418a00700 1 -- 172.21.15.18:0/2575183728 shutdown_connections 2024-04-21T22:31:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.289+0000 7f3418a00700 1 -- 172.21.15.18:0/2575183728 wait complete. 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.290+0000 7f3418a00700 1 Processor -- start 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.290+0000 7f3418a00700 1 -- start start 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414074c30 0x7f341419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414109fe0 0x7f34141a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f341410ff00 con 0x7f3414109fe0 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f341410fd80 con 0x7f3414076200 2024-04-21T22:31:42.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3418a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3414110080 con 0x7f3414074c30 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3413e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414109fe0 0x7f34141a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3412a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3412a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49088/0 (socket says 172.21.15.18:49088) 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3412a00700 1 -- 172.21.15.18:0/1578167262 learned_addr learned my addr 172.21.15.18:0/1578167262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.291+0000 7f3413400700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414074c30 0x7f341419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 -- 172.21.15.18:0/1578167262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414074c30 msgr2=0x7f341419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414074c30 0x7f341419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 -- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414109fe0 msgr2=0x7f34141a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414109fe0 0x7f34141a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 -- 172.21.15.18:0/1578167262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34141a2030 con 0x7f3414076200 2024-04-21T22:31:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3412a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f340000ec10 tx=0x7f340000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340000cc90 con 0x7f3414076200 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f340000ce30 con 0x7f3414076200 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400010690 con 0x7f3414076200 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.292+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34141a2320 con 0x7f3414076200 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.293+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34141a2810 con 0x7f3414076200 2024-04-21T22:31:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.294+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3414063890 con 0x7f3414076200 2024-04-21T22:31:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.296+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3400003680 con 0x7f3414076200 2024-04-21T22:31:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.298+0000 7f340be00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 0x7f33f80a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.298+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f34000cf3e0 con 0x7f3414076200 2024-04-21T22:31:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.298+0000 7f3413400700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 0x7f33f80a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.299+0000 7f3413400700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 0x7f33f80a52a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3404009680 tx=0x7f3404009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.302+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f340009c290 con 0x7f3414076200 2024-04-21T22:31:42.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.619+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f3414062e40 con 0x7f3414076200 2024-04-21T22:31:42.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.627+0000 7f340be00700 1 -- 172.21.15.18:0/1578167262 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f340009bb90 con 0x7f3414076200 2024-04-21T22:31:42.628 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-21T22:31:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDOkyVml5cLJRAAfNLm+jC/TQPKBPKMSsDJrg== 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 msgr2=0x7f33f80a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 0x7f33f80a52a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3404009680 tx=0x7f3404009260 comp rx=0 tx=0).stop 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 msgr2=0x7f341419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f340000ec10 tx=0x7f340000ef20 comp rx=0 tx=0).stop 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 shutdown_connections 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3414109fe0 0x7f34141a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3414074c30 0x7f341419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33f80a2de0 0x7f33f80a52a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 --2- 172.21.15.18:0/1578167262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3414076200 0x7f341419a910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:42.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 >> 172.21.15.18:0/1578167262 conn(0x7f34140fd6a0 msgr2=0x7f3414105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:42.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 shutdown_connections 2024-04-21T22:31:42.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:42.631+0000 7f3418a00700 1 -- 172.21.15.18:0/1578167262 wait complete. 2024-04-21T22:31:43.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:43 smithi018 ceph-mon[26614]: pgmap v328: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.9 KiB/s wr, 26 op/s 2024-04-21T22:31:43.336 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:43 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1578167262' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:43 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.337 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:43 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T22:31:43.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:43 smithi047 ceph-mon[31561]: pgmap v328: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.9 KiB/s wr, 26 op/s 2024-04-21T22:31:43.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:43 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1578167262' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:43 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:43 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T22:31:43.552 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:31:43.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-21T22:31:43.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-21T22:31:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:43 smithi081 ceph-mon[31692]: pgmap v328: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.9 KiB/s wr, 26 op/s 2024-04-21T22:31:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:43 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1578167262' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:43 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-21T22:31:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:43 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-21T22:31:43.686 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-21T22:31:43.686 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-21T22:31:43.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-21T22:31:44.187 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:45.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:45 smithi047 ceph-mon[31561]: pgmap v329: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 27 op/s 2024-04-21T22:31:45.531 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:45 smithi018 ceph-mon[26614]: pgmap v329: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 27 op/s 2024-04-21T22:31:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:45 smithi081 ceph-mon[31692]: pgmap v329: 97 pgs: 97 active+clean; 627 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.2 KiB/s wr, 27 op/s 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.383+0000 7fec67800700 1 -- 172.21.15.18:0/3432643366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60104c70 msgr2=0x7fec60105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.383+0000 7fec67800700 1 --2- 172.21.15.18:0/3432643366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60104c70 0x7fec60105100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec5800b0a0 tx=0x7fec5800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 -- 172.21.15.18:0/3432643366 shutdown_connections 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 --2- 172.21.15.18:0/3432643366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60104c70 0x7fec60105100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 --2- 172.21.15.18:0/3432643366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60107160 0x7fec6006a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 --2- 172.21.15.18:0/3432643366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6006b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 -- 172.21.15.18:0/3432643366 >> 172.21.15.18:0/3432643366 conn(0x7fec600780a0 msgr2=0x7fec600784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:46.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 -- 172.21.15.18:0/3432643366 shutdown_connections 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.384+0000 7fec67800700 1 -- 172.21.15.18:0/3432643366 wait complete. 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.385+0000 7fec67800700 1 Processor -- start 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.385+0000 7fec67800700 1 -- start start 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.385+0000 7fec67800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec67800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60104c70 0x7fec6019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:46.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec67800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60107160 0x7fec601a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:46.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec67800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec60118b60 con 0x7fec60104c70 2024-04-21T22:31:46.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec67800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec601189e0 con 0x7fec6006ae50 2024-04-21T22:31:46.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec67800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec60118ce0 con 0x7fec60107160 2024-04-21T22:31:46.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec5fe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60104c70 0x7fec6019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:46.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:46.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:50556/0 (socket says 172.21.15.18:50556) 2024-04-21T22:31:46.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 -- 172.21.15.18:0/1126681769 learned_addr learned my addr 172.21.15.18:0/1126681769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec65800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60107160 0x7fec601a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 -- 172.21.15.18:0/1126681769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60107160 msgr2=0x7fec601a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60107160 0x7fec601a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 -- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60104c70 msgr2=0x7fec6019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60104c70 0x7fec6019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.386+0000 7fec64e00700 1 -- 172.21.15.18:0/1126681769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec601a3fb0 con 0x7fec6006ae50 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec64e00700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec5400e9a0 tx=0x7fec5400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:46.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5400ca10 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec5400cbb0 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec601a42a0 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54018660 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.387+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec601abb20 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.388+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec40005330 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.390+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec54010430 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.392+0000 7fec5d600700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 0x7fec480a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.392+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fec540cf130 con 0x7fec6006ae50 2024-04-21T22:31:46.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.392+0000 7fec5fe00700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 0x7fec480a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:46.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.393+0000 7fec5fe00700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 0x7fec480a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec6006aba0 tx=0x7fec4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:46.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.396+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fec5409bfe0 con 0x7fec6006ae50 2024-04-21T22:31:46.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.693+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fec400058f0 con 0x7fec6006ae50 2024-04-21T22:31:46.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.700+0000 7fec5d600700 1 -- 172.21.15.18:0/1126681769 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7fec5409b8e0 con 0x7fec6006ae50 2024-04-21T22:31:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:46.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 msgr2=0x7fec480a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:46.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 0x7fec480a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec6006aba0 tx=0x7fec4c009260 comp rx=0 tx=0).stop 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 msgr2=0x7fec6019eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec5400e9a0 tx=0x7fec5400ecb0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 shutdown_connections 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec60107160 0x7fec601a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec480a2cb0 0x7fec480a5170 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec6006ae50 0x7fec6019eff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 --2- 172.21.15.18:0/1126681769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec60104c70 0x7fec6019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 >> 172.21.15.18:0/1126681769 conn(0x7fec600780a0 msgr2=0x7fec60103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 shutdown_connections 2024-04-21T22:31:46.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:46.706+0000 7fec67800700 1 -- 172.21.15.18:0/1126681769 wait complete. 2024-04-21T22:31:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:47 smithi047 ceph-mon[31561]: pgmap v330: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-04-21T22:31:47.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1126681769' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T22:31:47.510 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:47 smithi018 ceph-mon[26614]: pgmap v330: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-04-21T22:31:47.510 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1126681769' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1190552149},{"type":"v1","addr":"172.21.15.18:6801","nonce":1190552149}]},"active_addr":"172.21.15.18:6801/1190552149","active_change":"2024-04-21T22:23:15.934818+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.18:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3148841055}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":1645784357}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3549237195}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":3597214442}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":2355713373}]}]} 2024-04-21T22:31:47.591 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-21T22:31:47.591 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-21T22:31:47.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T22:31:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:47 smithi081 ceph-mon[31692]: pgmap v330: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-04-21T22:31:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1126681769' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-21T22:31:48.117 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:49.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:49 smithi047 ceph-mon[31561]: pgmap v331: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2024-04-21T22:31:49.550 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:49 smithi018 ceph-mon[26614]: pgmap v331: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2024-04-21T22:31:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:49 smithi081 ceph-mon[31692]: pgmap v331: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 -- 172.21.15.18:0/2533170386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 msgr2=0x7fdd4c1086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 --2- 172.21.15.18:0/2533170386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c1086d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009990 tx=0x7fdd3c009ca0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 -- 172.21.15.18:0/2533170386 shutdown_connections 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 --2- 172.21.15.18:0/2533170386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c102c50 0x7fdd4c10f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 --2- 172.21.15.18:0/2533170386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c1086d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 --2- 172.21.15.18:0/2533170386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 -- 172.21.15.18:0/2533170386 >> 172.21.15.18:0/2533170386 conn(0x7fdd4c079300 msgr2=0x7fdd4c079710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 -- 172.21.15.18:0/2533170386 shutdown_connections 2024-04-21T22:31:50.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.382+0000 7fdd51c00700 1 -- 172.21.15.18:0/2533170386 wait complete. 2024-04-21T22:31:50.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.384+0000 7fdd51c00700 1 Processor -- start 2024-04-21T22:31:50.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.384+0000 7fdd51c00700 1 -- start start 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c112580 con 0x7fdd4c1082f0 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c112400 con 0x7fdd4c102c50 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd51c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c112700 con 0x7fdd4c1022b0 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd42000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd4aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd42000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:50572/0 (socket says 172.21.15.18:50572) 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd42000700 1 -- 172.21.15.18:0/3052928740 learned_addr learned my addr 172.21.15.18:0/3052928740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:50.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd4aa00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:37688/0 (socket says 172.21.15.18:37688) 2024-04-21T22:31:50.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.385+0000 7fdd4b400700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:50.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 -- 172.21.15.18:0/3052928740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 msgr2=0x7fdd4c1a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:50.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 -- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 msgr2=0x7fdd4c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 -- 172.21.15.18:0/3052928740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c19b260 con 0x7fdd4c102c50 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd4aa00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd42000700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400ef10 tx=0x7fdd3400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400c9c0 con 0x7fdd4c102c50 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd34019070 con 0x7fdd4c102c50 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c19b4f0 con 0x7fdd4c102c50 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.386+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34007e60 con 0x7fdd4c102c50 2024-04-21T22:31:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.387+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c1a7810 con 0x7fdd4c102c50 2024-04-21T22:31:50.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.388+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c068f20 con 0x7fdd4c102c50 2024-04-21T22:31:50.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.390+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdd34012050 con 0x7fdd4c102c50 2024-04-21T22:31:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.391+0000 7fdd43e00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 0x7fdd300a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.391+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fdd340ceff0 con 0x7fdd4c102c50 2024-04-21T22:31:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.391+0000 7fdd4aa00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 0x7fdd300a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:50.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.392+0000 7fdd4aa00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 0x7fdd300a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00b2e0 tx=0x7fdd3c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:50.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.396+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fdd34010040 con 0x7fdd4c102c50 2024-04-21T22:31:50.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.626+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4c1a79e0 con 0x7fdd4c102c50 2024-04-21T22:31:50.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.628+0000 7fdd43e00700 1 -- 172.21.15.18:0/3052928740 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22112 (secure 0 0 0) 0x7fdd3409bee0 con 0x7fdd4c102c50 2024-04-21T22:31:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:50.629 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":85,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:31:30.502357+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:50.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 msgr2=0x7fdd300a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:50.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 0x7fdd300a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00b2e0 tx=0x7fdd3c005fd0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 msgr2=0x7fdd4c1a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:50.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400ef10 tx=0x7fdd3400c3a0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 shutdown_connections 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd4c1082f0 0x7fdd4c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c1022b0 0x7fdd4c1a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fdd300a2d30 0x7fdd300a51f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 --2- 172.21.15.18:0/3052928740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd4c102c50 0x7fdd4c1a0e80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.631+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 >> 172.21.15.18:0/3052928740 conn(0x7fdd4c079300 msgr2=0x7fdd4c10d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.632+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 shutdown_connections 2024-04-21T22:31:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:50.632+0000 7fdd51c00700 1 -- 172.21.15.18:0/3052928740 wait complete. 2024-04-21T22:31:51.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:51 smithi047 ceph-mon[31561]: pgmap v332: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-04-21T22:31:51.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:51 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3052928740' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:51.475 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:51 smithi018 ceph-mon[26614]: pgmap v332: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-04-21T22:31:51.475 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:51 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3052928740' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:51.539 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-21T22:31:51.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-21T22:31:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:51 smithi081 ceph-mon[31692]: pgmap v332: 97 pgs: 97 active+clean; 635 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-04-21T22:31:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:51 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3052928740' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:52.037 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:53.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:53 smithi047 ceph-mon[31561]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-04-21T22:31:53.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:53 smithi018 ceph-mon[26614]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-04-21T22:31:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:53 smithi081 ceph-mon[31692]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-04-21T22:31:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 -- 172.21.15.18:0/3676304714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4102d50 msgr2=0x7f6cc4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 --2- 172.21.15.18:0/3676304714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4102d50 0x7f6cc4106da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0098f0 tx=0x7f6cac009c00 comp rx=0 tx=0).stop 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 -- 172.21.15.18:0/3676304714 shutdown_connections 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 --2- 172.21.15.18:0/3676304714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc4107480 0x7f6cc410f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 --2- 172.21.15.18:0/3676304714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc41023a0 0x7f6cc4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 --2- 172.21.15.18:0/3676304714 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4102d50 0x7f6cc4106da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 -- 172.21.15.18:0/3676304714 >> 172.21.15.18:0/3676304714 conn(0x7f6cc40fdc50 msgr2=0x7f6cc4100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 -- 172.21.15.18:0/3676304714 shutdown_connections 2024-04-21T22:31:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.477+0000 7f6cc3200700 1 -- 172.21.15.18:0/3676304714 wait complete. 2024-04-21T22:31:54.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.478+0000 7f6cc3200700 1 Processor -- start 2024-04-21T22:31:54.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 -- start start 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc4102d50 0x7f6cc41a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4107480 0x7f6cc419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41124b0 con 0x7f6cc41023a0 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112330 con 0x7f6cc4107480 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112630 con 0x7f6cc4102d50 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc1e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57066/0 (socket says 172.21.15.18:57066) 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.479+0000 7f6cc1e00700 1 -- 172.21.15.18:0/1855956101 learned_addr learned my addr 172.21.15.18:0/1855956101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cb9400700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc4102d50 0x7f6cc41a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc2800700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4107480 0x7f6cc419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 -- 172.21.15.18:0/1855956101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc4102d50 msgr2=0x7f6cc41a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:54.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc4102d50 0x7f6cc41a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 -- 172.21.15.18:0/1855956101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4107480 msgr2=0x7f6cc419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4107480 0x7f6cc419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 -- 172.21.15.18:0/1855956101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc419b150 con 0x7f6cc41023a0 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.480+0000 7f6cc1e00700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9c0 tx=0x7f6cb400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.481+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400cbd0 con 0x7f6cc41023a0 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.481+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc419b440 con 0x7f6cc41023a0 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.481+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb400ee60 con 0x7f6cc41023a0 2024-04-21T22:31:54.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.481+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4005630 con 0x7f6cc41023a0 2024-04-21T22:31:54.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.481+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a7700 con 0x7f6cc41023a0 2024-04-21T22:31:54.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.482+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc4068f20 con 0x7f6cc41023a0 2024-04-21T22:31:54.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.484+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6cb4004750 con 0x7f6cc41023a0 2024-04-21T22:31:54.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.486+0000 7f6cbb400700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 0x7f6ca80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:31:54.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.486+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f6cb40cf390 con 0x7f6cc41023a0 2024-04-21T22:31:54.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.486+0000 7f6cb9400700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 0x7f6ca80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:31:54.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.487+0000 7f6cb9400700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 0x7f6ca80a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009fd0 tx=0x7f6cac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:31:54.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.490+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6cb409c240 con 0x7f6cc41023a0 2024-04-21T22:31:54.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.723+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cc419bf20 con 0x7f6cc41023a0 2024-04-21T22:31:54.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.725+0000 7f6cbb400700 1 -- 172.21.15.18:0/1855956101 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22112 (secure 0 0 0) 0x7f6cb409bb40 con 0x7f6cc41023a0 2024-04-21T22:31:54.726 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:31:54.726 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":85,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:31:30.502357+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:31:54.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.728+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 msgr2=0x7f6ca80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:54.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.728+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 0x7f6ca80a5170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009fd0 tx=0x7f6cac01a040 comp rx=0 tx=0).stop 2024-04-21T22:31:54.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.728+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 msgr2=0x7f6cc41a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:31:54.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.728+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9c0 tx=0x7f6cb400ecd0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 shutdown_connections 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6ca80a2cb0 0x7f6ca80a5170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cc4107480 0x7f6cc419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cc41023a0 0x7f6cc41a0830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 --2- 172.21.15.18:0/1855956101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc4102d50 0x7f6cc41a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 >> 172.21.15.18:0/1855956101 conn(0x7f6cc40fdc50 msgr2=0x7f6cc410ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 shutdown_connections 2024-04-21T22:31:54.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:31:54.729+0000 7f6cc3200700 1 -- 172.21.15.18:0/1855956101 wait complete. 2024-04-21T22:31:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:55 smithi047 ceph-mon[31561]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-21T22:31:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:55 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1855956101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:55.477 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:55 smithi018 ceph-mon[26614]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-21T22:31:55.477 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:55 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1855956101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:55.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-21T22:31:55.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-21T22:31:55.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-21T22:31:55.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-21T22:31:55.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-21T22:31:55.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-21T22:31:55.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-21T22:31:55.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-21T22:31:55.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-21T22:31:55.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-21T22:31:55.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-21T22:31:55.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-21T22:31:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:55 smithi081 ceph-mon[31692]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-04-21T22:31:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:55 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1855956101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:31:56.615 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:56.640 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:56.788 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.425 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:57 smithi018 ceph-mon[26614]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-21T22:31:57.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:57 smithi047 ceph-mon[31561]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-21T22:31:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:57 smithi081 ceph-mon[31692]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-21T22:31:57.834 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.836 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.844 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.848 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.856 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.857 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.862 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.865 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:57.868 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:31:59.318 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:31:59 smithi018 ceph-mon[26614]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:31:59.440 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:31:59 smithi081 ceph-mon[31692]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:31:59.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:31:59 smithi047 ceph-mon[31561]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:32:01.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:01 smithi018 ceph-mon[26614]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-21T22:32:01.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:01 smithi047 ceph-mon[31561]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-21T22:32:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:01 smithi081 ceph-mon[31692]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 852 B/s wr, 9 op/s 2024-04-21T22:32:03.505 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:03 smithi018 ceph-mon[26614]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:32:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:03 smithi081 ceph-mon[31692]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:32:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:03 smithi047 ceph-mon[31561]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-04-21T22:32:05.777 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:05 smithi018 ceph-mon[26614]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-21T22:32:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:05 smithi081 ceph-mon[31692]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-21T22:32:05.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:05 smithi047 ceph-mon[31561]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-21T22:32:07.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 -- 172.21.15.18:0/1093371991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 msgr2=0x7fe7f4115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 --2- 172.21.15.18:0/1093371991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f4115730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00b0a0 tx=0x7fe7ec00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 -- 172.21.15.18:0/1093371991 shutdown_connections 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 --2- 172.21.15.18:0/1093371991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f4115730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 --2- 172.21.15.18:0/1093371991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f410e860 0x7fe7f410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 --2- 172.21.15.18:0/1093371991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f4108860 0x7fe7f4108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 -- 172.21.15.18:0/1093371991 >> 172.21.15.18:0/1093371991 conn(0x7fe7f4075a00 msgr2=0x7fe7f4107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.184+0000 7fe7fb400700 1 -- 172.21.15.18:0/1093371991 shutdown_connections 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.185+0000 7fe7fb400700 1 -- 172.21.15.18:0/1093371991 wait complete. 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 Processor -- start 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 -- start start 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 0x7fe7f419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f410e860 0x7fe7f41a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:07.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4118bf0 con 0x7fe7f4109220 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4118a70 con 0x7fe7f410e860 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.186+0000 7fe7fb400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4118d70 con 0x7fe7f4108860 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 0x7fe7f419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f419f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48056/0 (socket says 172.21.15.18:48056) 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f3e00700 1 -- 172.21.15.18:0/2109960138 learned_addr learned my addr 172.21.15.18:0/2109960138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 0x7fe7f419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42252/0 (socket says 172.21.15.18:42252) 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f9400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f410e860 0x7fe7f41a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 -- 172.21.15.18:0/2109960138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f410e860 msgr2=0x7fe7f41a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f410e860 0x7fe7f41a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 -- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 msgr2=0x7fe7f419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7f4109220 0x7fe7f419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f41a3f90 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.187+0000 7fe7f8a00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 0x7fe7f419ef80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800e9f0 tx=0x7fe7e800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.188+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8004220 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.188+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7e8004d10 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.188+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f41a4280 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.188+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8005020 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.188+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f41abb00 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.189+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7f4076940 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.191+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe7e8004750 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f1600700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe7dc0a2cb0 0x7fe7dc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fe7e80cf1f0 con 0x7fe7f4108860 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f3e00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe7dc0a2cb0 0x7fe7dc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f1600700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] conn(0x7fe7dc0ac490 0x7fe7dc0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7dc0aef60 con 0x7fe7dc0ac490 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe7e80cf5a0 con 0x7fe7f4108860 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.193+0000 7fe7f9400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] conn(0x7fe7dc0ac490 0x7fe7dc0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.194+0000 7fe7f3e00700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe7dc0a2cb0 0x7fe7dc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40777c0 tx=0x7fe7e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.194+0000 7fe7f9400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] conn(0x7fe7dc0ac490 0x7fe7dc0ae8b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.195+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== osd.6 v2:172.21.15.18:6818/1273593856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7dc0aef60 con 0x7fe7dc0ac490 2024-04-21T22:32:07.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.215+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 --> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7f4109fa0 con 0x7fe7dc0ac490 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.215+0000 7fe7f1600700 1 -- 172.21.15.18:0/2109960138 <== osd.6 v2:172.21.15.18:6818/1273593856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe7f4109fa0 con 0x7fe7dc0ac490 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] conn(0x7fe7dc0ac490 msgr2=0x7fe7dc0ae8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] conn(0x7fe7dc0ac490 0x7fe7dc0ae8b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe7dc0a2cb0 msgr2=0x7fe7dc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe7dc0a2cb0 0x7fe7dc0a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40777c0 tx=0x7fe7e0009260 comp rx=0 tx=0).stop 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 msgr2=0x7fe7f419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 --2- 172.21.15.18:0/2109960138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f4108860 0x7fe7f419ef80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800e9f0 tx=0x7fe7e800ed00 comp rx=0 tx=0).stop 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7f9400700 1 -- 172.21.15.18:0/2109960138 reap_dead start 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 shutdown_connections 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 >> 172.21.15.18:0/2109960138 conn(0x7fe7f4075a00 msgr2=0x7fe7f4075ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 shutdown_connections 2024-04-21T22:32:07.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:07.216+0000 7fe7fb400700 1 -- 172.21.15.18:0/2109960138 wait complete. 2024-04-21T22:32:07.762 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:07 smithi018 ceph-mon[26614]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-21T22:32:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:07 smithi081 ceph-mon[31692]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-21T22:32:07.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:07 smithi047 ceph-mon[31561]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-04-21T22:32:09.809 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:09 smithi018 ceph-mon[26614]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:09 smithi081 ceph-mon[31692]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:09 smithi047 ceph-mon[31561]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:11 smithi018 ceph-mon[26614]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T22:32:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:11 smithi081 ceph-mon[31692]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T22:32:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:11 smithi047 ceph-mon[31561]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-21T22:32:12.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:10.999+0000 7f4aaa200700 1 -- 172.21.15.18:0/2662829619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa4104c70 msgr2=0x7f4aa4105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:10.999+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2662829619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa4104c70 0x7f4aa4105100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00b0a0 tx=0x7f4a9c00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 -- 172.21.15.18:0/2662829619 shutdown_connections 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2662829619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa4104c70 0x7f4aa4105100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2662829619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 0x7f4aa4069f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2662829619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa406a480 0x7f4aa406a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 -- 172.21.15.18:0/2662829619 >> 172.21.15.18:0/2662829619 conn(0x7f4aa40780e0 msgr2=0x7f4aa40784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 -- 172.21.15.18:0/2662829619 shutdown_connections 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.000+0000 7f4aaa200700 1 -- 172.21.15.18:0/2662829619 wait complete. 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.001+0000 7f4aaa200700 1 Processor -- start 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.001+0000 7f4aaa200700 1 -- start start 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.001+0000 7f4aaa200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa406a480 0x7f4aa419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aaa200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa4104c70 0x7f4aa419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aaa200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 0x7f4aa41a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:12.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aaa200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4118b40 con 0x7f4aa4104c70 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aaa200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41189c0 con 0x7f4aa406a480 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aaa200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4118cc0 con 0x7f4aa4107160 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aa3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa406a480 0x7f4aa419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa4104c70 0x7f4aa419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aa3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa406a480 0x7f4aa419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:60324/0 (socket says 172.21.15.18:60324) 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aa3400700 1 -- 172.21.15.18:0/2610539972 learned_addr learned my addr 172.21.15.18:0/2610539972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aa3e00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 0x7f4aa41a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 -- 172.21.15.18:0/2610539972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 msgr2=0x7f4aa41a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 0x7f4aa41a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 -- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa406a480 msgr2=0x7f4aa419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4aa406a480 0x7f4aa419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4a9be00700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa41a4000 con 0x7f4aa4104c70 2024-04-21T22:32:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.002+0000 7f4aa3e00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aa4107160 0x7f4aa41a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4a9be00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa4104c70 0x7f4aa419f530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00e9f0 tx=0x7f4a8c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00c9c0 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8c00cb60 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa41a42f0 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c018680 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.003+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa41abb70 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.004+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4aa4104630 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.006+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a8c010430 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa0c00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4a880a2d30 0x7f4a880a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f4a8c0cf660 con 0x7f4aa4104c70 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa3400700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4a880a2d30 0x7f4a880a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa0c00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] conn(0x7f4a880ac510 0x7f4a880ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a8c01bec0 con 0x7f4a880ac510 2024-04-21T22:32:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.008+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f4a8c0cfa10 con 0x7f4aa4104c70 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.009+0000 7f4aa3400700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4a880a2d30 0x7f4a880a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009ca0 tx=0x7f4a94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.009+0000 7f4aa3e00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] conn(0x7f4a880ac510 0x7f4a880ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.009+0000 7f4aa3e00700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] conn(0x7f4a880ac510 0x7f4a880ae930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.011+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== osd.7 v2:172.21.15.47:6816/2420410882 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a8c01bec0 con 0x7f4a880ac510 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.029+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 --> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4aa4101750 con 0x7f4a880ac510 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aa0c00700 1 -- 172.21.15.18:0/2610539972 <== osd.7 v2:172.21.15.47:6816/2420410882 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4aa4101750 con 0x7f4a880ac510 2024-04-21T22:32:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] conn(0x7f4a880ac510 msgr2=0x7f4a880ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] conn(0x7f4a880ac510 0x7f4a880ae930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4a880a2d30 msgr2=0x7f4a880a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4a880a2d30 0x7f4a880a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009ca0 tx=0x7f4a94009260 comp rx=0 tx=0).stop 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa4104c70 msgr2=0x7f4aa419f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 --2- 172.21.15.18:0/2610539972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4aa4104c70 0x7f4aa419f530 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00e9f0 tx=0x7f4a8c00ed00 comp rx=0 tx=0).stop 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aa3e00700 1 -- 172.21.15.18:0/2610539972 reap_dead start 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 shutdown_connections 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.030+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 >> 172.21.15.18:0/2610539972 conn(0x7f4aa40780e0 msgr2=0x7f4aa4103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.031+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 shutdown_connections 2024-04-21T22:32:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:11.031+0000 7f4aaa200700 1 -- 172.21.15.18:0/2610539972 wait complete. 2024-04-21T22:32:13.795 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:13 smithi018 ceph-mon[26614]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:13.861 INFO:teuthology.orchestra.run.smithi018.stdout:197568495667 2024-04-21T22:32:13.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-21T22:32:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:13 smithi081 ceph-mon[31692]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:13 smithi047 ceph-mon[31561]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.613+0000 7f7ea7400700 1 -- 172.21.15.18:0/3952572001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0104450 msgr2=0x7f7ea01048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.613+0000 7f7ea7400700 1 --2- 172.21.15.18:0/3952572001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0104450 0x7f7ea01048d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009990 tx=0x7f7e8c009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.613+0000 7f7ea7400700 1 -- 172.21.15.18:0/3952572001 shutdown_connections 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.613+0000 7f7ea7400700 1 --2- 172.21.15.18:0/3952572001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104e10 0x7f7ea0111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.614+0000 7f7ea7400700 1 --2- 172.21.15.18:0/3952572001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ea010a4e0 0x7f7ea010a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.614+0000 7f7ea7400700 1 --2- 172.21.15.18:0/3952572001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0104450 0x7f7ea01048d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.614+0000 7f7ea7400700 1 -- 172.21.15.18:0/3952572001 >> 172.21.15.18:0/3952572001 conn(0x7f7ea00fff40 msgr2=0x7f7ea0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.614+0000 7f7ea7400700 1 -- 172.21.15.18:0/3952572001 shutdown_connections 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.614+0000 7f7ea7400700 1 -- 172.21.15.18:0/3952572001 wait complete. 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.615+0000 7f7ea7400700 1 Processor -- start 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.615+0000 7f7ea7400700 1 -- start start 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.615+0000 7f7ea7400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 0x7f7ea01a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ea0104e10 0x7f7ea01a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea010a4e0 0x7f7ea019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea7400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea01147b0 con 0x7f7ea0104450 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea7400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0114630 con 0x7f7ea0104e10 2024-04-21T22:32:14.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea7400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea0114930 con 0x7f7ea010a4e0 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 0x7f7ea01a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 0x7f7ea01a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48060/0 (socket says 172.21.15.18:48060) 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 -- 172.21.15.18:0/2202104770 learned_addr learned my addr 172.21.15.18:0/2202104770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea5400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea010a4e0 0x7f7ea019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7e9fe00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ea0104e10 0x7f7ea01a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 -- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea010a4e0 msgr2=0x7f7ea019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea010a4e0 0x7f7ea019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 -- 172.21.15.18:0/2202104770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ea0104e10 msgr2=0x7f7ea01a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ea0104e10 0x7f7ea01a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.616+0000 7f7ea4a00700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea019b1b0 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7ea4a00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 0x7f7ea01a0890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400e9c0 tx=0x7f7e9400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400cbd0 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea019b4a0 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e9400ee60 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005630 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.617+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea01a7760 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.618+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ea00629c0 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.620+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7e94004750 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9d600700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e880a2d30 0x7f7e880a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f7e940cf6b0 con 0x7f7ea0104450 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9fe00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e880a2d30 0x7f7e880a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9d600700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] conn(0x7f7e880ac510 0x7f7e880ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e9401ee50 con 0x7f7e880ac510 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.622+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f7e940cfa60 con 0x7f7ea0104450 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.623+0000 7f7ea5400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] conn(0x7f7e880ac510 0x7f7e880ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.623+0000 7f7e9fe00700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e880a2d30 0x7f7e880a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0109a10 tx=0x7f7e8c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.623+0000 7f7ea5400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] conn(0x7f7e880ac510 0x7f7e880ae930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.624+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== osd.8 v2:172.21.15.81:6816/338495809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e9401ee50 con 0x7f7e880ac510 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.644+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 --> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ea0062e40 con 0x7f7e880ac510 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.644+0000 7f7e9d600700 1 -- 172.21.15.18:0/2202104770 <== osd.8 v2:172.21.15.81:6816/338495809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7ea0062e40 con 0x7f7e880ac510 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] conn(0x7f7e880ac510 msgr2=0x7f7e880ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] conn(0x7f7e880ac510 0x7f7e880ae930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e880a2d30 msgr2=0x7f7e880a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7e880a2d30 0x7f7e880a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0109a10 tx=0x7f7e8c00b260 comp rx=0 tx=0).stop 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 msgr2=0x7f7ea01a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea7400700 1 --2- 172.21.15.18:0/2202104770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ea0104450 0x7f7ea01a0890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400e9c0 tx=0x7f7e9400ecd0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.645+0000 7f7ea5400700 1 -- 172.21.15.18:0/2202104770 reap_dead start 2024-04-21T22:32:14.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.646+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 shutdown_connections 2024-04-21T22:32:14.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.646+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 >> 172.21.15.18:0/2202104770 conn(0x7f7ea00fff40 msgr2=0x7f7ea01004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:14.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.646+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 shutdown_connections 2024-04-21T22:32:14.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:09.646+0000 7f7ea7400700 1 -- 172.21.15.18:0/2202104770 wait complete. 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 -- 172.21.15.18:0/1459955650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 msgr2=0x7f2f28103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 --2- 172.21.15.18:0/1459955650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28103750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098f0 tx=0x7f2f18009c00 comp rx=0 tx=0).stop 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 -- 172.21.15.18:0/1459955650 shutdown_connections 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 --2- 172.21.15.18:0/1459955650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 0x7f2f2810ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 --2- 172.21.15.18:0/1459955650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28103750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 --2- 172.21.15.18:0/1459955650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f2810c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 -- 172.21.15.18:0/1459955650 >> 172.21.15.18:0/1459955650 conn(0x7f2f280fcbc0 msgr2=0x7f2f280fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 -- 172.21.15.18:0/1459955650 shutdown_connections 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.453+0000 7f2f2e600700 1 -- 172.21.15.18:0/1459955650 wait complete. 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.455+0000 7f2f2e600700 1 Processor -- start 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.455+0000 7f2f2e600700 1 -- start start 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28100fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f28101510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 0x7f2f28101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281124e0 con 0x7f2f2810c7a0 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112360 con 0x7f2f28103c90 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2e600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112660 con 0x7f2f28103370 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2dc00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 0x7f2f28101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f1fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f28101510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f1fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f28101510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:60346/0 (socket says 172.21.15.18:60346) 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f1fe00700 1 -- 172.21.15.18:0/3860098676 learned_addr learned my addr 172.21.15.18:0/3860098676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f2d200700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28100fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.456+0000 7f2f1fe00700 1 -- 172.21.15.18:0/3860098676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 msgr2=0x7f2f28100fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f1fe00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28100fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f1fe00700 1 -- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 msgr2=0x7f2f28101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f1fe00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 0x7f2f28101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f1fe00700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f281a6f40 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f2d200700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f28103370 0x7f2f28100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f2dc00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f2810c7a0 0x7f2f28101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f1fe00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f28101510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000eb30 tx=0x7f2f1000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000cbd0 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f281a7230 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f10004500 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10010430 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.457+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a77c0 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.458+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f28062940 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.461+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f10003f40 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f26000700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2f0c0a2cb0 0x7f2f0c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f2f100cf6f0 con 0x7f2f28103c90 2024-04-21T22:32:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f2d200700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2f0c0a2cb0 0x7f2f0c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f26000700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] conn(0x7f2f0c0ac490 0x7f2f0c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f1001aec0 con 0x7f2f0c0ac490 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.463+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f2f100cfaa0 con 0x7f2f28103c90 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.464+0000 7f2f2dc00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] conn(0x7f2f0c0ac490 0x7f2f0c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.464+0000 7f2f2d200700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2f0c0a2cb0 0x7f2f0c0a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098c0 tx=0x7f2f18019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.464+0000 7f2f2dc00700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] conn(0x7f2f0c0ac490 0x7f2f0c0ae8b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.465+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== osd.10 v2:172.21.15.47:6824/3325470664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f1001aec0 con 0x7f2f0c0ac490 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.483+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 --> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f28062d40 con 0x7f2f0c0ac490 2024-04-21T22:32:14.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.484+0000 7f2f26000700 1 -- 172.21.15.18:0/3860098676 <== osd.10 v2:172.21.15.47:6824/3325470664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2f28062d40 con 0x7f2f0c0ac490 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] conn(0x7f2f0c0ac490 msgr2=0x7f2f0c0ae8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] conn(0x7f2f0c0ac490 0x7f2f0c0ae8b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2f0c0a2cb0 msgr2=0x7f2f0c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2f0c0a2cb0 0x7f2f0c0a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098c0 tx=0x7f2f18019040 comp rx=0 tx=0).stop 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 msgr2=0x7f2f28101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 --2- 172.21.15.18:0/3860098676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2f28103c90 0x7f2f28101510 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000eb30 tx=0x7f2f1000ee40 comp rx=0 tx=0).stop 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2dc00700 1 -- 172.21.15.18:0/3860098676 reap_dead start 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 shutdown_connections 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 >> 172.21.15.18:0/3860098676 conn(0x7f2f280fcbc0 msgr2=0x7f2f280fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 shutdown_connections 2024-04-21T22:32:14.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:14.485+0000 7f2f2e600700 1 -- 172.21.15.18:0/3860098676 wait complete. 2024-04-21T22:32:15.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 -- 172.21.15.18:0/4028645328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 msgr2=0x7f2e30074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 --2- 172.21.15.18:0/4028645328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e30074880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009990 tx=0x7f2e24009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 -- 172.21.15.18:0/4028645328 shutdown_connections 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 --2- 172.21.15.18:0/4028645328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e30113400 0x7f2e301157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 --2- 172.21.15.18:0/4028645328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e30074880 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 --2- 172.21.15.18:0/4028645328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e30074dc0 0x7f2e30112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 -- 172.21.15.18:0/4028645328 >> 172.21.15.18:0/4028645328 conn(0x7f2e30079420 msgr2=0x7f2e30079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 -- 172.21.15.18:0/4028645328 shutdown_connections 2024-04-21T22:32:15.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.348+0000 7f2e38200700 1 -- 172.21.15.18:0/4028645328 wait complete. 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.349+0000 7f2e38200700 1 Processor -- start 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.349+0000 7f2e38200700 1 -- start start 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e3019f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e30074dc0 0x7f2e3019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e30113400 0x7f2e301a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e30118bf0 con 0x7f2e300744a0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e30118a70 con 0x7f2e30074dc0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e38200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e30118d70 con 0x7f2e30113400 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e3019f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e3019f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48096/0 (socket says 172.21.15.18:48096) 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 -- 172.21.15.18:0/2256004650 learned_addr learned my addr 172.21.15.18:0/2256004650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e34e00700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e30074dc0 0x7f2e3019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e36200700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e30113400 0x7f2e301a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 -- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e30113400 msgr2=0x7f2e301a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e30113400 0x7f2e301a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 -- 172.21.15.18:0/2256004650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e30074dc0 msgr2=0x7f2e3019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e30074dc0 0x7f2e3019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.350+0000 7f2e35800700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e301a40f0 con 0x7f2e300744a0 2024-04-21T22:32:15.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e35800700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e3019f0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2e24000c00 tx=0x7f2e2400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24027070 con 0x7f2e300744a0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24003d70 con 0x7f2e300744a0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400f460 con 0x7f2e300744a0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e38200700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e301a4380 con 0x7f2e300744a0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.351+0000 7f2e38200700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e301abc60 con 0x7f2e300744a0 2024-04-21T22:32:15.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.352+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e0c001030 con 0x7f2e300744a0 2024-04-21T22:32:15.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.354+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2e2402a070 con 0x7f2e300744a0 2024-04-21T22:32:15.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e2e000700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2e180a2d30 0x7f2e180a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f2e240d0690 con 0x7f2e300744a0 2024-04-21T22:32:15.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e34e00700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2e180a2d30 0x7f2e180a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e2e000700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] conn(0x7f2e180ac510 0x7f2e180ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e180aefe0 con 0x7f2e180ac510 2024-04-21T22:32:15.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f2e240d0a40 con 0x7f2e300744a0 2024-04-21T22:32:15.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.356+0000 7f2e36200700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] conn(0x7f2e180ac510 0x7f2e180ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.357+0000 7f2e34e00700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2e180a2d30 0x7f2e180a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e3010fd70 tx=0x7f2e1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.357+0000 7f2e36200700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] conn(0x7f2e180ac510 0x7f2e180ae930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.358+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== osd.2 v2:172.21.15.81:6800/311690470 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e180aefe0 con 0x7f2e180ac510 2024-04-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.376+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 --> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e0c002e60 con 0x7f2e180ac510 2024-04-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.376+0000 7f2e2e000700 1 -- 172.21.15.18:0/2256004650 <== osd.2 v2:172.21.15.81:6800/311690470 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2e0c002e60 con 0x7f2e180ac510 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] conn(0x7f2e180ac510 msgr2=0x7f2e180ae930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] conn(0x7f2e180ac510 0x7f2e180ae930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2e180a2d30 msgr2=0x7f2e180a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2e180a2d30 0x7f2e180a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e3010fd70 tx=0x7f2e1c009260 comp rx=0 tx=0).stop 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 msgr2=0x7f2e3019f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 --2- 172.21.15.18:0/2256004650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e300744a0 0x7f2e3019f0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2e24000c00 tx=0x7f2e2400bab0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e36200700 1 -- 172.21.15.18:0/2256004650 reap_dead start 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 shutdown_connections 2024-04-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 >> 172.21.15.18:0/2256004650 conn(0x7f2e30079420 msgr2=0x7f2e301122a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 shutdown_connections 2024-04-21T22:32:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.377+0000 7f2e23400700 1 -- 172.21.15.18:0/2256004650 wait complete. 2024-04-21T22:32:15.666 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:15 smithi018 ceph-mon[26614]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:15 smithi081 ceph-mon[31692]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:15.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:15 smithi047 ceph-mon[31561]: pgmap v344: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:15.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.968+0000 7efd44e00700 1 -- 172.21.15.18:0/1336689110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074d80 msgr2=0x7efd4010e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.968+0000 7efd44e00700 1 --2- 172.21.15.18:0/1336689110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074d80 0x7efd4010e6f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009990 tx=0x7efd2c009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 -- 172.21.15.18:0/1336689110 shutdown_connections 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 --2- 172.21.15.18:0/1336689110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd4010ec30 0x7efd40111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 --2- 172.21.15.18:0/1336689110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074460 0x7efd40074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 --2- 172.21.15.18:0/1336689110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074d80 0x7efd4010e6f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 -- 172.21.15.18:0/1336689110 >> 172.21.15.18:0/1336689110 conn(0x7efd40079390 msgr2=0x7efd400797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 -- 172.21.15.18:0/1336689110 shutdown_connections 2024-04-21T22:32:15.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.969+0000 7efd44e00700 1 -- 172.21.15.18:0/1336689110 wait complete. 2024-04-21T22:32:15.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.970+0000 7efd44e00700 1 Processor -- start 2024-04-21T22:32:15.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 -- start start 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074460 0x7efd401a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 0x7efd401a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd4010ec30 0x7efd4019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd40114720 con 0x7efd4010ec30 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd401145a0 con 0x7efd40074460 2024-04-21T22:32:15.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.971+0000 7efd44e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd401148a0 con 0x7efd40074d80 2024-04-21T22:32:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 0x7efd401a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074460 0x7efd401a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3e800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd4010ec30 0x7efd4019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 0x7efd401a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54314/0 (socket says 172.21.15.18:54314) 2024-04-21T22:32:15.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 -- 172.21.15.18:0/2271324100 learned_addr learned my addr 172.21.15.18:0/2271324100 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 -- 172.21.15.18:0/2271324100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074460 msgr2=0x7efd401a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd40074460 0x7efd401a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 -- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd4010ec30 msgr2=0x7efd4019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd4010ec30 0x7efd4019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4019b160 con 0x7efd40074d80 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.972+0000 7efd3d400700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 0x7efd401a0d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c00bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.973+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c027070 con 0x7efd40074d80 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.973+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c003d70 con 0x7efd40074d80 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.973+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4019b3f0 con 0x7efd40074d80 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.973+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00f460 con 0x7efd40074d80 2024-04-21T22:32:15.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.973+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd401a7710 con 0x7efd40074d80 2024-04-21T22:32:15.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.974+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd400629c0 con 0x7efd40074d80 2024-04-21T22:32:15.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.977+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efd2c02a070 con 0x7efd40074d80 2024-04-21T22:32:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.979+0000 7efd36a00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd240a2cb0 0x7efd240a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7efd2c0d0540 con 0x7efd40074d80 2024-04-21T22:32:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd3de00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd240a2cb0 0x7efd240a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd36a00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] conn(0x7efd240ac490 0x7efd240ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd240aef60 con 0x7efd240ac490 2024-04-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7efd2c0d08f0 con 0x7efd40074d80 2024-04-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd3e800700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] conn(0x7efd240ac490 0x7efd240ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.980+0000 7efd3de00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd240a2cb0 0x7efd240a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd4019bb40 tx=0x7efd30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.981+0000 7efd3e800700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] conn(0x7efd240ac490 0x7efd240ae8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:15.982+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== osd.9 v2:172.21.15.18:6826/2641133682 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd240aef60 con 0x7efd240ac490 2024-04-21T22:32:16.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.001+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 --> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd40062e40 con 0x7efd240ac490 2024-04-21T22:32:16.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.001+0000 7efd36a00700 1 -- 172.21.15.18:0/2271324100 <== osd.9 v2:172.21.15.18:6826/2641133682 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efd40062e40 con 0x7efd240ac490 2024-04-21T22:32:16.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] conn(0x7efd240ac490 msgr2=0x7efd240ae8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:16.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] conn(0x7efd240ac490 0x7efd240ae8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd240a2cb0 msgr2=0x7efd240a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efd240a2cb0 0x7efd240a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd4019bb40 tx=0x7efd30009260 comp rx=0 tx=0).stop 2024-04-21T22:32:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 msgr2=0x7efd401a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 --2- 172.21.15.18:0/2271324100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd40074d80 0x7efd401a0d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000c00 tx=0x7efd2c00bab0 comp rx=0 tx=0).stop 2024-04-21T22:32:16.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd3e800700 1 -- 172.21.15.18:0/2271324100 reap_dead start 2024-04-21T22:32:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 shutdown_connections 2024-04-21T22:32:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.002+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 >> 172.21.15.18:0/2271324100 conn(0x7efd40079390 msgr2=0x7efd400ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.003+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 shutdown_connections 2024-04-21T22:32:16.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:16.003+0000 7efd44e00700 1 -- 172.21.15.18:0/2271324100 wait complete. 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-21T22:32:16.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-21T22:32:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-04-21T22:32:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T22:32:16.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:16 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T22:32:16.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-21T22:32:16.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T22:32:16.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:16 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-04-21T22:32:16.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:16 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-21T22:32:17.685 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-04-21T22:32:17.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T22:32:17.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T22:32:17.686 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:17 smithi018 ceph-mon[26614]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T22:32:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-21T22:32:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T22:32:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:17 smithi081 ceph-mon[31692]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T22:32:17.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 -- 172.21.15.18:0/1677518218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 msgr2=0x7f3864102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:17.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 --2- 172.21.15.18:0/1677518218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f3864102780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3858009990 tx=0x7f3858009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 -- 172.21.15.18:0/1677518218 shutdown_connections 2024-04-21T22:32:17.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 --2- 172.21.15.18:0/1677518218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3864107480 0x7f386410f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 --2- 172.21.15.18:0/1677518218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f3864102780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 --2- 172.21.15.18:0/1677518218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864102d50 0x7f3864106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 -- 172.21.15.18:0/1677518218 >> 172.21.15.18:0/1677518218 conn(0x7f38640fdc50 msgr2=0x7f3864100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 -- 172.21.15.18:0/1677518218 shutdown_connections 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.537+0000 7f386a800700 1 -- 172.21.15.18:0/1677518218 wait complete. 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.538+0000 7f386a800700 1 Processor -- start 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 -- start start 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f38641a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:17.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864102d50 0x7f38641a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3864107480 0x7f386410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38641124e0 con 0x7f3864102d50 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3864112360 con 0x7f38641023a0 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f386a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3864112660 con 0x7f3864107480 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f3869400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f38641a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f3869400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f38641a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39510/0 (socket says 172.21.15.18:39510) 2024-04-21T22:32:17.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f3869400700 1 -- 172.21.15.18:0/667203273 learned_addr learned my addr 172.21.15.18:0/667203273 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.539+0000 7f3868a00700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864102d50 0x7f38641a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 -- 172.21.15.18:0/667203273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3864107480 msgr2=0x7f386410dfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3864107480 0x7f386410dfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 -- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864102d50 msgr2=0x7f38641a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3864102d50 0x7f38641a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386410e760 con 0x7f38641023a0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3869400700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f38641a3b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3858005f50 tx=0x7f385800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.540+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385800f8f0 con 0x7f38641023a0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.541+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386410e9f0 con 0x7f38641023a0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.541+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3858022470 con 0x7f38641023a0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.541+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858017650 con 0x7f38641023a0 2024-04-21T22:32:17.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.541+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38641abab0 con 0x7f38641023a0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.542+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3864075f80 con 0x7f38641023a0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.544+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3858009d10 con 0x7f38641023a0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.545+0000 7f3862000700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f384c0a2cb0 0x7f384c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.545+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8269+0+0 (secure 0 0 0) 0x7f38580d0370 con 0x7f38641023a0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3868a00700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f384c0a2cb0 0x7f384c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3862000700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] conn(0x7f384c0ac950 0x7f384c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f384c0af4c0 con 0x7f384c0ac950 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f38580d0720 con 0x7f38641023a0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3869e00700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] conn(0x7f384c0ac950 0x7f384c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.546+0000 7f3868a00700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f384c0a2cb0 0x7f384c0a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f386410f140 tx=0x7f3850009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.547+0000 7f3869e00700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] conn(0x7f384c0ac950 0x7f384c0aedf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.548+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== osd.3 v2:172.21.15.18:6810/334022394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f384c0af4c0 con 0x7f384c0ac950 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.573+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 --> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3864103880 con 0x7f384c0ac950 2024-04-21T22:32:17.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.574+0000 7f3862000700 1 -- 172.21.15.18:0/667203273 <== osd.3 v2:172.21.15.18:6810/334022394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3864103880 con 0x7f384c0ac950 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] conn(0x7f384c0ac950 msgr2=0x7f384c0aedf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] conn(0x7f384c0ac950 0x7f384c0aedf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f384c0a2cb0 msgr2=0x7f384c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f384c0a2cb0 0x7f384c0a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f386410f140 tx=0x7f3850009260 comp rx=0 tx=0).stop 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 msgr2=0x7f38641a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 --2- 172.21.15.18:0/667203273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38641023a0 0x7f38641a3b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3858005f50 tx=0x7f385800b840 comp rx=0 tx=0).stop 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f3869e00700 1 -- 172.21.15.18:0/667203273 reap_dead start 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 shutdown_connections 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 >> 172.21.15.18:0/667203273 conn(0x7f38640fdc50 msgr2=0x7f3864105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 shutdown_connections 2024-04-21T22:32:17.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:17.575+0000 7f386a800700 1 -- 172.21.15.18:0/667203273 wait complete. 2024-04-21T22:32:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: pgmap v345: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-21T22:32:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:17 smithi047 ceph-mon[31561]: osdmap e86: 12 total, 12 up, 12 in 2024-04-21T22:32:18.397 INFO:teuthology.orchestra.run.smithi018.stdout:219043332141 2024-04-21T22:32:18.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-21T22:32:18.688 INFO:teuthology.orchestra.run.smithi018.stdout:107374182470 2024-04-21T22:32:18.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-21T22:32:18.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:18 smithi018 ceph-mon[26614]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T22:32:18.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:18 smithi081 ceph-mon[31692]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T22:32:18.918 INFO:teuthology.orchestra.run.smithi018.stdout:253403070505 2024-04-21T22:32:18.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-21T22:32:18.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:18 smithi047 ceph-mon[31561]: osdmap e87: 12 total, 12 up, 12 in 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 -- 172.21.15.18:0/3765036045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 msgr2=0x7f3d2010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 --2- 172.21.15.18:0/3765036045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 0x7f3d2010e750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009990 tx=0x7f3d0c009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 -- 172.21.15.18:0/3765036045 shutdown_connections 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 --2- 172.21.15.18:0/3765036045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d2010ec90 0x7f3d20111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 --2- 172.21.15.18:0/3765036045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d20074460 0x7f3d20074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 --2- 172.21.15.18:0/3765036045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 0x7f3d2010e750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 -- 172.21.15.18:0/3765036045 >> 172.21.15.18:0/3765036045 conn(0x7f3d20079390 msgr2=0x7f3d200797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.580+0000 7f3d26e00700 1 -- 172.21.15.18:0/3765036045 shutdown_connections 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 -- 172.21.15.18:0/3765036045 wait complete. 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 Processor -- start 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 -- start start 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 0x7f3d201a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 0x7f3d201a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d2010ec90 0x7f3d2019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201147d0 con 0x7f3d20074460 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20114650 con 0x7f3d2010ec90 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d26e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20114950 con 0x7f3d20074d80 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d1fe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 0x7f3d201a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d1fe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 0x7f3d201a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36200/0 (socket says 172.21.15.18:36200) 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d1fe00700 1 -- 172.21.15.18:0/1173557033 learned_addr learned my addr 172.21.15.18:0/1173557033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:19.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.582+0000 7f3d24e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d2010ec90 0x7f3d2019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d1f400700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 0x7f3d201a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 -- 172.21.15.18:0/1173557033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 msgr2=0x7f3d201a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d20074d80 0x7f3d201a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 -- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 msgr2=0x7f3d201a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 0x7f3d201a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2019b130 con 0x7f3d2010ec90 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d1fe00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d20074460 0x7f3d201a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.584+0000 7f3d24e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d2010ec90 0x7f3d2019a9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800ef90 tx=0x7f3d1800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.585+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d180092e0 con 0x7f3d2010ec90 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.585+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d18004bb0 con 0x7f3d2010ec90 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.585+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2019b3c0 con 0x7f3d2010ec90 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.585+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18004020 con 0x7f3d2010ec90 2024-04-21T22:32:19.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.585+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a76e0 con 0x7f3d2010ec90 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.586+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d200ffde0 con 0x7f3d2010ec90 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.587+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3d1801b030 con 0x7f3d2010ec90 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.588+0000 7f3d1cc00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d040a2d30 0x7f3d040a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.588+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3d180cf090 con 0x7f3d2010ec90 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.588+0000 7f3d1fe00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d040a2d30 0x7f3d040a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.589+0000 7f3d1cc00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] conn(0x7f3d040ac970 0x7f3d040aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.589+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d040af4e0 con 0x7f3d040ac970 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.589+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f3d180cf440 con 0x7f3d2010ec90 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.589+0000 7f3d1f400700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] conn(0x7f3d040ac970 0x7f3d040aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.589+0000 7f3d1fe00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d040a2d30 0x7f3d040a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d2019bb10 tx=0x7f3d10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.591+0000 7f3d1f400700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] conn(0x7f3d040ac970 0x7f3d040aee10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.591+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== osd.1 v2:172.21.15.47:6800/253370991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d040af4e0 con 0x7f3d040ac970 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.609+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 --> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d20075b20 con 0x7f3d040ac970 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.610+0000 7f3d1cc00700 1 -- 172.21.15.18:0/1173557033 <== osd.1 v2:172.21.15.47:6800/253370991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d20075b20 con 0x7f3d040ac970 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] conn(0x7f3d040ac970 msgr2=0x7f3d040aee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] conn(0x7f3d040ac970 0x7f3d040aee10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d040a2d30 msgr2=0x7f3d040a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d040a2d30 0x7f3d040a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d2019bb10 tx=0x7f3d10009260 comp rx=0 tx=0).stop 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d2010ec90 msgr2=0x7f3d2019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 --2- 172.21.15.18:0/1173557033 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d2010ec90 0x7f3d2019a9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800ef90 tx=0x7f3d1800c3a0 comp rx=0 tx=0).stop 2024-04-21T22:32:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d24e00700 1 -- 172.21.15.18:0/1173557033 reap_dead start 2024-04-21T22:32:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 shutdown_connections 2024-04-21T22:32:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 >> 172.21.15.18:0/1173557033 conn(0x7f3d20079390 msgr2=0x7f3d200ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 shutdown_connections 2024-04-21T22:32:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.611+0000 7f3d26e00700 1 -- 172.21.15.18:0/1173557033 wait complete. 2024-04-21T22:32:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:19 smithi018 ceph-mon[26614]: pgmap v348: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:19 smithi081 ceph-mon[31692]: pgmap v348: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:19 smithi047 ceph-mon[31561]: pgmap v348: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:20.443 INFO:teuthology.orchestra.run.smithi018.stdout:77309411404 2024-04-21T22:32:20.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-21T22:32:20.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 -- 172.21.15.18:0/3991726368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 msgr2=0x7fd32c1048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 --2- 172.21.15.18:0/3991726368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1048d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd314009990 tx=0x7fd314009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 -- 172.21.15.18:0/3991726368 shutdown_connections 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 --2- 172.21.15.18:0/3991726368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 0x7fd32c111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 --2- 172.21.15.18:0/3991726368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd32c10a4e0 0x7fd32c10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 --2- 172.21.15.18:0/3991726368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1048d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 -- 172.21.15.18:0/3991726368 >> 172.21.15.18:0/3991726368 conn(0x7fd32c0fff40 msgr2=0x7fd32c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 -- 172.21.15.18:0/3991726368 shutdown_connections 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.719+0000 7fd332800700 1 -- 172.21.15.18:0/3991726368 wait complete. 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.720+0000 7fd332800700 1 Processor -- start 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 -- start start 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 0x7fd32c1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:20.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd32c10a4e0 0x7fd32c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114790 con 0x7fd32c104450 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114610 con 0x7fd32c10a4e0 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd332800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c114910 con 0x7fd32c104e10 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd32b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd32b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36204/0 (socket says 172.21.15.18:36204) 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd32b400700 1 -- 172.21.15.18:0/1273808718 learned_addr learned my addr 172.21.15.18:0/1273808718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd322a00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 0x7fd32c1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.721+0000 7fd32be00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd32c10a4e0 0x7fd32c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 -- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 msgr2=0x7fd32c1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 0x7fd32c1a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 -- 172.21.15.18:0/1273808718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd32c10a4e0 msgr2=0x7fd32c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd32c10a4e0 0x7fd32c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c19b190 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd322a00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32c104e10 0x7fd32c1a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd32b400700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1a0870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e9a0 tx=0x7fd31c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00ca10 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.722+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd31c00cbb0 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.723+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c19b480 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.723+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c018680 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.723+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1a7740 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.724+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd32c0629c0 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.726+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd31c010430 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.727+0000 7fd328c00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd30c0a2cb0 0x7fd30c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.727+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fd31c0cfc50 con 0x7fd32c104450 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.727+0000 7fd322a00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd30c0a2cb0 0x7fd30c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.728+0000 7fd328c00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] conn(0x7fd30c0ac8f0 0x7fd30c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.728+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd31c019ec0 con 0x7fd30c0ac8f0 2024-04-21T22:32:20.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.728+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd31c0d0000 con 0x7fd32c104450 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.728+0000 7fd32be00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] conn(0x7fd30c0ac8f0 0x7fd30c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.728+0000 7fd322a00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd30c0a2cb0 0x7fd30c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd32c109930 tx=0x7fd31400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.729+0000 7fd32be00700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] conn(0x7fd30c0ac8f0 0x7fd30c0aed90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.730+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== osd.11 v2:172.21.15.81:6824/2968006366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd31c019ec0 con 0x7fd30c0ac8f0 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.748+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 --> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd32c062dc0 con 0x7fd30c0ac8f0 2024-04-21T22:32:20.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.749+0000 7fd328c00700 1 -- 172.21.15.18:0/1273808718 <== osd.11 v2:172.21.15.81:6824/2968006366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd32c062dc0 con 0x7fd30c0ac8f0 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] conn(0x7fd30c0ac8f0 msgr2=0x7fd30c0aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] conn(0x7fd30c0ac8f0 0x7fd30c0aed90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd30c0a2cb0 msgr2=0x7fd30c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd30c0a2cb0 0x7fd30c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd32c109930 tx=0x7fd31400b260 comp rx=0 tx=0).stop 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 msgr2=0x7fd32c1a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 --2- 172.21.15.18:0/1273808718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd32c104450 0x7fd32c1a0870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e9a0 tx=0x7fd31c00ecb0 comp rx=0 tx=0).stop 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd32be00700 1 -- 172.21.15.18:0/1273808718 reap_dead start 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 shutdown_connections 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 >> 172.21.15.18:0/1273808718 conn(0x7fd32c0fff40 msgr2=0x7fd32c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 shutdown_connections 2024-04-21T22:32:20.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:19.750+0000 7fd332800700 1 -- 172.21.15.18:0/1273808718 wait complete. 2024-04-21T22:32:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 -- 172.21.15.18:0/2699485887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 msgr2=0x7f3144108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 --2- 172.21.15.18:0/2699485887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144108680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3134009990 tx=0x7f3134009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 -- 172.21.15.18:0/2699485887 shutdown_connections 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 --2- 172.21.15.18:0/2699485887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f314406b170 0x7f314410f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 --2- 172.21.15.18:0/2699485887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144108680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 --2- 172.21.15.18:0/2699485887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f314406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 -- 172.21.15.18:0/2699485887 >> 172.21.15.18:0/2699485887 conn(0x7f31440780a0 msgr2=0x7f31440784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 -- 172.21.15.18:0/2699485887 shutdown_connections 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.837+0000 7f314aa00700 1 -- 172.21.15.18:0/2699485887 wait complete. 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 Processor -- start 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 -- start start 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f31441011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f314406b170 0x7f3144101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3144112550 con 0x7f31441082a0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31441123d0 con 0x7f314406b170 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.839+0000 7f314aa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f31441126d0 con 0x7f314406a7d0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3148a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f31441011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f31441011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54364/0 (socket says 172.21.15.18:54364) 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 -- 172.21.15.18:0/2410457709 learned_addr learned my addr 172.21.15.18:0/2410457709 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143400700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f314406b170 0x7f3144101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 -- 172.21.15.18:0/2410457709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f314406b170 msgr2=0x7f3144101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f314406b170 0x7f3144101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 -- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 msgr2=0x7f3144101c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144101c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31441a6fb0 con 0x7f314406a7d0 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3148a00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31441082a0 0x7f3144101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.840+0000 7f3143e00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f31441011f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3134000c00 tx=0x7f313400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.841+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134027070 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.841+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3134003d70 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.841+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441a7240 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.841+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400f460 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.841+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a76f0 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.842+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3144062940 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.844+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f313402a070 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3140c00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31280a2d30 0x7f31280a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f31340d0be0 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3143400700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31280a2d30 0x7f31280a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3140c00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] conn(0x7f31280ac970 0x7f31280aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31280af4e0 con 0x7f31280ac970 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.846+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f31340d0f90 con 0x7f314406a7d0 2024-04-21T22:32:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.847+0000 7f3148a00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] conn(0x7f31280ac970 0x7f31280aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.847+0000 7f3143400700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31280a2d30 0x7f31280a51f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3144078780 tx=0x7f3130009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.847+0000 7f3148a00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] conn(0x7f31280ac970 0x7f31280aee10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.848+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== osd.0 v2:172.21.15.18:6802/4177425963 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31280af4e0 con 0x7f31280ac970 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.866+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 --> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3144062dc0 con 0x7f31280ac970 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.867+0000 7f3140c00700 1 -- 172.21.15.18:0/2410457709 <== osd.0 v2:172.21.15.18:6802/4177425963 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3144062dc0 con 0x7f31280ac970 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.867+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] conn(0x7f31280ac970 msgr2=0x7f31280aee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.867+0000 7f314aa00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] conn(0x7f31280ac970 0x7f31280aee10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31280a2d30 msgr2=0x7f31280a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31280a2d30 0x7f31280a51f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3144078780 tx=0x7f3130009260 comp rx=0 tx=0).stop 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 msgr2=0x7f31441011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 --2- 172.21.15.18:0/2410457709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f314406a7d0 0x7f31441011f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3134000c00 tx=0x7f313400ba90 comp rx=0 tx=0).stop 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f3148a00700 1 -- 172.21.15.18:0/2410457709 reap_dead start 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 shutdown_connections 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 >> 172.21.15.18:0/2410457709 conn(0x7f31440780a0 msgr2=0x7f31440fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 shutdown_connections 2024-04-21T22:32:21.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:20.868+0000 7f314aa00700 1 -- 172.21.15.18:0/2410457709 wait complete. 2024-04-21T22:32:21.667 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:21 smithi018 ceph-mon[26614]: pgmap v349: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3 op/s; 126 B/s, 0 objects/s recovering 2024-04-21T22:32:21.736 INFO:teuthology.orchestra.run.smithi018.stdout:309237645340 2024-04-21T22:32:21.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-21T22:32:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:21 smithi081 ceph-mon[31692]: pgmap v349: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3 op/s; 126 B/s, 0 objects/s recovering 2024-04-21T22:32:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:21 smithi047 ceph-mon[31561]: pgmap v349: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3 op/s; 126 B/s, 0 objects/s recovering 2024-04-21T22:32:23.122 INFO:teuthology.orchestra.run.smithi018.stdout:34359738455 2024-04-21T22:32:23.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-21T22:32:23.373 INFO:teuthology.orchestra.run.smithi018.stdout:343597383706 2024-04-21T22:32:23.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-21T22:32:23.580 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:23 smithi018 ceph-mon[26614]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.645+0000 7f060d200700 1 -- 172.21.15.18:0/3893016390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 msgr2=0x7f060806a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.645+0000 7f060d200700 1 --2- 172.21.15.18:0/3893016390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060806a3a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009990 tx=0x7f05f4009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 -- 172.21.15.18:0/3893016390 shutdown_connections 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 --2- 172.21.15.18:0/3893016390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 0x7f060810f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 --2- 172.21.15.18:0/3893016390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 0x7f0608108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 --2- 172.21.15.18:0/3893016390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060806a3a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 -- 172.21.15.18:0/3893016390 >> 172.21.15.18:0/3893016390 conn(0x7f06080780e0 msgr2=0x7f06080784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:23.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.646+0000 7f060d200700 1 -- 172.21.15.18:0/3893016390 shutdown_connections 2024-04-21T22:32:23.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.647+0000 7f060d200700 1 -- 172.21.15.18:0/3893016390 wait complete. 2024-04-21T22:32:23.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.649+0000 7f060d200700 1 Processor -- start 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.649+0000 7f060d200700 1 -- start start 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.649+0000 7f060d200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f060d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 0x7f060819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f060d200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 0x7f06081988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f060d200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0608112580 con 0x7f06081082b0 2024-04-21T22:32:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f060d200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0608112400 con 0x7f0608069f40 2024-04-21T22:32:23.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f060d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0608112700 con 0x7f060806a8e0 2024-04-21T22:32:23.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060819e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39562/0 (socket says 172.21.15.18:39562) 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605e00700 1 -- 172.21.15.18:0/735331260 learned_addr learned my addr 172.21.15.18:0/735331260 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605400700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 0x7f060819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0606800700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 0x7f06081988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605400700 1 -- 172.21.15.18:0/735331260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 msgr2=0x7f060819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605400700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0608069f40 0x7f060819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.650+0000 7f0605400700 1 -- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 msgr2=0x7f06081988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.651+0000 7f0605400700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 0x7f06081988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.651+0000 7f0605400700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0608199080 con 0x7f060806a8e0 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.651+0000 7f0606800700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06081082b0 0x7f06081988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:32:23.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.651+0000 7f0605400700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 0x7f060819ec10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05f40098e0 tx=0x7f05f400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.651+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4027070 con 0x7f060806a8e0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.652+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f400be60 con 0x7f060806a8e0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.652+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4022e30 con 0x7f060806a8e0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.652+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0608199310 con 0x7f060806a8e0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.652+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a5530 con 0x7f060806a8e0 2024-04-21T22:32:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.653+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06080629c0 con 0x7f060806a8e0 2024-04-21T22:32:23.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.658+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f05f402a070 con 0x7f060806a8e0 2024-04-21T22:32:23.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.659+0000 7f05fea00700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f05ec0a2d30 0x7f05ec0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:23.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.659+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f05f40d03e0 con 0x7f060806a8e0 2024-04-21T22:32:23.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.659+0000 7f0605e00700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f05ec0a2d30 0x7f05ec0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.660+0000 7f05fea00700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] conn(0x7f05ec0ac970 0x7f05ec0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.660+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05f4001d30 con 0x7f05ec0ac970 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.660+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f05f40d7050 con 0x7f060806a8e0 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.660+0000 7f0606800700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] conn(0x7f05ec0ac970 0x7f05ec0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.660+0000 7f0605e00700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f05ec0a2d30 0x7f05ec0a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009c10 tx=0x7f05f800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:23.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.661+0000 7f0606800700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] conn(0x7f05ec0ac970 0x7f05ec0aee10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:23.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.662+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== osd.5 v2:172.21.15.81:6808/1072045728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05f4001d30 con 0x7f05ec0ac970 2024-04-21T22:32:23.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.682+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 --> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0608062dc0 con 0x7f05ec0ac970 2024-04-21T22:32:23.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.683+0000 7f05fea00700 1 -- 172.21.15.18:0/735331260 <== osd.5 v2:172.21.15.81:6808/1072045728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0608062dc0 con 0x7f05ec0ac970 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.683+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] conn(0x7f05ec0ac970 msgr2=0x7f05ec0aee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.683+0000 7f060d200700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] conn(0x7f05ec0ac970 0x7f05ec0aee10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f05ec0a2d30 msgr2=0x7f05ec0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f05ec0a2d30 0x7f05ec0a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009c10 tx=0x7f05f800b040 comp rx=0 tx=0).stop 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 msgr2=0x7f060819ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:23.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 --2- 172.21.15.18:0/735331260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060806a8e0 0x7f060819ec10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05f40098e0 tx=0x7f05f400b8a0 comp rx=0 tx=0).stop 2024-04-21T22:32:23.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f0606800700 1 -- 172.21.15.18:0/735331260 reap_dead start 2024-04-21T22:32:23.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 shutdown_connections 2024-04-21T22:32:23.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 >> 172.21.15.18:0/735331260 conn(0x7f06080780e0 msgr2=0x7f06080ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:23.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 shutdown_connections 2024-04-21T22:32:23.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:23.684+0000 7f060d200700 1 -- 172.21.15.18:0/735331260 wait complete. 2024-04-21T22:32:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:23 smithi081 ceph-mon[31692]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:23.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:23 smithi047 ceph-mon[31561]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:24.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 -- 172.21.15.18:0/2544201024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41096a0 msgr2=0x7efed4111270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 --2- 172.21.15.18:0/2544201024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41096a0 0x7efed4111270 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efecc00b0d0 tx=0x7efecc00b3e0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 -- 172.21.15.18:0/2544201024 shutdown_connections 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 --2- 172.21.15.18:0/2544201024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41096a0 0x7efed4111270 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 --2- 172.21.15.18:0/2544201024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41045c0 0x7efed41049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 --2- 172.21.15.18:0/2544201024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 -- 172.21.15.18:0/2544201024 >> 172.21.15.18:0/2544201024 conn(0x7efed40ffe50 msgr2=0x7efed4102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 -- 172.21.15.18:0/2544201024 shutdown_connections 2024-04-21T22:32:24.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.302+0000 7efedaa00700 1 -- 172.21.15.18:0/2544201024 wait complete. 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.303+0000 7efedaa00700 1 Processor -- start 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 -- start start 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41045c0 0x7efed41a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed41a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41096a0 0x7efed419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efed41146e0 con 0x7efed41045c0 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efed4114560 con 0x7efed41096a0 2024-04-21T22:32:24.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efedaa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efed4114860 con 0x7efed4104f70 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efed9600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41045c0 0x7efed41a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efed8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed41a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efed9600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41045c0 0x7efed41a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36278/0 (socket says 172.21.15.18:36278) 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.304+0000 7efed8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed41a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54408/0 (socket says 172.21.15.18:54408) 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed9600700 1 -- 172.21.15.18:0/288565181 learned_addr learned my addr 172.21.15.18:0/288565181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efeda000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41096a0 0x7efed419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 -- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41096a0 msgr2=0x7efed419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41096a0 0x7efed419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 -- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41045c0 msgr2=0x7efed41a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efed41045c0 0x7efed41a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed419b0a0 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efeda000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efed41096a0 0x7efed419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.305+0000 7efed8c00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed41a0cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efec000e9c0 tx=0x7efec000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.306+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec000c9c0 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.306+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efec000cb60 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.306+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed419b390 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.306+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0018680 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.306+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed41a7650 con 0x7efed4104f70 2024-04-21T22:32:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.307+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efed4062940 con 0x7efed4104f70 2024-04-21T22:32:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.309+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efec0010430 con 0x7efed4104f70 2024-04-21T22:32:24.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.310+0000 7efed2000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efebc0a2d30 0x7efebc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:24.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7efec00cf6e0 con 0x7efed4104f70 2024-04-21T22:32:24.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efed9600700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efebc0a2d30 0x7efebc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:24.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efed2000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] conn(0x7efebc0ac970 0x7efebc0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:24.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efebc0af4e0 con 0x7efebc0ac970 2024-04-21T22:32:24.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7efec00cfa90 con 0x7efed4104f70 2024-04-21T22:32:24.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.311+0000 7efeda000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] conn(0x7efebc0ac970 0x7efebc0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:24.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.312+0000 7efed9600700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efebc0a2d30 0x7efebc0a51f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efed419ba80 tx=0x7efec8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:24.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.312+0000 7efeda000700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] conn(0x7efebc0ac970 0x7efebc0aee10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:24.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.313+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== osd.4 v2:172.21.15.47:6808/2276965592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efebc0af4e0 con 0x7efebc0ac970 2024-04-21T22:32:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.331+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 --> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efed4062d40 con 0x7efebc0ac970 2024-04-21T22:32:24.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.331+0000 7efed2000700 1 -- 172.21.15.18:0/288565181 <== osd.4 v2:172.21.15.47:6808/2276965592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efed4062d40 con 0x7efebc0ac970 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] conn(0x7efebc0ac970 msgr2=0x7efebc0aee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] conn(0x7efebc0ac970 0x7efebc0aee10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efebc0a2d30 msgr2=0x7efebc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efebc0a2d30 0x7efebc0a51f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efed419ba80 tx=0x7efec8009260 comp rx=0 tx=0).stop 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 msgr2=0x7efed41a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 --2- 172.21.15.18:0/288565181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efed4104f70 0x7efed41a0cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efec000e9c0 tx=0x7efec000ecd0 comp rx=0 tx=0).stop 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efeda000700 1 -- 172.21.15.18:0/288565181 reap_dead start 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 shutdown_connections 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 >> 172.21.15.18:0/288565181 conn(0x7efed40ffe50 msgr2=0x7efed4100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:24.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 shutdown_connections 2024-04-21T22:32:24.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:24.332+0000 7efedaa00700 1 -- 172.21.15.18:0/288565181 wait complete. 2024-04-21T22:32:24.763 INFO:teuthology.orchestra.run.smithi018.stdout:163208757309 2024-04-21T22:32:24.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-21T22:32:25.099 INFO:teuthology.orchestra.run.smithi018.stdout:55834574931 2024-04-21T22:32:25.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-21T22:32:25.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:25 smithi018 ceph-mon[26614]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:25 smithi081 ceph-mon[31692]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:25 smithi047 ceph-mon[31561]: pgmap v351: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2 op/s; 126 B/s, 1 objects/s recovering 2024-04-21T22:32:25.977 INFO:teuthology.orchestra.run.smithi018.stdout:287762808866 2024-04-21T22:32:25.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-21T22:32:26.331 INFO:teuthology.orchestra.run.smithi018.stdout:141733920834 2024-04-21T22:32:26.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-21T22:32:26.552 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.597 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.607 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.638 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.651 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.664 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.680 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:26.683 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:27 smithi018 ceph-mon[26614]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s; 106 B/s, 1 objects/s recovering 2024-04-21T22:32:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:27 smithi081 ceph-mon[31692]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s; 106 B/s, 1 objects/s recovering 2024-04-21T22:32:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:27 smithi047 ceph-mon[31561]: pgmap v352: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s; 106 B/s, 1 objects/s recovering 2024-04-21T22:32:29.785 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:29 smithi018 ceph-mon[26614]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5 op/s; 95 B/s, 1 objects/s recovering 2024-04-21T22:32:29.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:29 smithi081 ceph-mon[31692]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5 op/s; 95 B/s, 1 objects/s recovering 2024-04-21T22:32:29.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:29 smithi047 ceph-mon[31561]: pgmap v353: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5 op/s; 95 B/s, 1 objects/s recovering 2024-04-21T22:32:30.694 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:30 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:32:30.863 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:30 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:32:30.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:30 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:32:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:31 smithi018 ceph-mon[26614]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s; 84 B/s, 0 objects/s recovering 2024-04-21T22:32:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:31 smithi081 ceph-mon[31692]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s; 84 B/s, 0 objects/s recovering 2024-04-21T22:32:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:31 smithi047 ceph-mon[31561]: pgmap v354: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s; 84 B/s, 0 objects/s recovering 2024-04-21T22:32:33.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.056 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.057 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.057 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:32 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:32 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:33.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:32 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:34.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:33 smithi018 ceph-mon[26614]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:34.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:33 smithi081 ceph-mon[31692]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:34.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:33 smithi047 ceph-mon[31561]: pgmap v355: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:36.046 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:35 smithi018 ceph-mon[26614]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:36.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:35 smithi081 ceph-mon[31692]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:36.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:35 smithi047 ceph-mon[31561]: pgmap v356: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-04-21T22:32:37.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:37 smithi018 ceph-mon[26614]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:37.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 -- 172.21.15.18:0/2652197493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 msgr2=0x7f0024101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:37.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 --2- 172.21.15.18:0/2652197493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f0024101290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0014009990 tx=0x7f0014009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 -- 172.21.15.18:0/2652197493 shutdown_connections 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 --2- 172.21.15.18:0/2652197493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 0x7f0024110e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 --2- 172.21.15.18:0/2652197493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f0024101290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 --2- 172.21.15.18:0/2652197493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 0x7f002410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 -- 172.21.15.18:0/2652197493 >> 172.21.15.18:0/2652197493 conn(0x7f00240fcb50 msgr2=0x7f00240fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 -- 172.21.15.18:0/2652197493 shutdown_connections 2024-04-21T22:32:37.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.950+0000 7f0028a00700 1 -- 172.21.15.18:0/2652197493 wait complete. 2024-04-21T22:32:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 Processor -- start 2024-04-21T22:32:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 -- start start 2024-04-21T22:32:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 0x7f00241a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:37.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 0x7f002419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0024114720 con 0x7f002410ea60 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00241145a0 con 0x7f0024100eb0 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0028a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00241148a0 con 0x7f0024101860 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.952+0000 7f0022800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44476/0 (socket says 172.21.15.18:44476) 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 -- 172.21.15.18:0/2053656687 learned_addr learned my addr 172.21.15.18:0/2053656687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0023200700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 0x7f002419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:37.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f001be00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 0x7f00241a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 -- 172.21.15.18:0/2053656687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 msgr2=0x7f00241a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 0x7f00241a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 -- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 msgr2=0x7f002419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 0x7f002419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 -- 172.21.15.18:0/2053656687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002419b120 con 0x7f0024100eb0 2024-04-21T22:32:37.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.953+0000 7f0022800700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0014005910 tx=0x7f001400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.954+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014027070 con 0x7f0024100eb0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.954+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0014003d70 con 0x7f0024100eb0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.954+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002419b3b0 con 0x7f0024100eb0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.954+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001400f460 con 0x7f0024100eb0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.954+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a76d0 con 0x7f0024100eb0 2024-04-21T22:32:37.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.955+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0000005330 con 0x7f0024100eb0 2024-04-21T22:32:37.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.957+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f001402a070 con 0x7f0024100eb0 2024-04-21T22:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.958+0000 7f001b400700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 0x7f00080a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.958+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f00140d0390 con 0x7f0024100eb0 2024-04-21T22:32:37.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.959+0000 7f001be00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 0x7f00080a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:37.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.959+0000 7f001be00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 0x7f00080a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0024102890 tx=0x7f000c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:37.961+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0014013070 con 0x7f0024100eb0 2024-04-21T22:32:38.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:37 smithi081 ceph-mon[31692]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:38.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:37 smithi047 ceph-mon[31561]: pgmap v357: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:38.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.195+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f00000058f0 con 0x7f0024100eb0 2024-04-21T22:32:38.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.196+0000 7f001b400700 1 -- 172.21.15.18:0/2053656687 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f001409d220 con 0x7f0024100eb0 2024-04-21T22:32:38.216 INFO:teuthology.orchestra.run.smithi018.stdout:197568495673 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.199+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 msgr2=0x7f00080a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.199+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 0x7f00080a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0024102890 tx=0x7f000c009260 comp rx=0 tx=0).stop 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.199+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 msgr2=0x7f00241a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.199+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0014005910 tx=0x7f001400bab0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 shutdown_connections 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f002410ea60 0x7f002419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00080a2d30 0x7f00080a51f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0024100eb0 0x7f00241a0800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 --2- 172.21.15.18:0/2053656687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0024101860 0x7f00241a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 >> 172.21.15.18:0/2053656687 conn(0x7f00240fcb50 msgr2=0x7f00240fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 shutdown_connections 2024-04-21T22:32:38.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.200+0000 7f0028a00700 1 -- 172.21.15.18:0/2053656687 wait complete. 2024-04-21T22:32:38.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 -- 172.21.15.18:0/166997751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 msgr2=0x7f46d406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:38.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 --2- 172.21.15.18:0/166997751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d406ac30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46c00098f0 tx=0x7f46c0009c00 comp rx=0 tx=0).stop 2024-04-21T22:32:38.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 -- 172.21.15.18:0/166997751 shutdown_connections 2024-04-21T22:32:38.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 --2- 172.21.15.18:0/166997751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d410f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 --2- 172.21.15.18:0/166997751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d4108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 --2- 172.21.15.18:0/166997751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d406ac30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 -- 172.21.15.18:0/166997751 >> 172.21.15.18:0/166997751 conn(0x7f46d40780a0 msgr2=0x7f46d40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:38.981 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:38 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2053656687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T22:32:38.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.980+0000 7f46da600700 1 -- 172.21.15.18:0/166997751 shutdown_connections 2024-04-21T22:32:38.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.981+0000 7f46da600700 1 -- 172.21.15.18:0/166997751 wait complete. 2024-04-21T22:32:38.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.982+0000 7f46da600700 1 Processor -- start 2024-04-21T22:32:38.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.982+0000 7f46da600700 1 -- start start 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.982+0000 7f46da600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46da600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46da600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46da600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4112550 con 0x7f46d41082a0 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46da600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46d41123d0 con 0x7f46d406b170 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46da600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46d41126d0 con 0x7f46d406a7d0 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57916/0 (socket says 172.21.15.18:57916) 2024-04-21T22:32:38.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 -- 172.21.15.18:0/1395334025 learned_addr learned my addr 172.21.15.18:0/1395334025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:38.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:38.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d2a00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:38.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 -- 172.21.15.18:0/1395334025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 msgr2=0x7f46d419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 -- 172.21.15.18:0/1395334025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 msgr2=0x7f46d419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.983+0000 7f46d3e00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46d3e00700 1 -- 172.21.15.18:0/1395334025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d4199010 con 0x7f46d41082a0 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46d3400700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46d2a00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46d3e00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00e3c0 tx=0x7f46cc00e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0090d0 con 0x7f46d41082a0 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46cc009270 con 0x7f46d41082a0 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc004030 con 0x7f46d41082a0 2024-04-21T22:32:38.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d4199300 con 0x7f46d41082a0 2024-04-21T22:32:38.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.984+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d41a55c0 con 0x7f46d41082a0 2024-04-21T22:32:38.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.985+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d4068f20 con 0x7f46d41082a0 2024-04-21T22:32:38.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.988+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f46cc012050 con 0x7f46d41082a0 2024-04-21T22:32:38.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.990+0000 7f46cbe00700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 0x7f46b80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:38.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.990+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f46cc0cef40 con 0x7f46d41082a0 2024-04-21T22:32:38.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.991+0000 7f46d3400700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 0x7f46b80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:38.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.991+0000 7f46d3400700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 0x7f46b80a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009680 tx=0x7f46c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:38.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:38.993+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f46cc022060 con 0x7f46d41082a0 2024-04-21T22:32:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:38 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2053656687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T22:32:39.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:38 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2053656687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-21T22:32:39.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.227+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f46d402db30 con 0x7f46d41082a0 2024-04-21T22:32:39.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.227+0000 7f46cbe00700 1 -- 172.21.15.18:0/1395334025 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46cc010040 con 0x7f46d41082a0 2024-04-21T22:32:39.227 INFO:teuthology.orchestra.run.smithi018.stdout:219043332146 2024-04-21T22:32:39.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 msgr2=0x7f46b80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 0x7f46b80a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009680 tx=0x7f46c4009260 comp rx=0 tx=0).stop 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 msgr2=0x7f46d41988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00e3c0 tx=0x7f46cc00e6d0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 shutdown_connections 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46d41082a0 0x7f46d41988b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d406a7d0 0x7f46d419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f46b80a2cb0 0x7f46b80a5170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 --2- 172.21.15.18:0/1395334025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46d406b170 0x7f46d419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 >> 172.21.15.18:0/1395334025 conn(0x7f46d40780a0 msgr2=0x7f46d40ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:39.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 shutdown_connections 2024-04-21T22:32:39.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.232+0000 7f46da600700 1 -- 172.21.15.18:0/1395334025 wait complete. 2024-04-21T22:32:39.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 -- 172.21.15.18:0/2887316504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 msgr2=0x7f7a8c06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 --2- 172.21.15.18:0/2887316504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c06a8e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7a780098f0 tx=0x7f7a78009c00 comp rx=0 tx=0).stop 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 -- 172.21.15.18:0/2887316504 shutdown_connections 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 --2- 172.21.15.18:0/2887316504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c104c70 0x7f7a8c105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 --2- 172.21.15.18:0/2887316504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c107160 0x7f7a8c069f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 --2- 172.21.15.18:0/2887316504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c06a8e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 -- 172.21.15.18:0/2887316504 >> 172.21.15.18:0/2887316504 conn(0x7f7a8c0780e0 msgr2=0x7f7a8c0784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 -- 172.21.15.18:0/2887316504 shutdown_connections 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.385+0000 7f7a91600700 1 -- 172.21.15.18:0/2887316504 wait complete. 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.386+0000 7f7a91600700 1 Processor -- start 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 -- start start 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 0x7f7a8c19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c107160 0x7f7a8c1a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c118ba0 con 0x7f7a8c06a480 2024-04-21T22:32:39.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c118a20 con 0x7f7a8c107160 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a91600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c118d20 con 0x7f7a8c104c70 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a8aa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a8aa00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57954/0 (socket says 172.21.15.18:57954) 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a8aa00700 1 -- 172.21.15.18:0/1515011989 learned_addr learned my addr 172.21.15.18:0/1515011989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.387+0000 7f7a8a000700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 0x7f7a8c19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8b400700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c107160 0x7f7a8c1a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 -- 172.21.15.18:0/1515011989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 msgr2=0x7f7a8c19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 0x7f7a8c19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 -- 172.21.15.18:0/1515011989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c107160 msgr2=0x7f7a8c1a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c107160 0x7f7a8c1a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 -- 172.21.15.18:0/1515011989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c1a4080 con 0x7f7a8c06a480 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8a000700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 0x7f7a8c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.388+0000 7f7a8aa00700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9c0 tx=0x7f7a7c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.389+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00cbd0 con 0x7f7a8c06a480 2024-04-21T22:32:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.389+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a7c00ee60 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.389+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c1a4370 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.389+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c005630 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.389+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c1abbf0 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.390+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c068f20 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.394+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7a7c004750 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.396+0000 7f7a83400700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 0x7f7a700a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.397+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f7a7c0cf580 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.397+0000 7f7a8a000700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 0x7f7a700a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.397+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7a7c09c360 con 0x7f7a8c06a480 2024-04-21T22:32:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.398+0000 7f7a8a000700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 0x7f7a700a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009810 tx=0x7f7a78019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.661+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7a8c1abe20 con 0x7f7a8c06a480 2024-04-21T22:32:39.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.662+0000 7f7a83400700 1 -- 172.21.15.18:0/1515011989 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7a7c09bc60 con 0x7f7a8c06a480 2024-04-21T22:32:39.662 INFO:teuthology.orchestra.run.smithi018.stdout:163208757312 2024-04-21T22:32:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 msgr2=0x7f7a700a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 0x7f7a700a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009810 tx=0x7f7a78019040 comp rx=0 tx=0).stop 2024-04-21T22:32:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 msgr2=0x7f7a8c19f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9c0 tx=0x7f7a7c00ecd0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 shutdown_connections 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7a700a2d30 0x7f7a700a51f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c107160 0x7f7a8c1a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a8c06a480 0x7f7a8c19f070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 --2- 172.21.15.18:0/1515011989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a8c104c70 0x7f7a8c19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 >> 172.21.15.18:0/1515011989 conn(0x7f7a8c0780e0 msgr2=0x7f7a8c103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.665+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 shutdown_connections 2024-04-21T22:32:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.666+0000 7f7a91600700 1 -- 172.21.15.18:0/1515011989 wait complete. 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 -- 172.21.15.18:0/3484773500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 msgr2=0x7f028c10e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 --2- 172.21.15.18:0/3484773500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c10e7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f02780098f0 tx=0x7f0278009c00 comp rx=0 tx=0).stop 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 -- 172.21.15.18:0/3484773500 shutdown_connections 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 --2- 172.21.15.18:0/3484773500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c10ece0 0x7f028c1110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 --2- 172.21.15.18:0/3484773500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c069f40 0x7f028c06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 --2- 172.21.15.18:0/3484773500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c10e7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 -- 172.21.15.18:0/3484773500 >> 172.21.15.18:0/3484773500 conn(0x7f028c0780e0 msgr2=0x7f028c0784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 -- 172.21.15.18:0/3484773500 shutdown_connections 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.265+0000 7f0290c00700 1 -- 172.21.15.18:0/3484773500 wait complete. 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.266+0000 7f0290c00700 1 Processor -- start 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.266+0000 7f0290c00700 1 -- start start 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c10ece0 0x7f028c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f028c1147c0 con 0x7f028c10ece0 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f028c114640 con 0x7f028c06a860 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0290c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f028c114940 con 0x7f028c069f40 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.267+0000 7f0289e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f028a800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c10ece0 0x7f028c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49052/0 (socket says 172.21.15.18:49052) 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 -- 172.21.15.18:0/2527480364 learned_addr learned my addr 172.21.15.18:0/2527480364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289400700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 -- 172.21.15.18:0/2527480364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 msgr2=0x7f028c1a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c1a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 -- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c10ece0 msgr2=0x7f028c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c10ece0 0x7f028c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 -- 172.21.15.18:0/2527480364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c19b2a0 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289400700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.268+0000 7f0289e00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9c0 tx=0x7f027c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.269+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c00cbd0 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.269+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f027c00cd70 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.269+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c005660 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.269+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c19b590 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.269+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c1a7800 con 0x7f028c069f40 2024-04-21T22:32:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.270+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028c068f20 con 0x7f028c069f40 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.272+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f027c004750 con 0x7f028c069f40 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.274+0000 7f0282a00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 0x7f02700a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.274+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f027c0cf530 con 0x7f028c069f40 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.274+0000 7f0289400700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 0x7f02700a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.275+0000 7f0289400700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 0x7f02700a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f028c102760 tx=0x7f0278019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.276+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f027c0536f0 con 0x7f028c069f40 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.517+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f028c02db30 con 0x7f028c069f40 2024-04-21T22:32:40.045 INFO:teuthology.orchestra.run.smithi018.stdout:253403070511 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.518+0000 7f0282a00700 1 -- 172.21.15.18:0/2527480364 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f027c09c2b0 con 0x7f028c069f40 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 msgr2=0x7f02700a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 0x7f02700a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f028c102760 tx=0x7f0278019040 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 msgr2=0x7f028c1a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9c0 tx=0x7f027c00ecd0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 shutdown_connections 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f028c10ece0 0x7f028c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f028c069f40 0x7f028c1a0930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f02700a2d30 0x7f02700a51f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 --2- 172.21.15.18:0/2527480364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f028c06a860 0x7f028c1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 >> 172.21.15.18:0/2527480364 conn(0x7f028c0780e0 msgr2=0x7f028c1101d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:40.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 shutdown_connections 2024-04-21T22:32:40.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:39.521+0000 7f0290c00700 1 -- 172.21.15.18:0/2527480364 wait complete. 2024-04-21T22:32:40.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:39 smithi018 ceph-mon[26614]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:32:40.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1395334025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T22:32:40.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2527480364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T22:32:40.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1515011989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T22:32:40.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:39 smithi081 ceph-mon[31692]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:32:40.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1395334025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T22:32:40.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2527480364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T22:32:40.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1515011989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T22:32:40.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:39 smithi047 ceph-mon[31561]: pgmap v358: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:32:40.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1395334025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-21T22:32:40.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2527480364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-21T22:32:40.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1515011989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-21T22:32:41.080 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495667 got 197568495673 for osd.6 2024-04-21T22:32:41.080 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:41.867 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:41 smithi018 ceph-mon[26614]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:32:42.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:41 smithi081 ceph-mon[31692]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:32:42.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:41 smithi047 ceph-mon[31561]: pgmap v359: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:32:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:43 smithi018 ceph-mon[26614]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:44.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:43 smithi081 ceph-mon[31692]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:44.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:43 smithi047 ceph-mon[31561]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.194+0000 7f6d94a00700 1 -- 172.21.15.18:0/2439485889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d9010e980 msgr2=0x7f6d90110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.194+0000 7f6d94a00700 1 --2- 172.21.15.18:0/2439485889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d9010e980 0x7f6d90110df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b0a0 tx=0x7f6d8800b3b0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.194+0000 7f6d94a00700 1 -- 172.21.15.18:0/2439485889 shutdown_connections 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.194+0000 7f6d94a00700 1 --2- 172.21.15.18:0/2439485889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d9010e980 0x7f6d90110df0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.195+0000 7f6d94a00700 1 --2- 172.21.15.18:0/2439485889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d90074a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.195+0000 7f6d94a00700 1 --2- 172.21.15.18:0/2439485889 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d90074f80 0x7f6d9010e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.195+0000 7f6d94a00700 1 -- 172.21.15.18:0/2439485889 >> 172.21.15.18:0/2439485889 conn(0x7f6d900fdc50 msgr2=0x7f6d90100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.195+0000 7f6d94a00700 1 -- 172.21.15.18:0/2439485889 shutdown_connections 2024-04-21T22:32:44.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.195+0000 7f6d94a00700 1 -- 172.21.15.18:0/2439485889 wait complete. 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 Processor -- start 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 -- start start 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d901a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 0x7f6d901a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d901146a0 con 0x7f6d9010e980 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90114520 con 0x7f6d90074f80 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.196+0000 7f6d94a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90114820 con 0x7f6d90074660 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8f200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d901a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 0x7f6d901a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d901a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49068/0 (socket says 172.21.15.18:49068) 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8f200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57974/0 (socket says 172.21.15.18:57974) 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8e800700 1 -- 172.21.15.18:0/4039988181 learned_addr learned my addr 172.21.15.18:0/4039988181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 -- 172.21.15.18:0/4039988181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 msgr2=0x7f6d901a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:44.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d901a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 -- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 msgr2=0x7f6d9019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 -- 172.21.15.18:0/4039988181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9019b0e0 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8f200700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.197+0000 7f6d8de00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 0x7f6d901a0cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e9f0 tx=0x7f6d7c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.198+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00c9c0 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.198+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c00cb60 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.198+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9019b3d0 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.198+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c018680 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.198+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d901a7640 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.199+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d90068f20 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.202+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d7c010430 con 0x7f6d90074f80 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.203+0000 7f6d87400700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 0x7f6d740a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:44.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.203+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f6d7c0cf2e0 con 0x7f6d90074f80 2024-04-21T22:32:44.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.204+0000 7f6d8e800700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 0x7f6d740a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:44.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.204+0000 7f6d8e800700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 0x7f6d740a5170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d901111b0 tx=0x7f6d80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:44.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.208+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6d7c09c060 con 0x7f6d90074f80 2024-04-21T22:32:44.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.441+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6d9002db30 con 0x7f6d90074f80 2024-04-21T22:32:44.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.442+0000 7f6d87400700 1 -- 172.21.15.18:0/4039988181 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6d7c09b960 con 0x7f6d90074f80 2024-04-21T22:32:44.442 INFO:teuthology.orchestra.run.smithi018.stdout:343597383711 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.444+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 msgr2=0x7f6d740a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.444+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 0x7f6d740a5170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d901111b0 tx=0x7f6d80009260 comp rx=0 tx=0).stop 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.444+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 msgr2=0x7f6d901a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 0x7f6d901a0cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e9f0 tx=0x7f6d7c00ed00 comp rx=0 tx=0).stop 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 shutdown_connections 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d9010e980 0x7f6d9019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d90074660 0x7f6d901a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6d740a2cb0 0x7f6d740a5170 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 --2- 172.21.15.18:0/4039988181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d90074f80 0x7f6d901a0cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 >> 172.21.15.18:0/4039988181 conn(0x7f6d900fdc50 msgr2=0x7f6d900fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 shutdown_connections 2024-04-21T22:32:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:44.445+0000 7f6d94a00700 1 -- 172.21.15.18:0/4039988181 wait complete. 2024-04-21T22:32:45.072 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332141 got 219043332146 for osd.7 2024-04-21T22:32:45.072 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:44 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4039988181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T22:32:45.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.104+0000 7f45c7800700 1 -- 172.21.15.18:0/3639570403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 msgr2=0x7f45c010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.104+0000 7f45c7800700 1 --2- 172.21.15.18:0/3639570403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c010e750 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009990 tx=0x7f45ac009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 -- 172.21.15.18:0/3639570403 shutdown_connections 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 --2- 172.21.15.18:0/3639570403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c0111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 --2- 172.21.15.18:0/3639570403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c0074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 --2- 172.21.15.18:0/3639570403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c010e750 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 -- 172.21.15.18:0/3639570403 >> 172.21.15.18:0/3639570403 conn(0x7f45c0079390 msgr2=0x7f45c00797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 -- 172.21.15.18:0/3639570403 shutdown_connections 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.105+0000 7f45c7800700 1 -- 172.21.15.18:0/3639570403 wait complete. 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.106+0000 7f45c7800700 1 Processor -- start 2024-04-21T22:32:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.106+0000 7f45c7800700 1 -- start start 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.106+0000 7f45c7800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c01a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.106+0000 7f45c7800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c01a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.106+0000 7f45c7800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c7800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45c01147f0 con 0x7f45c0074d80 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c7800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0114670 con 0x7f45c010ec90 2024-04-21T22:32:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c7800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0114970 con 0x7f45c0074460 2024-04-21T22:32:45.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c01a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:45.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c01a0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49090/0 (socket says 172.21.15.18:49090) 2024-04-21T22:32:45.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c4e00700 1 -- 172.21.15.18:0/3956387430 learned_addr learned my addr 172.21.15.18:0/3956387430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:45.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45bfe00700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c01a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 -- 172.21.15.18:0/3956387430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 msgr2=0x7f45c01a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c01a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 -- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 msgr2=0x7f45c01a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c01a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.107+0000 7f45c5800700 1 -- 172.21.15.18:0/3956387430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c019b1b0 con 0x7f45c010ec90 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45c5800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c019aa50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45b800ef90 tx=0x7f45b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b80093a0 con 0x7f45c010ec90 2024-04-21T22:32:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c019b440 con 0x7f45c010ec90 2024-04-21T22:32:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b800c940 con 0x7f45c010ec90 2024-04-21T22:32:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8004520 con 0x7f45c010ec90 2024-04-21T22:32:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.108+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c01a7710 con 0x7f45c010ec90 2024-04-21T22:32:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.109+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c0068f20 con 0x7f45c010ec90 2024-04-21T22:32:45.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.112+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f45b801b030 con 0x7f45c010ec90 2024-04-21T22:32:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.113+0000 7f45bd600700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 0x7f45a80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.113+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f45b80ced50 con 0x7f45c010ec90 2024-04-21T22:32:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.113+0000 7f45c4e00700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 0x7f45a80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.114+0000 7f45c4e00700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 0x7f45a80a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45c0079a30 tx=0x7f45b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:45.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.115+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f45b8022020 con 0x7f45c010ec90 2024-04-21T22:32:45.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:44 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4039988181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T22:32:45.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:44 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4039988181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-21T22:32:45.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.362+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f45c01a78e0 con 0x7f45c010ec90 2024-04-21T22:32:45.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.363+0000 7f45bd600700 1 -- 172.21.15.18:0/3956387430 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f45b8010040 con 0x7f45c010ec90 2024-04-21T22:32:45.364 INFO:teuthology.orchestra.run.smithi018.stdout:77309411410 2024-04-21T22:32:45.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 msgr2=0x7f45a80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:45.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 0x7f45a80a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45c0079a30 tx=0x7f45b4009260 comp rx=0 tx=0).stop 2024-04-21T22:32:45.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 msgr2=0x7f45c019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:45.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c019aa50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45b800ef90 tx=0x7f45b800c3a0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 shutdown_connections 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f45a80a2cb0 0x7f45a80a5170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45c010ec90 0x7f45c019aa50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45c0074460 0x7f45c01a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 --2- 172.21.15.18:0/3956387430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45c0074d80 0x7f45c01a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.368+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 >> 172.21.15.18:0/3956387430 conn(0x7f45c0079390 msgr2=0x7f45c00ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.369+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 shutdown_connections 2024-04-21T22:32:45.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:45.369+0000 7f45c7800700 1 -- 172.21.15.18:0/3956387430 wait complete. 2024-04-21T22:32:46.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:45 smithi018 ceph-mon[26614]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:32:46.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:45 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3956387430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T22:32:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:45 smithi081 ceph-mon[31692]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:32:46.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:45 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3956387430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T22:32:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:45 smithi047 ceph-mon[31561]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:32:46.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:45 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3956387430' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 -- 172.21.15.18:0/1440882925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103c40 msgr2=0x7f78e010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 --2- 172.21.15.18:0/1440882925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103c40 0x7f78e010c130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009990 tx=0x7f78cc009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 -- 172.21.15.18:0/1440882925 shutdown_connections 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 --2- 172.21.15.18:0/1440882925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e010c750 0x7f78e010ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 --2- 172.21.15.18:0/1440882925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e0103320 0x7f78e0103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 --2- 172.21.15.18:0/1440882925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103c40 0x7f78e010c130 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.621+0000 7f78e6e00700 1 -- 172.21.15.18:0/1440882925 >> 172.21.15.18:0/1440882925 conn(0x7f78e00fcb50 msgr2=0x7f78e00fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.622+0000 7f78e6e00700 1 -- 172.21.15.18:0/1440882925 shutdown_connections 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.622+0000 7f78e6e00700 1 -- 172.21.15.18:0/1440882925 wait complete. 2024-04-21T22:32:47.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 Processor -- start 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 -- start start 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 0x7f78e01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0112470 con 0x7f78e0103320 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01122f0 con 0x7f78e0103c40 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.623+0000 7f78e6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01125f0 con 0x7f78e010c750 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e5a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 0x7f78e01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e5000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45292/0 (socket says 172.21.15.18:45292) 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 -- 172.21.15.18:0/598581554 learned_addr learned my addr 172.21.15.18:0/598581554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:47.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e5000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37148/0 (socket says 172.21.15.18:37148) 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e5a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 0x7f78e01a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50720/0 (socket says 172.21.15.18:50720) 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 -- 172.21.15.18:0/598581554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 msgr2=0x7f78e01a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 -- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 msgr2=0x7f78e01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 0x7f78e01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 -- 172.21.15.18:0/598581554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e019b0d0 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e5000700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.624+0000 7f78e6400700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78d800e940 tx=0x7f78d800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.625+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004a30 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.625+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e019b3c0 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.625+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78d8005500 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.625+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d800ce20 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.625+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e01a7680 con 0x7f78e010c750 2024-04-21T22:32:47.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.626+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e006a7f0 con 0x7f78e010c750 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.628+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f78d8005000 con 0x7f78e010c750 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.630+0000 7f78de000700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stdout:287762808872 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.630+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f78d80cf520 con 0x7f78e010c750 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.630+0000 7f78e5a00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:47.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.631+0000 7f78e5a00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 0x7f78c80a5170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009550 tx=0x7f78d40091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.632+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f78d80536f0 con 0x7f78e010c750 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.870+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f78e01a7910 con 0x7f78e010c750 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.882+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f78d8098210 con 0x7f78e010c750 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.883+0000 7f78de000700 1 -- 172.21.15.18:0/598581554 <== mon.1 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f78d80d0620 con 0x7f78e010c750 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 msgr2=0x7f78c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 0x7f78c80a5170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009550 tx=0x7f78d40091f0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 msgr2=0x7f78e019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78d800e940 tx=0x7f78d800ec50 comp rx=0 tx=0).stop 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 shutdown_connections 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78e010c750 0x7f78e019a970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78e0103320 0x7f78e01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f78c80a2cb0 0x7f78c80a5170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 --2- 172.21.15.18:0/598581554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78e0103c40 0x7f78e01a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 >> 172.21.15.18:0/598581554 conn(0x7f78e00fcb50 msgr2=0x7f78e00fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 shutdown_connections 2024-04-21T22:32:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:46.887+0000 7f78e6e00700 1 -- 172.21.15.18:0/598581554 wait complete. 2024-04-21T22:32:47.551 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757309 got 163208757312 for osd.5 2024-04-21T22:32:47.551 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:48.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:47 smithi018 ceph-mon[26614]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-21T22:32:48.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/598581554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T22:32:48.119 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:47 smithi018 ceph-mon[26614]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-21T22:32:48.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070505 got 253403070511 for osd.8 2024-04-21T22:32:48.122 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:48.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:47 smithi081 ceph-mon[31692]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-21T22:32:48.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/598581554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T22:32:48.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:47 smithi081 ceph-mon[31692]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-21T22:32:48.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:47 smithi047 ceph-mon[31561]: pgmap v362: 97 pgs: 97 active+clean; 644 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-21T22:32:48.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/598581554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-21T22:32:48.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:47 smithi047 ceph-mon[31561]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-21T22:32:48.729 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383706 got 343597383711 for osd.11 2024-04-21T22:32:48.730 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:49.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 -- 172.21.15.18:0/270680209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01012c0 msgr2=0x7f00d01016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 --2- 172.21.15.18:0/270680209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01012c0 0x7f00d01016a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00c00099c0 tx=0x7f00c0009cd0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 -- 172.21.15.18:0/270680209 shutdown_connections 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 --2- 172.21.15.18:0/270680209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d01063a0 0x7f00d010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 --2- 172.21.15.18:0/270680209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01012c0 0x7f00d01016a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 --2- 172.21.15.18:0/270680209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d0101c70 0x7f00d0105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 -- 172.21.15.18:0/270680209 >> 172.21.15.18:0/270680209 conn(0x7f00d00fcb50 msgr2=0x7f00d00fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 -- 172.21.15.18:0/270680209 shutdown_connections 2024-04-21T22:32:49.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.287+0000 7f00d5c00700 1 -- 172.21.15.18:0/270680209 wait complete. 2024-04-21T22:32:49.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.289+0000 7f00d5c00700 1 Processor -- start 2024-04-21T22:32:49.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.289+0000 7f00d5c00700 1 -- start start 2024-04-21T22:32:49.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 0x7f00d01a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01063a0 0x7f00d019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01102d0 con 0x7f00d0101c70 2024-04-21T22:32:49.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0110150 con 0x7f00d01012c0 2024-04-21T22:32:49.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0110450 con 0x7f00d01063a0 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00c7e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 0x7f00d01a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00cfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00cfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37186/0 (socket says 172.21.15.18:37186) 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00c7e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 0x7f00d01a0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50748/0 (socket says 172.21.15.18:50748) 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00cfe00700 1 -- 172.21.15.18:0/3673044751 learned_addr learned my addr 172.21.15.18:0/3673044751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.290+0000 7f00d5200700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01063a0 0x7f00d019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 -- 172.21.15.18:0/3673044751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01063a0 msgr2=0x7f00d019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01063a0 0x7f00d019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 -- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 msgr2=0x7f00d01a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 0x7f00d01a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 -- 172.21.15.18:0/3673044751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d019b0a0 con 0x7f00d01012c0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cfe00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00c0006010 tx=0x7f00c000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0003680 con 0x7f00d01012c0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00c00050d0 con 0x7f00d01012c0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d019b330 con 0x7f00d01012c0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.291+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0003db0 con 0x7f00d01012c0 2024-04-21T22:32:49.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.292+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d01a7600 con 0x7f00d01012c0 2024-04-21T22:32:49.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.293+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d0068f20 con 0x7f00d01012c0 2024-04-21T22:32:49.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.295+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f00c0005280 con 0x7f00d01012c0 2024-04-21T22:32:49.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.296+0000 7f00cd600700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 0x7f00b40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.296+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f00c00cfcd0 con 0x7f00d01012c0 2024-04-21T22:32:49.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.296+0000 7f00c7e00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 0x7f00b40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.297+0000 7f00c7e00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 0x7f00b40a52e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00d0107ce0 tx=0x7f00b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:49.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.300+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f00c0013070 con 0x7f00d01012c0 2024-04-21T22:32:49.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.551+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f00d01a77d0 con 0x7f00d01012c0 2024-04-21T22:32:49.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.551+0000 7f00cd600700 1 -- 172.21.15.18:0/3673044751 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f00c009cc40 con 0x7f00d01012c0 2024-04-21T22:32:49.552 INFO:teuthology.orchestra.run.smithi018.stdout:107374182476 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 msgr2=0x7f00b40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 0x7f00b40a52e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00d0107ce0 tx=0x7f00b8009260 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 msgr2=0x7f00d01a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00c0006010 tx=0x7f00c000f690 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 shutdown_connections 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00d01063a0 0x7f00d019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f00b40a2e20 0x7f00b40a52e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00d01012c0 0x7f00d01a0730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 --2- 172.21.15.18:0/3673044751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00d0101c70 0x7f00d01a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.554+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 >> 172.21.15.18:0/3673044751 conn(0x7f00d00fcb50 msgr2=0x7f00d00fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.555+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 shutdown_connections 2024-04-21T22:32:49.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.555+0000 7f00d5c00700 1 -- 172.21.15.18:0/3673044751 wait complete. 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.171+0000 7f0913a00700 1 -- 172.21.15.18:0/2319161573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c107150 msgr2=0x7f090c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.171+0000 7f0913a00700 1 --2- 172.21.15.18:0/2319161573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c107150 0x7f090c06a7d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0900009990 tx=0x7f0900009ca0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 -- 172.21.15.18:0/2319161573 shutdown_connections 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 --2- 172.21.15.18:0/2319161573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c104c60 0x7f090c1050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 --2- 172.21.15.18:0/2319161573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c107150 0x7f090c06a7d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 --2- 172.21.15.18:0/2319161573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 0x7f090c06b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 -- 172.21.15.18:0/2319161573 >> 172.21.15.18:0/2319161573 conn(0x7f090c0780a0 msgr2=0x7f090c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 -- 172.21.15.18:0/2319161573 shutdown_connections 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.172+0000 7f0913a00700 1 -- 172.21.15.18:0/2319161573 wait complete. 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.173+0000 7f0913a00700 1 Processor -- start 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 -- start start 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 0x7f090c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 0x7f090c1a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f090c118b30 con 0x7f090c104c60 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f090c1189b0 con 0x7f090c107150 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.174+0000 7f0913a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f090c118cb0 con 0x7f090c06ad10 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f090be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f090be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50732/0 (socket says 172.21.15.18:50732) 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f090be00700 1 -- 172.21.15.18:0/643746495 learned_addr learned my addr 172.21.15.18:0/643746495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 0x7f090c1a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911000700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 0x7f090c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 -- 172.21.15.18:0/643746495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 msgr2=0x7f090c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 0x7f090c19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 -- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 msgr2=0x7f090c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f0911a00700 1 -- 172.21.15.18:0/643746495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c1a3ff0 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.175+0000 7f090be00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0911a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 0x7f090c1a38b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f090400efc0 tx=0x7f090400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040092e0 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0904004bb0 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904004280 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c1a4280 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.176+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c1abb60 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.177+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090c068f20 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.179+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f090401b030 con 0x7f090c107150 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.181+0000 7f0909600700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 0x7f08f40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:49.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.181+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f09040ceb80 con 0x7f090c107150 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.181+0000 7f0911000700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 0x7f08f40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.182+0000 7f0911000700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 0x7f08f40a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0900006010 tx=0x7f090000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.185+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0904022020 con 0x7f090c107150 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.423+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f090c1abd30 con 0x7f090c107150 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.423+0000 7f0909600700 1 -- 172.21.15.18:0/643746495 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0904010040 con 0x7f090c107150 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stdout:34359738461 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 msgr2=0x7f08f40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 0x7f08f40a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0900006010 tx=0x7f090000b260 comp rx=0 tx=0).stop 2024-04-21T22:32:49.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 msgr2=0x7f090c1a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 0x7f090c1a38b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f090400efc0 tx=0x7f090400c3a0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 shutdown_connections 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f08f40a2c20 0x7f08f40a50e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f090c107150 0x7f090c1a38b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f090c06ad10 0x7f090c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 --2- 172.21.15.18:0/643746495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090c104c60 0x7f090c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.426+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 >> 172.21.15.18:0/643746495 conn(0x7f090c0780a0 msgr2=0x7f090c100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.427+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 shutdown_connections 2024-04-21T22:32:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:49.427+0000 7f0913a00700 1 -- 172.21.15.18:0/643746495 wait complete. 2024-04-21T22:32:50.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:49 smithi081 ceph-mon[31692]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:50.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/643746495' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T22:32:50.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3673044751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T22:32:50.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:49 smithi047 ceph-mon[31561]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:50.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/643746495' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T22:32:50.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3673044751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T22:32:50.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:49 smithi018 ceph-mon[26614]: pgmap v363: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-21T22:32:50.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/643746495' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-21T22:32:50.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3673044751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-21T22:32:50.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411410 for osd.2 2024-04-21T22:32:50.851 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:50.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 -- 172.21.15.18:0/899700742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406b300 msgr2=0x7f748410f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 --2- 172.21.15.18:0/899700742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406b300 0x7f748410f0f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f747c00b0a0 tx=0x7f747c00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 -- 172.21.15.18:0/899700742 shutdown_connections 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 --2- 172.21.15.18:0/899700742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406b300 0x7f748410f0f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 --2- 172.21.15.18:0/899700742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74841082b0 0x7f7484108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 --2- 172.21.15.18:0/899700742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f748406a960 0x7f748406adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 -- 172.21.15.18:0/899700742 >> 172.21.15.18:0/899700742 conn(0x7f74840780e0 msgr2=0x7f74840784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 -- 172.21.15.18:0/899700742 shutdown_connections 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.852+0000 7f748c200700 1 -- 172.21.15.18:0/899700742 wait complete. 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.853+0000 7f748c200700 1 Processor -- start 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 -- start start 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 0x7f74841a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:50.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74841082b0 0x7f748419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112580 con 0x7f748406a960 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112400 con 0x7f748406b300 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748c200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112700 con 0x7f74841082b0 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f7489800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 0x7f74841a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f7488e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f7489800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 0x7f74841a0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50766/0 (socket says 172.21.15.18:50766) 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f7488e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:37198/0 (socket says 172.21.15.18:37198) 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f7489800700 1 -- 172.21.15.18:0/3182500431 learned_addr learned my addr 172.21.15.18:0/3182500431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.854+0000 7f748a200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74841082b0 0x7f748419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 -- 172.21.15.18:0/3182500431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74841082b0 msgr2=0x7f748419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74841082b0 0x7f748419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 -- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 msgr2=0x7f74841a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 0x7f74841a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 -- 172.21.15.18:0/3182500431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748419b160 con 0x7f748406b300 2024-04-21T22:32:50.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7488e00700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f747000e9f0 tx=0x7f747000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470004220 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748419b450 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7470004d10 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.855+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470005020 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.856+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a7710 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.857+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7484068f20 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.859+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7470004750 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.860+0000 7f7482000700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 0x7f746c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.860+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f74700ceef0 con 0x7f748406b300 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.861+0000 7f7489800700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 0x7f746c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.861+0000 7f7489800700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 0x7f746c0a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7478009680 tx=0x7f7478009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:50.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:50.864+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f747009bdd0 con 0x7f748406b300 2024-04-21T22:32:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.095+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f74841a79a0 con 0x7f748406b300 2024-04-21T22:32:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.096+0000 7f7482000700 1 -- 172.21.15.18:0/3182500431 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f747009b6d0 con 0x7f748406b300 2024-04-21T22:32:51.096 INFO:teuthology.orchestra.run.smithi018.stdout:309237645347 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 msgr2=0x7f746c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 0x7f746c0a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7478009680 tx=0x7f7478009260 comp rx=0 tx=0).stop 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 msgr2=0x7f74841a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f747000e9f0 tx=0x7f747000ed00 comp rx=0 tx=0).stop 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 shutdown_connections 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74841082b0 0x7f748419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f748406a960 0x7f74841a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f746c0a2ca0 0x7f746c0a5160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 --2- 172.21.15.18:0/3182500431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f748406b300 0x7f74841a0d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 >> 172.21.15.18:0/3182500431 conn(0x7f74840780e0 msgr2=0x7f74840ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 shutdown_connections 2024-04-21T22:32:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:51.099+0000 7f748c200700 1 -- 172.21.15.18:0/3182500431 wait complete. 2024-04-21T22:32:52.130 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:51 smithi018 ceph-mon[26614]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T22:32:52.131 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:51 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3182500431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T22:32:52.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:51 smithi081 ceph-mon[31692]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T22:32:52.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:51 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3182500431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T22:32:52.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:51 smithi047 ceph-mon[31561]: pgmap v364: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-04-21T22:32:52.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:51 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3182500431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-21T22:32:52.323 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808866 got 287762808872 for osd.9 2024-04-21T22:32:52.324 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 -- 172.21.15.18:0/2977576534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01096a0 msgr2=0x7f06c0111270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 --2- 172.21.15.18:0/2977576534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01096a0 0x7f06c0111270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06b800b0d0 tx=0x7f06b800b3e0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 -- 172.21.15.18:0/2977576534 shutdown_connections 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 --2- 172.21.15.18:0/2977576534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01096a0 0x7f06c0111270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 --2- 172.21.15.18:0/2977576534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01045c0 0x7f06c01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 --2- 172.21.15.18:0/2977576534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c0108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 -- 172.21.15.18:0/2977576534 >> 172.21.15.18:0/2977576534 conn(0x7f06c00ffe50 msgr2=0x7f06c0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 -- 172.21.15.18:0/2977576534 shutdown_connections 2024-04-21T22:32:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.528+0000 7f06c5a00700 1 -- 172.21.15.18:0/2977576534 wait complete. 2024-04-21T22:32:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.529+0000 7f06c5a00700 1 Processor -- start 2024-04-21T22:32:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.529+0000 7f06c5a00700 1 -- start start 2024-04-21T22:32:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 0x7f06c01a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01096a0 0x7f06c019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01146e0 con 0x7f06c01045c0 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0114560 con 0x7f06c01096a0 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0114860 con 0x7f06c0104f70 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06bf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 0x7f06c01a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06bf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45380/0 (socket says 172.21.15.18:45380) 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06bf400700 1 -- 172.21.15.18:0/94925348 learned_addr learned my addr 172.21.15.18:0/94925348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:52.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.530+0000 7f06c5000700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01096a0 0x7f06c019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 -- 172.21.15.18:0/94925348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 msgr2=0x7f06c01a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 -- 172.21.15.18:0/94925348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01096a0 msgr2=0x7f06c019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01096a0 0x7f06c019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 -- 172.21.15.18:0/94925348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c019b000 con 0x7f06c01045c0 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bf400700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:32:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bfe00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 0x7f06c01a06e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06b000e9f0 tx=0x7f06b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b000cb70 con 0x7f06c01045c0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b000ee90 con 0x7f06c01045c0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c019b2f0 con 0x7f06c01045c0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0003dc0 con 0x7f06c01045c0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.531+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c01a75b0 con 0x7f06c01045c0 2024-04-21T22:32:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.532+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c0068f20 con 0x7f06c01045c0 2024-04-21T22:32:52.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.535+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f06b0004000 con 0x7f06c01045c0 2024-04-21T22:32:52.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.536+0000 7f06bcc00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 0x7f06a40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:52.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.536+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f06b00cf220 con 0x7f06c01045c0 2024-04-21T22:32:52.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.536+0000 7f06bf400700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 0x7f06a40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:52.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.537+0000 7f06bf400700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 0x7f06a40a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06c010ab60 tx=0x7f06ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:52.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.541+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f06b009c100 con 0x7f06c01045c0 2024-04-21T22:32:52.659 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182470 got 107374182476 for osd.3 2024-04-21T22:32:52.659 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.779+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f06c01a7840 con 0x7f06c01045c0 2024-04-21T22:32:52.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.779+0000 7f06bcc00700 1 -- 172.21.15.18:0/94925348 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06b009ba00 con 0x7f06c01045c0 2024-04-21T22:32:52.779 INFO:teuthology.orchestra.run.smithi018.stdout:55834574937 2024-04-21T22:32:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 msgr2=0x7f06a40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 0x7f06a40a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06c010ab60 tx=0x7f06ac009260 comp rx=0 tx=0).stop 2024-04-21T22:32:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 msgr2=0x7f06c01a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 0x7f06c01a06e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f06b000e9f0 tx=0x7f06b000ed00 comp rx=0 tx=0).stop 2024-04-21T22:32:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 shutdown_connections 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06a40a2c20 0x7f06a40a50e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c01096a0 0x7f06c019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c01045c0 0x7f06c01a06e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 --2- 172.21.15.18:0/94925348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c0104f70 0x7f06c01a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.783+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 >> 172.21.15.18:0/94925348 conn(0x7f06c00ffe50 msgr2=0x7f06c0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.784+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 shutdown_connections 2024-04-21T22:32:52.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:52.784+0000 7f06c5a00700 1 -- 172.21.15.18:0/94925348 wait complete. 2024-04-21T22:32:53.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:52 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/94925348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T22:32:53.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:52 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/94925348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T22:32:53.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:52 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/94925348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-21T22:32:53.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645340 got 309237645347 for osd.10 2024-04-21T22:32:53.713 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:53.927 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:53 smithi018 ceph-mon[26614]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:54.099 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738455 got 34359738461 for osd.0 2024-04-21T22:32:54.099 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:54.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:53 smithi081 ceph-mon[31692]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:54.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:53 smithi047 ceph-mon[31561]: pgmap v365: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:54.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574931 got 55834574937 for osd.1 2024-04-21T22:32:54.476 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:56.153 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:55 smithi018 ceph-mon[26614]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:56.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:55 smithi047 ceph-mon[31561]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:56.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:55 smithi081 ceph-mon[31692]: pgmap v366: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 -- 172.21.15.18:0/2661908221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 msgr2=0x7efc581027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 --2- 172.21.15.18:0/2661908221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc581027a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc480099c0 tx=0x7efc48009cd0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 -- 172.21.15.18:0/2661908221 shutdown_connections 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 --2- 172.21.15.18:0/2661908221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 0x7efc5810f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 --2- 172.21.15.18:0/2661908221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc581027a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 --2- 172.21.15.18:0/2661908221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 0x7efc58106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 -- 172.21.15.18:0/2661908221 >> 172.21.15.18:0/2661908221 conn(0x7efc580fdcb0 msgr2=0x7efc581000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 -- 172.21.15.18:0/2661908221 shutdown_connections 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.327+0000 7efc57e00700 1 -- 172.21.15.18:0/2661908221 wait complete. 2024-04-21T22:32:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.328+0000 7efc57e00700 1 Processor -- start 2024-04-21T22:32:57.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.328+0000 7efc57e00700 1 -- start start 2024-04-21T22:32:57.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 0x7efc58074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 0x7efc58074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc581124f0 con 0x7efc581023c0 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc58112370 con 0x7efc581074a0 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc57e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc58112670 con 0x7efc58102d70 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc56a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc56a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46844/0 (socket says 172.21.15.18:46844) 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc56a00700 1 -- 172.21.15.18:0/1392069515 learned_addr learned my addr 172.21.15.18:0/1392069515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.329+0000 7efc56000700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 0x7efc58074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc57400700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 0x7efc58074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 -- 172.21.15.18:0/1392069515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 msgr2=0x7efc58074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 0x7efc58074a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 -- 172.21.15.18:0/1392069515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 msgr2=0x7efc58074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 0x7efc58074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 -- 172.21.15.18:0/1392069515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc581ab2d0 con 0x7efc581023c0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc56a00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc48006010 tx=0x7efc48003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.330+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc480050c0 con 0x7efc581023c0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.331+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc4800f460 con 0x7efc581023c0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.331+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc581ab500 con 0x7efc581023c0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.331+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48017650 con 0x7efc581023c0 2024-04-21T22:32:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.331+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc581aba00 con 0x7efc581023c0 2024-04-21T22:32:57.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.332+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc581038a0 con 0x7efc581023c0 2024-04-21T22:32:57.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.334+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efc4800f610 con 0x7efc581023c0 2024-04-21T22:32:57.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.337+0000 7efc4f400700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 0x7efc3c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:32:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.337+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7efc480cfe00 con 0x7efc581023c0 2024-04-21T22:32:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.337+0000 7efc56000700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 0x7efc3c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:32:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.338+0000 7efc56000700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 0x7efc3c0a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efc58075cf0 tx=0x7efc44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:32:57.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.341+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7efc48013070 con 0x7efc581023c0 2024-04-21T22:32:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.589+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efc58075a60 con 0x7efc581023c0 2024-04-21T22:32:57.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.589+0000 7efc4f400700 1 -- 172.21.15.18:0/1392069515 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc48020370 con 0x7efc581023c0 2024-04-21T22:32:57.589 INFO:teuthology.orchestra.run.smithi018.stdout:141733920840 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.592+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 msgr2=0x7efc3c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.592+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 0x7efc3c0a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efc58075cf0 tx=0x7efc44009260 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.592+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 msgr2=0x7efc58074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.592+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc48006010 tx=0x7efc48003a90 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 shutdown_connections 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efc3c0a2ca0 0x7efc3c0a5160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc581074a0 0x7efc58074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc581023c0 0x7efc58074530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 --2- 172.21.15.18:0/1392069515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc58102d70 0x7efc58074a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 >> 172.21.15.18:0/1392069515 conn(0x7efc580fdcb0 msgr2=0x7efc580fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 shutdown_connections 2024-04-21T22:32:57.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:32:57.593+0000 7efc57e00700 1 -- 172.21.15.18:0/1392069515 wait complete. 2024-04-21T22:32:58.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:57 smithi047 ceph-mon[31561]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:58.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:57 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1392069515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T22:32:58.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:57 smithi018 ceph-mon[26614]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:58.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:57 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1392069515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T22:32:58.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:57 smithi081 ceph-mon[31692]: pgmap v367: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:32:58.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:57 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1392069515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-21T22:32:58.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920834 got 141733920840 for osd.4 2024-04-21T22:32:58.532 DEBUG:teuthology.parallel:result is None 2024-04-21T22:32:58.532 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-21T22:32:58.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-21T22:32:59.004 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:32:59.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:59.162 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:58 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:59.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:59.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:58 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:59.289 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:32:59.290 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:58 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:33:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:59 smithi047 ceph-mon[31561]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-21T22:33:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:33:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:33:00.195 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:32:59 smithi047 ceph-mon[31561]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:33:00.241 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:59 smithi018 ceph-mon[26614]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-21T22:33:00.241 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:33:00.242 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:33:00.242 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:32:59 smithi018 ceph-mon[26614]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:33:00.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:59 smithi081 ceph-mon[31692]: pgmap v368: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-04-21T22:33:00.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:33:00.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:33:00.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:32:59 smithi081 ceph-mon[31692]: from='mgr.14152 172.21.15.18:0/4255686947' entity='mgr.x' 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 -- 172.21.15.18:0/646820517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041022e0 msgr2=0x7f3204102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 --2- 172.21.15.18:0/646820517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041022e0 0x7f3204102760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31f00099c0 tx=0x7f31f0009cd0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 -- 172.21.15.18:0/646820517 shutdown_connections 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 --2- 172.21.15.18:0/646820517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3204102ca0 0x7f320410f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 --2- 172.21.15.18:0/646820517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32041082f0 0x7f32041086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 --2- 172.21.15.18:0/646820517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041022e0 0x7f3204102760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 -- 172.21.15.18:0/646820517 >> 172.21.15.18:0/646820517 conn(0x7f3204079390 msgr2=0x7f32040797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:01.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 -- 172.21.15.18:0/646820517 shutdown_connections 2024-04-21T22:33:01.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.355+0000 7f320be00700 1 -- 172.21.15.18:0/646820517 wait complete. 2024-04-21T22:33:01.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.356+0000 7f320be00700 1 Processor -- start 2024-04-21T22:33:01.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.356+0000 7f320be00700 1 -- start start 2024-04-21T22:33:01.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 0x7f32041a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:01.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3204102ca0 0x7f32041a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:01.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:01.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32041125f0 con 0x7f32041082f0 2024-04-21T22:33:01.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3204112470 con 0x7f3204102ca0 2024-04-21T22:33:01.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f320be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3204112770 con 0x7f32041022e0 2024-04-21T22:33:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f3209e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f3209e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-04-21T22:33:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f3209e00700 1 -- 172.21.15.18:0/847263149 learned_addr learned my addr 172.21.15.18:0/847263149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f3209400700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 0x7f32041a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.357+0000 7f3208a00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3204102ca0 0x7f32041a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 -- 172.21.15.18:0/847263149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 msgr2=0x7f32041a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 0x7f32041a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 -- 172.21.15.18:0/847263149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3204102ca0 msgr2=0x7f32041a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3204102ca0 0x7f32041a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 -- 172.21.15.18:0/847263149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320419b100 con 0x7f32041082f0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209400700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 0x7f32041a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3209e00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00efc0 tx=0x7f31fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0092e0 con 0x7f32041082f0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31fc004bb0 con 0x7f32041082f0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc004020 con 0x7f32041082f0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.358+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320419b390 con 0x7f32041082f0 2024-04-21T22:33:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.359+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32041a76b0 con 0x7f32041082f0 2024-04-21T22:33:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.360+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3204068f20 con 0x7f32041082f0 2024-04-21T22:33:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.362+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f31fc01b030 con 0x7f32041082f0 2024-04-21T22:33:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.363+0000 7f3202000700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 0x7f31ec0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.363+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f31fc0ce920 con 0x7f32041082f0 2024-04-21T22:33:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.363+0000 7f3209400700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 0x7f31ec0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.364+0000 7f3209400700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 0x7f31ec0a5160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f320419bae0 tx=0x7f31f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.368+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f31fc022020 con 0x7f32041082f0 2024-04-21T22:33:01.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.594+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3204075cd0 con 0x7f31ec0a2ca0 2024-04-21T22:33:01.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.619+0000 7f3202000700 1 -- 172.21.15.18:0/847263149 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258880 (secure 0 0 0) 0x7f3204075cd0 con 0x7f31ec0a2ca0 2024-04-21T22:33:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 msgr2=0x7f31ec0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 0x7f31ec0a5160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f320419bae0 tx=0x7f31f8009260 comp rx=0 tx=0).stop 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 msgr2=0x7f320419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00efc0 tx=0x7f31fc00c3a0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 shutdown_connections 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32041082f0 0x7f320419a9a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32041022e0 0x7f32041a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f31ec0a2ca0 0x7f31ec0a5160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 --2- 172.21.15.18:0/847263149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3204102ca0 0x7f32041a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.626+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 >> 172.21.15.18:0/847263149 conn(0x7f3204079390 msgr2=0x7f32040745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.627+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 shutdown_connections 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:01.627+0000 7f320be00700 1 -- 172.21.15.18:0/847263149 wait complete. 2024-04-21T22:33:01.628 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:33:02.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:01 smithi047 ceph-mon[31561]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-21T22:33:02.338 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:01 smithi018 ceph-mon[26614]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-21T22:33:02.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:01 smithi081 ceph-mon[31692]: pgmap v369: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-21T22:33:02.399 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-04-21T22:33:00.118277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659742,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":951,"num_read_kb":623,"num_write":436,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181749,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370876,"kb_used_data":13404,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570948,"statfs":{"total":1151940427776,"available":1151560650752,"internally_reserved":0,"allocated":13725696,"data_stored":7448982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":53,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005667"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109477+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:32:46.109477+0000","last_peered":"2024-04-21T22:32:46.109477+0000","last_clean":"2024-04-21T22:32:46.109477+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:32:46.109477+0000","last_undegraded":"2024-04-21T22:32:46.109477+0000","last_fullsized":"2024-04-21T22:32:46.109477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.106562+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:32:46.106562+0000","last_peered":"2024-04-21T22:32:46.106562+0000","last_clean":"2024-04-21T22:32:46.106562+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:32:46.106562+0000","last_undegraded":"2024-04-21T22:32:46.106562+0000","last_fullsized":"2024-04-21T22:32:46.106562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105547+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:32:46.105547+0000","last_peered":"2024-04-21T22:32:46.105547+0000","last_clean":"2024-04-21T22:32:46.105547+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:32:46.105547+0000","last_undegraded":"2024-04-21T22:32:46.105547+0000","last_fullsized":"2024-04-21T22:32:46.105547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.075044+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:32:46.075044+0000","last_peered":"2024-04-21T22:32:46.075044+0000","last_clean":"2024-04-21T22:32:46.075044+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:32:46.075044+0000","last_undegraded":"2024-04-21T22:32:46.075044+0000","last_fullsized":"2024-04-21T22:32:46.075044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.066356+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:32:46.066356+0000","last_peered":"2024-04-21T22:32:46.066356+0000","last_clean":"2024-04-21T22:32:46.066356+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:32:46.066356+0000","last_undegraded":"2024-04-21T22:32:46.066356+0000","last_fullsized":"2024-04-21T22:32:46.066356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.100430+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:32:46.100430+0000","last_peered":"2024-04-21T22:32:46.100430+0000","last_clean":"2024-04-21T22:32:46.100430+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:32:46.100430+0000","last_undegraded":"2024-04-21T22:32:46.100430+0000","last_fullsized":"2024-04-21T22:32:46.100430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104628+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:32:46.104628+0000","last_peered":"2024-04-21T22:32:46.104628+0000","last_clean":"2024-04-21T22:32:46.104628+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:32:46.104628+0000","last_undegraded":"2024-04-21T22:32:46.104628+0000","last_fullsized":"2024-04-21T22:32:46.104628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091467+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:32:46.091467+0000","last_peered":"2024-04-21T22:32:46.091467+0000","last_clean":"2024-04-21T22:32:46.091467+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:32:46.091467+0000","last_undegraded":"2024-04-21T22:32:46.091467+0000","last_fullsized":"2024-04-21T22:32:46.091467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089156+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:32:46.089156+0000","last_peered":"2024-04-21T22:32:46.089156+0000","last_clean":"2024-04-21T22:32:46.089156+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:32:46.089156+0000","last_undegraded":"2024-04-21T22:32:46.089156+0000","last_fullsized":"2024-04-21T22:32:46.089156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105970+0000","last_change":"2024-04-21T22:32:17.561622+0000","last_active":"2024-04-21T22:32:46.105970+0000","last_peered":"2024-04-21T22:32:46.105970+0000","last_clean":"2024-04-21T22:32:46.105970+0000","last_became_active":"2024-04-21T22:32:17.561139+0000","last_became_peered":"2024-04-21T22:32:17.561139+0000","last_unstale":"2024-04-21T22:32:46.105970+0000","last_undegraded":"2024-04-21T22:32:46.105970+0000","last_fullsized":"2024-04-21T22:32:46.105970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:52:09.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091422+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:32:46.091422+0000","last_peered":"2024-04-21T22:32:46.091422+0000","last_clean":"2024-04-21T22:32:46.091422+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:32:46.091422+0000","last_undegraded":"2024-04-21T22:32:46.091422+0000","last_fullsized":"2024-04-21T22:32:46.091422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.074328+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:32:46.074328+0000","last_peered":"2024-04-21T22:32:46.074328+0000","last_clean":"2024-04-21T22:32:46.074328+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:32:46.074328+0000","last_undegraded":"2024-04-21T22:32:46.074328+0000","last_fullsized":"2024-04-21T22:32:46.074328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.093363+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:32:46.093363+0000","last_peered":"2024-04-21T22:32:46.093363+0000","last_clean":"2024-04-21T22:32:46.093363+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:32:46.093363+0000","last_undegraded":"2024-04-21T22:32:46.093363+0000","last_fullsized":"2024-04-21T22:32:46.093363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105852+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:32:46.105852+0000","last_peered":"2024-04-21T22:32:46.105852+0000","last_clean":"2024-04-21T22:32:46.105852+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:32:46.105852+0000","last_undegraded":"2024-04-21T22:32:46.105852+0000","last_fullsized":"2024-04-21T22:32:46.105852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107967+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:32:46.107967+0000","last_peered":"2024-04-21T22:32:46.107967+0000","last_clean":"2024-04-21T22:32:46.107967+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:32:46.107967+0000","last_undegraded":"2024-04-21T22:32:46.107967+0000","last_fullsized":"2024-04-21T22:32:46.107967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.097809+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:32:46.097809+0000","last_peered":"2024-04-21T22:32:46.097809+0000","last_clean":"2024-04-21T22:32:46.097809+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:32:46.097809+0000","last_undegraded":"2024-04-21T22:32:46.097809+0000","last_fullsized":"2024-04-21T22:32:46.097809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109529+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:32:46.109529+0000","last_peered":"2024-04-21T22:32:46.109529+0000","last_clean":"2024-04-21T22:32:46.109529+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:32:46.109529+0000","last_undegraded":"2024-04-21T22:32:46.109529+0000","last_fullsized":"2024-04-21T22:32:46.109529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104208+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:32:46.104208+0000","last_peered":"2024-04-21T22:32:46.104208+0000","last_clean":"2024-04-21T22:32:46.104208+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:32:46.104208+0000","last_undegraded":"2024-04-21T22:32:46.104208+0000","last_fullsized":"2024-04-21T22:32:46.104208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089959+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:32:46.089959+0000","last_peered":"2024-04-21T22:32:46.089959+0000","last_clean":"2024-04-21T22:32:46.089959+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:32:46.089959+0000","last_undegraded":"2024-04-21T22:32:46.089959+0000","last_fullsized":"2024-04-21T22:32:46.089959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:56.721872+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:32:56.721872+0000","last_peered":"2024-04-21T22:32:56.721872+0000","last_clean":"2024-04-21T22:32:56.721872+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:32:56.721872+0000","last_undegraded":"2024-04-21T22:32:56.721872+0000","last_fullsized":"2024-04-21T22:32:56.721872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.085691+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:32:46.085691+0000","last_peered":"2024-04-21T22:32:46.085691+0000","last_clean":"2024-04-21T22:32:46.085691+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:32:46.085691+0000","last_undegraded":"2024-04-21T22:32:46.085691+0000","last_fullsized":"2024-04-21T22:32:46.085691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.562442+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:32:17.562442+0000","last_peered":"2024-04-21T22:32:17.562442+0000","last_clean":"2024-04-21T22:32:17.562442+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:32:17.562442+0000","last_undegraded":"2024-04-21T22:32:17.562442+0000","last_fullsized":"2024-04-21T22:32:17.562442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105716+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:32:46.105716+0000","last_peered":"2024-04-21T22:32:46.105716+0000","last_clean":"2024-04-21T22:32:46.105716+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:32:46.105716+0000","last_undegraded":"2024-04-21T22:32:46.105716+0000","last_fullsized":"2024-04-21T22:32:46.105716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556448+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:32:17.556448+0000","last_peered":"2024-04-21T22:32:17.556448+0000","last_clean":"2024-04-21T22:32:17.556448+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:32:17.556448+0000","last_undegraded":"2024-04-21T22:32:17.556448+0000","last_fullsized":"2024-04-21T22:32:17.556448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.092989+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:32:46.092989+0000","last_peered":"2024-04-21T22:32:46.092989+0000","last_clean":"2024-04-21T22:32:46.092989+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:32:46.092989+0000","last_undegraded":"2024-04-21T22:32:46.092989+0000","last_fullsized":"2024-04-21T22:32:46.092989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555523+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:32:17.555523+0000","last_peered":"2024-04-21T22:32:17.555523+0000","last_clean":"2024-04-21T22:32:17.555523+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:32:17.555523+0000","last_undegraded":"2024-04-21T22:32:17.555523+0000","last_fullsized":"2024-04-21T22:32:17.555523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.086162+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:32:46.086162+0000","last_peered":"2024-04-21T22:32:46.086162+0000","last_clean":"2024-04-21T22:32:46.086162+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:32:46.086162+0000","last_undegraded":"2024-04-21T22:32:46.086162+0000","last_fullsized":"2024-04-21T22:32:46.086162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:54.617071+0000","last_change":"2024-04-21T22:32:17.565781+0000","last_active":"2024-04-21T22:32:54.617071+0000","last_peered":"2024-04-21T22:32:54.617071+0000","last_clean":"2024-04-21T22:32:54.617071+0000","last_became_active":"2024-04-21T22:32:17.560490+0000","last_became_peered":"2024-04-21T22:32:17.560490+0000","last_unstale":"2024-04-21T22:32:54.617071+0000","last_undegraded":"2024-04-21T22:32:54.617071+0000","last_fullsized":"2024-04-21T22:32:54.617071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:20.976913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.100060+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:32:46.100060+0000","last_peered":"2024-04-21T22:32:46.100060+0000","last_clean":"2024-04-21T22:32:46.100060+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:32:46.100060+0000","last_undegraded":"2024-04-21T22:32:46.100060+0000","last_fullsized":"2024-04-21T22:32:46.100060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.568151+0000","last_change":"2024-04-21T22:32:17.568151+0000","last_active":"2024-04-21T22:32:17.568151+0000","last_peered":"2024-04-21T22:32:17.568151+0000","last_clean":"2024-04-21T22:32:17.568151+0000","last_became_active":"2024-04-21T22:32:17.560167+0000","last_became_peered":"2024-04-21T22:32:17.560167+0000","last_unstale":"2024-04-21T22:32:17.568151+0000","last_undegraded":"2024-04-21T22:32:17.568151+0000","last_fullsized":"2024-04-21T22:32:17.568151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:08.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091823+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:32:46.091823+0000","last_peered":"2024-04-21T22:32:46.091823+0000","last_clean":"2024-04-21T22:32:46.091823+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:32:46.091823+0000","last_undegraded":"2024-04-21T22:32:46.091823+0000","last_fullsized":"2024-04-21T22:32:46.091823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556330+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:32:17.556330+0000","last_peered":"2024-04-21T22:32:17.556330+0000","last_clean":"2024-04-21T22:32:17.556330+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:32:17.556330+0000","last_undegraded":"2024-04-21T22:32:17.556330+0000","last_fullsized":"2024-04-21T22:32:17.556330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095016+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:32:46.095016+0000","last_peered":"2024-04-21T22:32:46.095016+0000","last_clean":"2024-04-21T22:32:46.095016+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:32:46.095016+0000","last_undegraded":"2024-04-21T22:32:46.095016+0000","last_fullsized":"2024-04-21T22:32:46.095016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555278+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:32:17.555278+0000","last_peered":"2024-04-21T22:32:17.555278+0000","last_clean":"2024-04-21T22:32:17.555278+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:32:17.555278+0000","last_undegraded":"2024-04-21T22:32:17.555278+0000","last_fullsized":"2024-04-21T22:32:17.555278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104805+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:32:46.104805+0000","last_peered":"2024-04-21T22:32:46.104805+0000","last_clean":"2024-04-21T22:32:46.104805+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:32:46.104805+0000","last_undegraded":"2024-04-21T22:32:46.104805+0000","last_fullsized":"2024-04-21T22:32:46.104805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":187,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:55.618122+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:32:55.618122+0000","last_peered":"2024-04-21T22:32:55.618122+0000","last_clean":"2024-04-21T22:32:55.618122+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:32:55.618122+0000","last_undegraded":"2024-04-21T22:32:55.618122+0000","last_fullsized":"2024-04-21T22:32:55.618122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":162,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104688+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:32:46.104688+0000","last_peered":"2024-04-21T22:32:46.104688+0000","last_clean":"2024-04-21T22:32:46.104688+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:32:46.104688+0000","last_undegraded":"2024-04-21T22:32:46.104688+0000","last_fullsized":"2024-04-21T22:32:46.104688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552955+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:32:17.552955+0000","last_peered":"2024-04-21T22:32:17.552955+0000","last_clean":"2024-04-21T22:32:17.552955+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:32:17.552955+0000","last_undegraded":"2024-04-21T22:32:17.552955+0000","last_fullsized":"2024-04-21T22:32:17.552955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108546+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:32:46.108546+0000","last_peered":"2024-04-21T22:32:46.108546+0000","last_clean":"2024-04-21T22:32:46.108546+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:32:46.108546+0000","last_undegraded":"2024-04-21T22:32:46.108546+0000","last_fullsized":"2024-04-21T22:32:46.108546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555939+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:32:17.555939+0000","last_peered":"2024-04-21T22:32:17.555939+0000","last_clean":"2024-04-21T22:32:17.555939+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:32:17.555939+0000","last_undegraded":"2024-04-21T22:32:17.555939+0000","last_fullsized":"2024-04-21T22:32:17.555939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.090445+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:32:46.090445+0000","last_peered":"2024-04-21T22:32:46.090445+0000","last_clean":"2024-04-21T22:32:46.090445+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:32:46.090445+0000","last_undegraded":"2024-04-21T22:32:46.090445+0000","last_fullsized":"2024-04-21T22:32:46.090445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'35","reported_seq":228,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:55.618102+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:32:55.618102+0000","last_peered":"2024-04-21T22:32:55.618102+0000","last_clean":"2024-04-21T22:32:55.618102+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:32:55.618102+0000","last_undegraded":"2024-04-21T22:32:55.618102+0000","last_fullsized":"2024-04-21T22:32:55.618102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61122,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":147,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081955+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:32:46.081955+0000","last_peered":"2024-04-21T22:32:46.081955+0000","last_clean":"2024-04-21T22:32:46.081955+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:32:46.081955+0000","last_undegraded":"2024-04-21T22:32:46.081955+0000","last_fullsized":"2024-04-21T22:32:46.081955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.558842+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:32:17.558842+0000","last_peered":"2024-04-21T22:32:17.558842+0000","last_clean":"2024-04-21T22:32:17.558842+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:32:17.558842+0000","last_undegraded":"2024-04-21T22:32:17.558842+0000","last_fullsized":"2024-04-21T22:32:17.558842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099843+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:32:46.099843+0000","last_peered":"2024-04-21T22:32:46.099843+0000","last_clean":"2024-04-21T22:32:46.099843+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:32:46.099843+0000","last_undegraded":"2024-04-21T22:32:46.099843+0000","last_fullsized":"2024-04-21T22:32:46.099843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555056+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:32:17.555056+0000","last_peered":"2024-04-21T22:32:17.555056+0000","last_clean":"2024-04-21T22:32:17.555056+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:32:17.555056+0000","last_undegraded":"2024-04-21T22:32:17.555056+0000","last_fullsized":"2024-04-21T22:32:17.555056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.094411+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:32:46.094411+0000","last_peered":"2024-04-21T22:32:46.094411+0000","last_clean":"2024-04-21T22:32:46.094411+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:32:46.094411+0000","last_undegraded":"2024-04-21T22:32:46.094411+0000","last_fullsized":"2024-04-21T22:32:46.094411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'7","reported_seq":111,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:56.721897+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:32:56.721897+0000","last_peered":"2024-04-21T22:32:56.721897+0000","last_clean":"2024-04-21T22:32:56.721897+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:32:56.721897+0000","last_undegraded":"2024-04-21T22:32:56.721897+0000","last_fullsized":"2024-04-21T22:32:56.721897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.085723+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:32:46.085723+0000","last_peered":"2024-04-21T22:32:46.085723+0000","last_clean":"2024-04-21T22:32:46.085723+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:32:46.085723+0000","last_undegraded":"2024-04-21T22:32:46.085723+0000","last_fullsized":"2024-04-21T22:32:46.085723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555595+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:32:17.555595+0000","last_peered":"2024-04-21T22:32:17.555595+0000","last_clean":"2024-04-21T22:32:17.555595+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:32:17.555595+0000","last_undegraded":"2024-04-21T22:32:17.555595+0000","last_fullsized":"2024-04-21T22:32:17.555595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.079696+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:32:46.079696+0000","last_peered":"2024-04-21T22:32:46.079696+0000","last_clean":"2024-04-21T22:32:46.079696+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:32:46.079696+0000","last_undegraded":"2024-04-21T22:32:46.079696+0000","last_fullsized":"2024-04-21T22:32:46.079696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555895+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:32:17.555895+0000","last_peered":"2024-04-21T22:32:17.555895+0000","last_clean":"2024-04-21T22:32:17.555895+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:32:17.555895+0000","last_undegraded":"2024-04-21T22:32:17.555895+0000","last_fullsized":"2024-04-21T22:32:17.555895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081013+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:32:46.081013+0000","last_peered":"2024-04-21T22:32:46.081013+0000","last_clean":"2024-04-21T22:32:46.081013+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:32:46.081013+0000","last_undegraded":"2024-04-21T22:32:46.081013+0000","last_fullsized":"2024-04-21T22:32:46.081013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552891+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:32:17.552891+0000","last_peered":"2024-04-21T22:32:17.552891+0000","last_clean":"2024-04-21T22:32:17.552891+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:32:17.552891+0000","last_undegraded":"2024-04-21T22:32:17.552891+0000","last_fullsized":"2024-04-21T22:32:17.552891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095772+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:32:46.095772+0000","last_peered":"2024-04-21T22:32:46.095772+0000","last_clean":"2024-04-21T22:32:46.095772+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:32:46.095772+0000","last_undegraded":"2024-04-21T22:32:46.095772+0000","last_fullsized":"2024-04-21T22:32:46.095772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":107,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:56.722362+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:32:56.722362+0000","last_peered":"2024-04-21T22:32:56.722362+0000","last_clean":"2024-04-21T22:32:56.722362+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:32:56.722362+0000","last_undegraded":"2024-04-21T22:32:56.722362+0000","last_fullsized":"2024-04-21T22:32:56.722362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107148+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:32:46.107148+0000","last_peered":"2024-04-21T22:32:46.107148+0000","last_clean":"2024-04-21T22:32:46.107148+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:32:46.107148+0000","last_undegraded":"2024-04-21T22:32:46.107148+0000","last_fullsized":"2024-04-21T22:32:46.107148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.103991+0000","last_change":"2024-04-21T22:32:17.633622+0000","last_active":"2024-04-21T22:32:46.103991+0000","last_peered":"2024-04-21T22:32:46.103991+0000","last_clean":"2024-04-21T22:32:46.103991+0000","last_became_active":"2024-04-21T22:32:17.633145+0000","last_became_peered":"2024-04-21T22:32:17.633145+0000","last_unstale":"2024-04-21T22:32:46.103991+0000","last_undegraded":"2024-04-21T22:32:46.103991+0000","last_fullsized":"2024-04-21T22:32:46.103991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:23:14.639799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:56.721046+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:32:56.721046+0000","last_peered":"2024-04-21T22:32:56.721046+0000","last_clean":"2024-04-21T22:32:56.721046+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:32:56.721046+0000","last_undegraded":"2024-04-21T22:32:56.721046+0000","last_fullsized":"2024-04-21T22:32:56.721046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.088059+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:32:46.088059+0000","last_peered":"2024-04-21T22:32:46.088059+0000","last_clean":"2024-04-21T22:32:46.088059+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:32:46.088059+0000","last_undegraded":"2024-04-21T22:32:46.088059+0000","last_fullsized":"2024-04-21T22:32:46.088059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.632041+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:32:17.632041+0000","last_peered":"2024-04-21T22:32:17.632041+0000","last_clean":"2024-04-21T22:32:17.632041+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:32:17.632041+0000","last_undegraded":"2024-04-21T22:32:17.632041+0000","last_fullsized":"2024-04-21T22:32:17.632041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":352,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552728+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:32:17.552728+0000","last_peered":"2024-04-21T22:32:17.552728+0000","last_clean":"2024-04-21T22:32:17.552728+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:32:17.552728+0000","last_undegraded":"2024-04-21T22:32:17.552728+0000","last_fullsized":"2024-04-21T22:32:17.552728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.075754+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:32:46.075754+0000","last_peered":"2024-04-21T22:32:46.075754+0000","last_clean":"2024-04-21T22:32:46.075754+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:32:46.075754+0000","last_undegraded":"2024-04-21T22:32:46.075754+0000","last_fullsized":"2024-04-21T22:32:46.075754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.636128+0000","last_change":"2024-04-21T22:32:17.636128+0000","last_active":"2024-04-21T22:32:17.636128+0000","last_peered":"2024-04-21T22:32:17.636128+0000","last_clean":"2024-04-21T22:32:17.636128+0000","last_became_active":"2024-04-21T22:32:17.633263+0000","last_became_peered":"2024-04-21T22:32:17.633263+0000","last_unstale":"2024-04-21T22:32:17.636128+0000","last_undegraded":"2024-04-21T22:32:17.636128+0000","last_fullsized":"2024-04-21T22:32:17.636128+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:10:53.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556330+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:32:17.556330+0000","last_peered":"2024-04-21T22:32:17.556330+0000","last_clean":"2024-04-21T22:32:17.556330+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:32:17.556330+0000","last_undegraded":"2024-04-21T22:32:17.556330+0000","last_fullsized":"2024-04-21T22:32:17.556330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.102091+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:32:46.102091+0000","last_peered":"2024-04-21T22:32:46.102091+0000","last_clean":"2024-04-21T22:32:46.102091+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:32:46.102091+0000","last_undegraded":"2024-04-21T22:32:46.102091+0000","last_fullsized":"2024-04-21T22:32:46.102091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'14","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552885+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:32:17.552885+0000","last_peered":"2024-04-21T22:32:17.552885+0000","last_clean":"2024-04-21T22:32:17.552885+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:32:17.552885+0000","last_undegraded":"2024-04-21T22:32:17.552885+0000","last_fullsized":"2024-04-21T22:32:17.552885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095773+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:32:46.095773+0000","last_peered":"2024-04-21T22:32:46.095773+0000","last_clean":"2024-04-21T22:32:46.095773+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:32:46.095773+0000","last_undegraded":"2024-04-21T22:32:46.095773+0000","last_fullsized":"2024-04-21T22:32:46.095773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.631990+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:32:17.631990+0000","last_peered":"2024-04-21T22:32:17.631990+0000","last_clean":"2024-04-21T22:32:17.631990+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:32:17.631990+0000","last_undegraded":"2024-04-21T22:32:17.631990+0000","last_fullsized":"2024-04-21T22:32:17.631990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108539+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:32:46.108539+0000","last_peered":"2024-04-21T22:32:46.108539+0000","last_clean":"2024-04-21T22:32:46.108539+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:32:46.108539+0000","last_undegraded":"2024-04-21T22:32:46.108539+0000","last_fullsized":"2024-04-21T22:32:46.108539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.566661+0000","last_change":"2024-04-21T22:32:17.566661+0000","last_active":"2024-04-21T22:32:17.566661+0000","last_peered":"2024-04-21T22:32:17.566661+0000","last_clean":"2024-04-21T22:32:17.566661+0000","last_became_active":"2024-04-21T22:32:17.563348+0000","last_became_peered":"2024-04-21T22:32:17.563348+0000","last_unstale":"2024-04-21T22:32:17.566661+0000","last_undegraded":"2024-04-21T22:32:17.566661+0000","last_fullsized":"2024-04-21T22:32:17.566661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:05:28.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.049063+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:32:46.049063+0000","last_peered":"2024-04-21T22:32:46.049063+0000","last_clean":"2024-04-21T22:32:46.049063+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:32:46.049063+0000","last_undegraded":"2024-04-21T22:32:46.049063+0000","last_fullsized":"2024-04-21T22:32:46.049063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.561241+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:32:17.561241+0000","last_peered":"2024-04-21T22:32:17.561241+0000","last_clean":"2024-04-21T22:32:17.561241+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:32:17.561241+0000","last_undegraded":"2024-04-21T22:32:17.561241+0000","last_fullsized":"2024-04-21T22:32:17.561241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109161+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:32:46.109161+0000","last_peered":"2024-04-21T22:32:46.109161+0000","last_clean":"2024-04-21T22:32:46.109161+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:32:46.109161+0000","last_undegraded":"2024-04-21T22:32:46.109161+0000","last_fullsized":"2024-04-21T22:32:46.109161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.558673+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:32:17.558673+0000","last_peered":"2024-04-21T22:32:17.558673+0000","last_clean":"2024-04-21T22:32:17.558673+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:32:17.558673+0000","last_undegraded":"2024-04-21T22:32:17.558673+0000","last_fullsized":"2024-04-21T22:32:17.558673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.103621+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:32:46.103621+0000","last_peered":"2024-04-21T22:32:46.103621+0000","last_clean":"2024-04-21T22:32:46.103621+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:32:46.103621+0000","last_undegraded":"2024-04-21T22:32:46.103621+0000","last_fullsized":"2024-04-21T22:32:46.103621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.571734+0000","last_change":"2024-04-21T22:32:17.571734+0000","last_active":"2024-04-21T22:32:17.571734+0000","last_peered":"2024-04-21T22:32:17.571734+0000","last_clean":"2024-04-21T22:32:17.571734+0000","last_became_active":"2024-04-21T22:32:17.559276+0000","last_became_peered":"2024-04-21T22:32:17.559276+0000","last_unstale":"2024-04-21T22:32:17.571734+0000","last_undegraded":"2024-04-21T22:32:17.571734+0000","last_fullsized":"2024-04-21T22:32:17.571734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:45.969569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.094289+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:32:46.094289+0000","last_peered":"2024-04-21T22:32:46.094289+0000","last_clean":"2024-04-21T22:32:46.094289+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:32:46.094289+0000","last_undegraded":"2024-04-21T22:32:46.094289+0000","last_fullsized":"2024-04-21T22:32:46.094289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'7","reported_seq":110,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:55.653338+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:32:55.653338+0000","last_peered":"2024-04-21T22:32:55.653338+0000","last_clean":"2024-04-21T22:32:55.653338+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:32:55.653338+0000","last_undegraded":"2024-04-21T22:32:55.653338+0000","last_fullsized":"2024-04-21T22:32:55.653338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091381+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:32:46.091381+0000","last_peered":"2024-04-21T22:32:46.091381+0000","last_clean":"2024-04-21T22:32:46.091381+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:32:46.091381+0000","last_undegraded":"2024-04-21T22:32:46.091381+0000","last_fullsized":"2024-04-21T22:32:46.091381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555726+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:32:17.555726+0000","last_peered":"2024-04-21T22:32:17.555726+0000","last_clean":"2024-04-21T22:32:17.555726+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:32:17.555726+0000","last_undegraded":"2024-04-21T22:32:17.555726+0000","last_fullsized":"2024-04-21T22:32:17.555726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095851+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:32:46.095851+0000","last_peered":"2024-04-21T22:32:46.095851+0000","last_clean":"2024-04-21T22:32:46.095851+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:32:46.095851+0000","last_undegraded":"2024-04-21T22:32:46.095851+0000","last_fullsized":"2024-04-21T22:32:46.095851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.639229+0000","last_change":"2024-04-21T22:32:17.639229+0000","last_active":"2024-04-21T22:32:17.639229+0000","last_peered":"2024-04-21T22:32:17.639229+0000","last_clean":"2024-04-21T22:32:17.639229+0000","last_became_active":"2024-04-21T22:32:17.633285+0000","last_became_peered":"2024-04-21T22:32:17.633285+0000","last_unstale":"2024-04-21T22:32:17.639229+0000","last_undegraded":"2024-04-21T22:32:17.639229+0000","last_fullsized":"2024-04-21T22:32:17.639229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:12:41.023954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.078708+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:32:46.078708+0000","last_peered":"2024-04-21T22:32:46.078708+0000","last_clean":"2024-04-21T22:32:46.078708+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:32:46.078708+0000","last_undegraded":"2024-04-21T22:32:46.078708+0000","last_fullsized":"2024-04-21T22:32:46.078708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.082109+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:32:46.082109+0000","last_peered":"2024-04-21T22:32:46.082109+0000","last_clean":"2024-04-21T22:32:46.082109+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:32:46.082109+0000","last_undegraded":"2024-04-21T22:32:46.082109+0000","last_fullsized":"2024-04-21T22:32:46.082109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.074259+0000","last_change":"2024-04-21T22:32:17.562956+0000","last_active":"2024-04-21T22:32:46.074259+0000","last_peered":"2024-04-21T22:32:46.074259+0000","last_clean":"2024-04-21T22:32:46.074259+0000","last_became_active":"2024-04-21T22:32:17.562432+0000","last_became_peered":"2024-04-21T22:32:17.562432+0000","last_unstale":"2024-04-21T22:32:46.074259+0000","last_undegraded":"2024-04-21T22:32:46.074259+0000","last_fullsized":"2024-04-21T22:32:46.074259+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:37:08.467907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089643+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:32:46.089643+0000","last_peered":"2024-04-21T22:32:46.089643+0000","last_clean":"2024-04-21T22:32:46.089643+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:32:46.089643+0000","last_undegraded":"2024-04-21T22:32:46.089643+0000","last_fullsized":"2024-04-21T22:32:46.089643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108615+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:32:46.108615+0000","last_peered":"2024-04-21T22:32:46.108615+0000","last_clean":"2024-04-21T22:32:46.108615+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:32:46.108615+0000","last_undegraded":"2024-04-21T22:32:46.108615+0000","last_fullsized":"2024-04-21T22:32:46.108615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.101420+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:32:46.101420+0000","last_peered":"2024-04-21T22:32:46.101420+0000","last_clean":"2024-04-21T22:32:46.101420+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:32:46.101420+0000","last_undegraded":"2024-04-21T22:32:46.101420+0000","last_fullsized":"2024-04-21T22:32:46.101420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081257+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:32:46.081257+0000","last_peered":"2024-04-21T22:32:46.081257+0000","last_clean":"2024-04-21T22:32:46.081257+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:32:46.081257+0000","last_undegraded":"2024-04-21T22:32:46.081257+0000","last_fullsized":"2024-04-21T22:32:46.081257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.073680+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:32:46.073680+0000","last_peered":"2024-04-21T22:32:46.073680+0000","last_clean":"2024-04-21T22:32:46.073680+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:32:46.073680+0000","last_undegraded":"2024-04-21T22:32:46.073680+0000","last_fullsized":"2024-04-21T22:32:46.073680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.087685+0000","last_change":"2024-04-21T22:32:17.632654+0000","last_active":"2024-04-21T22:32:46.087685+0000","last_peered":"2024-04-21T22:32:46.087685+0000","last_clean":"2024-04-21T22:32:46.087685+0000","last_became_active":"2024-04-21T22:32:17.632354+0000","last_became_peered":"2024-04-21T22:32:17.632354+0000","last_unstale":"2024-04-21T22:32:46.087685+0000","last_undegraded":"2024-04-21T22:32:46.087685+0000","last_fullsized":"2024-04-21T22:32:46.087685+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:51.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104462+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:32:46.104462+0000","last_peered":"2024-04-21T22:32:46.104462+0000","last_clean":"2024-04-21T22:32:46.104462+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:32:46.104462+0000","last_undegraded":"2024-04-21T22:32:46.104462+0000","last_fullsized":"2024-04-21T22:32:46.104462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099021+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:32:46.099021+0000","last_peered":"2024-04-21T22:32:46.099021+0000","last_clean":"2024-04-21T22:32:46.099021+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:32:46.099021+0000","last_undegraded":"2024-04-21T22:32:46.099021+0000","last_fullsized":"2024-04-21T22:32:46.099021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099782+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:32:46.099782+0000","last_peered":"2024-04-21T22:32:46.099782+0000","last_clean":"2024-04-21T22:32:46.099782+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:32:46.099782+0000","last_undegraded":"2024-04-21T22:32:46.099782+0000","last_fullsized":"2024-04-21T22:32:46.099782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107609+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:32:46.107609+0000","last_peered":"2024-04-21T22:32:46.107609+0000","last_clean":"2024-04-21T22:32:46.107609+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:32:46.107609+0000","last_undegraded":"2024-04-21T22:32:46.107609+0000","last_fullsized":"2024-04-21T22:32:46.107609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.080385+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:32:46.080385+0000","last_peered":"2024-04-21T22:32:46.080385+0000","last_clean":"2024-04-21T22:32:46.080385+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:32:46.080385+0000","last_undegraded":"2024-04-21T22:32:46.080385+0000","last_fullsized":"2024-04-21T22:32:46.080385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69140,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":815,"num_read_kb":504,"num_write":253,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383714,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":458691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1109688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":457313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1576960,"data_stored":1050504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":456652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":518687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":458523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":519971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":457045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1581056,"data_stored":1048496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:33:02.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-21T22:33:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:03.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:02 smithi047 ceph-mon[31561]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:03.194 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:02 smithi047 ceph-mon[31561]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-21T22:33:03.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:02 smithi018 ceph-mon[26614]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:03.260 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:02 smithi018 ceph-mon[26614]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-21T22:33:03.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:02 smithi081 ceph-mon[31692]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:03.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:02 smithi081 ceph-mon[31692]: pgmap v370: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-04-21T22:33:05.273 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:05 smithi018 ceph-mon[26614]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 -- 172.21.15.18:0/3197874019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 msgr2=0x7fd91410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 --2- 172.21.15.18:0/3197874019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd91410ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd904009990 tx=0x7fd904009ca0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 -- 172.21.15.18:0/3197874019 shutdown_connections 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 --2- 172.21.15.18:0/3197874019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd914115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 --2- 172.21.15.18:0/3197874019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd91410ec40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 --2- 172.21.15.18:0/3197874019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd914108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 -- 172.21.15.18:0/3197874019 >> 172.21.15.18:0/3197874019 conn(0x7fd914075a00 msgr2=0x7fd914107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:05.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 -- 172.21.15.18:0/3197874019 shutdown_connections 2024-04-21T22:33:05.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.325+0000 7fd919400700 1 -- 172.21.15.18:0/3197874019 wait complete. 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.326+0000 7fd919400700 1 Processor -- start 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.326+0000 7fd919400700 1 -- start start 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd91419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd91419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd9141a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd914118be0 con 0x7fd91410e860 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd914118a60 con 0x7fd914109220 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd919400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd914118d60 con 0x7fd914108860 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd911e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd91419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd911e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd91419f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:35038/0 (socket says 172.21.15.18:35038) 2024-04-21T22:33:05.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd912800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd91419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:05.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd911e00700 1 -- 172.21.15.18:0/2526264453 learned_addr learned my addr 172.21.15.18:0/2526264453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:05.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.327+0000 7fd913200700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd9141a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:05.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 -- 172.21.15.18:0/2526264453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 msgr2=0x7fd91419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd91419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 -- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 msgr2=0x7fd9141a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd9141a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 -- 172.21.15.18:0/2526264453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9141a4020 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd912800700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd91419f010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b5c0 tx=0x7fd9040047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904004830 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9141a42b0 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd904005020 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904003c30 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.328+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9141abb90 con 0x7fd914108860 2024-04-21T22:33:05.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.330+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd914068f20 con 0x7fd914108860 2024-04-21T22:33:05.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.331+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd904029060 con 0x7fd914108860 2024-04-21T22:33:05.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.333+0000 7fd90b400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 0x7fd8f80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:05.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.333+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fd9040cfae0 con 0x7fd914108860 2024-04-21T22:33:05.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.333+0000 7fd911e00700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 0x7fd8f80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:05.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.334+0000 7fd911e00700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 0x7fd8f80a50e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9140778c0 tx=0x7fd90000b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:05.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.337+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd904013070 con 0x7fd914108860 2024-04-21T22:33:05.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:05 smithi047 ceph-mon[31561]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:05.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.569+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9141a0370 con 0x7fd8f80a2c20 2024-04-21T22:33:05.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.586+0000 7fd90b400700 1 -- 172.21.15.18:0/2526264453 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258879 (secure 0 0 0) 0x7fd9141a0370 con 0x7fd8f80a2c20 2024-04-21T22:33:05.592 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 msgr2=0x7fd8f80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 0x7fd8f80a50e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9140778c0 tx=0x7fd90000b500 comp rx=0 tx=0).stop 2024-04-21T22:33:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 msgr2=0x7fd91419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd91419f010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b5c0 tx=0x7fd9040047b0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 shutdown_connections 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd91410e860 0x7fd9141a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd914108860 0x7fd91419f010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fd8f80a2c20 0x7fd8f80a50e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 --2- 172.21.15.18:0/2526264453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914109220 0x7fd91419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 >> 172.21.15.18:0/2526264453 conn(0x7fd914075a00 msgr2=0x7fd914075f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 shutdown_connections 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:05.593+0000 7fd919400700 1 -- 172.21.15.18:0/2526264453 wait complete. 2024-04-21T22:33:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:33:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:05 smithi081 ceph-mon[31692]: pgmap v371: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:06.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:06 smithi047 ceph-mon[31561]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:06.452 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:06 smithi018 ceph-mon[26614]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:06.527 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-21T22:33:04.120066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659742,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1000,"num_read_kb":647,"num_write":436,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181749,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370876,"kb_used_data":13404,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124570948,"statfs":{"total":1151940427776,"available":1151560650752,"internally_reserved":0,"allocated":13725696,"data_stored":7448982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":59,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005602"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109477+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:32:46.109477+0000","last_peered":"2024-04-21T22:32:46.109477+0000","last_clean":"2024-04-21T22:32:46.109477+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:32:46.109477+0000","last_undegraded":"2024-04-21T22:32:46.109477+0000","last_fullsized":"2024-04-21T22:32:46.109477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.106562+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:32:46.106562+0000","last_peered":"2024-04-21T22:32:46.106562+0000","last_clean":"2024-04-21T22:32:46.106562+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:32:46.106562+0000","last_undegraded":"2024-04-21T22:32:46.106562+0000","last_fullsized":"2024-04-21T22:32:46.106562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105547+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:32:46.105547+0000","last_peered":"2024-04-21T22:32:46.105547+0000","last_clean":"2024-04-21T22:32:46.105547+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:32:46.105547+0000","last_undegraded":"2024-04-21T22:32:46.105547+0000","last_fullsized":"2024-04-21T22:32:46.105547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.075044+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:32:46.075044+0000","last_peered":"2024-04-21T22:32:46.075044+0000","last_clean":"2024-04-21T22:32:46.075044+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:32:46.075044+0000","last_undegraded":"2024-04-21T22:32:46.075044+0000","last_fullsized":"2024-04-21T22:32:46.075044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.066356+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:32:46.066356+0000","last_peered":"2024-04-21T22:32:46.066356+0000","last_clean":"2024-04-21T22:32:46.066356+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:32:46.066356+0000","last_undegraded":"2024-04-21T22:32:46.066356+0000","last_fullsized":"2024-04-21T22:32:46.066356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.100430+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:32:46.100430+0000","last_peered":"2024-04-21T22:32:46.100430+0000","last_clean":"2024-04-21T22:32:46.100430+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:32:46.100430+0000","last_undegraded":"2024-04-21T22:32:46.100430+0000","last_fullsized":"2024-04-21T22:32:46.100430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104628+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:32:46.104628+0000","last_peered":"2024-04-21T22:32:46.104628+0000","last_clean":"2024-04-21T22:32:46.104628+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:32:46.104628+0000","last_undegraded":"2024-04-21T22:32:46.104628+0000","last_fullsized":"2024-04-21T22:32:46.104628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091467+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:32:46.091467+0000","last_peered":"2024-04-21T22:32:46.091467+0000","last_clean":"2024-04-21T22:32:46.091467+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:32:46.091467+0000","last_undegraded":"2024-04-21T22:32:46.091467+0000","last_fullsized":"2024-04-21T22:32:46.091467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089156+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:32:46.089156+0000","last_peered":"2024-04-21T22:32:46.089156+0000","last_clean":"2024-04-21T22:32:46.089156+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:32:46.089156+0000","last_undegraded":"2024-04-21T22:32:46.089156+0000","last_fullsized":"2024-04-21T22:32:46.089156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105970+0000","last_change":"2024-04-21T22:32:17.561622+0000","last_active":"2024-04-21T22:32:46.105970+0000","last_peered":"2024-04-21T22:32:46.105970+0000","last_clean":"2024-04-21T22:32:46.105970+0000","last_became_active":"2024-04-21T22:32:17.561139+0000","last_became_peered":"2024-04-21T22:32:17.561139+0000","last_unstale":"2024-04-21T22:32:46.105970+0000","last_undegraded":"2024-04-21T22:32:46.105970+0000","last_fullsized":"2024-04-21T22:32:46.105970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:52:09.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091422+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:32:46.091422+0000","last_peered":"2024-04-21T22:32:46.091422+0000","last_clean":"2024-04-21T22:32:46.091422+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:32:46.091422+0000","last_undegraded":"2024-04-21T22:32:46.091422+0000","last_fullsized":"2024-04-21T22:32:46.091422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.074328+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:32:46.074328+0000","last_peered":"2024-04-21T22:32:46.074328+0000","last_clean":"2024-04-21T22:32:46.074328+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:32:46.074328+0000","last_undegraded":"2024-04-21T22:32:46.074328+0000","last_fullsized":"2024-04-21T22:32:46.074328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.093363+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:32:46.093363+0000","last_peered":"2024-04-21T22:32:46.093363+0000","last_clean":"2024-04-21T22:32:46.093363+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:32:46.093363+0000","last_undegraded":"2024-04-21T22:32:46.093363+0000","last_fullsized":"2024-04-21T22:32:46.093363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105852+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:32:46.105852+0000","last_peered":"2024-04-21T22:32:46.105852+0000","last_clean":"2024-04-21T22:32:46.105852+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:32:46.105852+0000","last_undegraded":"2024-04-21T22:32:46.105852+0000","last_fullsized":"2024-04-21T22:32:46.105852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107967+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:32:46.107967+0000","last_peered":"2024-04-21T22:32:46.107967+0000","last_clean":"2024-04-21T22:32:46.107967+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:32:46.107967+0000","last_undegraded":"2024-04-21T22:32:46.107967+0000","last_fullsized":"2024-04-21T22:32:46.107967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.097809+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:32:46.097809+0000","last_peered":"2024-04-21T22:32:46.097809+0000","last_clean":"2024-04-21T22:32:46.097809+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:32:46.097809+0000","last_undegraded":"2024-04-21T22:32:46.097809+0000","last_fullsized":"2024-04-21T22:32:46.097809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109529+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:32:46.109529+0000","last_peered":"2024-04-21T22:32:46.109529+0000","last_clean":"2024-04-21T22:32:46.109529+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:32:46.109529+0000","last_undegraded":"2024-04-21T22:32:46.109529+0000","last_fullsized":"2024-04-21T22:32:46.109529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104208+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:32:46.104208+0000","last_peered":"2024-04-21T22:32:46.104208+0000","last_clean":"2024-04-21T22:32:46.104208+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:32:46.104208+0000","last_undegraded":"2024-04-21T22:32:46.104208+0000","last_fullsized":"2024-04-21T22:32:46.104208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089959+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:32:46.089959+0000","last_peered":"2024-04-21T22:32:46.089959+0000","last_clean":"2024-04-21T22:32:46.089959+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:32:46.089959+0000","last_undegraded":"2024-04-21T22:32:46.089959+0000","last_fullsized":"2024-04-21T22:32:46.089959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:01.732351+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:33:01.732351+0000","last_peered":"2024-04-21T22:33:01.732351+0000","last_clean":"2024-04-21T22:33:01.732351+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:33:01.732351+0000","last_undegraded":"2024-04-21T22:33:01.732351+0000","last_fullsized":"2024-04-21T22:33:01.732351+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.085691+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:32:46.085691+0000","last_peered":"2024-04-21T22:32:46.085691+0000","last_clean":"2024-04-21T22:32:46.085691+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:32:46.085691+0000","last_undegraded":"2024-04-21T22:32:46.085691+0000","last_fullsized":"2024-04-21T22:32:46.085691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.562442+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:32:17.562442+0000","last_peered":"2024-04-21T22:32:17.562442+0000","last_clean":"2024-04-21T22:32:17.562442+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:32:17.562442+0000","last_undegraded":"2024-04-21T22:32:17.562442+0000","last_fullsized":"2024-04-21T22:32:17.562442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.105716+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:32:46.105716+0000","last_peered":"2024-04-21T22:32:46.105716+0000","last_clean":"2024-04-21T22:32:46.105716+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:32:46.105716+0000","last_undegraded":"2024-04-21T22:32:46.105716+0000","last_fullsized":"2024-04-21T22:32:46.105716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556448+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:32:17.556448+0000","last_peered":"2024-04-21T22:32:17.556448+0000","last_clean":"2024-04-21T22:32:17.556448+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:32:17.556448+0000","last_undegraded":"2024-04-21T22:32:17.556448+0000","last_fullsized":"2024-04-21T22:32:17.556448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.092989+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:32:46.092989+0000","last_peered":"2024-04-21T22:32:46.092989+0000","last_clean":"2024-04-21T22:32:46.092989+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:32:46.092989+0000","last_undegraded":"2024-04-21T22:32:46.092989+0000","last_fullsized":"2024-04-21T22:32:46.092989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555523+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:32:17.555523+0000","last_peered":"2024-04-21T22:32:17.555523+0000","last_clean":"2024-04-21T22:32:17.555523+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:32:17.555523+0000","last_undegraded":"2024-04-21T22:32:17.555523+0000","last_fullsized":"2024-04-21T22:32:17.555523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.086162+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:32:46.086162+0000","last_peered":"2024-04-21T22:32:46.086162+0000","last_clean":"2024-04-21T22:32:46.086162+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:32:46.086162+0000","last_undegraded":"2024-04-21T22:32:46.086162+0000","last_fullsized":"2024-04-21T22:32:46.086162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:59.624923+0000","last_change":"2024-04-21T22:32:17.565781+0000","last_active":"2024-04-21T22:32:59.624923+0000","last_peered":"2024-04-21T22:32:59.624923+0000","last_clean":"2024-04-21T22:32:59.624923+0000","last_became_active":"2024-04-21T22:32:17.560490+0000","last_became_peered":"2024-04-21T22:32:17.560490+0000","last_unstale":"2024-04-21T22:32:59.624923+0000","last_undegraded":"2024-04-21T22:32:59.624923+0000","last_fullsized":"2024-04-21T22:32:59.624923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:20.976913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":1,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.100060+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:32:46.100060+0000","last_peered":"2024-04-21T22:32:46.100060+0000","last_clean":"2024-04-21T22:32:46.100060+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:32:46.100060+0000","last_undegraded":"2024-04-21T22:32:46.100060+0000","last_fullsized":"2024-04-21T22:32:46.100060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.568151+0000","last_change":"2024-04-21T22:32:17.568151+0000","last_active":"2024-04-21T22:32:17.568151+0000","last_peered":"2024-04-21T22:32:17.568151+0000","last_clean":"2024-04-21T22:32:17.568151+0000","last_became_active":"2024-04-21T22:32:17.560167+0000","last_became_peered":"2024-04-21T22:32:17.560167+0000","last_unstale":"2024-04-21T22:32:17.568151+0000","last_undegraded":"2024-04-21T22:32:17.568151+0000","last_fullsized":"2024-04-21T22:32:17.568151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:08.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091823+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:32:46.091823+0000","last_peered":"2024-04-21T22:32:46.091823+0000","last_clean":"2024-04-21T22:32:46.091823+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:32:46.091823+0000","last_undegraded":"2024-04-21T22:32:46.091823+0000","last_fullsized":"2024-04-21T22:32:46.091823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556330+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:32:17.556330+0000","last_peered":"2024-04-21T22:32:17.556330+0000","last_clean":"2024-04-21T22:32:17.556330+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:32:17.556330+0000","last_undegraded":"2024-04-21T22:32:17.556330+0000","last_fullsized":"2024-04-21T22:32:17.556330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095016+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:32:46.095016+0000","last_peered":"2024-04-21T22:32:46.095016+0000","last_clean":"2024-04-21T22:32:46.095016+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:32:46.095016+0000","last_undegraded":"2024-04-21T22:32:46.095016+0000","last_fullsized":"2024-04-21T22:32:46.095016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555278+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:32:17.555278+0000","last_peered":"2024-04-21T22:32:17.555278+0000","last_clean":"2024-04-21T22:32:17.555278+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:32:17.555278+0000","last_undegraded":"2024-04-21T22:32:17.555278+0000","last_fullsized":"2024-04-21T22:32:17.555278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104805+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:32:46.104805+0000","last_peered":"2024-04-21T22:32:46.104805+0000","last_clean":"2024-04-21T22:32:46.104805+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:32:46.104805+0000","last_undegraded":"2024-04-21T22:32:46.104805+0000","last_fullsized":"2024-04-21T22:32:46.104805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":197,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:00.625981+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:33:00.625981+0000","last_peered":"2024-04-21T22:33:00.625981+0000","last_clean":"2024-04-21T22:33:00.625981+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:33:00.625981+0000","last_undegraded":"2024-04-21T22:33:00.625981+0000","last_fullsized":"2024-04-21T22:33:00.625981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104688+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:32:46.104688+0000","last_peered":"2024-04-21T22:32:46.104688+0000","last_clean":"2024-04-21T22:32:46.104688+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:32:46.104688+0000","last_undegraded":"2024-04-21T22:32:46.104688+0000","last_fullsized":"2024-04-21T22:32:46.104688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552955+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:32:17.552955+0000","last_peered":"2024-04-21T22:32:17.552955+0000","last_clean":"2024-04-21T22:32:17.552955+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:32:17.552955+0000","last_undegraded":"2024-04-21T22:32:17.552955+0000","last_fullsized":"2024-04-21T22:32:17.552955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108546+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:32:46.108546+0000","last_peered":"2024-04-21T22:32:46.108546+0000","last_clean":"2024-04-21T22:32:46.108546+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:32:46.108546+0000","last_undegraded":"2024-04-21T22:32:46.108546+0000","last_fullsized":"2024-04-21T22:32:46.108546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555939+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:32:17.555939+0000","last_peered":"2024-04-21T22:32:17.555939+0000","last_clean":"2024-04-21T22:32:17.555939+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:32:17.555939+0000","last_undegraded":"2024-04-21T22:32:17.555939+0000","last_fullsized":"2024-04-21T22:32:17.555939+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.090445+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:32:46.090445+0000","last_peered":"2024-04-21T22:32:46.090445+0000","last_clean":"2024-04-21T22:32:46.090445+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:32:46.090445+0000","last_undegraded":"2024-04-21T22:32:46.090445+0000","last_fullsized":"2024-04-21T22:32:46.090445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'35","reported_seq":238,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:00.626003+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:33:00.626003+0000","last_peered":"2024-04-21T22:33:00.626003+0000","last_clean":"2024-04-21T22:33:00.626003+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:33:00.626003+0000","last_undegraded":"2024-04-21T22:33:00.626003+0000","last_fullsized":"2024-04-21T22:33:00.626003+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61122,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":184,"num_read_kb":152,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081955+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:32:46.081955+0000","last_peered":"2024-04-21T22:32:46.081955+0000","last_clean":"2024-04-21T22:32:46.081955+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:32:46.081955+0000","last_undegraded":"2024-04-21T22:32:46.081955+0000","last_fullsized":"2024-04-21T22:32:46.081955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.558842+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:32:17.558842+0000","last_peered":"2024-04-21T22:32:17.558842+0000","last_clean":"2024-04-21T22:32:17.558842+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:32:17.558842+0000","last_undegraded":"2024-04-21T22:32:17.558842+0000","last_fullsized":"2024-04-21T22:32:17.558842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099843+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:32:46.099843+0000","last_peered":"2024-04-21T22:32:46.099843+0000","last_clean":"2024-04-21T22:32:46.099843+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:32:46.099843+0000","last_undegraded":"2024-04-21T22:32:46.099843+0000","last_fullsized":"2024-04-21T22:32:46.099843+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555056+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:32:17.555056+0000","last_peered":"2024-04-21T22:32:17.555056+0000","last_clean":"2024-04-21T22:32:17.555056+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:32:17.555056+0000","last_undegraded":"2024-04-21T22:32:17.555056+0000","last_fullsized":"2024-04-21T22:32:17.555056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.094411+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:32:46.094411+0000","last_peered":"2024-04-21T22:32:46.094411+0000","last_clean":"2024-04-21T22:32:46.094411+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:32:46.094411+0000","last_undegraded":"2024-04-21T22:32:46.094411+0000","last_fullsized":"2024-04-21T22:32:46.094411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'7","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:01.733088+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:33:01.733088+0000","last_peered":"2024-04-21T22:33:01.733088+0000","last_clean":"2024-04-21T22:33:01.733088+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:33:01.733088+0000","last_undegraded":"2024-04-21T22:33:01.733088+0000","last_fullsized":"2024-04-21T22:33:01.733088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.085723+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:32:46.085723+0000","last_peered":"2024-04-21T22:32:46.085723+0000","last_clean":"2024-04-21T22:32:46.085723+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:32:46.085723+0000","last_undegraded":"2024-04-21T22:32:46.085723+0000","last_fullsized":"2024-04-21T22:32:46.085723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555595+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:32:17.555595+0000","last_peered":"2024-04-21T22:32:17.555595+0000","last_clean":"2024-04-21T22:32:17.555595+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:32:17.555595+0000","last_undegraded":"2024-04-21T22:32:17.555595+0000","last_fullsized":"2024-04-21T22:32:17.555595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.079696+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:32:46.079696+0000","last_peered":"2024-04-21T22:32:46.079696+0000","last_clean":"2024-04-21T22:32:46.079696+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:32:46.079696+0000","last_undegraded":"2024-04-21T22:32:46.079696+0000","last_fullsized":"2024-04-21T22:32:46.079696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555895+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:32:17.555895+0000","last_peered":"2024-04-21T22:32:17.555895+0000","last_clean":"2024-04-21T22:32:17.555895+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:32:17.555895+0000","last_undegraded":"2024-04-21T22:32:17.555895+0000","last_fullsized":"2024-04-21T22:32:17.555895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081013+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:32:46.081013+0000","last_peered":"2024-04-21T22:32:46.081013+0000","last_clean":"2024-04-21T22:32:46.081013+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:32:46.081013+0000","last_undegraded":"2024-04-21T22:32:46.081013+0000","last_fullsized":"2024-04-21T22:32:46.081013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552891+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:32:17.552891+0000","last_peered":"2024-04-21T22:32:17.552891+0000","last_clean":"2024-04-21T22:32:17.552891+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:32:17.552891+0000","last_undegraded":"2024-04-21T22:32:17.552891+0000","last_fullsized":"2024-04-21T22:32:17.552891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095772+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:32:46.095772+0000","last_peered":"2024-04-21T22:32:46.095772+0000","last_clean":"2024-04-21T22:32:46.095772+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:32:46.095772+0000","last_undegraded":"2024-04-21T22:32:46.095772+0000","last_fullsized":"2024-04-21T22:32:46.095772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":112,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:01.733167+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:33:01.733167+0000","last_peered":"2024-04-21T22:33:01.733167+0000","last_clean":"2024-04-21T22:33:01.733167+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:33:01.733167+0000","last_undegraded":"2024-04-21T22:33:01.733167+0000","last_fullsized":"2024-04-21T22:33:01.733167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107148+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:32:46.107148+0000","last_peered":"2024-04-21T22:32:46.107148+0000","last_clean":"2024-04-21T22:32:46.107148+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:32:46.107148+0000","last_undegraded":"2024-04-21T22:32:46.107148+0000","last_fullsized":"2024-04-21T22:32:46.107148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.103991+0000","last_change":"2024-04-21T22:32:17.633622+0000","last_active":"2024-04-21T22:32:46.103991+0000","last_peered":"2024-04-21T22:32:46.103991+0000","last_clean":"2024-04-21T22:32:46.103991+0000","last_became_active":"2024-04-21T22:32:17.633145+0000","last_became_peered":"2024-04-21T22:32:17.633145+0000","last_unstale":"2024-04-21T22:32:46.103991+0000","last_undegraded":"2024-04-21T22:32:46.103991+0000","last_fullsized":"2024-04-21T22:32:46.103991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:23:14.639799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":112,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:00.729895+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:33:00.729895+0000","last_peered":"2024-04-21T22:33:00.729895+0000","last_clean":"2024-04-21T22:33:00.729895+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:33:00.729895+0000","last_undegraded":"2024-04-21T22:33:00.729895+0000","last_fullsized":"2024-04-21T22:33:00.729895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.088059+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:32:46.088059+0000","last_peered":"2024-04-21T22:32:46.088059+0000","last_clean":"2024-04-21T22:32:46.088059+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:32:46.088059+0000","last_undegraded":"2024-04-21T22:32:46.088059+0000","last_fullsized":"2024-04-21T22:32:46.088059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.632041+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:32:17.632041+0000","last_peered":"2024-04-21T22:32:17.632041+0000","last_clean":"2024-04-21T22:32:17.632041+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:32:17.632041+0000","last_undegraded":"2024-04-21T22:32:17.632041+0000","last_fullsized":"2024-04-21T22:32:17.632041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":352,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552728+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:32:17.552728+0000","last_peered":"2024-04-21T22:32:17.552728+0000","last_clean":"2024-04-21T22:32:17.552728+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:32:17.552728+0000","last_undegraded":"2024-04-21T22:32:17.552728+0000","last_fullsized":"2024-04-21T22:32:17.552728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.075754+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:32:46.075754+0000","last_peered":"2024-04-21T22:32:46.075754+0000","last_clean":"2024-04-21T22:32:46.075754+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:32:46.075754+0000","last_undegraded":"2024-04-21T22:32:46.075754+0000","last_fullsized":"2024-04-21T22:32:46.075754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.636128+0000","last_change":"2024-04-21T22:32:17.636128+0000","last_active":"2024-04-21T22:32:17.636128+0000","last_peered":"2024-04-21T22:32:17.636128+0000","last_clean":"2024-04-21T22:32:17.636128+0000","last_became_active":"2024-04-21T22:32:17.633263+0000","last_became_peered":"2024-04-21T22:32:17.633263+0000","last_unstale":"2024-04-21T22:32:17.636128+0000","last_undegraded":"2024-04-21T22:32:17.636128+0000","last_fullsized":"2024-04-21T22:32:17.636128+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:10:53.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.556330+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:32:17.556330+0000","last_peered":"2024-04-21T22:32:17.556330+0000","last_clean":"2024-04-21T22:32:17.556330+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:32:17.556330+0000","last_undegraded":"2024-04-21T22:32:17.556330+0000","last_fullsized":"2024-04-21T22:32:17.556330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.102091+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:32:46.102091+0000","last_peered":"2024-04-21T22:32:46.102091+0000","last_clean":"2024-04-21T22:32:46.102091+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:32:46.102091+0000","last_undegraded":"2024-04-21T22:32:46.102091+0000","last_fullsized":"2024-04-21T22:32:46.102091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'14","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.552885+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:32:17.552885+0000","last_peered":"2024-04-21T22:32:17.552885+0000","last_clean":"2024-04-21T22:32:17.552885+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:32:17.552885+0000","last_undegraded":"2024-04-21T22:32:17.552885+0000","last_fullsized":"2024-04-21T22:32:17.552885+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095773+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:32:46.095773+0000","last_peered":"2024-04-21T22:32:46.095773+0000","last_clean":"2024-04-21T22:32:46.095773+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:32:46.095773+0000","last_undegraded":"2024-04-21T22:32:46.095773+0000","last_fullsized":"2024-04-21T22:32:46.095773+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.631990+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:32:17.631990+0000","last_peered":"2024-04-21T22:32:17.631990+0000","last_clean":"2024-04-21T22:32:17.631990+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:32:17.631990+0000","last_undegraded":"2024-04-21T22:32:17.631990+0000","last_fullsized":"2024-04-21T22:32:17.631990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108539+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:32:46.108539+0000","last_peered":"2024-04-21T22:32:46.108539+0000","last_clean":"2024-04-21T22:32:46.108539+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:32:46.108539+0000","last_undegraded":"2024-04-21T22:32:46.108539+0000","last_fullsized":"2024-04-21T22:32:46.108539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.566661+0000","last_change":"2024-04-21T22:32:17.566661+0000","last_active":"2024-04-21T22:32:17.566661+0000","last_peered":"2024-04-21T22:32:17.566661+0000","last_clean":"2024-04-21T22:32:17.566661+0000","last_became_active":"2024-04-21T22:32:17.563348+0000","last_became_peered":"2024-04-21T22:32:17.563348+0000","last_unstale":"2024-04-21T22:32:17.566661+0000","last_undegraded":"2024-04-21T22:32:17.566661+0000","last_fullsized":"2024-04-21T22:32:17.566661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:05:28.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.049063+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:32:46.049063+0000","last_peered":"2024-04-21T22:32:46.049063+0000","last_clean":"2024-04-21T22:32:46.049063+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:32:46.049063+0000","last_undegraded":"2024-04-21T22:32:46.049063+0000","last_fullsized":"2024-04-21T22:32:46.049063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.561241+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:32:17.561241+0000","last_peered":"2024-04-21T22:32:17.561241+0000","last_clean":"2024-04-21T22:32:17.561241+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:32:17.561241+0000","last_undegraded":"2024-04-21T22:32:17.561241+0000","last_fullsized":"2024-04-21T22:32:17.561241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.109161+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:32:46.109161+0000","last_peered":"2024-04-21T22:32:46.109161+0000","last_clean":"2024-04-21T22:32:46.109161+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:32:46.109161+0000","last_undegraded":"2024-04-21T22:32:46.109161+0000","last_fullsized":"2024-04-21T22:32:46.109161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.558673+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:32:17.558673+0000","last_peered":"2024-04-21T22:32:17.558673+0000","last_clean":"2024-04-21T22:32:17.558673+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:32:17.558673+0000","last_undegraded":"2024-04-21T22:32:17.558673+0000","last_fullsized":"2024-04-21T22:32:17.558673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.103621+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:32:46.103621+0000","last_peered":"2024-04-21T22:32:46.103621+0000","last_clean":"2024-04-21T22:32:46.103621+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:32:46.103621+0000","last_undegraded":"2024-04-21T22:32:46.103621+0000","last_fullsized":"2024-04-21T22:32:46.103621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.571734+0000","last_change":"2024-04-21T22:32:17.571734+0000","last_active":"2024-04-21T22:32:17.571734+0000","last_peered":"2024-04-21T22:32:17.571734+0000","last_clean":"2024-04-21T22:32:17.571734+0000","last_became_active":"2024-04-21T22:32:17.559276+0000","last_became_peered":"2024-04-21T22:32:17.559276+0000","last_unstale":"2024-04-21T22:32:17.571734+0000","last_undegraded":"2024-04-21T22:32:17.571734+0000","last_fullsized":"2024-04-21T22:32:17.571734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:45.969569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.094289+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:32:46.094289+0000","last_peered":"2024-04-21T22:32:46.094289+0000","last_clean":"2024-04-21T22:32:46.094289+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:32:46.094289+0000","last_undegraded":"2024-04-21T22:32:46.094289+0000","last_fullsized":"2024-04-21T22:32:46.094289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'7","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:33:00.660783+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:33:00.660783+0000","last_peered":"2024-04-21T22:33:00.660783+0000","last_clean":"2024-04-21T22:33:00.660783+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:33:00.660783+0000","last_undegraded":"2024-04-21T22:33:00.660783+0000","last_fullsized":"2024-04-21T22:33:00.660783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.091381+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:32:46.091381+0000","last_peered":"2024-04-21T22:32:46.091381+0000","last_clean":"2024-04-21T22:32:46.091381+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:32:46.091381+0000","last_undegraded":"2024-04-21T22:32:46.091381+0000","last_fullsized":"2024-04-21T22:32:46.091381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.555726+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:32:17.555726+0000","last_peered":"2024-04-21T22:32:17.555726+0000","last_clean":"2024-04-21T22:32:17.555726+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:32:17.555726+0000","last_undegraded":"2024-04-21T22:32:17.555726+0000","last_fullsized":"2024-04-21T22:32:17.555726+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.095851+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:32:46.095851+0000","last_peered":"2024-04-21T22:32:46.095851+0000","last_clean":"2024-04-21T22:32:46.095851+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:32:46.095851+0000","last_undegraded":"2024-04-21T22:32:46.095851+0000","last_fullsized":"2024-04-21T22:32:46.095851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:17.639229+0000","last_change":"2024-04-21T22:32:17.639229+0000","last_active":"2024-04-21T22:32:17.639229+0000","last_peered":"2024-04-21T22:32:17.639229+0000","last_clean":"2024-04-21T22:32:17.639229+0000","last_became_active":"2024-04-21T22:32:17.633285+0000","last_became_peered":"2024-04-21T22:32:17.633285+0000","last_unstale":"2024-04-21T22:32:17.639229+0000","last_undegraded":"2024-04-21T22:32:17.639229+0000","last_fullsized":"2024-04-21T22:32:17.639229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:12:41.023954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.078708+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:32:46.078708+0000","last_peered":"2024-04-21T22:32:46.078708+0000","last_clean":"2024-04-21T22:32:46.078708+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:32:46.078708+0000","last_undegraded":"2024-04-21T22:32:46.078708+0000","last_fullsized":"2024-04-21T22:32:46.078708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.082109+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:32:46.082109+0000","last_peered":"2024-04-21T22:32:46.082109+0000","last_clean":"2024-04-21T22:32:46.082109+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:32:46.082109+0000","last_undegraded":"2024-04-21T22:32:46.082109+0000","last_fullsized":"2024-04-21T22:32:46.082109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.074259+0000","last_change":"2024-04-21T22:32:17.562956+0000","last_active":"2024-04-21T22:32:46.074259+0000","last_peered":"2024-04-21T22:32:46.074259+0000","last_clean":"2024-04-21T22:32:46.074259+0000","last_became_active":"2024-04-21T22:32:17.562432+0000","last_became_peered":"2024-04-21T22:32:17.562432+0000","last_unstale":"2024-04-21T22:32:46.074259+0000","last_undegraded":"2024-04-21T22:32:46.074259+0000","last_fullsized":"2024-04-21T22:32:46.074259+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:37:08.467907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.089643+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:32:46.089643+0000","last_peered":"2024-04-21T22:32:46.089643+0000","last_clean":"2024-04-21T22:32:46.089643+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:32:46.089643+0000","last_undegraded":"2024-04-21T22:32:46.089643+0000","last_fullsized":"2024-04-21T22:32:46.089643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.108615+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:32:46.108615+0000","last_peered":"2024-04-21T22:32:46.108615+0000","last_clean":"2024-04-21T22:32:46.108615+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:32:46.108615+0000","last_undegraded":"2024-04-21T22:32:46.108615+0000","last_fullsized":"2024-04-21T22:32:46.108615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.101420+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:32:46.101420+0000","last_peered":"2024-04-21T22:32:46.101420+0000","last_clean":"2024-04-21T22:32:46.101420+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:32:46.101420+0000","last_undegraded":"2024-04-21T22:32:46.101420+0000","last_fullsized":"2024-04-21T22:32:46.101420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.081257+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:32:46.081257+0000","last_peered":"2024-04-21T22:32:46.081257+0000","last_clean":"2024-04-21T22:32:46.081257+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:32:46.081257+0000","last_undegraded":"2024-04-21T22:32:46.081257+0000","last_fullsized":"2024-04-21T22:32:46.081257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.073680+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:32:46.073680+0000","last_peered":"2024-04-21T22:32:46.073680+0000","last_clean":"2024-04-21T22:32:46.073680+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:32:46.073680+0000","last_undegraded":"2024-04-21T22:32:46.073680+0000","last_fullsized":"2024-04-21T22:32:46.073680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.087685+0000","last_change":"2024-04-21T22:32:17.632654+0000","last_active":"2024-04-21T22:32:46.087685+0000","last_peered":"2024-04-21T22:32:46.087685+0000","last_clean":"2024-04-21T22:32:46.087685+0000","last_became_active":"2024-04-21T22:32:17.632354+0000","last_became_peered":"2024-04-21T22:32:17.632354+0000","last_unstale":"2024-04-21T22:32:46.087685+0000","last_undegraded":"2024-04-21T22:32:46.087685+0000","last_fullsized":"2024-04-21T22:32:46.087685+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:51.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.104462+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:32:46.104462+0000","last_peered":"2024-04-21T22:32:46.104462+0000","last_clean":"2024-04-21T22:32:46.104462+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:32:46.104462+0000","last_undegraded":"2024-04-21T22:32:46.104462+0000","last_fullsized":"2024-04-21T22:32:46.104462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099021+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:32:46.099021+0000","last_peered":"2024-04-21T22:32:46.099021+0000","last_clean":"2024-04-21T22:32:46.099021+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:32:46.099021+0000","last_undegraded":"2024-04-21T22:32:46.099021+0000","last_fullsized":"2024-04-21T22:32:46.099021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.099782+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:32:46.099782+0000","last_peered":"2024-04-21T22:32:46.099782+0000","last_clean":"2024-04-21T22:32:46.099782+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:32:46.099782+0000","last_undegraded":"2024-04-21T22:32:46.099782+0000","last_fullsized":"2024-04-21T22:32:46.099782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.107609+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:32:46.107609+0000","last_peered":"2024-04-21T22:32:46.107609+0000","last_clean":"2024-04-21T22:32:46.107609+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:32:46.107609+0000","last_undegraded":"2024-04-21T22:32:46.107609+0000","last_fullsized":"2024-04-21T22:32:46.107609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-21T22:32:46.080385+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:32:46.080385+0000","last_peered":"2024-04-21T22:32:46.080385+0000","last_clean":"2024-04-21T22:32:46.080385+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:32:46.080385+0000","last_undegraded":"2024-04-21T22:32:46.080385+0000","last_fullsized":"2024-04-21T22:32:46.080385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69140,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":864,"num_read_kb":528,"num_write":253,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383715,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":458691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36956,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708196,"statfs":{"total":95995035648,"available":95957192704,"internally_reserved":0,"allocated":1658880,"data_stored":1109688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070516,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":457313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332152,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1576960,"data_stored":1050504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":966656,"data_stored":456652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":518687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":458523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1048576,"data_stored":519971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":457045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757317,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1581056,"data_stored":1048496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:33:06.532 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-21T22:33:06.532 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-21T22:33:06.532 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-21T22:33:06.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-21T22:33:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:06 smithi081 ceph-mon[31692]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:33:07.051 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:07.442 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:07 smithi018 ceph-mon[26614]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:07.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:07 smithi047 ceph-mon[31561]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:07 smithi081 ceph-mon[31692]: pgmap v372: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 -- 172.21.15.18:0/3277464179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104e10 msgr2=0x7f601c111320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 --2- 172.21.15.18:0/3277464179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104e10 0x7f601c111320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f601400b0a0 tx=0x7f601400b3b0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 -- 172.21.15.18:0/3277464179 shutdown_connections 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 --2- 172.21.15.18:0/3277464179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104e10 0x7f601c111320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 --2- 172.21.15.18:0/3277464179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c10a4e0 0x7f601c10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 --2- 172.21.15.18:0/3277464179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c104450 0x7f601c1048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 -- 172.21.15.18:0/3277464179 >> 172.21.15.18:0/3277464179 conn(0x7f601c0fff40 msgr2=0x7f601c102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 -- 172.21.15.18:0/3277464179 shutdown_connections 2024-04-21T22:33:09.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.295+0000 7f6021400700 1 -- 172.21.15.18:0/3277464179 wait complete. 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.296+0000 7f6021400700 1 Processor -- start 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 -- start start 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c104e10 0x7f601c1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 0x7f601c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f601c114790 con 0x7f601c104e10 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f601c114610 con 0x7f601c104450 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.297+0000 7f6021400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f601c114910 con 0x7f601c10a4e0 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f6019e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c104e10 0x7f601c1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55304/0 (socket says 172.21.15.18:55304) 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 -- 172.21.15.18:0/1860343394 learned_addr learned my addr 172.21.15.18:0/1860343394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:09.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601b200700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 0x7f601c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 -- 172.21.15.18:0/1860343394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 msgr2=0x7f601c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 0x7f601c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 -- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c104e10 msgr2=0x7f601c1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c104e10 0x7f601c1a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 -- 172.21.15.18:0/1860343394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c19b190 con 0x7f601c104450 2024-04-21T22:33:09.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601b200700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 0x7f601c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.298+0000 7f601a800700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f600c00d950 tx=0x7f600c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.299+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c016070 con 0x7f601c104450 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.299+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f600c00fd70 con 0x7f601c104450 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.299+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c00e610 con 0x7f601c104450 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.299+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c19b480 con 0x7f601c104450 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.299+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c1a7740 con 0x7f601c104450 2024-04-21T22:33:09.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.300+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601c068f20 con 0x7f601c104450 2024-04-21T22:33:09.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.302+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f600c019070 con 0x7f601c104450 2024-04-21T22:33:09.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.303+0000 7f6013400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 0x7f60000a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:09.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.304+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f600c0cea50 con 0x7f601c104450 2024-04-21T22:33:09.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.304+0000 7f6019e00700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 0x7f60000a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:09.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.304+0000 7f6019e00700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 0x7f60000a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f601c109930 tx=0x7f6008009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:09.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.308+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f600c09b930 con 0x7f601c104450 2024-04-21T22:33:09.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:09 smithi047 ceph-mon[31561]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-21T22:33:09.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.589+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f601c02db30 con 0x7f601c104450 2024-04-21T22:33:09.589 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:09 smithi018 ceph-mon[26614]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-21T22:33:09.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.590+0000 7f6013400700 1 -- 172.21.15.18:0/1860343394 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f600c09b230 con 0x7f601c104450 2024-04-21T22:33:09.590 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:09.590 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.592+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 msgr2=0x7f60000a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.592+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 0x7f60000a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f601c109930 tx=0x7f6008009260 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.592+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 msgr2=0x7f601c1a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.592+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f600c00d950 tx=0x7f600c00dc60 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 shutdown_connections 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f601c10a4e0 0x7f601c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f60000a2ca0 0x7f60000a5160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f601c104450 0x7f601c1a0870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 --2- 172.21.15.18:0/1860343394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f601c104e10 0x7f601c1a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 >> 172.21.15.18:0/1860343394 conn(0x7f601c0fff40 msgr2=0x7f601c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 shutdown_connections 2024-04-21T22:33:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:09.593+0000 7f6021400700 1 -- 172.21.15.18:0/1860343394 wait complete. 2024-04-21T22:33:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:09 smithi081 ceph-mon[31692]: pgmap v373: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-04-21T22:33:10.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:10 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1860343394' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T22:33:10.492 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-21T22:33:10.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:10.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:10 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1860343394' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T22:33:10.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:10 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1860343394' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 -- 172.21.15.18:0/1734740108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c076100 msgr2=0x7f904c076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 --2- 172.21.15.18:0/1734740108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c076100 0x7f904c076520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f903c009ca0 tx=0x7f903c02c100 comp rx=0 tx=0).stop 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 -- 172.21.15.18:0/1734740108 shutdown_connections 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 --2- 172.21.15.18:0/1734740108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077ce0 0x7f904c078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 --2- 172.21.15.18:0/1734740108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c077340 0x7f904c0777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 --2- 172.21.15.18:0/1734740108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c076100 0x7f904c076520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 -- 172.21.15.18:0/1734740108 >> 172.21.15.18:0/1734740108 conn(0x7f904c0fef90 msgr2=0x7f904c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 -- 172.21.15.18:0/1734740108 shutdown_connections 2024-04-21T22:33:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.720+0000 7f9051c00640 1 -- 172.21.15.18:0/1734740108 wait complete. 2024-04-21T22:33:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 Processor -- start 2024-04-21T22:33:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 -- start start 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077340 0x7f904c19e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c077ce0 0x7f904c1a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f904c1139e0 con 0x7f904c076100 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f904c113860 con 0x7f904c077ce0 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.722+0000 7f9051c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f904c113b60 con 0x7f904c077340 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43644/0 (socket says 172.21.15.18:43644) 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 -- 172.21.15.18:0/4167727779 learned_addr learned my addr 172.21.15.18:0/4167727779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904a000640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077340 0x7f904c19e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904b400640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c077ce0 0x7f904c1a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 -- 172.21.15.18:0/4167727779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077340 msgr2=0x7f904c19e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077340 0x7f904c19e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 -- 172.21.15.18:0/4167727779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c077ce0 msgr2=0x7f904c1a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c077ce0 0x7f904c1a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.723+0000 7f904aa00640 1 -- 172.21.15.18:0/4167727779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c1a5cb0 con 0x7f904c076100 2024-04-21T22:33:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f904aa00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f903c0325f0 tx=0x7f903c035d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c039040 con 0x7f904c076100 2024-04-21T22:33:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f903c044070 con 0x7f904c076100 2024-04-21T22:33:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c1a5f40 con 0x7f904c076100 2024-04-21T22:33:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c004460 con 0x7f904c076100 2024-04-21T22:33:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.724+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1a6340 con 0x7f904c076100 2024-04-21T22:33:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.725+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c110370 con 0x7f904c076100 2024-04-21T22:33:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.727+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f903c004600 con 0x7f904c076100 2024-04-21T22:33:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.729+0000 7f9043400640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.729+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f903c0f1620 con 0x7f904c076100 2024-04-21T22:33:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.729+0000 7f904a000640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:10.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.730+0000 7f904a000640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 0x7f90300a5050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90340095f0 tx=0x7f9034005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.734+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f903c0be500 con 0x7f904c076100 2024-04-21T22:33:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.939+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f904c0623e0 con 0x7f904c076100 2024-04-21T22:33:10.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.942+0000 7f9043400640 1 -- 172.21.15.18:0/4167727779 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f903c0bde00 con 0x7f904c076100 2024-04-21T22:33:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:10.942 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 msgr2=0x7f90300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 0x7f90300a5050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90340095f0 tx=0x7f9034005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 msgr2=0x7f904c19e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f903c0325f0 tx=0x7f903c035d10 comp rx=0 tx=0).stop 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 shutdown_connections 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f90300a2b90 0x7f90300a5050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c077ce0 0x7f904c1a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f904c077340 0x7f904c19e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 --2- 172.21.15.18:0/4167727779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c076100 0x7f904c19e090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 >> 172.21.15.18:0/4167727779 conn(0x7f904c0fef90 msgr2=0x7f904c100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 shutdown_connections 2024-04-21T22:33:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:10.945+0000 7f9051c00640 1 -- 172.21.15.18:0/4167727779 wait complete. 2024-04-21T22:33:10.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:33:10.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:33:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 -- 172.21.15.18:0/2585598140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 msgr2=0x7fa358076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2585598140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa358076520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa348009900 tx=0x7fa34802bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 -- 172.21.15.18:0/2585598140 shutdown_connections 2024-04-21T22:33:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2585598140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 0x7fa358078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2585598140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa3580777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2585598140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa358076520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 -- 172.21.15.18:0/2585598140 >> 172.21.15.18:0/2585598140 conn(0x7fa3580fed50 msgr2=0x7fa358101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 -- 172.21.15.18:0/2585598140 shutdown_connections 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.188+0000 7fa35ca00640 1 -- 172.21.15.18:0/2585598140 wait complete. 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.189+0000 7fa35ca00640 1 Processor -- start 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.189+0000 7fa35ca00640 1 -- start start 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa35819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 0x7fa3581a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa358113850 con 0x7fa358077ce0 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581136d0 con 0x7fa358076100 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa35ca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581139d0 con 0x7fa358077340 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa357200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 0x7fa3581a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa356800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa35819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60402/0 (socket says 172.21.15.18:60402) 2024-04-21T22:33:11.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa356800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa35819df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55332/0 (socket says 172.21.15.18:55332) 2024-04-21T22:33:11.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.190+0000 7fa34fe00640 1 -- 172.21.15.18:0/2331148071 learned_addr learned my addr 172.21.15.18:0/2331148071 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 -- 172.21.15.18:0/2331148071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 msgr2=0x7fa35819df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa35819df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 -- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 msgr2=0x7fa3581a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 0x7fa3581a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 -- 172.21.15.18:0/2331148071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3581a5b20 con 0x7fa358077340 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34fe00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e9f0 tx=0x7fa34000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34000cd80 con 0x7fa358077340 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3581a5e10 con 0x7fa358077340 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340005500 con 0x7fa358077340 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340010690 con 0x7fa358077340 2024-04-21T22:33:11.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.191+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3581a62d0 con 0x7fa358077340 2024-04-21T22:33:11.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.192+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa358110130 con 0x7fa358077340 2024-04-21T22:33:11.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.195+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa3400046c0 con 0x7fa358077340 2024-04-21T22:33:11.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.196+0000 7fa34f400640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 0x7fa33c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.196+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fa3400cf670 con 0x7fa358077340 2024-04-21T22:33:11.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.196+0000 7fa356800640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 0x7fa33c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.197+0000 7fa356800640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 0x7fa33c0a5050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa34802c7b0 tx=0x7fa348005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:11.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.198+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fa3400536f0 con 0x7fa358077340 2024-04-21T22:33:11.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:11 smithi018 ceph-mon[26614]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-21T22:33:11.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:11 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4167727779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:11.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.403+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa35802d370 con 0x7fa358077340 2024-04-21T22:33:11.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.404+0000 7fa34f400640 1 -- 172.21.15.18:0/2331148071 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fa34009c550 con 0x7fa358077340 2024-04-21T22:33:11.404 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:33:11.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 msgr2=0x7fa33c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 0x7fa33c0a5050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa34802c7b0 tx=0x7fa348005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 msgr2=0x7fa35819e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e9f0 tx=0x7fa34000edf0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 shutdown_connections 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa33c0a2b90 0x7fa33c0a5050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa358077ce0 0x7fa3581a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358077340 0x7fa35819e440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 --2- 172.21.15.18:0/2331148071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358076100 0x7fa35819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.407+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 >> 172.21.15.18:0/2331148071 conn(0x7fa3580fed50 msgr2=0x7fa358100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.408+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 shutdown_connections 2024-04-21T22:33:11.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.408+0000 7fa35ca00640 1 -- 172.21.15.18:0/2331148071 wait complete. 2024-04-21T22:33:11.429 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:33:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:11 smithi081 ceph-mon[31692]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-21T22:33:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:11 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4167727779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 -- 172.21.15.18:0/1505984255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96341037c0 msgr2=0x7f9634103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 --2- 172.21.15.18:0/1505984255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96341037c0 0x7f9634103be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9628009900 tx=0x7f962802bc50 comp rx=0 tx=0).stop 2024-04-21T22:33:11.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 -- 172.21.15.18:0/1505984255 shutdown_connections 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 --2- 172.21.15.18:0/1505984255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9634105370 0x7f963410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 --2- 172.21.15.18:0/1505984255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 --2- 172.21.15.18:0/1505984255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96341037c0 0x7f9634103be0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 -- 172.21.15.18:0/1505984255 >> 172.21.15.18:0/1505984255 conn(0x7f96340fed50 msgr2=0x7f9634101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.649+0000 7f963b200640 1 -- 172.21.15.18:0/1505984255 shutdown_connections 2024-04-21T22:33:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.650+0000 7f963b200640 1 -- 172.21.15.18:0/1505984255 wait complete. 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 Processor -- start 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 -- start start 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634079a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9634105370 0x7f9634076060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f963410f430 con 0x7f96341049b0 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f963410f2b0 con 0x7f9634105370 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f963b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f963410f5b0 con 0x7f96341037c0 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f9639400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634079a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.651+0000 7f9639e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60414/0 (socket says 172.21.15.18:60414) 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 -- 172.21.15.18:0/3573131178 learned_addr learned my addr 172.21.15.18:0/3573131178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f963a800640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9634105370 0x7f9634076060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 -- 172.21.15.18:0/3573131178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9634105370 msgr2=0x7f9634076060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9634105370 0x7f9634076060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 -- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 msgr2=0x7f9634079a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634079a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 -- 172.21.15.18:0/3573131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9634076920 con 0x7f96341037c0 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639400640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634079a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:11.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.652+0000 7f9639e00640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9628000c00 tx=0x7f9628005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.653+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628042020 con 0x7f96341037c0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.653+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96280044d0 con 0x7f96341037c0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.653+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341a5ff0 con 0x7f96341037c0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.653+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962803e460 con 0x7f96341037c0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.653+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341a63a0 con 0x7f96341037c0 2024-04-21T22:33:11.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.654+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963404f500 con 0x7f96341037c0 2024-04-21T22:33:11.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.656+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9628045020 con 0x7f96341037c0 2024-04-21T22:33:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.657+0000 7f962ea00640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 0x7f961c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.657+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f96280f1060 con 0x7f96341037c0 2024-04-21T22:33:11.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.658+0000 7f9639400640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 0x7f961c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.658+0000 7f9639400640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 0x7f961c0a5050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9634077470 tx=0x7f9624005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:11.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.661+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f962804c020 con 0x7f96341037c0 2024-04-21T22:33:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:11 smithi047 ceph-mon[31561]: pgmap v374: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-04-21T22:33:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:11 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4167727779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:11.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.874+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9634062340 con 0x7f96341037c0 2024-04-21T22:33:11.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.875+0000 7f962ea00640 1 -- 172.21.15.18:0/3573131178 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f96280bdf40 con 0x7f96341037c0 2024-04-21T22:33:11.875 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 msgr2=0x7f961c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 0x7f961c0a5050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9634077470 tx=0x7f9624005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 msgr2=0x7f96340794f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9628000c00 tx=0x7f9628005d50 comp rx=0 tx=0).stop 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 shutdown_connections 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f961c0a2b90 0x7f961c0a5050 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9634105370 0x7f9634076060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96341049b0 0x7f9634079a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 --2- 172.21.15.18:0/3573131178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96341037c0 0x7f96340794f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 >> 172.21.15.18:0/3573131178 conn(0x7f96340fed50 msgr2=0x7f9634107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 shutdown_connections 2024-04-21T22:33:11.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:11.878+0000 7f963b200640 1 -- 172.21.15.18:0/3573131178 wait complete. 2024-04-21T22:33:11.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:33:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 -- 172.21.15.18:0/1764279540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 msgr2=0x7fc2a41019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1764279540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a41019e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc298009860 tx=0x7fc29802bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 -- 172.21.15.18:0/1764279540 shutdown_connections 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1764279540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 0x7fc2a4109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1764279540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1764279540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a41019e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 -- 172.21.15.18:0/1764279540 >> 172.21.15.18:0/1764279540 conn(0x7fc2a40fcb50 msgr2=0x7fc2a40fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 -- 172.21.15.18:0/1764279540 shutdown_connections 2024-04-21T22:33:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.113+0000 7fc2aa200640 1 -- 172.21.15.18:0/1764279540 wait complete. 2024-04-21T22:33:12.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.114+0000 7fc2aa200640 1 Processor -- start 2024-04-21T22:33:12.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 -- start start 2024-04-21T22:33:12.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 0x7fc2a41a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a410d210 con 0x7fc2a4103170 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a410d090 con 0x7fc2a41015c0 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2aa200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a410d390 con 0x7fc2a41027b0 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2a9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 0x7fc2a41a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2a8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2a3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2a8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55372/0 (socket says 172.21.15.18:55372) 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.115+0000 7fc2a8e00640 1 -- 172.21.15.18:0/1759308901 learned_addr learned my addr 172.21.15.18:0/1759308901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 -- 172.21.15.18:0/1759308901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 msgr2=0x7fc2a419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 -- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 msgr2=0x7fc2a41a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 0x7fc2a41a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 -- 172.21.15.18:0/1759308901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a41a1740 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a3e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a8e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2980349e0 tx=0x7fc2980042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298041020 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2980323b0 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a41a19d0 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.116+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298039040 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.117+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a41a1ec0 con 0x7fc2a41015c0 2024-04-21T22:33:12.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.118+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a41a2090 con 0x7fc2a41015c0 2024-04-21T22:33:12.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.120+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc298044020 con 0x7fc2a41015c0 2024-04-21T22:33:12.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.121+0000 7fc2a1600640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 0x7fc28c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.121+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc2980f0960 con 0x7fc2a41015c0 2024-04-21T22:33:12.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.121+0000 7fc2a3e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 0x7fc28c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.122+0000 7fc2a3e00640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 0x7fc28c0a5050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2a419b030 tx=0x7fc290009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:12.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.125+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc29804b020 con 0x7fc2a41015c0 2024-04-21T22:33:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.332+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2a41a2420 con 0x7fc2a41015c0 2024-04-21T22:33:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.333+0000 7fc2a1600640 1 -- 172.21.15.18:0/1759308901 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7fc2980bd840 con 0x7fc2a41015c0 2024-04-21T22:33:12.333 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:33:12.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 msgr2=0x7fc28c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 0x7fc28c0a5050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2a419b030 tx=0x7fc290009260 comp rx=0 tx=0).stop 2024-04-21T22:33:12.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 msgr2=0x7fc2a4199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2980349e0 tx=0x7fc2980042f0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 shutdown_connections 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc28c0a2b90 0x7fc28c0a5050 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2a4103170 0x7fc2a41a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a41027b0 0x7fc2a419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 --2- 172.21.15.18:0/1759308901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a41015c0 0x7fc2a4199b70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 >> 172.21.15.18:0/1759308901 conn(0x7fc2a40fcb50 msgr2=0x7fc2a4073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 shutdown_connections 2024-04-21T22:33:12.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.336+0000 7fc2aa200640 1 -- 172.21.15.18:0/1759308901 wait complete. 2024-04-21T22:33:12.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.571+0000 7ff403a00640 1 -- 172.21.15.18:0/1862305125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 msgr2=0x7ff3fc0ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.571+0000 7ff403a00640 1 --2- 172.21.15.18:0/1862305125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc0ffe50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009900 tx=0x7ff3f002bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 -- 172.21.15.18:0/1862305125 shutdown_connections 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 --2- 172.21.15.18:0/1862305125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 0x7ff3fc107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 --2- 172.21.15.18:0/1862305125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 0x7ff3fc1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 --2- 172.21.15.18:0/1862305125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc0ffe50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 -- 172.21.15.18:0/1862305125 >> 172.21.15.18:0/1862305125 conn(0x7ff3fc0faf80 msgr2=0x7ff3fc0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:12.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 -- 172.21.15.18:0/1862305125 shutdown_connections 2024-04-21T22:33:12.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.572+0000 7ff403a00640 1 -- 172.21.15.18:0/1862305125 wait complete. 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 Processor -- start 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 -- start start 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 0x7ff3fc195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 0x7ff3fc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc10b230 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc10b0b0 con 0x7ff3fc1015e0 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff403a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc10b3b0 con 0x7ff3fc100c20 2024-04-21T22:33:12.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff401000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff401000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43714/0 (socket says 172.21.15.18:43714) 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.573+0000 7ff401000640 1 -- 172.21.15.18:0/907552614 learned_addr learned my addr 172.21.15.18:0/907552614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 0x7ff3fc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff3fbe00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 0x7ff3fc195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 -- 172.21.15.18:0/907552614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 msgr2=0x7ff3fc195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 0x7ff3fc195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 -- 172.21.15.18:0/907552614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 msgr2=0x7ff3fc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 0x7ff3fc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 -- 172.21.15.18:0/907552614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc19d4c0 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.574+0000 7ff401000640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0000c00 tx=0x7ff3f002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.575+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0043020 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.575+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3f00054e0 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.575+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0003c40 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.575+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc19d750 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.575+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc19dc50 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.576+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc106d50 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.578+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff3f0046020 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.580+0000 7ff3f9600640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 0x7ff3e40a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:12.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.580+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff3f00f1060 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.580+0000 7ff3fbe00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 0x7ff3e40a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:12.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.581+0000 7ff3fbe00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 0x7ff3e40a7260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc196db0 tx=0x7ff3e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:12.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.584+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff3f004d020 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2331148071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:12 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3573131178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:12 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2331148071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:12 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3573131178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:12 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2331148071' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:12 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3573131178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:12.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.831+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3fc02d170 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.832+0000 7ff3f9600640 1 -- 172.21.15.18:0/907552614 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7ff3f00bdf40 con 0x7ff3fc0ffa30 2024-04-21T22:33:12.832 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:33:12.832 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:12.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 msgr2=0x7ff3e40a7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 0x7ff3e40a7260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc196db0 tx=0x7ff3e8005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:12.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 msgr2=0x7ff3fc1958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:12.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0000c00 tx=0x7ff3f002c650 comp rx=0 tx=0).stop 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 shutdown_connections 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff3e40a4da0 0x7ff3e40a7260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3fc1015e0 0x7ff3fc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3fc100c20 0x7ff3fc195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 --2- 172.21.15.18:0/907552614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3fc0ffa30 0x7ff3fc1958a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 >> 172.21.15.18:0/907552614 conn(0x7ff3fc0faf80 msgr2=0x7ff3fc103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.835+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 shutdown_connections 2024-04-21T22:33:12.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:12.836+0000 7ff403a00640 1 -- 172.21.15.18:0/907552614 wait complete. 2024-04-21T22:33:12.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 -- 172.21.15.18:0/1179878070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 msgr2=0x7f9ee4103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/1179878070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4103cc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009be0 tx=0x7f9ed402bef0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 -- 172.21.15.18:0/1179878070 shutdown_connections 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/1179878070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee410bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/1179878070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 0x7f9ee4104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/1179878070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4103cc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 -- 172.21.15.18:0/1179878070 >> 172.21.15.18:0/1179878070 conn(0x7f9ee40fee10 msgr2=0x7f9ee4101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 -- 172.21.15.18:0/1179878070 shutdown_connections 2024-04-21T22:33:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.077+0000 7f9ee8c00640 1 -- 172.21.15.18:0/1179878070 wait complete. 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.078+0000 7f9ee8c00640 1 Processor -- start 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.078+0000 7f9ee8c00640 1 -- start start 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.078+0000 7f9ee8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.078+0000 7f9ee8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 0x7f9ee419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.078+0000 7f9ee8c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee8c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f4f0 con 0x7f9ee41038a0 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee8c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f370 con 0x7f9ee4104a90 2024-04-21T22:33:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee8c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee410f670 con 0x7f9ee4105450 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60472/0 (socket says 172.21.15.18:60472) 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 -- 172.21.15.18:0/3076820229 learned_addr learned my addr 172.21.15.18:0/3076820229 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43726/0 (socket says 172.21.15.18:43726) 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee2a00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 0x7f9ee419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 -- 172.21.15.18:0/3076820229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 msgr2=0x7f9ee419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 0x7f9ee419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 -- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 msgr2=0x7f9ee4199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3e00640 1 -- 172.21.15.18:0/3076820229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee41a17b0 con 0x7f9ee4105450 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.079+0000 7f9ee3400640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9ee3e00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00e970 tx=0x7f9edc00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00ccc0 con 0x7f9ee4105450 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee41a1aa0 con 0x7f9ee4105450 2024-04-21T22:33:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9edc00ce60 con 0x7f9ee4105450 2024-04-21T22:33:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc010490 con 0x7f9ee4105450 2024-04-21T22:33:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.080+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee41a1fa0 con 0x7f9ee4105450 2024-04-21T22:33:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.081+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee410ac10 con 0x7f9ee4105450 2024-04-21T22:33:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.083+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9edc005020 con 0x7f9ee4105450 2024-04-21T22:33:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.085+0000 7f9edbe00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 0x7f9ec80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.085+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f9edc0cf530 con 0x7f9ee4105450 2024-04-21T22:33:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.085+0000 7f9ee3400640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 0x7f9ec80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.086+0000 7f9ee3400640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 0x7f9ec80a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006010 tx=0x7f9ed4000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.089+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f9edc09c410 con 0x7f9ee4105450 2024-04-21T22:33:13.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.297+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ee4062340 con 0x7f9ee4105450 2024-04-21T22:33:13.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.299+0000 7f9edbe00640 1 -- 172.21.15.18:0/3076820229 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f9edc09bd10 con 0x7f9ee4105450 2024-04-21T22:33:13.299 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:13.299 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 msgr2=0x7f9ec80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 0x7f9ec80a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4006010 tx=0x7f9ed4000f40 comp rx=0 tx=0).stop 2024-04-21T22:33:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 msgr2=0x7f9ee41a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00e970 tx=0x7f9edc00ed70 comp rx=0 tx=0).stop 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 shutdown_connections 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ec80a2b80 0x7f9ec80a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ee4105450 0x7f9ee41a1140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ee4104a90 0x7f9ee419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 --2- 172.21.15.18:0/3076820229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ee41038a0 0x7f9ee4199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 >> 172.21.15.18:0/3076820229 conn(0x7f9ee40fee10 msgr2=0x7f9ee4107de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:13.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 shutdown_connections 2024-04-21T22:33:13.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.302+0000 7f9ee8c00640 1 -- 172.21.15.18:0/3076820229 wait complete. 2024-04-21T22:33:13.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:33:13.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:33:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.545+0000 7f638b000640 1 -- 172.21.15.18:0/172322203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410b820 msgr2=0x7f638410dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.545+0000 7f638b000640 1 --2- 172.21.15.18:0/172322203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410b820 0x7f638410dc10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f637000aa10 tx=0x7f637002cf60 comp rx=0 tx=0).stop 2024-04-21T22:33:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 -- 172.21.15.18:0/172322203 shutdown_connections 2024-04-21T22:33:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 --2- 172.21.15.18:0/172322203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638410e280 0x7f6384110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 --2- 172.21.15.18:0/172322203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410b820 0x7f638410dc10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 --2- 172.21.15.18:0/172322203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638406a4b0 0x7f638410b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 -- 172.21.15.18:0/172322203 >> 172.21.15.18:0/172322203 conn(0x7f638406e950 msgr2=0x7f6384070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 -- 172.21.15.18:0/172322203 shutdown_connections 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.546+0000 7f638b000640 1 -- 172.21.15.18:0/172322203 wait complete. 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 Processor -- start 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 -- start start 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638410b820 0x7f63841a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410e280 0x7f63841a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6384113a10 con 0x7f638406a4b0 2024-04-21T22:33:13.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6384113890 con 0x7f638410e280 2024-04-21T22:33:13.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.547+0000 7f638b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6384113b90 con 0x7f638410b820 2024-04-21T22:33:13.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43748/0 (socket says 172.21.15.18:43748) 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6389000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410e280 0x7f63841a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 -- 172.21.15.18:0/520085928 learned_addr learned my addr 172.21.15.18:0/520085928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383400640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638410b820 0x7f63841a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 -- 172.21.15.18:0/520085928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638410b820 msgr2=0x7f63841a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638410b820 0x7f63841a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 -- 172.21.15.18:0/520085928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410e280 msgr2=0x7f63841a78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410e280 0x7f63841a78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 -- 172.21.15.18:0/520085928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63841a7f30 con 0x7f638406a4b0 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.548+0000 7f6383e00640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f637400e9c0 tx=0x7f637400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.549+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637400cd80 con 0x7f638406a4b0 2024-04-21T22:33:13.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.549+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63740035f0 con 0x7f638406a4b0 2024-04-21T22:33:13.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.549+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63841a8220 con 0x7f638406a4b0 2024-04-21T22:33:13.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.549+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374010690 con 0x7f638406a4b0 2024-04-21T22:33:13.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.549+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63841a8790 con 0x7f638406a4b0 2024-04-21T22:33:13.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.550+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63841a8a50 con 0x7f638406a4b0 2024-04-21T22:33:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.552+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f63740037a0 con 0x7f638406a4b0 2024-04-21T22:33:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.554+0000 7f6380c00640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 0x7f63680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.554+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f63740cf3c0 con 0x7f638406a4b0 2024-04-21T22:33:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.554+0000 7f6383400640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 0x7f63680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.555+0000 7f6383400640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 0x7f63680a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6370037040 tx=0x7f6370000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.559+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f637409c300 con 0x7f638406a4b0 2024-04-21T22:33:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:13 smithi018 ceph-mon[26614]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:13 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1759308901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:13 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/907552614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:13 smithi081 ceph-mon[31692]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1759308901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/907552614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:13 smithi047 ceph-mon[31561]: pgmap v375: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-04-21T22:33:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:13 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1759308901' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:13 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/907552614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:13.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.768+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63841a8c20 con 0x7f638406a4b0 2024-04-21T22:33:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.769+0000 7f6380c00640 1 -- 172.21.15.18:0/520085928 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f637409bc00 con 0x7f638406a4b0 2024-04-21T22:33:13.769 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:33:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.771+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 msgr2=0x7f63680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.771+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 0x7f63680a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6370037040 tx=0x7f6370000bc0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.771+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 msgr2=0x7f63841a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.771+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f637400e9c0 tx=0x7f637400ee80 comp rx=0 tx=0).stop 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 shutdown_connections 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f63680a2c10 0x7f63680a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f638410e280 0x7f63841a78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f638410b820 0x7f63841a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 --2- 172.21.15.18:0/520085928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638406a4b0 0x7f63841a0310 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 >> 172.21.15.18:0/520085928 conn(0x7f638406e950 msgr2=0x7f6384070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 shutdown_connections 2024-04-21T22:33:13.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:13.772+0000 7f638b000640 1 -- 172.21.15.18:0/520085928 wait complete. 2024-04-21T22:33:13.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:33:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.008+0000 7fb24f200640 1 -- 172.21.15.18:0/4040906518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 msgr2=0x7fb250104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.008+0000 7fb24f200640 1 --2- 172.21.15.18:0/4040906518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb250104420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb240009ca0 tx=0x7fb24002c100 comp rx=0 tx=0).stop 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 -- 172.21.15.18:0/4040906518 shutdown_connections 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 --2- 172.21.15.18:0/4040906518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb2501096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 --2- 172.21.15.18:0/4040906518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 --2- 172.21.15.18:0/4040906518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb250104420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 -- 172.21.15.18:0/4040906518 >> 172.21.15.18:0/4040906518 conn(0x7fb2500fba20 msgr2=0x7fb2500fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 -- 172.21.15.18:0/4040906518 shutdown_connections 2024-04-21T22:33:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.009+0000 7fb24f200640 1 -- 172.21.15.18:0/4040906518 wait complete. 2024-04-21T22:33:14.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.010+0000 7fb24f200640 1 Processor -- start 2024-04-21T22:33:14.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.010+0000 7fb24f200640 1 -- start start 2024-04-21T22:33:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.010+0000 7fb24f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb25019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010d240 con 0x7fb250107290 2024-04-21T22:33:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010d0c0 con 0x7fb250102030 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010d3c0 con 0x7fb250104960 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb25019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55476/0 (socket says 172.21.15.18:55476) 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24de00640 1 -- 172.21.15.18:0/1011418727 learned_addr learned my addr 172.21.15.18:0/1011418727 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24d400640 1 -- 172.21.15.18:0/1011418727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 msgr2=0x7fb2501978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24d400640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24d400640 1 -- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 msgr2=0x7fb25019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.011+0000 7fb24d400640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb25019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24d400640 1 -- 172.21.15.18:0/1011418727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25019f500 con 0x7fb250104960 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24e800640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb25019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24de00640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24d400640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250197e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb238009b20 tx=0x7fb23800b2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23801e070 con 0x7fb250104960 2024-04-21T22:33:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23800bd00 con 0x7fb250104960 2024-04-21T22:33:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238019450 con 0x7fb250104960 2024-04-21T22:33:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2500ffe80 con 0x7fb250104960 2024-04-21T22:33:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.012+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb250100380 con 0x7fb250104960 2024-04-21T22:33:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.014+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2500fd510 con 0x7fb250104960 2024-04-21T22:33:14.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.016+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb238021070 con 0x7fb250104960 2024-04-21T22:33:14.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.017+0000 7fb246a00640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 0x7fb2340a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.018+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fb2380d2990 con 0x7fb250104960 2024-04-21T22:33:14.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.018+0000 7fb24de00640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 0x7fb2340a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.018+0000 7fb24de00640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 0x7fb2340a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb240006010 tx=0x7fb240004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.022+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb23809f220 con 0x7fb250104960 2024-04-21T22:33:14.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.228+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2501017c0 con 0x7fb250104960 2024-04-21T22:33:14.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.229+0000 7fb246a00640 1 -- 172.21.15.18:0/1011418727 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fb2380a3520 con 0x7fb250104960 2024-04-21T22:33:14.229 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:33:14.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.231+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 msgr2=0x7fb2340a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.231+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 0x7fb2340a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb240006010 tx=0x7fb240004a40 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 msgr2=0x7fb250197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250197e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb238009b20 tx=0x7fb23800b2c0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 shutdown_connections 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fb2340a2b90 0x7fb2340a5050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb250107290 0x7fb25019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb250104960 0x7fb250197e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 --2- 172.21.15.18:0/1011418727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb250102030 0x7fb2501978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 >> 172.21.15.18:0/1011418727 conn(0x7fb2500fba20 msgr2=0x7fb250102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 shutdown_connections 2024-04-21T22:33:14.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.232+0000 7fb24f200640 1 -- 172.21.15.18:0/1011418727 wait complete. 2024-04-21T22:33:14.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 -- 172.21.15.18:0/1049516234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 msgr2=0x7f38d4107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 --2- 172.21.15.18:0/1049516234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d4107fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009ca0 tx=0x7f38c402c100 comp rx=0 tx=0).stop 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 -- 172.21.15.18:0/1049516234 shutdown_connections 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 --2- 172.21.15.18:0/1049516234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4109770 0x7f38d4110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 --2- 172.21.15.18:0/1049516234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4108db0 0x7f38d4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 --2- 172.21.15.18:0/1049516234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d4107fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 -- 172.21.15.18:0/1049516234 >> 172.21.15.18:0/1049516234 conn(0x7f38d4076b80 msgr2=0x7f38d4078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 -- 172.21.15.18:0/1049516234 shutdown_connections 2024-04-21T22:33:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.470+0000 7f38da400640 1 -- 172.21.15.18:0/1049516234 wait complete. 2024-04-21T22:33:14.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.471+0000 7f38da400640 1 Processor -- start 2024-04-21T22:33:14.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.471+0000 7f38da400640 1 -- start start 2024-04-21T22:33:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4108db0 0x7f38d419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4109770 0x7f38d41a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38d4113840 con 0x7f38d4109770 2024-04-21T22:33:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41136c0 con 0x7f38d4107bc0 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38da400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38d41139c0 con 0x7f38d4108db0 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38d9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38d9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4109770 0x7f38d41a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38d9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55482/0 (socket says 172.21.15.18:55482) 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38d9000640 1 -- 172.21.15.18:0/3498846235 learned_addr learned my addr 172.21.15.18:0/3498846235 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.472+0000 7f38d3e00640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4108db0 0x7f38d419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 -- 172.21.15.18:0/3498846235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4108db0 msgr2=0x7f38d419e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4108db0 0x7f38d419e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 -- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4109770 msgr2=0x7f38d41a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4109770 0x7f38d41a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 -- 172.21.15.18:0/3498846235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d41a5b10 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d9000640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38c40324c0 tx=0x7f38c4035d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.473+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4039040 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.474+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c4044070 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.474+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d41a5da0 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.474+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40044a0 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.474+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d41a61d0 con 0x7f38d4107bc0 2024-04-21T22:33:14.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.475+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d410ef60 con 0x7f38d4107bc0 2024-04-21T22:33:14.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.477+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f38c4004640 con 0x7f38d4107bc0 2024-04-21T22:33:14.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.478+0000 7f38d1600640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 0x7f38b80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.478+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f38c40f1630 con 0x7f38d4107bc0 2024-04-21T22:33:14.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.478+0000 7f38d3e00640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 0x7f38b80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.479+0000 7f38d3e00640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 0x7f38b80a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0095f0 tx=0x7f38bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.483+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f38c40be510 con 0x7f38d4107bc0 2024-04-21T22:33:14.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:14 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3076820229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:14.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:14 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/520085928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:14.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:14 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3076820229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:14.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:14 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/520085928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.689+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38d40623e0 con 0x7f38d4107bc0 2024-04-21T22:33:14.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.690+0000 7f38d1600640 1 -- 172.21.15.18:0/3498846235 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f38c40bde10 con 0x7f38d4107bc0 2024-04-21T22:33:14.690 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:33:14.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 msgr2=0x7f38b80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 0x7f38b80a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0095f0 tx=0x7f38bc005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:14.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 msgr2=0x7f38d419def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38c40324c0 tx=0x7f38c4035d90 comp rx=0 tx=0).stop 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 shutdown_connections 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f38b80a2b90 0x7f38b80a5050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d4109770 0x7f38d41a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d4108db0 0x7f38d419e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 --2- 172.21.15.18:0/3498846235 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38d4107bc0 0x7f38d419def0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.692+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 >> 172.21.15.18:0/3498846235 conn(0x7f38d4076b80 msgr2=0x7f38d410c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.693+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 shutdown_connections 2024-04-21T22:33:14.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.693+0000 7f38da400640 1 -- 172.21.15.18:0/3498846235 wait complete. 2024-04-21T22:33:14.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:14 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3076820229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:14.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:14 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/520085928' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:14.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 -- 172.21.15.18:0/1672324085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 msgr2=0x7f4ed410a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 --2- 172.21.15.18:0/1672324085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed410a420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009860 tx=0x7f4ec402bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 -- 172.21.15.18:0/1672324085 shutdown_connections 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 --2- 172.21.15.18:0/1672324085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed4112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 --2- 172.21.15.18:0/1672324085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 0x7f4ed410b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 --2- 172.21.15.18:0/1672324085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed410a420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 -- 172.21.15.18:0/1672324085 >> 172.21.15.18:0/1672324085 conn(0x7f4ed4070780 msgr2=0x7f4ed4072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 -- 172.21.15.18:0/1672324085 shutdown_connections 2024-04-21T22:33:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.921+0000 7f4eda200640 1 -- 172.21.15.18:0/1672324085 wait complete. 2024-04-21T22:33:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 Processor -- start 2024-04-21T22:33:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 -- start start 2024-04-21T22:33:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 0x7f4ed41a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed41a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4115be0 con 0x7f4ed410bbb0 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4115a60 con 0x7f4ed410b1f0 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.923+0000 7f4eda200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4115d60 con 0x7f4ed410a000 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60536/0 (socket says 172.21.15.18:60536) 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 -- 172.21.15.18:0/1084234249 learned_addr learned my addr 172.21.15.18:0/1084234249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3e00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed41a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed2a00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 0x7f4ed41a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 -- 172.21.15.18:0/1084234249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 msgr2=0x7f4ed41a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 0x7f4ed41a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 -- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 msgr2=0x7f4ed41a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed41a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 -- 172.21.15.18:0/1084234249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed41aa0f0 con 0x7f4ed410a000 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3e00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed41a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.924+0000 7f4ed3400640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40349e0 tx=0x7f4ec4032430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.925+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4041020 con 0x7f4ed410a000 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.925+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed41aa380 con 0x7f4ed410a000 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.925+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ec402c9f0 con 0x7f4ed410a000 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.925+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4039040 con 0x7f4ed410a000 2024-04-21T22:33:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.925+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed41aa8c0 con 0x7f4ed410a000 2024-04-21T22:33:14.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.926+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed41aab20 con 0x7f4ed410a000 2024-04-21T22:33:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.928+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4ec4044020 con 0x7f4ed410a000 2024-04-21T22:33:14.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.930+0000 7f4ecbe00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 0x7f4eb80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:14.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.930+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f4ec40f0980 con 0x7f4ed410a000 2024-04-21T22:33:14.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.930+0000 7f4ed2a00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 0x7f4eb80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:14.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.931+0000 7f4ed2a00640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 0x7f4eb80a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4ed41a39e0 tx=0x7f4ec0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:14.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:14.934+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f4ec404b020 con 0x7f4ed410a000 2024-04-21T22:33:15.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.175+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ed41aacf0 con 0x7f4ed410a000 2024-04-21T22:33:15.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.176+0000 7f4ecbe00640 1 -- 172.21.15.18:0/1084234249 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7f4ec40bd860 con 0x7f4ed410a000 2024-04-21T22:33:15.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:15.177 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:33:15.177 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 msgr2=0x7f4eb80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 0x7f4eb80a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4ed41a39e0 tx=0x7f4ec0005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 msgr2=0x7f4ed41a24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40349e0 tx=0x7f4ec4032430 comp rx=0 tx=0).stop 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 shutdown_connections 2024-04-21T22:33:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f4eb80a2c10 0x7f4eb80a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ed410bbb0 0x7f4ed41a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ed410b1f0 0x7f4ed41a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 --2- 172.21.15.18:0/1084234249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ed410a000 0x7f4ed41a24d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 >> 172.21.15.18:0/1084234249 conn(0x7f4ed4070780 msgr2=0x7f4ed406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 shutdown_connections 2024-04-21T22:33:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.180+0000 7f4eda200640 1 -- 172.21.15.18:0/1084234249 wait complete. 2024-04-21T22:33:15.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 -- 172.21.15.18:0/2651080085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c1038a0 msgr2=0x7f113c103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 --2- 172.21.15.18:0/2651080085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c1038a0 0x7f113c103cc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f112c009ca0 tx=0x7f112c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 -- 172.21.15.18:0/2651080085 shutdown_connections 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 --2- 172.21.15.18:0/2651080085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c105450 0x7f113c10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 --2- 172.21.15.18:0/2651080085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 --2- 172.21.15.18:0/2651080085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c1038a0 0x7f113c103cc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.413+0000 7f113be00640 1 -- 172.21.15.18:0/2651080085 >> 172.21.15.18:0/2651080085 conn(0x7f113c0fee10 msgr2=0x7f113c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.414+0000 7f113be00640 1 -- 172.21.15.18:0/2651080085 shutdown_connections 2024-04-21T22:33:15.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.414+0000 7f113be00640 1 -- 172.21.15.18:0/2651080085 wait complete. 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 Processor -- start 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 -- start start 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 0x7f113c1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f113c10f4f0 con 0x7f113c1038a0 2024-04-21T22:33:15.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f113c10f370 con 0x7f113c104a90 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f113c10f670 con 0x7f113c105450 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.415+0000 7f113aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43812/0 (socket says 172.21.15.18:43812) 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 -- 172.21.15.18:0/1078087955 learned_addr learned my addr 172.21.15.18:0/1078087955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113b400640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 0x7f113c1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113a000640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 -- 172.21.15.18:0/1078087955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 msgr2=0x7f113c1a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 0x7f113c1a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 -- 172.21.15.18:0/1078087955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 msgr2=0x7f113c19a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c19a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 -- 172.21.15.18:0/1078087955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c1a17b0 con 0x7f113c1038a0 2024-04-21T22:33:15.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113b400640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 0x7f113c1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113a000640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.416+0000 7f113aa00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f112c000f80 tx=0x7f112c032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.417+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c041020 con 0x7f113c1038a0 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.417+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113c1a1a40 con 0x7f113c1038a0 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.417+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f112c034cd0 con 0x7f113c1038a0 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.417+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c039040 con 0x7f113c1038a0 2024-04-21T22:33:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.417+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113c1a1f50 con 0x7f113c1038a0 2024-04-21T22:33:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.418+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113c10ac10 con 0x7f113c1038a0 2024-04-21T22:33:15.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.420+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f112c044020 con 0x7f113c1038a0 2024-04-21T22:33:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.421+0000 7f1140a00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 0x7f11200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.421+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f112c0f0da0 con 0x7f113c1038a0 2024-04-21T22:33:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.422+0000 7f113a000640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 0x7f11200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.422+0000 7f113a000640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 0x7f11200a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f113c19b0a0 tx=0x7f1124005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:15.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.426+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f112c04b020 con 0x7f113c1038a0 2024-04-21T22:33:15.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:15 smithi018 ceph-mon[26614]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:15.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:15 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1011418727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:15 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3498846235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:15 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1084234249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:15.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.636+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f113c062340 con 0x7f113c1038a0 2024-04-21T22:33:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:15 smithi081 ceph-mon[31692]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:15 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1011418727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:15 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3498846235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:15 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1084234249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.640+0000 7f1140a00640 1 -- 172.21.15.18:0/1078087955 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f112c0348f0 con 0x7f113c1038a0 2024-04-21T22:33:15.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:15.641 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 msgr2=0x7f11200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 0x7f11200a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f113c19b0a0 tx=0x7f1124005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 msgr2=0x7f113c199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f112c000f80 tx=0x7f112c032ec0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 shutdown_connections 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f11200a2c00 0x7f11200a50c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f113c105450 0x7f113c1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f113c104a90 0x7f113c19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 --2- 172.21.15.18:0/1078087955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f113c1038a0 0x7f113c199b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 >> 172.21.15.18:0/1078087955 conn(0x7f113c0fee10 msgr2=0x7f113c107de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 shutdown_connections 2024-04-21T22:33:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.644+0000 7f113be00640 1 -- 172.21.15.18:0/1078087955 wait complete. 2024-04-21T22:33:15.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:33:15.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:15 smithi047 ceph-mon[31561]: pgmap v376: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-04-21T22:33:15.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:15 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1011418727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:15 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3498846235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:15.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:15 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1084234249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 -- 172.21.15.18:0/790962085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8107dc0 msgr2=0x7f35d81081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 --2- 172.21.15.18:0/790962085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8107dc0 0x7f35d81081e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009900 tx=0x7f35c802bc40 comp rx=0 tx=0).stop 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 -- 172.21.15.18:0/790962085 shutdown_connections 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 --2- 172.21.15.18:0/790962085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8109970 0x7f35d8110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 --2- 172.21.15.18:0/790962085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d8109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 --2- 172.21.15.18:0/790962085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8107dc0 0x7f35d81081e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 -- 172.21.15.18:0/790962085 >> 172.21.15.18:0/790962085 conn(0x7f35d8076d90 msgr2=0x7f35d80791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 -- 172.21.15.18:0/790962085 shutdown_connections 2024-04-21T22:33:15.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.882+0000 7f35dee00640 1 -- 172.21.15.18:0/790962085 wait complete. 2024-04-21T22:33:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 Processor -- start 2024-04-21T22:33:15.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 -- start start 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8107dc0 0x7f35d819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d819e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8113a30 con 0x7f35d8109970 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35d81138b0 con 0x7f35d8107dc0 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dee00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8113bb0 con 0x7f35d8108fb0 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.883+0000 7f35dce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43384/0 (socket says 172.21.15.18:43384) 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 -- 172.21.15.18:0/1126198485 learned_addr learned my addr 172.21.15.18:0/1126198485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35d7e00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8107dc0 0x7f35d819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35cf400640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d819e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 -- 172.21.15.18:0/1126198485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 msgr2=0x7f35d819e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d819e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 -- 172.21.15.18:0/1126198485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8107dc0 msgr2=0x7f35d819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8107dc0 0x7f35d819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 -- 172.21.15.18:0/1126198485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d81a5d20 con 0x7f35d8109970 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35cf400640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d819e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.884+0000 7f35dce00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35d000eaa0 tx=0x7f35d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.885+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d000cdb0 con 0x7f35d8109970 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.885+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35d0005020 con 0x7f35d8109970 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.885+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d00116b0 con 0x7f35d8109970 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.885+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d81a5fb0 con 0x7f35d8109970 2024-04-21T22:33:15.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.885+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d81a6480 con 0x7f35d8109970 2024-04-21T22:33:15.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.886+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d810f180 con 0x7f35d8109970 2024-04-21T22:33:15.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.888+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f35d0005560 con 0x7f35d8109970 2024-04-21T22:33:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.889+0000 7f35d5600640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 0x7f35bc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.889+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f35d00cf200 con 0x7f35d8109970 2024-04-21T22:33:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.889+0000 7f35d7e00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 0x7f35bc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:15.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.890+0000 7f35d7e00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 0x7f35bc0a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35c8000c00 tx=0x7f35c8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:15.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:15.893+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f35d0016030 con 0x7f35d8109970 2024-04-21T22:33:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.146+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35d802d170 con 0x7f35d8109970 2024-04-21T22:33:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.148+0000 7f35d5600640 1 -- 172.21.15.18:0/1126198485 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7f35d009baf0 con 0x7f35d8109970 2024-04-21T22:33:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:16.148 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:33:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.150+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 msgr2=0x7f35bc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 0x7f35bc0a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35c8000c00 tx=0x7f35c8005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 msgr2=0x7f35d81a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35d000eaa0 tx=0x7f35d000ef60 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 shutdown_connections 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f35bc0a2b90 0x7f35bc0a5050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35d8109970 0x7f35d81a56b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d8108fb0 0x7f35d819e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 --2- 172.21.15.18:0/1126198485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d8107dc0 0x7f35d819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 >> 172.21.15.18:0/1126198485 conn(0x7f35d8076d90 msgr2=0x7f35d810c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 shutdown_connections 2024-04-21T22:33:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.151+0000 7f35dee00640 1 -- 172.21.15.18:0/1126198485 wait complete. 2024-04-21T22:33:16.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-21T22:31:28.985001+0000', 'modified': '2024-04-21T22:31:36.529368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24596, 'mds_1': 24568, 'mds_2': 24538, 'mds_3': 24509, 'mds_4': 24496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14475': {'gid': 14475, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6841/2953480850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 2953480850}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 2953480850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6833/3754896489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6832', 'nonce': 3754896489}, {'type': 'v1', 'addr': '172.21.15.47:6833', 'nonce': 3754896489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/2486302783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2486302783}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2486302783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'j', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.18:6835/1168118848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 1168118848}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1168118848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.47:6835/877045007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 877045007}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 877045007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.81:6835/1298670178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1298670178}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1298670178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6837/639724797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6836', 'nonce': 639724797}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 639724797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/2293229120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2293229120}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2293229120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.81:6839/3777779454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3777779454}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3777779454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6839/3521127091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6838', 'nonce': 3521127091}, {'type': 'v1', 'addr': '172.21.15.47:6839', 'nonce': 3521127091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24596, 'qdb_cluster': [24568, 24596, 24509, 24538, 24496]} 2024-04-21T22:33:16.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-21T22:33:16.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 -- 172.21.15.18:0/3153428455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100780 msgr2=0x7ff548100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 --2- 172.21.15.18:0/3153428455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100780 0x7ff548100be0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff534009900 tx=0x7ff53402bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 -- 172.21.15.18:0/3153428455 shutdown_connections 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 --2- 172.21.15.18:0/3153428455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 --2- 172.21.15.18:0/3153428455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff548100780 0x7ff548100be0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 --2- 172.21.15.18:0/3153428455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5480ffe20 0x7ff548100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 -- 172.21.15.18:0/3153428455 >> 172.21.15.18:0/3153428455 conn(0x7ff5480fba20 msgr2=0x7ff5480fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 -- 172.21.15.18:0/3153428455 shutdown_connections 2024-04-21T22:33:16.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.384+0000 7ff54d600640 1 -- 172.21.15.18:0/3153428455 wait complete. 2024-04-21T22:33:16.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.385+0000 7ff54d600640 1 Processor -- start 2024-04-21T22:33:16.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.385+0000 7ff54d600640 1 -- start start 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5480ffe20 0x7ff548199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff548100780 0x7ff548199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810f460 con 0x7ff548101120 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810f2e0 con 0x7ff548100780 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff54810f5e0 con 0x7ff5480ffe20 2024-04-21T22:33:16.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43404/0 (socket says 172.21.15.18:43404) 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff54cc00640 1 -- 172.21.15.18:0/388235696 learned_addr learned my addr 172.21.15.18:0/388235696 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff547e00640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5480ffe20 0x7ff548199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.386+0000 7ff547400640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff548100780 0x7ff548199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 -- 172.21.15.18:0/388235696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5480ffe20 msgr2=0x7ff548199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5480ffe20 0x7ff548199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 -- 172.21.15.18:0/388235696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff548100780 msgr2=0x7ff548199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff548100780 0x7ff548199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 -- 172.21.15.18:0/388235696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5481a16c0 con 0x7ff548101120 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54cc00640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e970 tx=0x7ff54000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff544c00640 1 -- 172.21.15.18:0/388235696 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54000ccc0 con 0x7ff548101120 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff544c00640 1 -- 172.21.15.18:0/388235696 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff54000ce60 con 0x7ff548101120 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5481a19b0 con 0x7ff548101120 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.387+0000 7ff544c00640 1 -- 172.21.15.18:0/388235696 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540010490 con 0x7ff548101120 2024-04-21T22:33:16.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.388+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481a1e80 con 0x7ff548101120 2024-04-21T22:33:16.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff544c00640 1 -- 172.21.15.18:0/388235696 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff540005020 con 0x7ff548101120 2024-04-21T22:33:16.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 Processor -- start 2024-04-21T22:33:16.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 -- start start 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c1319526d0 0x55c131952af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c131958230 0x55c13195a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c131853dc0 con 0x55c131958230 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c1318b6ce0 con 0x55c1319526d0 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.391+0000 7ff5517df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c13185f7c0 con 0x55c1319530c0 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48198/0 (socket says 172.21.15.18:48198) 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 -- 172.21.15.18:0/3640298585 learned_addr learned my addr 172.21.15.18:0/3640298585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547400640 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c1319526d0 0x55c131952af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547400640 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c131958230 0x55c13195a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 -- 172.21.15.18:0/3640298585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c1319526d0 msgr2=0x55c131952af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c1319526d0 0x55c131952af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 -- 172.21.15.18:0/3640298585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c131958230 msgr2=0x55c13195a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c131958230 0x55c13195a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 -- 172.21.15.18:0/3640298585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1315cb2d0 con 0x55c1319530c0 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.392+0000 7ff547e00640 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff5380114f0 tx=0x7ff5380119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed4ef90e025dac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff544c00640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 0x7ff52c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff53d200640 1 -- 172.21.15.18:0/3640298585 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538004d20 con 0x55c1319530c0 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff53d200640 1 -- 172.21.15.18:0/3640298585 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff538004050 con 0x55c1319530c0 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff53d200640 1 -- 172.21.15.18:0/3640298585 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53800f7c0 con 0x55c1319530c0 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff544c00640 1 -- 172.21.15.18:0/388235696 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff5400cf530 con 0x7ff548101120 2024-04-21T22:33:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff547400640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 0x7ff52c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff5517df740 1 -- 172.21.15.18:0/3640298585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 msgr2=0x55c131957bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.393+0000 7ff5517df740 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff5380114f0 tx=0x7ff5380119b0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff547400640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 0x7ff52c0a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff53402c240 tx=0x7ff53402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 -- 172.21.15.18:0/3640298585 shutdown_connections 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c131958230 0x55c13195a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131957bc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 --2- 172.21.15.18:0/3640298585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c1319526d0 0x55c131952af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 -- 172.21.15.18:0/3640298585 >> 172.21.15.18:0/3640298585 conn(0x55c13194dc40 msgr2=0x55c13194e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 -- 172.21.15.18:0/3640298585 shutdown_connections 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 -- 172.21.15.18:0/3640298585 wait complete. 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 -- start start 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.394+0000 7ff5517df740 1 Processor -- start 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c131872c10 con 0x55c1319526d0 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c1318b2ca0 con 0x55c131958230 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c13195b1e0 con 0x55c1319530c0 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff5517df740 10 client.0 _ll_register_callbacks cb 0x55c1318ade00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff547400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff547400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48212/0 (socket says 172.21.15.18:48212) 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff547e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff547400640 1 -- 172.21.15.18:0/2014839138 learned_addr learned my addr 172.21.15.18:0/2014839138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.395+0000 7ff54cc00640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 -- 172.21.15.18:0/2014839138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 msgr2=0x55c131963f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 -- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 msgr2=0x55c13195c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 -- 172.21.15.18:0/2014839138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1316956b0 con 0x55c1319530c0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff54cc00640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547e00640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff547400640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff534005ab0 tx=0x7ff534005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34649c9aa16256a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff531600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534053020 con 0x55c1319530c0 2024-04-21T22:33:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff534004380 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.396+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff538004050 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.397+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff534004eb0 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.397+0000 7ff5517df740 10 client.25012 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.397+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c131967330 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.397+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff538004050 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff534003a20 con 0x55c1319530c0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 10 client.25012 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 10 client.25012 resolve_mds: resolved name 'j' to daemon mds.j 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 20 client.25012 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c131969a60 0x55c13196aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 4 client.25012 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1318c4220 con 0x55c131969a60 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.398+0000 7ff547e00640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c131969a60 0x55c13196aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.399+0000 7ff547e00640 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c131969a60 0x55c13196aed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=491a02cd70f58b3 server_cookie=be375d1b50a8ccc1 in_seq=0 out_seq=0 2024-04-21T22:33:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.399+0000 7ff531600640 10 client.25012 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.399+0000 7ff531600640 1 -- 172.21.15.18:0/2014839138 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c1318c4220 con 0x55c131969a60 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.399+0000 7ff531600640 10 client.25012 handle_command_reply: tid=0 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 client.25012 shutdown 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 msgr2=0x55c13195cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff534005ab0 tx=0x7ff534005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 shutdown_connections 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c131969a60 0x55c13196aed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 --2- 172.21.15.18:0/2014839138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff531600640 0 client.25012 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 >> 172.21.15.18:0/2014839138 conn(0x55c13194dc40 msgr2=0x55c13194cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 shutdown_connections 2024-04-21T22:33:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 1 -- 172.21.15.18:0/2014839138 wait complete. 2024-04-21T22:33:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.400+0000 7ff5517df740 20 client.25012 trim_cache size 0 max 16384 2024-04-21T22:33:16.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 Processor -- start 2024-04-21T22:33:16.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 -- start start 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c131969210 con 0x55c1319526d0 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c1319698e0 con 0x55c131958230 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff5517df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c131969fb0 con 0x55c1319530c0 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.421+0000 7ff547e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51466/0 (socket says 172.21.15.18:51466) 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 -- 172.21.15.18:0/1086672010 learned_addr learned my addr 172.21.15.18:0/1086672010 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff547400640 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 -- 172.21.15.18:0/1086672010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 msgr2=0x55c13195cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 -- 172.21.15.18:0/1086672010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 msgr2=0x55c13195c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 -- 172.21.15.18:0/1086672010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c131953fc0 con 0x55c131958230 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff547e00640 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff54cc00640 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff54009bca0 tx=0x7ff540098030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f677a9667d6845 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.422+0000 7ff533e00640 1 -- 172.21.15.18:0/1086672010 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400a00c0 con 0x55c131958230 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff533e00640 1 -- 172.21.15.18:0/1086672010 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5400b9070 con 0x55c131958230 2024-04-21T22:33:16.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff533e00640 1 -- 172.21.15.18:0/1086672010 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400cf0c0 con 0x55c131958230 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 -- 172.21.15.18:0/1086672010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 msgr2=0x55c131963f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff54009bca0 tx=0x7ff540098030 comp rx=0 tx=0).stop 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 -- 172.21.15.18:0/1086672010 shutdown_connections 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131963f10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c13195cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 --2- 172.21.15.18:0/1086672010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 -- 172.21.15.18:0/1086672010 >> 172.21.15.18:0/1086672010 conn(0x55c13194dc40 msgr2=0x55c13194e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 -- 172.21.15.18:0/1086672010 shutdown_connections 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.423+0000 7ff5517df740 1 -- 172.21.15.18:0/1086672010 wait complete. 2024-04-21T22:33:16.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 -- start start 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 Processor -- start 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131960010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131962fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c13196ad50 con 0x55c1319526d0 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c13196a680 con 0x55c131958230 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c13196b420 con 0x55c1319530c0 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.424+0000 7ff5517df740 10 client.0 _ll_register_callbacks cb 0x7ff5380093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43446/0 (socket says 172.21.15.18:43446) 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 -- 172.21.15.18:0/4133295770 learned_addr learned my addr 172.21.15.18:0/4133295770 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547400640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131960010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff54cc00640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131962fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 -- 172.21.15.18:0/4133295770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 msgr2=0x55c131960010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131960010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 -- 172.21.15.18:0/4133295770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 msgr2=0x55c131962fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131962fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 -- 172.21.15.18:0/4133295770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1319635d0 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff547e00640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5380114f0 tx=0x7ff538004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a56b4887b736c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.425+0000 7ff531600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538003e00 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff53802bb50 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5400b9070 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff538039070 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff5517df740 10 client.14889 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c1319cfe20 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5400b9070 con 0x55c1319526d0 2024-04-21T22:33:16.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff53802b360 con 0x55c1319526d0 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.426+0000 7ff5517df740 10 client.14889 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff5517df740 10 client.14889 resolve_mds: resolved name 'j' to daemon mds.j 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff5517df740 20 client.14889 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c1319d48a0 0x55c1319d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff5517df740 4 client.14889 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "status"}) -- 0x55c1318be570 con 0x55c1319d48a0 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff547400640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c1319d48a0 0x55c1319d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff547400640 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c1319d48a0 0x55c1319d35b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=995490fa98a480bb server_cookie=20be138f3af47938 in_seq=0 out_seq=0 2024-04-21T22:33:16.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.427+0000 7ff531600640 10 client.14889 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff531600640 1 -- 172.21.15.18:0/4133295770 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c1318be570 con 0x55c1319d48a0 2024-04-21T22:33:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff531600640 10 client.14889 handle_command_reply: tid=0 2024-04-21T22:33:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 client.14889 shutdown 2024-04-21T22:33:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 msgr2=0x55c13195fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5380114f0 tx=0x7ff538004720 comp rx=0 tx=0).stop 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 shutdown_connections 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c1319d48a0 0x55c1319d35b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c131958230 0x55c131962fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c1319530c0 0x55c131960010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 --2- 172.21.15.18:0/4133295770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c1319526d0 0x55c13195fad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff531600640 0 client.14889 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 >> 172.21.15.18:0/4133295770 conn(0x55c13194dc40 msgr2=0x55c1319544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 shutdown_connections 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 1 -- 172.21.15.18:0/4133295770 wait complete. 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.428+0000 7ff5517df740 20 client.14889 trim_cache size 0 max 16384 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24496, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 100.90571738600001, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 143.73471456499999 2024-04-21T22:33:16.433 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 msgr2=0x7ff52c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 0x7ff52c0a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff53402c240 tx=0x7ff53402df90 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 msgr2=0x7ff5481a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff54000e970 tx=0x7ff54000ed70 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 shutdown_connections 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff52c0a2b90 0x7ff52c0a5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff548101120 0x7ff5481a1050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff548100780 0x7ff548199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 --2- 172.21.15.18:0/388235696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5480ffe20 0x7ff548199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 >> 172.21.15.18:0/388235696 conn(0x7ff5480fba20 msgr2=0x7ff5480fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 shutdown_connections 2024-04-21T22:33:16.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.429+0000 7ff54d600640 1 -- 172.21.15.18:0/388235696 wait complete. 2024-04-21T22:33:16.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:16 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1078087955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.444 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:16 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1126198485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-21T22:33:16.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:16 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1078087955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:16 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1126198485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1269283151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 msgr2=0x7ff4ac106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1269283151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac106d50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff494009900 tx=0x7ff49402bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1269283151 shutdown_connections 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1269283151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 0x7ff4ac1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1269283151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac106d50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1269283151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 0x7ff4ac104420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1269283151 >> 172.21.15.18:0/1269283151 conn(0x7ff4ac0fba20 msgr2=0x7ff4ac0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1269283151 shutdown_connections 2024-04-21T22:33:16.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.645+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1269283151 wait complete. 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 Processor -- start 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 -- start start 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 0x7ff4ac199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 0x7ff4ac1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac10d270 con 0x7ff4ac104960 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac10d0f0 con 0x7ff4ac102030 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.646+0000 7ff4b1e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac10d3f0 con 0x7ff4ac107290 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43476/0 (socket says 172.21.15.18:43476) 2024-04-21T22:33:16.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 -- 172.21.15.18:0/1577219547 learned_addr learned my addr 172.21.15.18:0/1577219547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 0x7ff4ac199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4b1400640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 0x7ff4ac1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 -- 172.21.15.18:0/1577219547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 msgr2=0x7ff4ac1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 0x7ff4ac1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 -- 172.21.15.18:0/1577219547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 msgr2=0x7ff4ac199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 0x7ff4ac199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 -- 172.21.15.18:0/1577219547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac1a1700 con 0x7ff4ac104960 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.647+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff494000c00 tx=0x7ff49402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.648+0000 7ff4a9600640 1 -- 172.21.15.18:0/1577219547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494043020 con 0x7ff4ac104960 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.648+0000 7ff4a9600640 1 -- 172.21.15.18:0/1577219547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4940054e0 con 0x7ff4ac104960 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.648+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac1a1990 con 0x7ff4ac104960 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.648+0000 7ff4a9600640 1 -- 172.21.15.18:0/1577219547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494003c40 con 0x7ff4ac104960 2024-04-21T22:33:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.648+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac1a1f30 con 0x7ff4ac104960 2024-04-21T22:33:16.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.651+0000 7ff4a9600640 1 -- 172.21.15.18:0/1577219547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff494046020 con 0x7ff4ac104960 2024-04-21T22:33:16.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.651+0000 7ff4b61b1740 1 Processor -- start 2024-04-21T22:33:16.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.651+0000 7ff4b61b1740 1 -- start start 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a7230 0x55649e6a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55649e5a2dc0 con 0x55649e6a7230 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55649e605ce0 con 0x55649e6a16d0 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55649e5ae7c0 con 0x55649e6a20c0 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51496/0 (socket says 172.21.15.18:51496) 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b1400640 1 -- 172.21.15.18:0/3120684025 learned_addr learned my addr 172.21.15.18:0/3120684025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4abe00640 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a7230 0x55649e6a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b1400640 1 -- 172.21.15.18:0/3120684025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 msgr2=0x55649e6a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.652+0000 7ff4b1400640 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4b1400640 1 -- 172.21.15.18:0/3120684025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a7230 msgr2=0x55649e6a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4b1400640 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a7230 0x55649e6a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4b1400640 1 -- 172.21.15.18:0/3120684025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649e31a2d0 con 0x55649e6a16d0 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4a9600640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 0x7ff4900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4b1400640 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009ca0 tx=0x7ff4a4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6c7fed5cd747cd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4a9600640 1 -- 172.21.15.18:0/1577219547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff4940f0fc0 con 0x7ff4ac104960 2024-04-21T22:33:16.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4a1c00640 1 -- 172.21.15.18:0/3120684025 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a401e070 con 0x55649e6a16d0 2024-04-21T22:33:16.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 0x7ff4900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4a1c00640 1 -- 172.21.15.18:0/3120684025 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4a4009e50 con 0x55649e6a16d0 2024-04-21T22:33:16.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.653+0000 7ff4a1c00640 1 -- 172.21.15.18:0/3120684025 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400ea60 con 0x55649e6a16d0 2024-04-21T22:33:16.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3120684025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 msgr2=0x55649e6a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 0x7ff4900a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55649e6a24c0 tx=0x7ff49c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009ca0 tx=0x7ff4a4011810 comp rx=0 tx=0).stop 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3120684025 shutdown_connections 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a7230 0x55649e6a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3120684025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a16d0 0x55649e6a1af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3120684025 >> 172.21.15.18:0/3120684025 conn(0x55649e69cc40 msgr2=0x55649e69d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3120684025 shutdown_connections 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.654+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3120684025 wait complete. 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 -- start start 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 Processor -- start 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a16d0 0x55649e6abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.655+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55649e5c1c10 con 0x55649e6a20c0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55649e601ca0 con 0x55649e6a7230 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55649e6aa1e0 con 0x55649e6a16d0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4b61b1740 10 client.0 _ll_register_callbacks cb 0x55649e5fce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43486/0 (socket says 172.21.15.18:43486) 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 -- 172.21.15.18:0/1862640530 learned_addr learned my addr 172.21.15.18:0/1862640530 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a16d0 0x55649e6abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4b1400640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 -- 172.21.15.18:0/1862640530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a16d0 msgr2=0x55649e6abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a16d0 0x55649e6abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 -- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 msgr2=0x55649e6b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 -- 172.21.15.18:0/1862640530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649e3e46b0 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.656+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4940bd730 tx=0x7ff4940b9440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef40e1125bf14e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff49a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4940bd2e0 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff4940eeb50 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4a4009e50 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff4940bd100 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff4b61b1740 10 client.14901 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55649e6b63e0 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.657+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4a4009e50 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff4940c5f80 con 0x55649e6a20c0 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 10 client.14901 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 10 client.14901 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 20 client.14901 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e6b8a50 0x55649e6b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 4 client.14901 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:16.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649e613220 con 0x55649e6b8a50 2024-04-21T22:33:16.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.658+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e6b8a50 0x55649e6b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.659+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e6b8a50 0x55649e6b9ec0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=89ce532c6a362943 server_cookie=5e1b20c2159c66da in_seq=0 out_seq=0 2024-04-21T22:33:16.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.659+0000 7ff49a000640 10 client.14901 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.659+0000 7ff49a000640 1 -- 172.21.15.18:0/1862640530 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55649e613220 con 0x55649e6b8a50 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff49a000640 10 client.14901 handle_command_reply: tid=0 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 client.14901 shutdown 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 msgr2=0x55649e6ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4940bd730 tx=0x7ff4940b9440 comp rx=0 tx=0).stop 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 shutdown_connections 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e6b8a50 0x55649e6b9ec0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a20c0 0x55649e6ac030 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1862640530 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a16d0 0x55649e6abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff49a000640 0 client.14901 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 >> 172.21.15.18:0/1862640530 conn(0x55649e69cc40 msgr2=0x55649e69bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 shutdown_connections 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1862640530 wait complete. 2024-04-21T22:33:16.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.660+0000 7ff4b61b1740 20 client.14901 trim_cache size 0 max 16384 2024-04-21T22:33:16.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.680+0000 7ff4b61b1740 1 Processor -- start 2024-04-21T22:33:16.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 -- start start 2024-04-21T22:33:16.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6a3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55649e6b8200 con 0x55649e6a16d0 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55649e6b88d0 con 0x55649e6a7230 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55649e6b8fa0 con 0x55649e6a20c0 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43492/0 (socket says 172.21.15.18:43492) 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b0a00640 1 -- 172.21.15.18:0/1287629255 learned_addr learned my addr 172.21.15.18:0/1287629255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4b1400640 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.681+0000 7ff4abe00640 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 -- 172.21.15.18:0/1287629255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 msgr2=0x55649e6b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 -- 172.21.15.18:0/1287629255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 msgr2=0x55649e6a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6a3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 -- 172.21.15.18:0/1287629255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649e69d9b0 con 0x55649e6a16d0 2024-04-21T22:33:16.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55649e69dbb0 tx=0x7ff49c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5460e247fb6ce7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4a1200640 1 -- 172.21.15.18:0/1287629255 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c004b20 con 0x55649e6a16d0 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4a1200640 1 -- 172.21.15.18:0/1287629255 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff49c004cc0 con 0x55649e6a16d0 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.682+0000 7ff4a1200640 1 -- 172.21.15.18:0/1287629255 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0044c0 con 0x55649e6a16d0 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1287629255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 msgr2=0x55649e69d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55649e69dbb0 tx=0x7ff49c01a000 comp rx=0 tx=0).stop 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1287629255 shutdown_connections 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a7230 0x55649e6a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a20c0 0x55649e6b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/1287629255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e69d020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1287629255 >> 172.21.15.18:0/1287629255 conn(0x55649e69cc40 msgr2=0x55649e6aa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1287629255 shutdown_connections 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- 172.21.15.18:0/1287629255 wait complete. 2024-04-21T22:33:16.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.683+0000 7ff4b61b1740 1 -- start start 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 Processor -- start 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 0x55649e6b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55649e6b9d40 con 0x55649e6a16d0 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55649e6b9670 con 0x55649e6a20c0 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55649e6ba410 con 0x55649e6a7230 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b61b1740 10 client.0 _ll_register_callbacks cb 0x7ff494009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43496/0 (socket says 172.21.15.18:43496) 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51524/0 (socket says 172.21.15.18:51524) 2024-04-21T22:33:16.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b0a00640 1 -- 172.21.15.18:0/3346624928 learned_addr learned my addr 172.21.15.18:0/3346624928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.684+0000 7ff4b1400640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 0x55649e6b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 -- 172.21.15.18:0/3346624928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 msgr2=0x55649e6b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 0x55649e6b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 -- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 msgr2=0x55649e6af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 -- 172.21.15.18:0/3346624928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649e6b2890 con 0x55649e6a16d0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b1400640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 0x55649e6b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4abe00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b0a00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff49c004310 tx=0x7ff49c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd502a593efd36b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff49a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c038030 con 0x55649e6a16d0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff49c02f070 con 0x55649e6a16d0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.685+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff49c004cc0 con 0x55649e6a16d0 2024-04-21T22:33:16.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff49c043070 con 0x55649e6a16d0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 10 client.14907 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55649e71f020 con 0x55649e6a16d0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff49c004cc0 con 0x55649e6a16d0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff49c03f4d0 con 0x55649e6a16d0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 10 client.14907 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 10 client.14907 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 20 client.14907 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e7238c0 0x55649e7225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 4 client.14907 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.686+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "status"}) -- 0x55649e60d570 con 0x55649e7238c0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff4abe00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e7238c0 0x55649e7225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff4abe00640 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e7238c0 0x55649e7225d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=63d67b549d1d9294 server_cookie=57f291fc0cd387a7 in_seq=0 out_seq=0 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff49a000640 10 client.14907 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:16.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff49a000640 1 -- 172.21.15.18:0/3346624928 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55649e60d570 con 0x55649e7238c0 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff49a000640 10 client.14907 handle_command_reply: tid=0 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff4b61b1740 1 client.14907 shutdown 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 msgr2=0x55649e6aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.687+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff49c004310 tx=0x7ff49c004ac0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 shutdown_connections 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55649e7238c0 0x55649e7225d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55649e6a7230 0x55649e6b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55649e6a20c0 0x55649e6af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 --2- 172.21.15.18:0/3346624928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55649e6a16d0 0x55649e6aed40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff49a000640 0 client.14907 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 >> 172.21.15.18:0/3346624928 conn(0x55649e69cc40 msgr2=0x55649e6a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 shutdown_connections 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 1 -- 172.21.15.18:0/3346624928 wait complete. 2024-04-21T22:33:16.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b61b1740 20 client.14907 trim_cache size 0 max 16384 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24509, 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 102.179406027, 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:16.693 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:16.694 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 136.534356 2024-04-21T22:33:16.694 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:16.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 msgr2=0x7ff4900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 0x7ff4900a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55649e6a24c0 tx=0x7ff49c009500 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 msgr2=0x7ff4ac19a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.688+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff494000c00 tx=0x7ff49402c650 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 shutdown_connections 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff4900a2c10 0x7ff4900a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4ac107290 0x7ff4ac1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4ac104960 0x7ff4ac19a020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 --2- 172.21.15.18:0/1577219547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ac102030 0x7ff4ac199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 >> 172.21.15.18:0/1577219547 conn(0x7ff4ac0fba20 msgr2=0x7ff4ac1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 shutdown_connections 2024-04-21T22:33:16.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.689+0000 7ff4b1e00640 1 -- 172.21.15.18:0/1577219547 wait complete. 2024-04-21T22:33:16.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:16 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1078087955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:16 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1126198485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:16.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-21T22:33:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 -- 172.21.15.18:0/2269327330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 msgr2=0x7f2c3c1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2269327330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c1019f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009900 tx=0x7f2c3002bc50 comp rx=0 tx=0).stop 2024-04-21T22:33:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 -- 172.21.15.18:0/2269327330 shutdown_connections 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2269327330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c103180 0x7f2c3c109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2269327330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c1027c0 0x7f2c3c102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2269327330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c1019f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 -- 172.21.15.18:0/2269327330 >> 172.21.15.18:0/2269327330 conn(0x7f2c3c0fcb40 msgr2=0x7f2c3c0fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 -- 172.21.15.18:0/2269327330 shutdown_connections 2024-04-21T22:33:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.923+0000 7f2c42a00640 1 -- 172.21.15.18:0/2269327330 wait complete. 2024-04-21T22:33:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.924+0000 7f2c42a00640 1 Processor -- start 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.924+0000 7f2c42a00640 1 -- start start 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c1027c0 0x7f2c3c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 0x7f2c3c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c10d220 con 0x7f2c3c1027c0 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c10d0a0 con 0x7f2c3c1015d0 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c10d3a0 con 0x7f2c3c103180 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c41600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c41600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51540/0 (socket says 172.21.15.18:51540) 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c41600640 1 -- 172.21.15.18:0/2558577879 learned_addr learned my addr 172.21.15.18:0/2558577879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c1027c0 0x7f2c3c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c42000640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 0x7f2c3c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c41600640 1 -- 172.21.15.18:0/2558577879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 msgr2=0x7f2c3c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.925+0000 7f2c41600640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 0x7f2c3c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c41600640 1 -- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c1027c0 msgr2=0x7f2c3c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c41600640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c1027c0 0x7f2c3c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c41600640 1 -- 172.21.15.18:0/2558577879 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c19f580 con 0x7f2c3c1015d0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c42000640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 0x7f2c3c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c41600640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c30000c00 tx=0x7f2c30005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c3a000640 1 -- 172.21.15.18:0/2558577879 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30042020 con 0x7f2c3c1015d0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c19f810 con 0x7f2c3c1015d0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c3a000640 1 -- 172.21.15.18:0/2558577879 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c300044d0 con 0x7f2c3c1015d0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c3a000640 1 -- 172.21.15.18:0/2558577879 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3003e460 con 0x7f2c3c1015d0 2024-04-21T22:33:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.926+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c19fdb0 con 0x7f2c3c1015d0 2024-04-21T22:33:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 Processor -- start 2024-04-21T22:33:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 -- start start 2024-04-21T22:33:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e080c0 0x557398e0cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e0f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557398d08dc0 con 0x557398e0d230 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557398d6bce0 con 0x557398e080c0 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c46c55740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557398d147c0 con 0x557398e076d0 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c42000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c42000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48306/0 (socket says 172.21.15.18:48306) 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c42000640 1 -- 172.21.15.18:0/342990552 learned_addr learned my addr 172.21.15.18:0/342990552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.930+0000 7f2c40c00640 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e0f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 -- 172.21.15.18:0/342990552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e080c0 msgr2=0x557398e0cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e080c0 0x557398e0cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 -- 172.21.15.18:0/342990552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 msgr2=0x557398e0f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e0f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 -- 172.21.15.18:0/342990552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557398a802d0 con 0x557398e076d0 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c3a000640 1 -- 172.21.15.18:0/2558577879 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2c30045020 con 0x7f2c3c1015d0 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c42000640 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009fd0 tx=0x7f2c34010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147d70651cc682dd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.931+0000 7f2c2e600640 1 -- 172.21.15.18:0/342990552 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34011700 con 0x557398e076d0 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c2e600640 1 -- 172.21.15.18:0/342990552 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c34011d80 con 0x557398e076d0 2024-04-21T22:33:16.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c2e600640 1 -- 172.21.15.18:0/342990552 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400e3c0 con 0x557398e076d0 2024-04-21T22:33:16.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 -- 172.21.15.18:0/342990552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 msgr2=0x557398e07af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009fd0 tx=0x7f2c34010860 comp rx=0 tx=0).stop 2024-04-21T22:33:16.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 -- 172.21.15.18:0/342990552 shutdown_connections 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e0f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e080c0 0x557398e0cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 --2- 172.21.15.18:0/342990552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e07af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 -- 172.21.15.18:0/342990552 >> 172.21.15.18:0/342990552 conn(0x557398e02c40 msgr2=0x557398e03040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 -- 172.21.15.18:0/342990552 shutdown_connections 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.932+0000 7f2c46c55740 1 -- 172.21.15.18:0/342990552 wait complete. 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.933+0000 7f2c3a000640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 0x7f2c240a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.933+0000 7f2c3a000640 1 -- 172.21.15.18:0/2558577879 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f2c300f1010 con 0x7f2c3c1015d0 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.933+0000 7f2c46c55740 1 -- start start 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.933+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 0x7f2c240a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.933+0000 7f2c46c55740 1 Processor -- start 2024-04-21T22:33:16.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 0x7f2c240a4f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x557398e03bb0 tx=0x7f2c2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e15f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e1d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557398d27c10 con 0x557398e080c0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557398d67ca0 con 0x557398e0d230 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557398e101e0 con 0x557398e076d0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c46c55740 10 client.0 _ll_register_callbacks cb 0x557398d62e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c41600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e15f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43552/0 (socket says 172.21.15.18:43552) 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c40c00640 1 -- 172.21.15.18:0/2823399264 learned_addr learned my addr 172.21.15.18:0/2823399264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.934+0000 7f2c42000640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e1d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 -- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 msgr2=0x557398e15f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e15f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 -- 172.21.15.18:0/2823399264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 msgr2=0x557398e1d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e1d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 -- 172.21.15.18:0/2823399264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557398b4a6b0 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c41600640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e15f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c42000640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e1d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c40c00640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800bf90 tx=0x7f2c28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9269337ca7c3f936 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.935+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2802c060 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c34011d80 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f2c28017030 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c2801c600 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c46c55740 10 client.14919 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557398e20910 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c34011d80 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.936+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2c28032990 con 0x557398e080c0 2024-04-21T22:33:16.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 10 client.14919 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 10 client.14919 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 20 client.14919 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e22f40 0x557398e243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 4 client.14919 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557398d79220 con 0x557398e22f40 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.937+0000 7f2c41600640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e22f40 0x557398e243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.938+0000 7f2c41600640 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e22f40 0x557398e243b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ec59af4036c14ef server_cookie=2b352f7534a94670 in_seq=0 out_seq=0 2024-04-21T22:33:16.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.938+0000 7f2c22a00640 10 client.14919 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.938+0000 7f2c22a00640 1 -- 172.21.15.18:0/2823399264 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557398d79220 con 0x557398e22f40 2024-04-21T22:33:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.938+0000 7f2c22a00640 10 client.14919 handle_command_reply: tid=0 2024-04-21T22:33:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.938+0000 7f2c46c55740 1 client.14919 shutdown 2024-04-21T22:33:16.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 msgr2=0x557398e16440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800bf90 tx=0x7f2c28004730 comp rx=0 tx=0).stop 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 shutdown_connections 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e22f40 0x557398e243b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e1d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e16440 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2823399264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e15f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c22a00640 0 client.14919 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 >> 172.21.15.18:0/2823399264 conn(0x557398e02c40 msgr2=0x557398e01d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 shutdown_connections 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 1 -- 172.21.15.18:0/2823399264 wait complete. 2024-04-21T22:33:16.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.939+0000 7f2c46c55740 20 client.14919 trim_cache size 0 max 16384 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.959+0000 7f2c46c55740 1 Processor -- start 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.959+0000 7f2c46c55740 1 -- start start 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e03020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e1d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e09650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557398e226f0 con 0x557398e080c0 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557398e22dc0 con 0x557398e0d230 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c46c55740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557398e23490 con 0x557398e076d0 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e03020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e1d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43564/0 (socket says 172.21.15.18:43564) 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c40c00640 1 -- 172.21.15.18:0/2776962031 learned_addr learned my addr 172.21.15.18:0/2776962031 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c42000640 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e09650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 -- 172.21.15.18:0/2776962031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 msgr2=0x557398e09650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e09650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 -- 172.21.15.18:0/2776962031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 msgr2=0x557398e1d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e1d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c41600640 1 -- 172.21.15.18:0/2776962031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557398e20730 con 0x557398e076d0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.960+0000 7f2c42000640 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e09650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.961+0000 7f2c41600640 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e03020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c300eebe0 tx=0x7f2c300eea60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e88ee14059286f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.961+0000 7f2c2dc00640 1 -- 172.21.15.18:0/2776962031 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300bd8f0 con 0x557398e076d0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.961+0000 7f2c2dc00640 1 -- 172.21.15.18:0/2776962031 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c300c1ca0 con 0x557398e076d0 2024-04-21T22:33:16.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.961+0000 7f2c2dc00640 1 -- 172.21.15.18:0/2776962031 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300bddb0 con 0x557398e076d0 2024-04-21T22:33:16.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- 172.21.15.18:0/2776962031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 msgr2=0x557398e03020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e03020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c300eebe0 tx=0x7f2c300eea60 comp rx=0 tx=0).stop 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- 172.21.15.18:0/2776962031 shutdown_connections 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e0d230 0x557398e09650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e080c0 0x557398e1d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 --2- 172.21.15.18:0/2776962031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e076d0 0x557398e03020 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- 172.21.15.18:0/2776962031 >> 172.21.15.18:0/2776962031 conn(0x557398e02c40 msgr2=0x557398e08b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- 172.21.15.18:0/2776962031 shutdown_connections 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- 172.21.15.18:0/2776962031 wait complete. 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 -- start start 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.962+0000 7f2c46c55740 1 Processor -- start 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e080c0 0x557398e1d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e86f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557398e24230 con 0x557398e0d230 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557398e23b60 con 0x557398e076d0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557398e24900 con 0x557398e080c0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c46c55740 10 client.0 _ll_register_callbacks cb 0x7f2c2800b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c42000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e86f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c41600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c41600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51572/0 (socket says 172.21.15.18:51572) 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c41600640 1 -- 172.21.15.18:0/4011266659 learned_addr learned my addr 172.21.15.18:0/4011266659 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.963+0000 7f2c40c00640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e080c0 0x557398e1d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 -- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e080c0 msgr2=0x557398e1d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e080c0 0x557398e1d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 -- 172.21.15.18:0/4011266659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 msgr2=0x557398e86f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:16.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e86f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 -- 172.21.15.18:0/4011266659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557398e87730 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c42000640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e86f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c41600640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c300bd5f0 tx=0x7f2c300c6560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39487458227ba924 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300d5070 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f2c300bbbf0 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c300c1ca0 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.964+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c300bd8f0 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 10 client.25043 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557398e88a30 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c300c1ca0 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2c300bcd40 con 0x557398e076d0 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 10 client.25043 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 10 client.25043 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 20 client.25043 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e8d360 0x557398e8c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 4 client.25043 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "status"}) -- 0x557398d73570 con 0x557398e8d360 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.965+0000 7f2c40c00640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e8d360 0x557398e8c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c40c00640 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e8d360 0x557398e8c070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2650be4c64b89091 server_cookie=29f867003e837459 in_seq=0 out_seq=0 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c22a00640 10 client.25043 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c22a00640 1 -- 172.21.15.18:0/4011266659 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557398d73570 con 0x557398e8d360 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c22a00640 10 client.25043 handle_command_reply: tid=0 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 client.25043 shutdown 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 msgr2=0x557398e0c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c300bd5f0 tx=0x7f2c300c6560 comp rx=0 tx=0).stop 2024-04-21T22:33:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 shutdown_connections 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x557398e8d360 0x557398e8c070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557398e0d230 0x557398e86f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c22a00640 0 client.25043 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557398e080c0 0x557398e1d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 --2- 172.21.15.18:0/4011266659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557398e076d0 0x557398e0c0b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.966+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 >> 172.21.15.18:0/4011266659 conn(0x557398e02c40 msgr2=0x557398e03020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 shutdown_connections 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c46c55740 1 -- 172.21.15.18:0/4011266659 wait complete. 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c46c55740 20 client.25043 trim_cache size 0 max 16384 2024-04-21T22:33:16.971 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24538, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 103.469182535, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 133.87590882699999 2024-04-21T22:33:16.972 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 msgr2=0x7f2c240a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 0x7f2c240a4f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x557398e03bb0 tx=0x7f2c2800b410 comp rx=0 tx=0).stop 2024-04-21T22:33:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 msgr2=0x7f2c3c197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.967+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c30000c00 tx=0x7f2c30005d50 comp rx=0 tx=0).stop 2024-04-21T22:33:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 shutdown_connections 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f2c240a2aa0 0x7f2c240a4f60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3c103180 0x7f2c3c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c3c1027c0 0x7f2c3c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 --2- 172.21.15.18:0/2558577879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c3c1015d0 0x7f2c3c197960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 >> 172.21.15.18:0/2558577879 conn(0x7f2c3c0fcb40 msgr2=0x7f2c3c105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 shutdown_connections 2024-04-21T22:33:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:16.968+0000 7f2c42a00640 1 -- 172.21.15.18:0/2558577879 wait complete. 2024-04-21T22:33:16.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-21T22:33:17.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 -- 172.21.15.18:0/4073562365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52140ffe20 msgr2=0x7f5214102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 --2- 172.21.15.18:0/4073562365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52140ffe20 0x7f5214102250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5208009900 tx=0x7f520802bc40 comp rx=0 tx=0).stop 2024-04-21T22:33:17.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 -- 172.21.15.18:0/4073562365 shutdown_connections 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 --2- 172.21.15.18:0/4073562365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214105140 0x7f52141055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 --2- 172.21.15.18:0/4073562365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5214102790 0x7f5214104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 --2- 172.21.15.18:0/4073562365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f52140ffe20 0x7f5214102250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 -- 172.21.15.18:0/4073562365 >> 172.21.15.18:0/4073562365 conn(0x7f52140fba20 msgr2=0x7f52140fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.201+0000 7f521a800640 1 -- 172.21.15.18:0/4073562365 shutdown_connections 2024-04-21T22:33:17.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.202+0000 7f521a800640 1 -- 172.21.15.18:0/4073562365 wait complete. 2024-04-21T22:33:17.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.202+0000 7f521a800640 1 Processor -- start 2024-04-21T22:33:17.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 -- start start 2024-04-21T22:33:17.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 0x7f521419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5214105140 0x7f52141a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5214113870 con 0x7f5214102790 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f52141136f0 con 0x7f5214105140 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f521a800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52141139f0 con 0x7f52140ffe20 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5218a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5219400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 0x7f521419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5219e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5214105140 0x7f52141a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5218a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43606/0 (socket says 172.21.15.18:43606) 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5218a00640 1 -- 172.21.15.18:0/4194694223 learned_addr learned my addr 172.21.15.18:0/4194694223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.203+0000 7f5219400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 0x7f521419dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48350/0 (socket says 172.21.15.18:48350) 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 -- 172.21.15.18:0/4194694223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 msgr2=0x7f521419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 0x7f521419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 -- 172.21.15.18:0/4194694223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5214105140 msgr2=0x7f52141a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5214105140 0x7f52141a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 -- 172.21.15.18:0/4194694223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52141a5ab0 con 0x7f5214102790 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5218a00640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f520000e9f0 tx=0x7f520000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5212000640 1 -- 172.21.15.18:0/4194694223 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520000cd80 con 0x7f5214102790 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52141a5da0 con 0x7f5214102790 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5212000640 1 -- 172.21.15.18:0/4194694223 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5200005500 con 0x7f5214102790 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f5212000640 1 -- 172.21.15.18:0/4194694223 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200010690 con 0x7f5214102790 2024-04-21T22:33:17.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.204+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52141a6210 con 0x7f5214102790 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f5212000640 1 -- 172.21.15.18:0/4194694223 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f52000046c0 con 0x7f5214102790 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 Processor -- start 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 -- start start 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 0x559492b8bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b8c230 0x559492b8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559492a87dc0 con 0x559492b866d0 2024-04-21T22:33:17.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559492aeace0 con 0x559492b870c0 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.208+0000 7f521ea16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559492a937c0 con 0x559492b8c230 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43618/0 (socket says 172.21.15.18:43618) 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 -- 172.21.15.18:0/2699126616 learned_addr learned my addr 172.21.15.18:0/2699126616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5218a00640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b8c230 0x559492b8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219400640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 0x559492b8bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 -- 172.21.15.18:0/2699126616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b8c230 msgr2=0x559492b8e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b8c230 0x559492b8e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 -- 172.21.15.18:0/2699126616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 msgr2=0x559492b8bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 0x559492b8bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 -- 172.21.15.18:0/2699126616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594927ff2d0 con 0x559492b866d0 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219400640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 0x559492b8bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5212000640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 0x7f51fc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5219e00640 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f520c009fd0 tx=0x7f520c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38466a244cad616 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.209+0000 7f5212000640 1 -- 172.21.15.18:0/4194694223 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f52000cf490 con 0x7f5214102790 2024-04-21T22:33:17.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.210+0000 7f5219400640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 0x7f51fc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.210+0000 7f5206600640 1 -- 172.21.15.18:0/2699126616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c004d20 con 0x559492b866d0 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.210+0000 7f5206600640 1 -- 172.21.15.18:0/2699126616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f520c004050 con 0x559492b866d0 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.210+0000 7f5206600640 1 -- 172.21.15.18:0/2699126616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c005260 con 0x559492b866d0 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- 172.21.15.18:0/2699126616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 msgr2=0x559492b86af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f5219400640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 0x7f51fc0a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f520802c250 tx=0x7f520802e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f520c009fd0 tx=0x7f520c0118d0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- 172.21.15.18:0/2699126616 shutdown_connections 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b8c230 0x559492b8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b870c0 0x559492b8bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 --2- 172.21.15.18:0/2699126616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b866d0 0x559492b86af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- 172.21.15.18:0/2699126616 >> 172.21.15.18:0/2699126616 conn(0x559492b81c40 msgr2=0x559492b82040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- 172.21.15.18:0/2699126616 shutdown_connections 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- 172.21.15.18:0/2699126616 wait complete. 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 -- start start 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.211+0000 7f521ea16740 1 Processor -- start 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b90ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b91010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559492aa6c10 con 0x559492b8c230 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559492ae6ca0 con 0x559492b866d0 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559492b8f1e0 con 0x559492b870c0 2024-04-21T22:33:17.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f521ea16740 10 client.0 _ll_register_callbacks cb 0x559492ae1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f5219400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b90ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43628/0 (socket says 172.21.15.18:43628) 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f5219e00640 1 -- 172.21.15.18:0/3804946985 learned_addr learned my addr 172.21.15.18:0/3804946985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.212+0000 7f5218a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b91010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 -- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 msgr2=0x559492b91010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b91010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 -- 172.21.15.18:0/3804946985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 msgr2=0x559492b90ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b90ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 -- 172.21.15.18:0/3804946985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594928c96b0 con 0x559492b8c230 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5218a00640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b91010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f5219e00640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f520c011dd0 tx=0x7f520c004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d51020c0d776d40 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f51faa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c028020 con 0x559492b8c230 2024-04-21T22:33:17.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f520c004410 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f520c004050 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f520c033050 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f521ea16740 10 client.14937 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.213+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559492b9b350 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f520c004050 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f520c00f570 con 0x559492b8c230 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 10 client.14937 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 10 client.14937 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 20 client.14937 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492b9d7d0 0x559492b9ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 4 client.14937 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559492af8220 con 0x559492b9d7d0 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.214+0000 7f5219400640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492b9d7d0 0x559492b9ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.215+0000 7f5219400640 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492b9d7d0 0x559492b9ec40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91968b3a9ec58f4a server_cookie=b2213a067e4edd49 in_seq=0 out_seq=0 2024-04-21T22:33:17.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.215+0000 7f51faa00640 10 client.14937 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f51faa00640 1 -- 172.21.15.18:0/3804946985 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559492af8220 con 0x559492b9d7d0 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f51faa00640 10 client.14937 handle_command_reply: tid=0 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 client.14937 shutdown 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 msgr2=0x559492b97fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f520c011dd0 tx=0x7f520c004d60 comp rx=0 tx=0).stop 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 shutdown_connections 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492b9d7d0 0x559492b9ec40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97fe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b91010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 --2- 172.21.15.18:0/3804946985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b90ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f51faa00640 0 client.14937 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 >> 172.21.15.18:0/3804946985 conn(0x559492b81c40 msgr2=0x559492b80d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 shutdown_connections 2024-04-21T22:33:17.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.216+0000 7f521ea16740 1 -- 172.21.15.18:0/3804946985 wait complete. 2024-04-21T22:33:17.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.217+0000 7f521ea16740 20 client.14937 trim_cache size 0 max 16384 2024-04-21T22:33:17.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.237+0000 7f521ea16740 1 Processor -- start 2024-04-21T22:33:17.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.237+0000 7f521ea16740 1 -- start start 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b97fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b90a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559492b9cf80 con 0x559492b8c230 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559492b9d650 con 0x559492b866d0 2024-04-21T22:33:17.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f521ea16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559492b9dd20 con 0x559492b870c0 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b90a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51616/0 (socket says 172.21.15.18:51616) 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5218a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b97fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 -- 172.21.15.18:0/3105819934 learned_addr learned my addr 172.21.15.18:0/3105819934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 -- 172.21.15.18:0/3105819934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 msgr2=0x559492b97fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b97fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 -- 172.21.15.18:0/3105819934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 msgr2=0x559492b90a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b90a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219400640 1 -- 172.21.15.18:0/3105819934 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559492b86310 con 0x559492b866d0 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5218a00640 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b97fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.238+0000 7f5219e00640 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b90a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.239+0000 7f5219400640 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f520802e010 tx=0x7f5208041070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38efdc4b3312d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.239+0000 7f5205c00640 1 -- 172.21.15.18:0/3105819934 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520805a070 con 0x559492b866d0 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.239+0000 7f5205c00640 1 -- 172.21.15.18:0/3105819934 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52080046c0 con 0x559492b866d0 2024-04-21T22:33:17.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.239+0000 7f5205c00640 1 -- 172.21.15.18:0/3105819934 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208054530 con 0x559492b866d0 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- 172.21.15.18:0/3105819934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 msgr2=0x559492b82020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f520802e010 tx=0x7f5208041070 comp rx=0 tx=0).stop 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- 172.21.15.18:0/3105819934 shutdown_connections 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b90a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b97fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 --2- 172.21.15.18:0/3105819934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b82020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- 172.21.15.18:0/3105819934 >> 172.21.15.18:0/3105819934 conn(0x559492b81c40 msgr2=0x559492b9c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- 172.21.15.18:0/3105819934 shutdown_connections 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- 172.21.15.18:0/3105819934 wait complete. 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.240+0000 7f521ea16740 1 -- start start 2024-04-21T22:33:17.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 Processor -- start 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b941d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559492b9eac0 con 0x559492b8c230 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559492b9e3f0 con 0x559492b866d0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559492b9f190 con 0x559492b870c0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f521ea16740 10 client.0 _ll_register_callbacks cb 0x7f52000d2da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f5218a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f5219e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f5219400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f5218a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48382/0 (socket says 172.21.15.18:48382) 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.241+0000 7f5218a00640 1 -- 172.21.15.18:0/759723058 learned_addr learned my addr 172.21.15.18:0/759723058 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 -- 172.21.15.18:0/759723058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 msgr2=0x559492b941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 -- 172.21.15.18:0/759723058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 msgr2=0x559492b97190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 -- 172.21.15.18:0/759723058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559492b8bf80 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f5218a00640 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52000980d0 tx=0x7f5200005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0cc8fb6a8aea062 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f51faa00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520009b7b0 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52080046c0 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.242+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f520009b2c0 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f520009b5d0 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 10 client.25072 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559492b91970 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52080046c0 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f520009ab30 con 0x559492b870c0 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 10 client.25072 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 10 client.25072 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 20 client.25072 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:17.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492c08af0 0x559492c07800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 4 client.25072 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:17.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "status"}) -- 0x559492af2570 con 0x559492c08af0 2024-04-21T22:33:17.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.243+0000 7f5219400640 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492c08af0 0x559492c07800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.244+0000 7f5219400640 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492c08af0 0x559492c07800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb357c2d9c048e95 server_cookie=3a4651c2542ae8cc in_seq=0 out_seq=0 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.244+0000 7f51faa00640 10 client.25072 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.244+0000 7f51faa00640 1 -- 172.21.15.18:0/759723058 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x559492af2570 con 0x559492c08af0 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.244+0000 7f51faa00640 10 client.25072 handle_command_reply: tid=0 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.244+0000 7f521ea16740 1 client.25072 shutdown 2024-04-21T22:33:17.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 msgr2=0x559492b94710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52000980d0 tx=0x7f5200005760 comp rx=0 tx=0).stop 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 shutdown_connections 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x559492c08af0 0x559492c07800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559492b8c230 0x559492b97190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559492b870c0 0x559492b94710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 --2- 172.21.15.18:0/759723058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559492b866d0 0x559492b941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f51faa00640 0 client.25072 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 >> 172.21.15.18:0/759723058 conn(0x559492b81c40 msgr2=0x559492b82020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 shutdown_connections 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 1 -- 172.21.15.18:0/759723058 wait complete. 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.245+0000 7f521ea16740 20 client.25072 trim_cache size 0 max 16384 2024-04-21T22:33:17.248 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24568, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 104.354878493, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 125.662703842 2024-04-21T22:33:17.249 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:17.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 msgr2=0x7f51fc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 0x7f51fc0a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f520802c250 tx=0x7f520802e040 comp rx=0 tx=0).stop 2024-04-21T22:33:17.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 msgr2=0x7f521419e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f520000e9f0 tx=0x7f520000edf0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 shutdown_connections 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f51fc0a2b90 0x7f51fc0a5050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5214105140 0x7f52141a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5214102790 0x7f521419e420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 --2- 172.21.15.18:0/4194694223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52140ffe20 0x7f521419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 >> 172.21.15.18:0/4194694223 conn(0x7f52140fba20 msgr2=0x7f5214103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 shutdown_connections 2024-04-21T22:33:17.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.246+0000 7f521a800640 1 -- 172.21.15.18:0/4194694223 wait complete. 2024-04-21T22:33:17.261 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:17 smithi018 ceph-mon[26614]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:17.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-21T22:33:17.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 -- 172.21.15.18:0/1566204266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4108db0 msgr2=0x7feab4109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 --2- 172.21.15.18:0/1566204266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4108db0 0x7feab4109230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009860 tx=0x7fea9c02bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 -- 172.21.15.18:0/1566204266 shutdown_connections 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 --2- 172.21.15.18:0/1566204266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4109770 0x7feab4110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 --2- 172.21.15.18:0/1566204266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4108db0 0x7feab4109230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 --2- 172.21.15.18:0/1566204266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab4107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.471+0000 7feab3e00640 1 -- 172.21.15.18:0/1566204266 >> 172.21.15.18:0/1566204266 conn(0x7feab4076b80 msgr2=0x7feab4078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.472+0000 7feab3e00640 1 -- 172.21.15.18:0/1566204266 shutdown_connections 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.472+0000 7feab3e00640 1 -- 172.21.15.18:0/1566204266 wait complete. 2024-04-21T22:33:17.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.473+0000 7feab3e00640 1 Processor -- start 2024-04-21T22:33:17.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.473+0000 7feab3e00640 1 -- start start 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.473+0000 7feab3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab419dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 0x7feab419e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4109770 0x7feab41a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feab4113820 con 0x7feab4108db0 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feab41136a0 con 0x7feab4107bc0 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feab41139a0 con 0x7feab4109770 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab419dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 0x7feab419e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab419dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51648/0 (socket says 172.21.15.18:51648) 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab2a00640 1 -- 172.21.15.18:0/3699055583 learned_addr learned my addr 172.21.15.18:0/3699055583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feab3400640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4109770 0x7feab41a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 -- 172.21.15.18:0/3699055583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4109770 msgr2=0x7feab41a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4109770 0x7feab41a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 -- 172.21.15.18:0/3699055583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 msgr2=0x7feab419dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab419dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.474+0000 7feaaa000640 1 -- 172.21.15.18:0/3699055583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab41a5ac0 con 0x7feab4108db0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feaaa000640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 0x7feab419e3e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02c0b0 tx=0x7fea9c032430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feaabe00640 1 -- 172.21.15.18:0/3699055583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c041020 con 0x7feab4108db0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feaabe00640 1 -- 172.21.15.18:0/3699055583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c02c9f0 con 0x7feab4108db0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab41a5d50 con 0x7feab4108db0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feaabe00640 1 -- 172.21.15.18:0/3699055583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c039040 con 0x7feab4108db0 2024-04-21T22:33:17.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.475+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab41a61c0 con 0x7feab4108db0 2024-04-21T22:33:17.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 Processor -- start 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feaabe00640 1 -- 172.21.15.18:0/3699055583 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fea9c044020 con 0x7feab4108db0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 -- start start 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea832000c0 0x55ea83204bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea832076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea83100dc0 con 0x55ea831ff6d0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea83163ce0 con 0x55ea832000c0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.479+0000 7feabc855740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea8310c7c0 con 0x55ea83205230 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43672/0 (socket says 172.21.15.18:43672) 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 -- 172.21.15.18:0/74057092 learned_addr learned my addr 172.21.15.18:0/74057092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab2a00640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea832000c0 0x55ea83204bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feaaa000640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea832076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 -- 172.21.15.18:0/74057092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 msgr2=0x55ea832076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea832076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 -- 172.21.15.18:0/74057092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea832000c0 msgr2=0x55ea83204bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea832000c0 0x55ea83204bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 -- 172.21.15.18:0/74057092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea82e782d0 con 0x55ea831ff6d0 2024-04-21T22:33:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feaaa000640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea832076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.480+0000 7feab3400640 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fd0 tx=0x7feaac0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c9737a2e562895 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feaabe00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 0x7fea980a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feaa3e00640 1 -- 172.21.15.18:0/74057092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac004d20 con 0x55ea831ff6d0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feaa3e00640 1 -- 172.21.15.18:0/74057092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaac004050 con 0x55ea831ff6d0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feaa3e00640 1 -- 172.21.15.18:0/74057092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac005260 con 0x55ea831ff6d0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feaabe00640 1 -- 172.21.15.18:0/3699055583 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fea9c0f08b0 con 0x7feab4108db0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feab2a00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 0x7fea980a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feabc855740 1 -- 172.21.15.18:0/74057092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 msgr2=0x55ea831ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.481+0000 7feabc855740 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feaac009fd0 tx=0x7feaac0118d0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feab2a00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 0x7fea980a5050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55ea832004c0 tx=0x7feaa4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 -- 172.21.15.18:0/74057092 shutdown_connections 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea832076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea832000c0 0x55ea83204bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 --2- 172.21.15.18:0/74057092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea831ffaf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 -- 172.21.15.18:0/74057092 >> 172.21.15.18:0/74057092 conn(0x55ea831fac40 msgr2=0x55ea831fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 -- 172.21.15.18:0/74057092 shutdown_connections 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 -- 172.21.15.18:0/74057092 wait complete. 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 -- start start 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.482+0000 7feabc855740 1 Processor -- start 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 0x55ea83209af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83211070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea8311fc10 con 0x55ea832000c0 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea8315fca0 con 0x55ea83205230 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea832081e0 con 0x55ea831ff6d0 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feabc855740 10 client.0 _ll_register_callbacks cb 0x55ea8315ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feaaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feaaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43674/0 (socket says 172.21.15.18:43674) 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feaaa000640 1 -- 172.21.15.18:0/607765162 learned_addr learned my addr 172.21.15.18:0/607765162 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feab2a00640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 0x55ea83209af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.483+0000 7feab3400640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83211070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 -- 172.21.15.18:0/607765162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 msgr2=0x55ea83209af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 0x55ea83209af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 -- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 msgr2=0x55ea83211070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83211070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 -- 172.21.15.18:0/607765162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea82f426b0 con 0x55ea832000c0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feab2a00640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 0x55ea83209af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaaa000640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005b60 tx=0x7fea9c009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9619bfee90e563d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaa0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0bc9f0 con 0x55ea832000c0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fea9c0042c0 con 0x55ea832000c0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaac004050 con 0x55ea832000c0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea9c032e50 con 0x55ea832000c0 2024-04-21T22:33:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feabc855740 10 client.14955 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.484+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea832143e0 con 0x55ea832000c0 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaac004050 con 0x55ea832000c0 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fea9c03c030 con 0x55ea832000c0 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 10 client.14955 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 10 client.14955 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 20 client.14955 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83216aa0 0x55ea83217f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 4 client.14955 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.485+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea83171220 con 0x55ea83216aa0 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.486+0000 7feab2a00640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83216aa0 0x55ea83217f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.486+0000 7feab2a00640 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83216aa0 0x55ea83217f10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e066f2600bcce811 server_cookie=a5783ed95cedeca5 in_seq=0 out_seq=0 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.486+0000 7feaa0c00640 10 client.14955 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.487+0000 7feaa0c00640 1 -- 172.21.15.18:0/607765162 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea83171220 con 0x55ea83216aa0 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.487+0000 7feaa0c00640 10 client.14955 handle_command_reply: tid=0 2024-04-21T22:33:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.487+0000 7feabc855740 1 client.14955 shutdown 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 msgr2=0x55ea8320a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005b60 tx=0x7fea9c009550 comp rx=0 tx=0).stop 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 shutdown_connections 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83211070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320a030 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83216aa0 0x55ea83217f10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 --2- 172.21.15.18:0/607765162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea831ff6d0 0x55ea83209af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 >> 172.21.15.18:0/607765162 conn(0x55ea831fac40 msgr2=0x55ea831f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feaa0c00640 0 client.14955 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 shutdown_connections 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 1 -- 172.21.15.18:0/607765162 wait complete. 2024-04-21T22:33:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.488+0000 7feabc855740 20 client.14955 trim_cache size 0 max 16384 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 Processor -- start 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 -- start start 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea83215730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83209700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea83216250 con 0x55ea831ff6d0 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea83216920 con 0x55ea83205230 2024-04-21T22:33:17.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.508+0000 7feabc855740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea83216ff0 con 0x55ea832000c0 2024-04-21T22:33:17.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feab2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea83215730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feab3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83209700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feab2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea83215730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43676/0 (socket says 172.21.15.18:43676) 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48406/0 (socket says 172.21.15.18:48406) 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feab2a00640 1 -- 172.21.15.18:0/1161178598 learned_addr learned my addr 172.21.15.18:0/1161178598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 -- 172.21.15.18:0/1161178598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 msgr2=0x55ea83209700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83209700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 -- 172.21.15.18:0/1161178598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 msgr2=0x55ea83215730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea83215730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.509+0000 7feaaa000640 1 -- 172.21.15.18:0/1161178598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea83200950 con 0x55ea832000c0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feaaa000640 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0c57d0 tx=0x7fea9c005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c52921cd0a46845 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feaa3400640 1 -- 172.21.15.18:0/1161178598 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0bc9f0 con 0x55ea832000c0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feaa3400640 1 -- 172.21.15.18:0/1161178598 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c0bd790 con 0x55ea832000c0 2024-04-21T22:33:17.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feaa3400640 1 -- 172.21.15.18:0/1161178598 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0b9700 con 0x55ea832000c0 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feabc855740 1 -- 172.21.15.18:0/1161178598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 msgr2=0x55ea83215c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.510+0000 7feabc855740 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0c57d0 tx=0x7fea9c005780 comp rx=0 tx=0).stop 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 -- 172.21.15.18:0/1161178598 shutdown_connections 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea83205230 0x55ea83209700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea832000c0 0x55ea83215c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 --2- 172.21.15.18:0/1161178598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea831ff6d0 0x55ea83215730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 -- 172.21.15.18:0/1161178598 >> 172.21.15.18:0/1161178598 conn(0x55ea831fac40 msgr2=0x55ea832015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 -- 172.21.15.18:0/1161178598 shutdown_connections 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 -- 172.21.15.18:0/1161178598 wait complete. 2024-04-21T22:33:17.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 -- start start 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.511+0000 7feabc855740 1 Processor -- start 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea831ff6d0 0x55ea8320c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea8320fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ea83217d90 con 0x55ea832000c0 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ea832176c0 con 0x55ea831ff6d0 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ea83218460 con 0x55ea83205230 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feabc855740 10 client.0 _ll_register_callbacks cb 0x7fea9c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43688/0 (socket says 172.21.15.18:43688) 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feab2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea831ff6d0 0x55ea8320c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 -- 172.21.15.18:0/1958852219 learned_addr learned my addr 172.21.15.18:0/1958852219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:17.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feab3400640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea8320fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 -- 172.21.15.18:0/1958852219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 msgr2=0x55ea8320fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea8320fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 -- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea831ff6d0 msgr2=0x55ea8320c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea831ff6d0 0x55ea8320c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.512+0000 7feaaa000640 1 -- 172.21.15.18:0/1958852219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea83210180 con 0x55ea832000c0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feaaa000640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004630 tx=0x7fea9c0d61c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9260b47ccc5284d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feaa0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0bc9f0 con 0x55ea832000c0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fea9c0c5a70 con 0x55ea832000c0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9c0bd790 con 0x55ea832000c0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea9c02c5e0 con 0x55ea832000c0 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feabc855740 10 client.14961 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:17.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.513+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ea83210180 con 0x55ea832000c0 2024-04-21T22:33:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c0bd790 con 0x55ea832000c0 2024-04-21T22:33:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fea9c03c050 con 0x55ea832000c0 2024-04-21T22:33:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 10 client.14961 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 10 client.14961 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T22:33:17.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 20 client.14961 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83281880 0x55ea8327e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 4 client.14961 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "status"}) -- 0x55ea8316b570 con 0x55ea83281880 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.514+0000 7feab2a00640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83281880 0x55ea8327e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feab2a00640 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83281880 0x55ea8327e390 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293a143823232dc6 server_cookie=50750ddfa7f0ba3b in_seq=0 out_seq=0 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feaa0c00640 10 client.14961 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feaa0c00640 1 -- 172.21.15.18:0/1958852219 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ea8316b570 con 0x55ea83281880 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feaa0c00640 10 client.14961 handle_command_reply: tid=0 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feabc855740 1 client.14961 shutdown 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 msgr2=0x55ea8320cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.515+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004630 tx=0x7fea9c0d61c0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 shutdown_connections 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ea83281880 0x55ea8327e390 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ea83205230 0x55ea8320fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ea832000c0 0x55ea8320cd40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feaa0c00640 0 client.14961 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 --2- 172.21.15.18:0/1958852219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ea831ff6d0 0x55ea8320c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 >> 172.21.15.18:0/1958852219 conn(0x55ea831fac40 msgr2=0x55ea832015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 shutdown_connections 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 1 -- 172.21.15.18:0/1958852219 wait complete. 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.516+0000 7feabc855740 20 client.14961 trim_cache size 0 max 16384 2024-04-21T22:33:17.519 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24596, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 107.665127674, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 114.52932726500001 2024-04-21T22:33:17.520 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 msgr2=0x7fea980a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 0x7fea980a5050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55ea832004c0 tx=0x7feaa4009260 comp rx=0 tx=0).stop 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 msgr2=0x7feab419e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 0x7feab419e3e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02c0b0 tx=0x7fea9c032430 comp rx=0 tx=0).stop 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 shutdown_connections 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fea980a2b90 0x7fea980a5050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feab4109770 0x7feab41a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feab4108db0 0x7feab419e3e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 --2- 172.21.15.18:0/3699055583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feab4107bc0 0x7feab419dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:17.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 >> 172.21.15.18:0/3699055583 conn(0x7feab4076b80 msgr2=0x7feab410c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:17.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 shutdown_connections 2024-04-21T22:33:17.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:17.517+0000 7feab3e00640 1 -- 172.21.15.18:0/3699055583 wait complete. 2024-04-21T22:33:17.539 INFO:tasks.cephadm:Setup complete, yielding 2024-04-21T22:33:17.539 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-21T22:33:17.549 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:33:17.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-21T22:33:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:17 smithi081 ceph-mon[31692]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:17.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:17 smithi047 ceph-mon[31561]: pgmap v377: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:18.003 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:19.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:19 smithi018 ceph-mon[26614]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:19 smithi081 ceph-mon[31692]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:19 smithi047 ceph-mon[31561]: pgmap v378: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 -- 172.21.15.18:0/870328504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff88410e870 msgr2=0x7ff884110c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 --2- 172.21.15.18:0/870328504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff88410e870 0x7ff884110c60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00b0a0 tx=0x7ff87c00b3b0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 -- 172.21.15.18:0/870328504 shutdown_connections 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 --2- 172.21.15.18:0/870328504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff88410e870 0x7ff884110c60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 --2- 172.21.15.18:0/870328504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff884076260 0x7ff8840746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 --2- 172.21.15.18:0/870328504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff884075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.302+0000 7ff889a00700 1 -- 172.21.15.18:0/870328504 >> 172.21.15.18:0/870328504 conn(0x7ff8840fd830 msgr2=0x7ff8840ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.303+0000 7ff889a00700 1 -- 172.21.15.18:0/870328504 shutdown_connections 2024-04-21T22:33:20.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.303+0000 7ff889a00700 1 -- 172.21.15.18:0/870328504 wait complete. 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 Processor -- start 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 -- start start 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff88419ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 0x7ff88419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 0x7ff8841a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff884114490 con 0x7ff884076260 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff884114310 con 0x7ff884074c90 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff889a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff884114610 con 0x7ff88410e870 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff882000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 0x7ff88419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff882a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff88419ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff882000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 0x7ff88419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43708/0 (socket says 172.21.15.18:43708) 2024-04-21T22:33:20.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.304+0000 7ff882000700 1 -- 172.21.15.18:0/1937920727 learned_addr learned my addr 172.21.15.18:0/1937920727 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff883400700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 0x7ff8841a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 -- 172.21.15.18:0/1937920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 msgr2=0x7ff8841a5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 0x7ff8841a5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 -- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 msgr2=0x7ff88419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 0x7ff88419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 -- 172.21.15.18:0/1937920727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841a6690 con 0x7ff884074c90 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff883400700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 0x7ff8841a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:20.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.305+0000 7ff882a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff88419ea30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff87400e9c0 tx=0x7ff87400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.306+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874004220 con 0x7ff884074c90 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.306+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff874004d10 con 0x7ff884074c90 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.306+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8841a6980 con 0x7ff884074c90 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.306+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874005020 con 0x7ff884074c90 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.306+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8841a6e70 con 0x7ff884074c90 2024-04-21T22:33:20.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.307+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff884068f20 con 0x7ff884074c90 2024-04-21T22:33:20.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.309+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff874004750 con 0x7ff884074c90 2024-04-21T22:33:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.310+0000 7ff87b400700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 0x7ff8680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.310+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7ff8740cef40 con 0x7ff884074c90 2024-04-21T22:33:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.310+0000 7ff882000700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 0x7ff8680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:20.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.311+0000 7ff882000700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 0x7ff8680a50e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff870005950 tx=0x7ff870009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:20.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.315+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff87409be20 con 0x7ff884074c90 2024-04-21T22:33:20.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.565+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff884062670 con 0x7ff8680a2c20 2024-04-21T22:33:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.568+0000 7ff87b400700 1 -- 172.21.15.18:0/1937920727 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff884062670 con 0x7ff8680a2c20 2024-04-21T22:33:20.569 INFO:teuthology.orchestra.run.smithi018.stdout:Backend: cephadm 2024-04-21T22:33:20.569 INFO:teuthology.orchestra.run.smithi018.stdout:Available: Yes 2024-04-21T22:33:20.569 INFO:teuthology.orchestra.run.smithi018.stdout:Paused: No 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 msgr2=0x7ff8680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 0x7ff8680a50e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff870005950 tx=0x7ff870009260 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 msgr2=0x7ff88419ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff88419ea30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff87400e9c0 tx=0x7ff87400ecd0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 shutdown_connections 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff88410e870 0x7ff8841a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7ff8680a2c20 0x7ff8680a50e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff884074c90 0x7ff88419ea30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 --2- 172.21.15.18:0/1937920727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff884076260 0x7ff88419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:20.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 >> 172.21.15.18:0/1937920727 conn(0x7ff8840fd830 msgr2=0x7ff884101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:20.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.572+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 shutdown_connections 2024-04-21T22:33:20.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:20.573+0000 7ff889a00700 1 -- 172.21.15.18:0/1937920727 wait complete. 2024-04-21T22:33:21.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-21T22:33:21.525 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:21 smithi018 ceph-mon[26614]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:21.525 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:21 smithi018 ceph-mon[26614]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:21 smithi081 ceph-mon[31692]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:21 smithi081 ceph-mon[31692]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:21 smithi047 ceph-mon[31561]: pgmap v379: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:21 smithi047 ceph-mon[31561]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:23.326 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:23 smithi018 ceph-mon[26614]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:23 smithi081 ceph-mon[31692]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:23.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:23 smithi047 ceph-mon[31561]: pgmap v380: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.235+0000 7fecaf000700 1 -- 172.21.15.18:0/1760674549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8101470 msgr2=0x7feca81018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.235+0000 7fecaf000700 1 --2- 172.21.15.18:0/1760674549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8101470 0x7feca81018f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec94009990 tx=0x7fec94009ca0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 -- 172.21.15.18:0/1760674549 shutdown_connections 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 --2- 172.21.15.18:0/1760674549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 0x7feca81022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 --2- 172.21.15.18:0/1760674549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8100b10 0x7feca8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 --2- 172.21.15.18:0/1760674549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8101470 0x7feca81018f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 -- 172.21.15.18:0/1760674549 >> 172.21.15.18:0/1760674549 conn(0x7feca80fc730 msgr2=0x7feca80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:24.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 -- 172.21.15.18:0/1760674549 shutdown_connections 2024-04-21T22:33:24.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.236+0000 7fecaf000700 1 -- 172.21.15.18:0/1760674549 wait complete. 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 Processor -- start 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 -- start start 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8101470 0x7feca819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 0x7feca81a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.237+0000 7fecaf000700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feca81100a0 con 0x7feca8101e30 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7fecaf000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feca810ff20 con 0x7feca8100b10 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7fecaf000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feca8110220 con 0x7feca8101470 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:51716/0 (socket says 172.21.15.18:51716) 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 -- 172.21.15.18:0/3459432629 learned_addr learned my addr 172.21.15.18:0/3459432629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7fecad000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 0x7feca81a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7400700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8101470 0x7feca819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 -- 172.21.15.18:0/3459432629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8101470 msgr2=0x7feca819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8101470 0x7feca819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 -- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 msgr2=0x7feca81a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 0x7feca81a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.238+0000 7feca7e00700 1 -- 172.21.15.18:0/3459432629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca81a2350 con 0x7feca8100b10 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7feca7e00700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec9800eb30 tx=0x7fec9800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9800cbd0 con 0x7feca8100b10 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec98004500 con 0x7feca8100b10 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98010430 con 0x7feca8100b10 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca81a2640 con 0x7feca8100b10 2024-04-21T22:33:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.239+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca81a2bd0 con 0x7feca8100b10 2024-04-21T22:33:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.240+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca8068f20 con 0x7feca8100b10 2024-04-21T22:33:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.242+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fec98043ae0 con 0x7feca8100b10 2024-04-21T22:33:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.244+0000 7feca4c00700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 0x7fec8c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.244+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fec980cf2f0 con 0x7feca8100b10 2024-04-21T22:33:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.244+0000 7feca7400700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 0x7fec8c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.245+0000 7feca7400700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 0x7fec8c0a5160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec9400b7b0 tx=0x7fec94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.246+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fec9809c1d0 con 0x7feca8100b10 2024-04-21T22:33:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.483+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7feca8062670 con 0x7fec8c0a2ca0 2024-04-21T22:33:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.510+0000 7feca4c00700 1 -- 172.21.15.18:0/3459432629 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7feca8062670 con 0x7fec8c0a2ca0 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.a smithi018 running (2m) 26s ago 2m 16.2M - 19.0.0-2405-g820a2f8c 6702148920ad 04e6faa97f1b 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.b smithi047 running (2m) 52s ago 2m 25.2M - 19.0.0-2405-g820a2f8c 6702148920ad 4838d455bf22 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.c smithi081 running (2m) 52s ago 2m 18.1M - 19.0.0-2405-g820a2f8c 6702148920ad 0d263ddff047 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.d smithi018 running (2m) 26s ago 2m 12.4M - 19.0.0-2405-g820a2f8c 6702148920ad 13319b2bc17a 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.e smithi047 running (2m) 52s ago 2m 18.0M - 19.0.0-2405-g820a2f8c 6702148920ad 6eff87e796c0 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.f smithi081 running (2m) 52s ago 2m 20.7M - 19.0.0-2405-g820a2f8c 6702148920ad a13756a7d8e3 2024-04-21T22:33:24.512 INFO:teuthology.orchestra.run.smithi018.stdout:mds.g smithi018 running (2m) 26s ago 2m 12.4M - 19.0.0-2405-g820a2f8c 6702148920ad 6be4feab8b13 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mds.h smithi047 running (2m) 52s ago 2m 19.2M - 19.0.0-2405-g820a2f8c 6702148920ad e81a73ea2b36 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mds.i smithi081 running (2m) 52s ago 2m 18.2M - 19.0.0-2405-g820a2f8c 6702148920ad ef1ea682a0cf 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mds.j smithi018 running (2m) 26s ago 2m 16.6M - 19.0.0-2405-g820a2f8c 6702148920ad a2bd32e9261d 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mds.k smithi047 running (2m) 52s ago 2m 19.5M - 19.0.0-2405-g820a2f8c 6702148920ad d78ec9de268a 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mds.l smithi081 running (2m) 52s ago 2m 18.4M - 19.0.0-2405-g820a2f8c 6702148920ad dabc1de13a74 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.x smithi018 *:9283,8765 running (11m) 26s ago 11m 514M - 19.0.0-2405-g820a2f8c 6702148920ad 653fbebb8fe7 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.y smithi047 *:8443,8765 running (8m) 52s ago 8m 451M - 19.0.0-2405-g820a2f8c 6702148920ad d189d8fca718 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mgr.z smithi081 *:8443,8765 running (8m) 52s ago 8m 453M - 19.0.0-2405-g820a2f8c 6702148920ad 4e46bb695ce0 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a smithi018 running (11m) 26s ago 11m 48.0M 2048M 19.0.0-2405-g820a2f8c 6702148920ad bee3d151b772 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b smithi047 running (9m) 52s ago 9m 39.7M 2048M 19.0.0-2405-g820a2f8c 6702148920ad ae1d53615a09 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c smithi081 running (9m) 52s ago 9m 42.4M 2048M 19.0.0-2405-g820a2f8c 6702148920ad b77a6ef78c88 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 smithi018 running (8m) 26s ago 8m 47.6M 4273M 19.0.0-2405-g820a2f8c 6702148920ad dfae22c007e4 2024-04-21T22:33:24.513 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 smithi047 running (7m) 52s ago 7m 50.9M 4273M 19.0.0-2405-g820a2f8c 6702148920ad 0a20fe85827c 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 smithi081 running (7m) 52s ago 7m 56.9M 4272M 19.0.0-2405-g820a2f8c 6702148920ad 601429b9f40a 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 smithi018 running (6m) 26s ago 6m 45.5M 4273M 19.0.0-2405-g820a2f8c 6702148920ad c87506c09594 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 smithi047 running (6m) 52s ago 6m 44.3M 4273M 19.0.0-2405-g820a2f8c 6702148920ad 14b2c614f4ef 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 smithi081 running (6m) 52s ago 5m 53.9M 4272M 19.0.0-2405-g820a2f8c 6702148920ad 89b0df1185df 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 smithi018 running (5m) 26s ago 5m 50.9M 4273M 19.0.0-2405-g820a2f8c 6702148920ad 28dff93182b9 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 smithi047 running (4m) 52s ago 4m 46.8M 4273M 19.0.0-2405-g820a2f8c 6702148920ad fa4afdcb43f6 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 smithi081 running (4m) 52s ago 4m 45.5M 4272M 19.0.0-2405-g820a2f8c 6702148920ad 89a4d452581a 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 smithi018 running (3m) 26s ago 3m 43.9M 4273M 19.0.0-2405-g820a2f8c 6702148920ad cc94cd9006cc 2024-04-21T22:33:24.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 smithi047 running (3m) 52s ago 3m 55.3M 4273M 19.0.0-2405-g820a2f8c 6702148920ad 1d88d3092547 2024-04-21T22:33:24.515 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 smithi081 running (3m) 52s ago 3m 50.8M 4272M 19.0.0-2405-g820a2f8c 6702148920ad c989e63b6ab5 2024-04-21T22:33:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 msgr2=0x7fec8c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 0x7fec8c0a5160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec9400b7b0 tx=0x7fec94005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 msgr2=0x7feca819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec9800eb30 tx=0x7fec9800ee40 comp rx=0 tx=0).stop 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 shutdown_connections 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feca8101e30 0x7feca81a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec8c0a2ca0 0x7fec8c0a5160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feca8100b10 0x7feca819a6f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 --2- 172.21.15.18:0/3459432629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feca8101470 0x7feca819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 >> 172.21.15.18:0/3459432629 conn(0x7feca80fc730 msgr2=0x7feca80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.513+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 shutdown_connections 2024-04-21T22:33:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:24.514+0000 7fecaf000700 1 -- 172.21.15.18:0/3459432629 wait complete. 2024-04-21T22:33:25.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-21T22:33:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:25 smithi018 ceph-mon[26614]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:25 smithi018 ceph-mon[26614]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:25 smithi081 ceph-mon[31692]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:25 smithi081 ceph-mon[31692]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:25 smithi047 ceph-mon[31561]: pgmap v381: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:25 smithi047 ceph-mon[31561]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:25.771 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:27.544 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:27 smithi018 ceph-mon[26614]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:27.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:27 smithi081 ceph-mon[31692]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:27 smithi047 ceph-mon[31561]: pgmap v382: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 -- 172.21.15.18:0/846061732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f38106070 msgr2=0x7f1f3810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 --2- 172.21.15.18:0/846061732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f38106070 0x7f1f3810c920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400b0d0 tx=0x7f1f3400b3e0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 -- 172.21.15.18:0/846061732 shutdown_connections 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 --2- 172.21.15.18:0/846061732 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f38106070 0x7f1f3810c920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 --2- 172.21.15.18:0/846061732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f381044d0 0x7f1f381048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 --2- 172.21.15.18:0/846061732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f38105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 -- 172.21.15.18:0/846061732 >> 172.21.15.18:0/846061732 conn(0x7f1f380ffa90 msgr2=0x7f1f38101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.097+0000 7f1f40800700 1 -- 172.21.15.18:0/846061732 shutdown_connections 2024-04-21T22:33:28.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.098+0000 7f1f40800700 1 -- 172.21.15.18:0/846061732 wait complete. 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.098+0000 7f1f40800700 1 Processor -- start 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 -- start start 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f381044d0 0x7f1f3819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 0x7f1f381a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381100f0 con 0x7f1f381056d0 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810ff70 con 0x7f1f381044d0 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f40800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38110270 con 0x7f1f38106070 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f3d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f3d400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48594/0 (socket says 172.21.15.18:48594) 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f3d400700 1 -- 172.21.15.18:0/2203905236 learned_addr learned my addr 172.21.15.18:0/2203905236 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f3de00700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f381044d0 0x7f1f3819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.099+0000 7f1f3e800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 0x7f1f381a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:28.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 -- 172.21.15.18:0/2203905236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 msgr2=0x7f1f381a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 0x7f1f381a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 -- 172.21.15.18:0/2203905236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f381044d0 msgr2=0x7f1f3819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f381044d0 0x7f1f3819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 -- 172.21.15.18:0/2203905236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f381a22b0 con 0x7f1f381056d0 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3e800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 0x7f1f381a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:28.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f3d400700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e9d0 tx=0x7f1f2800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800cbd0 con 0x7f1f381056d0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.100+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f381a25a0 con 0x7f1f381056d0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.101+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2800cd70 con 0x7f1f381056d0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.101+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28018680 con 0x7f1f381056d0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.101+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381a2b30 con 0x7f1f381056d0 2024-04-21T22:33:28.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.102+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f38068f20 con 0x7f1f381056d0 2024-04-21T22:33:28.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.105+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1f280188e0 con 0x7f1f381056d0 2024-04-21T22:33:28.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.106+0000 7f1f32a00700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 0x7f1f200a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:28.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.106+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f1f280cf820 con 0x7f1f381056d0 2024-04-21T22:33:28.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.107+0000 7f1f3de00700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 0x7f1f200a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:28.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.107+0000 7f1f3de00700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 0x7f1f200a50e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f38105530 tx=0x7f1f2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:28.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.108+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1f2809c700 con 0x7f1f381056d0 2024-04-21T22:33:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.348+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f1f38062670 con 0x7f1f200a2c20 2024-04-21T22:33:28.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.366+0000 7f1f32a00700 1 -- 172.21.15.18:0/2203905236 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f1f38062670 con 0x7f1f200a2c20 2024-04-21T22:33:28.367 INFO:teuthology.orchestra.run.smithi018.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-21T22:33:28.367 INFO:teuthology.orchestra.run.smithi018.stdout:mds.all 12/12 56s ago 2m smithi018=a;smithi018=d;smithi018=g;smithi018=j;smithi047=b;smithi047=e;smithi047=h;smithi047=k;smithi081=c;smithi081=f;smithi081=i;smithi081=l;count:12 2024-04-21T22:33:28.367 INFO:teuthology.orchestra.run.smithi018.stdout:mgr 3/3 56s ago 8m smithi018=x;smithi047=y;smithi081=z;count:3 2024-04-21T22:33:28.367 INFO:teuthology.orchestra.run.smithi018.stdout:mon 3/3 56s ago 9m smithi018:172.21.15.18=a;smithi047:172.21.15.47=b;smithi081:172.21.15.81=c;count:3 2024-04-21T22:33:28.367 INFO:teuthology.orchestra.run.smithi018.stdout:osd 12 56s ago - 2024-04-21T22:33:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 msgr2=0x7f1f200a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 0x7f1f200a50e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f38105530 tx=0x7f1f2c009260 comp rx=0 tx=0).stop 2024-04-21T22:33:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 msgr2=0x7f1f3819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800e9d0 tx=0x7f1f2800ece0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 shutdown_connections 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f38106070 0x7f1f381a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f1f200a2c20 0x7f1f200a50e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f381044d0 0x7f1f3819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 --2- 172.21.15.18:0/2203905236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f381056d0 0x7f1f3819ab90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.369+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 >> 172.21.15.18:0/2203905236 conn(0x7f1f380ffa90 msgr2=0x7f1f38108970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.370+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 shutdown_connections 2024-04-21T22:33:28.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:28.370+0000 7f1f40800700 1 -- 172.21.15.18:0/2203905236 wait complete. 2024-04-21T22:33:29.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-21T22:33:29.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:29 smithi018 ceph-mon[26614]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:29.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:29 smithi018 ceph-mon[26614]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:29.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:29 smithi081 ceph-mon[31692]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:29.749 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:29 smithi081 ceph-mon[31692]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:29.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:29 smithi047 ceph-mon[31561]: pgmap v383: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:29.749 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:29 smithi047 ceph-mon[31561]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:29.750 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:31.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:31 smithi018 ceph-mon[26614]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:31 smithi081 ceph-mon[31692]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:31.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:31 smithi047 ceph-mon[31561]: pgmap v384: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 -- 172.21.15.18:0/772831410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 msgr2=0x7fc654100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 --2- 172.21.15.18:0/772831410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc654100ed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc648009990 tx=0x7fc648009ca0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 -- 172.21.15.18:0/772831410 shutdown_connections 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 --2- 172.21.15.18:0/772831410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 0x7fc654102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 --2- 172.21.15.18:0/772831410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc654100ed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 --2- 172.21.15.18:0/772831410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 0x7fc654101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.009+0000 7fc65b200700 1 -- 172.21.15.18:0/772831410 >> 172.21.15.18:0/772831410 conn(0x7fc6540fc650 msgr2=0x7fc6540fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:32.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.010+0000 7fc65b200700 1 -- 172.21.15.18:0/772831410 shutdown_connections 2024-04-21T22:33:32.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.010+0000 7fc65b200700 1 -- 172.21.15.18:0/772831410 wait complete. 2024-04-21T22:33:32.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.011+0000 7fc65b200700 1 Processor -- start 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.011+0000 7fc65b200700 1 -- start start 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 0x7fc65419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 0x7fc6541a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc65410ffb0 con 0x7fc654100ab0 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc65410fe30 con 0x7fc654101410 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc654110130 con 0x7fc654101dd0 2024-04-21T22:33:32.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc659e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc659e00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48612/0 (socket says 172.21.15.18:48612) 2024-04-21T22:33:32.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc659e00700 1 -- 172.21.15.18:0/2194427411 learned_addr learned my addr 172.21.15.18:0/2194427411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc659400700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 0x7fc65419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.012+0000 7fc65a800700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 0x7fc6541a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 -- 172.21.15.18:0/2194427411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 msgr2=0x7fc6541a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 0x7fc6541a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 -- 172.21.15.18:0/2194427411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 msgr2=0x7fc65419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 0x7fc65419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 -- 172.21.15.18:0/2194427411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6541a2200 con 0x7fc654100ab0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc659e00700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6480095c0 tx=0x7fc64800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648026070 con 0x7fc654100ab0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc648003d70 con 0x7fc654100ab0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6541a2490 con 0x7fc654100ab0 2024-04-21T22:33:32.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648021410 con 0x7fc654100ab0 2024-04-21T22:33:32.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.013+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6541a28e0 con 0x7fc654100ab0 2024-04-21T22:33:32.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.015+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc654068f20 con 0x7fc654100ab0 2024-04-21T22:33:32.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.017+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc648029070 con 0x7fc654100ab0 2024-04-21T22:33:32.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.018+0000 7fc64ea00700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 0x7fc63c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:32.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.018+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc6480d0420 con 0x7fc654100ab0 2024-04-21T22:33:32.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.018+0000 7fc659400700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 0x7fc63c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:32.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.019+0000 7fc659400700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 0x7fc63c0a50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc644009c60 tx=0x7fc644009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:32.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.021+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc648030080 con 0x7fc654100ab0 2024-04-21T22:33:32.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.254+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc654062730 con 0x7fc63c0a2c20 2024-04-21T22:33:32.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.258+0000 7fc64ea00700 1 -- 172.21.15.18:0/2194427411 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7fc654062730 con 0x7fc63c0a2c20 2024-04-21T22:33:32.259 INFO:teuthology.orchestra.run.smithi018.stdout:HOST ADDR LABELS STATUS 2024-04-21T22:33:32.259 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 172.21.15.18 2024-04-21T22:33:32.259 INFO:teuthology.orchestra.run.smithi018.stdout:smithi047 172.21.15.47 2024-04-21T22:33:32.259 INFO:teuthology.orchestra.run.smithi018.stdout:smithi081 172.21.15.81 2024-04-21T22:33:32.260 INFO:teuthology.orchestra.run.smithi018.stdout:3 hosts in cluster 2024-04-21T22:33:32.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 msgr2=0x7fc63c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 0x7fc63c0a50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc644009c60 tx=0x7fc644009260 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 msgr2=0x7fc65419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6480095c0 tx=0x7fc64800bb90 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 shutdown_connections 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc654101dd0 0x7fc6541a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc654100ab0 0x7fc65419a5f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc63c0a2c20 0x7fc63c0a50e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 --2- 172.21.15.18:0/2194427411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc654101410 0x7fc65419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.261+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 >> 172.21.15.18:0/2194427411 conn(0x7fc6540fc650 msgr2=0x7fc6540fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.262+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 shutdown_connections 2024-04-21T22:33:32.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:32.262+0000 7fc65b200700 1 -- 172.21.15.18:0/2194427411 wait complete. 2024-04-21T22:33:33.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-21T22:33:33.558 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:33.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:33 smithi018 ceph-mon[26614]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:33.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:33 smithi018 ceph-mon[26614]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:33 smithi081 ceph-mon[31692]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:33 smithi081 ceph-mon[31692]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:33 smithi047 ceph-mon[31561]: pgmap v385: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:33 smithi047 ceph-mon[31561]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:35.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:35 smithi018 ceph-mon[26614]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:35 smithi081 ceph-mon[31692]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:35.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:35 smithi047 ceph-mon[31561]: pgmap v386: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 -- 172.21.15.18:0/1517500402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc95810a470 msgr2=0x7fc958110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 --2- 172.21.15.18:0/1517500402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc95810a470 0x7fc958110d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc95000b0d0 tx=0x7fc95000b3e0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 -- 172.21.15.18:0/1517500402 shutdown_connections 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 --2- 172.21.15.18:0/1517500402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc95810a470 0x7fc958110d20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 --2- 172.21.15.18:0/1517500402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9581088d0 0x7fc958108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 --2- 172.21.15.18:0/1517500402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc958109ad0 0x7fc958109f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 -- 172.21.15.18:0/1517500402 >> 172.21.15.18:0/1517500402 conn(0x7fc9580778a0 msgr2=0x7fc958079ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 -- 172.21.15.18:0/1517500402 shutdown_connections 2024-04-21T22:33:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.828+0000 7fc95e200700 1 -- 172.21.15.18:0/1517500402 wait complete. 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.830+0000 7fc95e200700 1 Processor -- start 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.830+0000 7fc95e200700 1 -- start start 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.830+0000 7fc95e200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.830+0000 7fc95e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc958109ad0 0x7fc95819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.830+0000 7fc95e200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 0x7fc9581a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:35.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc95e200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc958114510 con 0x7fc9581088d0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc95e200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc958114390 con 0x7fc95810a470 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc95e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc958114690 con 0x7fc958109ad0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52306/0 (socket says 172.21.15.18:52306) 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 -- 172.21.15.18:0/1922137859 learned_addr learned my addr 172.21.15.18:0/1922137859 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc956a00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc958109ad0 0x7fc95819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957e00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 0x7fc9581a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 -- 172.21.15.18:0/1922137859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc958109ad0 msgr2=0x7fc95819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc958109ad0 0x7fc95819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 -- 172.21.15.18:0/1922137859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 msgr2=0x7fc9581a5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 0x7fc9581a5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957400700 1 -- 172.21.15.18:0/1922137859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9581a6690 con 0x7fc9581088d0 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.831+0000 7fc957e00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 0x7fc9581a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:33:35.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc957400700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc94800e980 tx=0x7fc94800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:35.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94800cbd0 con 0x7fc9581088d0 2024-04-21T22:33:35.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc948004510 con 0x7fc9581088d0 2024-04-21T22:33:35.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9581a6980 con 0x7fc9581088d0 2024-04-21T22:33:35.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948010430 con 0x7fc9581088d0 2024-04-21T22:33:35.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.832+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9581a6ec0 con 0x7fc9581088d0 2024-04-21T22:33:35.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.833+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc958068f20 con 0x7fc9581088d0 2024-04-21T22:33:35.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.835+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc948003eb0 con 0x7fc9581088d0 2024-04-21T22:33:35.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.837+0000 7fc94fe00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 0x7fc93c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:35.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.837+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fc9480cf3b0 con 0x7fc9581088d0 2024-04-21T22:33:35.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.837+0000 7fc956a00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 0x7fc93c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:35.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.838+0000 7fc956a00700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 0x7fc93c0a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc944009c60 tx=0x7fc944009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:35.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:35.842+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc94809c290 con 0x7fc9581088d0 2024-04-21T22:33:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.075+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 --> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc958062670 con 0x7fc93c0a2ca0 2024-04-21T22:33:36.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.080+0000 7fc94fe00700 1 -- 172.21.15.18:0/1922137859 <== mgr.14152 v2:172.21.15.18:6800/1190552149 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc958062670 con 0x7fc93c0a2ca0 2024-04-21T22:33:36.081 INFO:teuthology.orchestra.run.smithi018.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-21T22:33:36.081 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-21T22:33:36.081 INFO:teuthology.orchestra.run.smithi018.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-04-21T22:33:36.081 INFO:teuthology.orchestra.run.smithi018.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-21T22:33:36.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 msgr2=0x7fc93c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 0x7fc93c0a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc944009c60 tx=0x7fc944009260 comp rx=0 tx=0).stop 2024-04-21T22:33:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 msgr2=0x7fc95819ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:36.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc94800e980 tx=0x7fc94800ec90 comp rx=0 tx=0).stop 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 shutdown_connections 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fc93c0a2ca0 0x7fc93c0a5160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc95810a470 0x7fc9581a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9581088d0 0x7fc95819ea30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 --2- 172.21.15.18:0/1922137859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc958109ad0 0x7fc95819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.083+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 >> 172.21.15.18:0/1922137859 conn(0x7fc9580778a0 msgr2=0x7fc95810cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.084+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 shutdown_connections 2024-04-21T22:33:36.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:36.084+0000 7fc95e200700 1 -- 172.21.15.18:0/1922137859 wait complete. 2024-04-21T22:33:36.898 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-21T22:33:36.907 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:33:36.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-21T22:33:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:37 smithi018 ceph-mon[26614]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:37 smithi018 ceph-mon[26614]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:37 smithi081 ceph-mon[31692]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:37 smithi081 ceph-mon[31692]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:37 smithi047 ceph-mon[31561]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:33:37.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:37 smithi047 ceph-mon[31561]: pgmap v387: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:39.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:39 smithi018 ceph-mon[26614]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:39.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 -- 172.21.15.18:0/2550652510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0102c50 msgr2=0x7f6ff0105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:39.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 --2- 172.21.15.18:0/2550652510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0102c50 0x7f6ff0105040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009990 tx=0x7f6fe0009ca0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 -- 172.21.15.18:0/2550652510 shutdown_connections 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 --2- 172.21.15.18:0/2550652510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0107eb0 0x7f6ff010a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 --2- 172.21.15.18:0/2550652510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0102c50 0x7f6ff0105040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 --2- 172.21.15.18:0/2550652510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0105580 0x7f6ff0107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 -- 172.21.15.18:0/2550652510 >> 172.21.15.18:0/2550652510 conn(0x7f6ff00fc660 msgr2=0x7f6ff00feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 -- 172.21.15.18:0/2550652510 shutdown_connections 2024-04-21T22:33:39.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.615+0000 7f6fef200700 1 -- 172.21.15.18:0/2550652510 wait complete. 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.616+0000 7f6fef200700 1 Processor -- start 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 -- start start 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0105580 0x7f6ff0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0107eb0 0x7f6ff019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff010ddf0 con 0x7f6ff0105580 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff010dc70 con 0x7f6ff0107eb0 2024-04-21T22:33:39.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.617+0000 7f6fef200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff010df70 con 0x7f6ff0102c50 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46312/0 (socket says 172.21.15.18:46312) 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 -- 172.21.15.18:0/2870934290 learned_addr learned my addr 172.21.15.18:0/2870934290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fed400700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0105580 0x7f6ff0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fee800700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0107eb0 0x7f6ff019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 -- 172.21.15.18:0/2870934290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0107eb0 msgr2=0x7f6ff019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0107eb0 0x7f6ff019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 -- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0105580 msgr2=0x7f6ff0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0105580 0x7f6ff0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 -- 172.21.15.18:0/2870934290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff01a0060 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.618+0000 7f6fede00700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00095c0 tx=0x7f6fe000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.619+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0026070 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.619+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fe0003d70 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.619+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff01a02f0 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.619+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0021410 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.619+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff01a0740 con 0x7f6ff0102c50 2024-04-21T22:33:39.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.620+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff0068f20 con 0x7f6ff0102c50 2024-04-21T22:33:39.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.622+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6fe0029070 con 0x7f6ff0102c50 2024-04-21T22:33:39.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.623+0000 7f6fe6a00700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 0x7f6fd40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:39.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.624+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f6fe00cff10 con 0x7f6ff0102c50 2024-04-21T22:33:39.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.624+0000 7f6fed400700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 0x7f6fd40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:39.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.624+0000 7f6fed400700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 0x7f6fd40a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009c60 tx=0x7f6fdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:39.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.628+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6fe005d6f0 con 0x7f6ff0102c50 2024-04-21T22:33:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:39 smithi081 ceph-mon[31692]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:39 smithi047 ceph-mon[31561]: pgmap v388: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:39.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.914+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6ff0062e40 con 0x7f6ff0102c50 2024-04-21T22:33:39.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.915+0000 7f6fe6a00700 1 -- 172.21.15.18:0/2870934290 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3078 (secure 0 0 0) 0x7f6fe0013070 con 0x7f6ff0102c50 2024-04-21T22:33:39.916 INFO:teuthology.orchestra.run.smithi018.stdout:e27 2024-04-21T22:33:39.916 INFO:teuthology.orchestra.run.smithi018.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-21T22:33:39.916 INFO:teuthology.orchestra.run.smithi018.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T22:33:39.916 INFO:teuthology.orchestra.run.smithi018.stdout:legacy client fscid: 1 2024-04-21T22:33:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:Filesystem 'cephfs' (1) 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:fs_name cephfs 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 27 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-04-21T22:31:28.985001+0000 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-04-21T22:31:36.529368+0000 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:tableserver 0 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:root 0 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:session_timeout 300 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:session_autoclose 300 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:max_file_size 1099511627776 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:max_xattr_size 65536 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:required_client_features {} 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure 0 2024-04-21T22:33:39.917 INFO:teuthology.orchestra.run.smithi018.stdout:last_failure_osd_epoch 0 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:max_mds 5 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:in 0,1,2,3,4 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:up {0=24596,1=24568,2=24538,3=24509,4=24496} 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:failed 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:damaged 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:stopped 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:data_pools [3] 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:metadata_pool 2 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:inline_data disabled 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:balancer 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:bal_rank_mask -1 2024-04-21T22:33:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:standby_count_wanted 0 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:qdb_cluster leader: 24596 members: 24568,24596,24509,24538,24496 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b{0:24596} state up:active seq 3 addr [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c{0:24550} state up:standby-replay seq 1 addr [v2:172.21.15.81:6836/2293229120,v1:172.21.15.81:6837/2293229120] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.i{1:24568} state up:active seq 7 addr [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.h{1:24539} state up:standby-replay seq 1 addr [v2:172.21.15.47:6836/639724797,v1:172.21.15.47:6837/639724797] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.f{2:24538} state up:active seq 9 addr [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.l{2:24469} state up:standby-replay seq 1 addr [v2:172.21.15.81:6832/2486302783,v1:172.21.15.81:6833/2486302783] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.e{3:24509} state up:active seq 10 addr [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.k{3:24461} state up:standby-replay seq 1 addr [v2:172.21.15.47:6832/3754896489,v1:172.21.15.47:6833/3754896489] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.j{4:24496} state up:active seq 12 addr [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a{4:14475} state up:standby-replay seq 1 addr [v2:172.21.15.18:6840/2953480850,v1:172.21.15.18:6841/2953480850] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout:Standby daemons: 2024-04-21T22:33:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:39.920 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d{-1:14409} state up:standby seq 1 addr [v2:172.21.15.18:6836/260606364,v1:172.21.15.18:6837/260606364] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.920 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.g{-1:14457} state up:standby seq 1 addr [v2:172.21.15.18:6838/1438768551,v1:172.21.15.18:6839/1438768551] compat {c=[1],r=[1],i=[1fff]}] 2024-04-21T22:33:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 msgr2=0x7f6fd40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 0x7f6fd40a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009c60 tx=0x7f6fdc009260 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 msgr2=0x7f6ff0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00095c0 tx=0x7f6fe000bb90 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 shutdown_connections 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f6fd40a2c20 0x7f6fd40a50e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ff0107eb0 0x7f6ff019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff0102c50 0x7f6ff0198400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 --2- 172.21.15.18:0/2870934290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff0105580 0x7f6ff0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 >> 172.21.15.18:0/2870934290 conn(0x7f6ff00fc660 msgr2=0x7f6ff0103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 shutdown_connections 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:39.918+0000 7f6fef200700 1 -- 172.21.15.18:0/2870934290 wait complete. 2024-04-21T22:33:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:40.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:40 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2870934290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T22:33:40.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:40 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2870934290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T22:33:40.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:40 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2870934290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-21T22:33:40.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-21T22:33:41.208 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:41.561 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:41 smithi018 ceph-mon[26614]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:41 smithi081 ceph-mon[31692]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:41 smithi047 ceph-mon[31561]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 -- 172.21.15.18:0/2773416680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c100560 msgr2=0x7fec3c100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 --2- 172.21.15.18:0/2773416680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c100560 0x7fec3c100980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0099c0 tx=0x7fec2c009cd0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 -- 172.21.15.18:0/2773416680 shutdown_connections 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 --2- 172.21.15.18:0/2773416680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c103f80 0x7fec3c10a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 --2- 172.21.15.18:0/2773416680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c100560 0x7fec3c100980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 --2- 172.21.15.18:0/2773416680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c1035e0 0x7fec3c103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 -- 172.21.15.18:0/2773416680 >> 172.21.15.18:0/2773416680 conn(0x7fec3c0fbec0 msgr2=0x7fec3c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 -- 172.21.15.18:0/2773416680 shutdown_connections 2024-04-21T22:33:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.504+0000 7fec42200700 1 -- 172.21.15.18:0/2773416680 wait complete. 2024-04-21T22:33:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.505+0000 7fec42200700 1 Processor -- start 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.505+0000 7fec42200700 1 -- start start 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c1035e0 0x7fec3c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c103f80 0x7fec3c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c10deb0 con 0x7fec3c100560 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c10dd30 con 0x7fec3c103f80 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec42200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c10e030 con 0x7fec3c1035e0 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec3b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec3b400700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52352/0 (socket says 172.21.15.18:52352) 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec3b400700 1 -- 172.21.15.18:0/3877632629 learned_addr learned my addr 172.21.15.18:0/3877632629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec3be00700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c103f80 0x7fec3c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.506+0000 7fec32a00700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c1035e0 0x7fec3c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 -- 172.21.15.18:0/3877632629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c1035e0 msgr2=0x7fec3c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c1035e0 0x7fec3c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 -- 172.21.15.18:0/3877632629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c103f80 msgr2=0x7fec3c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c103f80 0x7fec3c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 -- 172.21.15.18:0/3877632629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c1a2360 con 0x7fec3c100560 2024-04-21T22:33:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec3b400700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec2c005b40 tx=0x7fec2c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c027070 con 0x7fec3c100560 2024-04-21T22:33:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec2c022470 con 0x7fec3c100560 2024-04-21T22:33:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c009e60 con 0x7fec3c100560 2024-04-21T22:33:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c1a25f0 con 0x7fec3c100560 2024-04-21T22:33:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.507+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c1a2aa0 con 0x7fec3c100560 2024-04-21T22:33:43.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.509+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c068f20 con 0x7fec3c100560 2024-04-21T22:33:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.511+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fec2c02a070 con 0x7fec3c100560 2024-04-21T22:33:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.512+0000 7fec38c00700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 0x7fec200a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.512+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fec2c0cffe0 con 0x7fec3c100560 2024-04-21T22:33:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.513+0000 7fec32a00700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 0x7fec200a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:43.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.513+0000 7fec32a00700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 0x7fec200a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec24009c60 tx=0x7fec24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:43.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.515+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fec2c013070 con 0x7fec3c100560 2024-04-21T22:33:43.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:43 smithi018 ceph-mon[26614]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:43 smithi081 ceph-mon[31692]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:43 smithi047 ceph-mon[31561]: pgmap v390: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:43.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.743+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fec3c1a2f30 con 0x7fec3c100560 2024-04-21T22:33:43.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.744+0000 7fec38c00700 1 -- 172.21.15.18:0/3877632629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5298 (secure 0 0 0) 0x7fec2c09cf90 con 0x7fec3c100560 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 87 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-04-21T22:22:06.206207+0000 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-04-21T22:32:17.548077+0000 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 26 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client luminous 2024-04-21T22:33:43.747 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 12 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6802/4177425963,v1:172.21.15.18:6803/4177425963] [v2:172.21.15.18:6804/4177425963,v1:172.21.15.18:6805/4177425963] exists,up 9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/253370991,v1:172.21.15.47:6801/253370991] [v2:172.21.15.47:6802/253370991,v1:172.21.15.47:6803/253370991] exists,up 8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/311690470,v1:172.21.15.81:6801/311690470] [v2:172.21.15.81:6802/311690470,v1:172.21.15.81:6803/311690470] exists,up 49058d27-4b5c-4142-b287-4036d3c90a24 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6810/334022394,v1:172.21.15.18:6811/334022394] [v2:172.21.15.18:6812/334022394,v1:172.21.15.18:6813/334022394] exists,up b1c370c5-aee2-453e-af57-9defb8842429 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6808/2276965592,v1:172.21.15.47:6809/2276965592] [v2:172.21.15.47:6810/2276965592,v1:172.21.15.47:6811/2276965592] exists,up feeccde7-a47e-468e-b3d5-9aa13e0ac807 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/1072045728,v1:172.21.15.81:6809/1072045728] [v2:172.21.15.81:6810/1072045728,v1:172.21.15.81:6811/1072045728] exists,up 589fe240-12d2-42f3-9a1e-a2aaee0959ca 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6818/1273593856,v1:172.21.15.18:6819/1273593856] [v2:172.21.15.18:6820/1273593856,v1:172.21.15.18:6821/1273593856] exists,up d5e511f2-088a-40f5-b6a1-b95c04890eed 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 51 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6816/2420410882,v1:172.21.15.47:6817/2420410882] [v2:172.21.15.47:6818/2420410882,v1:172.21.15.47:6819/2420410882] exists,up 2fcb5522-f12d-4b28-8765-a40c88b42ae1 2024-04-21T22:33:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:osd.8 up in weight 1 up_from 59 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/338495809,v1:172.21.15.81:6817/338495809] [v2:172.21.15.81:6818/338495809,v1:172.21.15.81:6819/338495809] exists,up 7046706c-9c23-47c7-bda8-4225a7b15865 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6826/2641133682,v1:172.21.15.18:6827/2641133682] [v2:172.21.15.18:6828/2641133682,v1:172.21.15.18:6829/2641133682] exists,up 5876c45c-6319-41bd-9555-8b327bc0f71b 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6824/3325470664,v1:172.21.15.47:6825/3325470664] [v2:172.21.15.47:6826/3325470664,v1:172.21.15.47:6827/3325470664] exists,up ffe5b328-b599-4eda-9a41-a022b00456df 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6824/2968006366,v1:172.21.15.81:6825/2968006366] [v2:172.21.15.81:6826/2968006366,v1:172.21.15.81:6827/2968006366] exists,up 4039a314-53cb-4831-bb48-ece414ca7950 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.0 [8,4] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.8 [2,11] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.b [2,6] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.e [2,4] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.1a [8,1] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 2.1b [5,11] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.0 [5,9] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.21 [4,8] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.27 [3,9] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 3.36 [4,9] 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1190708936 expires 2024-04-22T22:23:15.934588+0000 2024-04-21T22:33:43.749 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1049747041 expires 2024-04-22T22:23:15.934588+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/3876986128 expires 2024-04-22T22:23:15.934588+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3234192848 expires 2024-04-22T22:22:40.017835+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/1652127099 expires 2024-04-22T22:22:40.017835+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/810668682 expires 2024-04-22T22:23:15.934588+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:0/3055541210 expires 2024-04-22T22:22:40.017835+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/4119930103 expires 2024-04-22T22:22:40.017835+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6801/4119930103 expires 2024-04-22T22:22:40.017835+0000 2024-04-21T22:33:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:blocklist 172.21.15.18:6800/3876986128 expires 2024-04-22T22:23:15.934588+0000 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 msgr2=0x7fec200a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 0x7fec200a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec24009c60 tx=0x7fec24009260 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 msgr2=0x7fec3c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec2c005b40 tx=0x7fec2c009580 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 shutdown_connections 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fec200a2ca0 0x7fec200a5160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec3c103f80 0x7fec3c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec3c100560 0x7fec3c19a700 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 --2- 172.21.15.18:0/3877632629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec3c1035e0 0x7fec3c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:43.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 >> 172.21.15.18:0/3877632629 conn(0x7fec3c0fbec0 msgr2=0x7fec3c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:43.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 shutdown_connections 2024-04-21T22:33:43.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:43.748+0000 7fec42200700 1 -- 172.21.15.18:0/3877632629 wait complete. 2024-04-21T22:33:44.525 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:44 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3877632629' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T22:33:44.575 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-21T22:33:44.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:44.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:44 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3877632629' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T22:33:44.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:44 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3877632629' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-21T22:33:44.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.806+0000 7f5e5a400640 1 -- 172.21.15.18:0/2432786840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e54100700 msgr2=0x7f5e54100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.806+0000 7f5e5a400640 1 --2- 172.21.15.18:0/2432786840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e54100700 0x7f5e54100b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009900 tx=0x7f5e3c02bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 -- 172.21.15.18:0/2432786840 shutdown_connections 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 --2- 172.21.15.18:0/2432786840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e541022b0 0x7f5e54108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 --2- 172.21.15.18:0/2432786840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541018f0 0x7f5e54101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 --2- 172.21.15.18:0/2432786840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e54100700 0x7f5e54100b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 -- 172.21.15.18:0/2432786840 >> 172.21.15.18:0/2432786840 conn(0x7f5e540fbcb0 msgr2=0x7f5e540fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 -- 172.21.15.18:0/2432786840 shutdown_connections 2024-04-21T22:33:44.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.807+0000 7f5e5a400640 1 -- 172.21.15.18:0/2432786840 wait complete. 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 Processor -- start 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 -- start start 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 0x7f5e54104640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541022b0 0x7f5e54103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410c330 con 0x7f5e541018f0 2024-04-21T22:33:44.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410c1b0 con 0x7f5e54100700 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.808+0000 7f5e5a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5410c4b0 con 0x7f5e541022b0 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 0x7f5e54104640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52372/0 (socket says 172.21.15.18:52372) 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e52a00640 1 -- 172.21.15.18:0/3727939098 learned_addr learned my addr 172.21.15.18:0/3727939098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:44.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53e00640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541022b0 0x7f5e54103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 -- 172.21.15.18:0/3727939098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541022b0 msgr2=0x7f5e54103210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541022b0 0x7f5e54103210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 -- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 msgr2=0x7f5e54102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 -- 172.21.15.18:0/3727939098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e54103ad0 con 0x7f5e54100700 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e52a00640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.809+0000 7f5e53400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 0x7f5e54104640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009230 tx=0x7f5e3c02c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.810+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c043020 con 0x7f5e54100700 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.810+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e541a1c10 con 0x7f5e54100700 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.810+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3c0054e0 con 0x7f5e54100700 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.810+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c003bf0 con 0x7f5e54100700 2024-04-21T22:33:44.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.810+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e541a2180 con 0x7f5e54100700 2024-04-21T22:33:44.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.811+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e541a23b0 con 0x7f5e54100700 2024-04-21T22:33:44.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.813+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5e3c046020 con 0x7f5e54100700 2024-04-21T22:33:44.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.815+0000 7f5e4be00640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 0x7f5e380a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:44.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.815+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f5e3c0f14f0 con 0x7f5e54100700 2024-04-21T22:33:44.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.815+0000 7f5e52a00640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 0x7f5e380a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:44.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.816+0000 7f5e52a00640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 0x7f5e380a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e541043b0 tx=0x7f5e44009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:44.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:44.817+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5e3c04d020 con 0x7f5e54100700 2024-04-21T22:33:45.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.025+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e541a2580 con 0x7f5e54100700 2024-04-21T22:33:45.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.028+0000 7f5e4be00640 1 -- 172.21.15.18:0/3727939098 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f5e3c0be3d0 con 0x7f5e54100700 2024-04-21T22:33:45.029 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:45.029 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 msgr2=0x7f5e380a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 0x7f5e380a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e541043b0 tx=0x7f5e44009800 comp rx=0 tx=0).stop 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 msgr2=0x7f5e54104640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 0x7f5e54104640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009230 tx=0x7f5e3c02c6c0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 shutdown_connections 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f5e380a2b90 0x7f5e380a5050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e541022b0 0x7f5e54103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e541018f0 0x7f5e54102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 --2- 172.21.15.18:0/3727939098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e54100700 0x7f5e54104640 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 >> 172.21.15.18:0/3727939098 conn(0x7f5e540fbcb0 msgr2=0x7f5e540fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:45.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 shutdown_connections 2024-04-21T22:33:45.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.031+0000 7f5e5a400640 1 -- 172.21.15.18:0/3727939098 wait complete. 2024-04-21T22:33:45.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:33:45.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3948678828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0109770 msgr2=0x7fa3b0110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3948678828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0109770 0x7fa3b0110000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009be0 tx=0x7fa3a802bef0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3948678828 shutdown_connections 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3948678828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0109770 0x7fa3b0110000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3948678828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0108db0 0x7fa3b0109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3948678828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0107bc0 0x7fa3b0107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3948678828 >> 172.21.15.18:0/3948678828 conn(0x7fa3b0076b80 msgr2=0x7fa3b0078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3948678828 shutdown_connections 2024-04-21T22:33:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.271+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3948678828 wait complete. 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.272+0000 7fa3b4e00640 1 Processor -- start 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.272+0000 7fa3b4e00640 1 -- start start 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 0x7fa3b019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0109770 0x7fa3b01a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0113840 con 0x7fa3b0107bc0 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01136c0 con 0x7fa3b0109770 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3b4e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01139c0 con 0x7fa3b0108db0 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52396/0 (socket says 172.21.15.18:52396) 2024-04-21T22:33:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3af400640 1 -- 172.21.15.18:0/3788134632 learned_addr learned my addr 172.21.15.18:0/3788134632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3afe00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0109770 0x7fa3b01a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.273+0000 7fa3aea00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 0x7fa3b019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 -- 172.21.15.18:0/3788134632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 msgr2=0x7fa3b019e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 0x7fa3b019e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 -- 172.21.15.18:0/3788134632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0109770 msgr2=0x7fa3b01a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0109770 0x7fa3b01a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 -- 172.21.15.18:0/3788134632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b01a5a70 con 0x7fa3b0107bc0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3aea00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 0x7fa3b019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3af400640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e9c0 tx=0x7fa3a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000cd80 con 0x7fa3b0107bc0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a00035f0 con 0x7fa3b0107bc0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b01a5d60 con 0x7fa3b0107bc0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0010690 con 0x7fa3b0107bc0 2024-04-21T22:33:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.274+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a61a0 con 0x7fa3b0107bc0 2024-04-21T22:33:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.276+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b010eee0 con 0x7fa3b0107bc0 2024-04-21T22:33:45.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.279+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa3a00037a0 con 0x7fa3b0107bc0 2024-04-21T22:33:45.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.279+0000 7fa3a7e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 0x7fa3940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.279+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fa3a00cf560 con 0x7fa3b0107bc0 2024-04-21T22:33:45.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.280+0000 7fa3aea00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 0x7fa3940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.280+0000 7fa3aea00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 0x7fa3940a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3b019f360 tx=0x7fa39c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.282+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fa3a009c440 con 0x7fa3b0107bc0 2024-04-21T22:33:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.491+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3b002d170 con 0x7fa3b0107bc0 2024-04-21T22:33:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.492+0000 7fa3a7e00640 1 -- 172.21.15.18:0/3788134632 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fa3a009bd40 con 0x7fa3b0107bc0 2024-04-21T22:33:45.493 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 msgr2=0x7fa3940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 0x7fa3940a5050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3b019f360 tx=0x7fa39c009260 comp rx=0 tx=0).stop 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 msgr2=0x7fa3b019de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e9c0 tx=0x7fa3a000ee80 comp rx=0 tx=0).stop 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 shutdown_connections 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fa3940a2b90 0x7fa3940a5050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3b0109770 0x7fa3b01a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3b0108db0 0x7fa3b019e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 --2- 172.21.15.18:0/3788134632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3b0107bc0 0x7fa3b019de50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.495+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 >> 172.21.15.18:0/3788134632 conn(0x7fa3b0076b80 msgr2=0x7fa3b010c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.496+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 shutdown_connections 2024-04-21T22:33:45.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.496+0000 7fa3b4e00640 1 -- 172.21.15.18:0/3788134632 wait complete. 2024-04-21T22:33:45.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:33:45.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:45 smithi018 ceph-mon[26614]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:45.585 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:45 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3727939098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:45 smithi081 ceph-mon[31692]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:45 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3727939098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:45 smithi047 ceph-mon[31561]: pgmap v391: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-04-21T22:33:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:45 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3727939098' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.729+0000 7f0651c00640 1 -- 172.21.15.18:0/2802304534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 msgr2=0x7f064c107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.729+0000 7f0651c00640 1 --2- 172.21.15.18:0/2802304534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c107fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f063c009900 tx=0x7f063c02bc50 comp rx=0 tx=0).stop 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 -- 172.21.15.18:0/2802304534 shutdown_connections 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 --2- 172.21.15.18:0/2802304534 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c109770 0x7f064c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 --2- 172.21.15.18:0/2802304534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c108db0 0x7f064c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 --2- 172.21.15.18:0/2802304534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c107fe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 -- 172.21.15.18:0/2802304534 >> 172.21.15.18:0/2802304534 conn(0x7f064c076b80 msgr2=0x7f064c078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 -- 172.21.15.18:0/2802304534 shutdown_connections 2024-04-21T22:33:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.730+0000 7f0651c00640 1 -- 172.21.15.18:0/2802304534 wait complete. 2024-04-21T22:33:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.731+0000 7f0651c00640 1 Processor -- start 2024-04-21T22:33:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.731+0000 7f0651c00640 1 -- start start 2024-04-21T22:33:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c108db0 0x7f064c19e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c109770 0x7f064c1a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f064c113810 con 0x7f064c109770 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f064c113690 con 0x7f064c108db0 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f064c113990 con 0x7f064c107bc0 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f064be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f064be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46390/0 (socket says 172.21.15.18:46390) 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f064be00640 1 -- 172.21.15.18:0/2527610896 learned_addr learned my addr 172.21.15.18:0/2527610896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0643400640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c108db0 0x7f064c19e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f0651200640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c109770 0x7f064c1a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f064be00640 1 -- 172.21.15.18:0/2527610896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c108db0 msgr2=0x7f064c19e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.732+0000 7f064be00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c108db0 0x7f064c19e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f064be00640 1 -- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c109770 msgr2=0x7f064c1a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f064be00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c109770 0x7f064c1a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f064be00640 1 -- 172.21.15.18:0/2527610896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c1a5ba0 con 0x7f064c107bc0 2024-04-21T22:33:45.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f064be00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f063c000c00 tx=0x7f063c005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c042020 con 0x7f064c107bc0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c0044d0 con 0x7f064c107bc0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c1a5e30 con 0x7f064c107bc0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c03e460 con 0x7f064c107bc0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.733+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c1a62f0 con 0x7f064c107bc0 2024-04-21T22:33:45.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.734+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c10ef60 con 0x7f064c107bc0 2024-04-21T22:33:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.737+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f063c045020 con 0x7f064c107bc0 2024-04-21T22:33:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.738+0000 7f0649600640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 0x7f06300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.738+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f063c0f1610 con 0x7f064c107bc0 2024-04-21T22:33:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.738+0000 7f0643400640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 0x7f06300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.739+0000 7f0643400640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 0x7f06300a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f064c19f490 tx=0x7f0634005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.740+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f063c04c020 con 0x7f064c107bc0 2024-04-21T22:33:45.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.951+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f064c02d3c0 con 0x7f064c107bc0 2024-04-21T22:33:45.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.952+0000 7f0649600640 1 -- 172.21.15.18:0/2527610896 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f063c0be4f0 con 0x7f064c107bc0 2024-04-21T22:33:45.953 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.954+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 msgr2=0x7f06300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.954+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 0x7f06300a50d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f064c19f490 tx=0x7f0634005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.954+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 msgr2=0x7f064c19df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.954+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f063c000c00 tx=0x7f063c005d50 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 shutdown_connections 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06300a2c10 0x7f06300a50d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f064c109770 0x7f064c1a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c108db0 0x7f064c19e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 --2- 172.21.15.18:0/2527610896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064c107bc0 0x7f064c19df80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 >> 172.21.15.18:0/2527610896 conn(0x7f064c076b80 msgr2=0x7f064c10c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:45.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 shutdown_connections 2024-04-21T22:33:45.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:45.955+0000 7f0651c00640 1 -- 172.21.15.18:0/2527610896 wait complete. 2024-04-21T22:33:45.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.191+0000 7f4355400640 1 -- 172.21.15.18:0/2822495127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 msgr2=0x7f4350102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.191+0000 7f4355400640 1 --2- 172.21.15.18:0/2822495127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350102c30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f433c009900 tx=0x7f433c02bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 -- 172.21.15.18:0/2822495127 shutdown_connections 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 --2- 172.21.15.18:0/2822495127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4350103170 0x7f4350109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 --2- 172.21.15.18:0/2822495127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350102c30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 --2- 172.21.15.18:0/2822495127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43501015c0 0x7f43501019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 -- 172.21.15.18:0/2822495127 >> 172.21.15.18:0/2822495127 conn(0x7f43500fcb50 msgr2=0x7f43500fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 -- 172.21.15.18:0/2822495127 shutdown_connections 2024-04-21T22:33:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.192+0000 7f4355400640 1 -- 172.21.15.18:0/2822495127 wait complete. 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 Processor -- start 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 -- start start 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43501015c0 0x7f43501978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f435010d280 con 0x7f43501027b0 2024-04-21T22:33:46.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f435010d100 con 0x7f43501015c0 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4355400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f435010d400 con 0x7f4350103170 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f434f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56592/0 (socket says 172.21.15.18:56592) 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 -- 172.21.15.18:0/1211031016 learned_addr learned my addr 172.21.15.18:0/1211031016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f434f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56664/0 (socket says 172.21.15.18:56664) 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f434fe00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43501015c0 0x7f43501978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 -- 172.21.15.18:0/1211031016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43501015c0 msgr2=0x7f43501978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43501015c0 0x7f43501978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 -- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 msgr2=0x7f4350197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.194+0000 7f4354a00640 1 -- 172.21.15.18:0/1211031016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435019f510 con 0x7f4350103170 2024-04-21T22:33:46.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f4354a00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f434800eb10 tx=0x7f434800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348004b20 con 0x7f4350103170 2024-04-21T22:33:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4348004cc0 con 0x7f4350103170 2024-04-21T22:33:46.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435019f800 con 0x7f4350103170 2024-04-21T22:33:46.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348010760 con 0x7f4350103170 2024-04-21T22:33:46.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.195+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435019fcd0 con 0x7f4350103170 2024-04-21T22:33:46.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.196+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43501088e0 con 0x7f4350103170 2024-04-21T22:33:46.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.198+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4348044b30 con 0x7f4350103170 2024-04-21T22:33:46.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.200+0000 7f434cc00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 0x7f43340a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.200+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f43480cf640 con 0x7f4350103170 2024-04-21T22:33:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.200+0000 7f434fe00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 0x7f43340a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.201+0000 7f434fe00640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 0x7f43340a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f43400095f0 tx=0x7f4340005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:46.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.202+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f434809c520 con 0x7f4350103170 2024-04-21T22:33:46.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.410+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f435002d300 con 0x7f4350103170 2024-04-21T22:33:46.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.412+0000 7f434cc00640 1 -- 172.21.15.18:0/1211031016 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f4348044e20 con 0x7f4350103170 2024-04-21T22:33:46.412 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:33:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 msgr2=0x7f43340a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 0x7f43340a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f43400095f0 tx=0x7f4340005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 msgr2=0x7f435019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f434800eb10 tx=0x7f434800c2d0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 shutdown_connections 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f43340a2b90 0x7f43340a5050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4350103170 0x7f435019eea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43501027b0 0x7f4350197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 --2- 172.21.15.18:0/1211031016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43501015c0 0x7f43501978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 >> 172.21.15.18:0/1211031016 conn(0x7f43500fcb50 msgr2=0x7f4350105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 shutdown_connections 2024-04-21T22:33:46.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.415+0000 7f4355400640 1 -- 172.21.15.18:0/1211031016 wait complete. 2024-04-21T22:33:46.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:33:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:46 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3788134632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:46 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2527610896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:46 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3788134632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:46 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2527610896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 -- 172.21.15.18:0/1925140968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114107ce0 msgr2=0x7f4114108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 --2- 172.21.15.18:0/1925140968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114107ce0 0x7f4114108100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4104009900 tx=0x7f410402bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 -- 172.21.15.18:0/1925140968 shutdown_connections 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 --2- 172.21.15.18:0/1925140968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 --2- 172.21.15.18:0/1925140968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114108e80 0x7f4114109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 --2- 172.21.15.18:0/1925140968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114107ce0 0x7f4114108100 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 -- 172.21.15.18:0/1925140968 >> 172.21.15.18:0/1925140968 conn(0x7f4114076c30 msgr2=0x7f4114079070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 -- 172.21.15.18:0/1925140968 shutdown_connections 2024-04-21T22:33:46.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.645+0000 7f4119400640 1 -- 172.21.15.18:0/1925140968 wait complete. 2024-04-21T22:33:46.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.646+0000 7f4119400640 1 Processor -- start 2024-04-21T22:33:46.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.646+0000 7f4119400640 1 -- start start 2024-04-21T22:33:46.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4114113910 con 0x7f4114107ce0 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4114113790 con 0x7f4114108e80 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4119400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4114113a90 con 0x7f4114109840 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49572/0 (socket says 172.21.15.18:49572) 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56682/0 (socket says 172.21.15.18:56682) 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113400640 1 -- 172.21.15.18:0/2377824682 learned_addr learned my addr 172.21.15.18:0/2377824682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4118a00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.647+0000 7f4113e00640 1 -- 172.21.15.18:0/2377824682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 msgr2=0x7f41141a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113e00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141a5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113e00640 1 -- 172.21.15.18:0/2377824682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 msgr2=0x7f411419e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113e00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113e00640 1 -- 172.21.15.18:0/2377824682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41141a5b80 con 0x7f4114107ce0 2024-04-21T22:33:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4118a00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4113e00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f410402c170 tx=0x7f410402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104041070 con 0x7f4114107ce0 2024-04-21T22:33:46.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41141a5e10 con 0x7f4114107ce0 2024-04-21T22:33:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104004450 con 0x7f4114107ce0 2024-04-21T22:33:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104003e50 con 0x7f4114107ce0 2024-04-21T22:33:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.648+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41141a6270 con 0x7f4114107ce0 2024-04-21T22:33:46.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.649+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411410efb0 con 0x7f4114107ce0 2024-04-21T22:33:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.651+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4104044070 con 0x7f4114107ce0 2024-04-21T22:33:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.653+0000 7f4110c00640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 0x7f40f80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:46.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.653+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f41040f0a80 con 0x7f4114107ce0 2024-04-21T22:33:46.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.653+0000 7f4113400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 0x7f40f80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:46.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.654+0000 7f4113400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 0x7f40f80a5260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f411419f470 tx=0x7f4100005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:46.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.657+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f41040f2e20 con 0x7f4114107ce0 2024-04-21T22:33:46.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:46 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3788134632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:46 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2527610896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:46.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.903+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4114062340 con 0x7f4114107ce0 2024-04-21T22:33:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.904+0000 7f4110c00640 1 -- 172.21.15.18:0/2377824682 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7f41040bd310 con 0x7f4114107ce0 2024-04-21T22:33:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:46.904 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:33:46.905 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:46.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.906+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 msgr2=0x7f40f80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.906+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 0x7f40f80a5260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f411419f470 tx=0x7f4100005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.906+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 msgr2=0x7f411419df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.906+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f410402c170 tx=0x7f410402c650 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 shutdown_connections 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f40f80a2da0 0x7f40f80a5260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114109840 0x7f41141a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4114108e80 0x7f411419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 --2- 172.21.15.18:0/2377824682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4114107ce0 0x7f411419df60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 >> 172.21.15.18:0/2377824682 conn(0x7f4114076c30 msgr2=0x7f411410c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 shutdown_connections 2024-04-21T22:33:46.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:46.907+0000 7f4119400640 1 -- 172.21.15.18:0/2377824682 wait complete. 2024-04-21T22:33:46.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.139+0000 7f33c7e00640 1 -- 172.21.15.18:0/364893627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8103220 msgr2=0x7f33c8109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.139+0000 7f33c7e00640 1 --2- 172.21.15.18:0/364893627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8103220 0x7f33c8109ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009ca0 tx=0x7f33c002c100 comp rx=0 tx=0).stop 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 -- 172.21.15.18:0/364893627 shutdown_connections 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 --2- 172.21.15.18:0/364893627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8103220 0x7f33c8109ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 --2- 172.21.15.18:0/364893627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8102860 0x7f33c8102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 --2- 172.21.15.18:0/364893627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 0x7f33c8101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 -- 172.21.15.18:0/364893627 >> 172.21.15.18:0/364893627 conn(0x7f33c80fcc00 msgr2=0x7f33c80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 -- 172.21.15.18:0/364893627 shutdown_connections 2024-04-21T22:33:47.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.140+0000 7f33c7e00640 1 -- 172.21.15.18:0/364893627 wait complete. 2024-04-21T22:33:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 Processor -- start 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 -- start start 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 0x7f33c80754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8103220 0x7f33c8074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33c810d2d0 con 0x7f33c8102860 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f33c810d150 con 0x7f33c8101670 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33c810d450 con 0x7f33c8103220 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56708/0 (socket says 172.21.15.18:56708) 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 0x7f33c80754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.141+0000 7f33c6000640 1 -- 172.21.15.18:0/3904603451 learned_addr learned my addr 172.21.15.18:0/3904603451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c7400640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8103220 0x7f33c8074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 -- 172.21.15.18:0/3904603451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8103220 msgr2=0x7f33c8074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8103220 0x7f33c8074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 -- 172.21.15.18:0/3904603451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 msgr2=0x7f33c80754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 0x7f33c80754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 -- 172.21.15.18:0/3904603451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c8074900 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c6000640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33b400ea60 tx=0x7f33b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b400cde0 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b40035f0 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4010670 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.142+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c81a1a00 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.143+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c81a1f00 con 0x7f33c8102860 2024-04-21T22:33:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.144+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c8108990 con 0x7f33c8102860 2024-04-21T22:33:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.146+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f33b40037a0 con 0x7f33c8102860 2024-04-21T22:33:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.148+0000 7f33bf400640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 0x7f33ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.148+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f33b40cf390 con 0x7f33c8102860 2024-04-21T22:33:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.148+0000 7f33c6a00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 0x7f33ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.149+0000 7f33c6a00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 0x7f33ac0a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33b80095f0 tx=0x7f33b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.152+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f33b409c270 con 0x7f33c8102860 2024-04-21T22:33:47.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.363+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33c802d170 con 0x7f33c8102860 2024-04-21T22:33:47.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.365+0000 7f33bf400640 1 -- 172.21.15.18:0/3904603451 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f33b409bb70 con 0x7f33c8102860 2024-04-21T22:33:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:47.365 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:47.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.367+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 msgr2=0x7f33ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.367+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 0x7f33ac0a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33b80095f0 tx=0x7f33b8005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.367+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 msgr2=0x7f33c8073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.367+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33b400ea60 tx=0x7f33b400ef20 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 shutdown_connections 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f33ac0a2c00 0x7f33ac0a50c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c8103220 0x7f33c8074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c8102860 0x7f33c8073b30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 --2- 172.21.15.18:0/3904603451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c8101670 0x7f33c80754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 >> 172.21.15.18:0/3904603451 conn(0x7f33c80fcc00 msgr2=0x7f33c8105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 shutdown_connections 2024-04-21T22:33:47.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.368+0000 7f33c7e00640 1 -- 172.21.15.18:0/3904603451 wait complete. 2024-04-21T22:33:47.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:33:47.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.591+0000 7f3fcbe00640 1 -- 172.21.15.18:0/3455946467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 msgr2=0x7f3fc4074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.591+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/3455946467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc4074620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009930 tx=0x7f3fb002bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 -- 172.21.15.18:0/3455946467 shutdown_connections 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/3455946467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc410dd60 0x7f3fc4110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/3455946467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc4074620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/3455946467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc4075780 0x7f3fc4073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 -- 172.21.15.18:0/3455946467 >> 172.21.15.18:0/3455946467 conn(0x7f3fc40fcd00 msgr2=0x7f3fc40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 -- 172.21.15.18:0/3455946467 shutdown_connections 2024-04-21T22:33:47.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.592+0000 7f3fcbe00640 1 -- 172.21.15.18:0/3455946467 wait complete. 2024-04-21T22:33:47.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 Processor -- start 2024-04-21T22:33:47.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 -- start start 2024-04-21T22:33:47.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 0x7f3fc419e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc410dd60 0x7f3fc41a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc41139e0 con 0x7f3fc40741a0 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4113860 con 0x7f3fc4075780 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fcbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc4113b60 con 0x7f3fc410dd60 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fc9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fc9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56728/0 (socket says 172.21.15.18:56728) 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.593+0000 7f3fc9400640 1 -- 172.21.15.18:0/804583148 learned_addr learned my addr 172.21.15.18:0/804583148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9e00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc410dd60 0x7f3fc41a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc8a00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 0x7f3fc419e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 -- 172.21.15.18:0/804583148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc410dd60 msgr2=0x7f3fc41a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc410dd60 0x7f3fc41a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 -- 172.21.15.18:0/804583148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 msgr2=0x7f3fc419e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 0x7f3fc419e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 -- 172.21.15.18:0/804583148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc41a5d20 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc8a00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 0x7f3fc419e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc9400640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800e9f0 tx=0x7f3fb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800cd80 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fb8010910 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.594+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8018990 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.595+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc41a5fb0 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.595+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc41a6420 con 0x7f3fc40741a0 2024-04-21T22:33:47.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:47 smithi018 ceph-mon[26614]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:47.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1211031016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:47.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2377824682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:47.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.596+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc4103f30 con 0x7f3fc40741a0 2024-04-21T22:33:47.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.598+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3fb8010ac0 con 0x7f3fc40741a0 2024-04-21T22:33:47.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.600+0000 7f3fc2000640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 0x7f3fac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:47.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.600+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3fb80cf3e0 con 0x7f3fc40741a0 2024-04-21T22:33:47.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.600+0000 7f3fc8a00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 0x7f3fac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:47.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.601+0000 7f3fc8a00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 0x7f3fac0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.604+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3fb809c2c0 con 0x7f3fc40741a0 2024-04-21T22:33:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:47 smithi081 ceph-mon[31692]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1211031016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2377824682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:47 smithi047 ceph-mon[31561]: pgmap v392: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-04-21T22:33:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1211031016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2377824682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:47.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.811+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fc4062440 con 0x7f3fc40741a0 2024-04-21T22:33:47.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.812+0000 7f3fc2000640 1 -- 172.21.15.18:0/804583148 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f3fb809bbc0 con 0x7f3fc40741a0 2024-04-21T22:33:47.812 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:33:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 msgr2=0x7f3fac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 0x7f3fac0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb0005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 msgr2=0x7f3fc419e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:47.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800e9f0 tx=0x7f3fb800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 shutdown_connections 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3fac0a2c10 0x7f3fac0a50d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc410dd60 0x7f3fc41a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fc4075780 0x7f3fc419e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 --2- 172.21.15.18:0/804583148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fc40741a0 0x7f3fc419e100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.814+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 >> 172.21.15.18:0/804583148 conn(0x7f3fc40fcd00 msgr2=0x7f3fc4101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.815+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 shutdown_connections 2024-04-21T22:33:47.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:47.815+0000 7f3fcbe00640 1 -- 172.21.15.18:0/804583148 wait complete. 2024-04-21T22:33:47.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 -- 172.21.15.18:0/4280171196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481027a0 msgr2=0x7f5248102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 --2- 172.21.15.18:0/4280171196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481027a0 0x7f5248102c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5234009860 tx=0x7f523402bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 -- 172.21.15.18:0/4280171196 shutdown_connections 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 --2- 172.21.15.18:0/4280171196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 0x7f52481099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 --2- 172.21.15.18:0/4280171196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481027a0 0x7f5248102c20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 --2- 172.21.15.18:0/4280171196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481015b0 0x7f52481019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 -- 172.21.15.18:0/4280171196 >> 172.21.15.18:0/4280171196 conn(0x7f52480fcb20 msgr2=0x7f52480fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 -- 172.21.15.18:0/4280171196 shutdown_connections 2024-04-21T22:33:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.048+0000 7f5247e00640 1 -- 172.21.15.18:0/4280171196 wait complete. 2024-04-21T22:33:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.049+0000 7f5247e00640 1 Processor -- start 2024-04-21T22:33:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 -- start start 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 0x7f5248197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 0x7f524819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f524810d210 con 0x7f52481015b0 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f524810d090 con 0x7f5248103160 2024-04-21T22:33:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5247e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f524810d390 con 0x7f52481027a0 2024-04-21T22:33:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5246a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5246a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56742/0 (socket says 172.21.15.18:56742) 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5246a00640 1 -- 172.21.15.18:0/2726017639 learned_addr learned my addr 172.21.15.18:0/2726017639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.050+0000 7f5246000640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 0x7f5248197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5247400640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 0x7f524819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 -- 172.21.15.18:0/2726017639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 msgr2=0x7f5248197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 0x7f5248197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 -- 172.21.15.18:0/2726017639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 msgr2=0x7f524819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 0x7f524819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 -- 172.21.15.18:0/2726017639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524819f500 con 0x7f52481015b0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246000640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 0x7f5248197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5246a00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f523800e9f0 tx=0x7f523800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523800ccc0 con 0x7f52481015b0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52380035f0 con 0x7f52481015b0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523800ce60 con 0x7f52481015b0 2024-04-21T22:33:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.051+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524819f7f0 con 0x7f52481015b0 2024-04-21T22:33:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.052+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524819fcc0 con 0x7f52481015b0 2024-04-21T22:33:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.053+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248108920 con 0x7f52481015b0 2024-04-21T22:33:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.055+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f52380037a0 con 0x7f52481015b0 2024-04-21T22:33:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.056+0000 7f523f400640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 0x7f522c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.056+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f52380cf280 con 0x7f52481015b0 2024-04-21T22:33:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.057+0000 7f5246000640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 0x7f522c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.057+0000 7f5246000640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 0x7f522c0a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f523402c180 tx=0x7f523402e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.061+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f523809c160 con 0x7f52481015b0 2024-04-21T22:33:48.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.266+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f52480623e0 con 0x7f52481015b0 2024-04-21T22:33:48.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.267+0000 7f523f400640 1 -- 172.21.15.18:0/2726017639 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f523809ba60 con 0x7f52481015b0 2024-04-21T22:33:48.267 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 msgr2=0x7f522c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 0x7f522c0a50d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f523402c180 tx=0x7f523402e040 comp rx=0 tx=0).stop 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 msgr2=0x7f52481978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f523800e9f0 tx=0x7f523800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 shutdown_connections 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f522c0a2c10 0x7f522c0a50d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5248103160 0x7f524819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52481027a0 0x7f5248197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 --2- 172.21.15.18:0/2726017639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52481015b0 0x7f52481978e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.270+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 >> 172.21.15.18:0/2726017639 conn(0x7f52480fcb20 msgr2=0x7f5248105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.271+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 shutdown_connections 2024-04-21T22:33:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.271+0000 7f5247e00640 1 -- 172.21.15.18:0/2726017639 wait complete. 2024-04-21T22:33:48.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 -- 172.21.15.18:0/1613944548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00107bc0 msgr2=0x7f9d00107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 --2- 172.21.15.18:0/1613944548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00107bc0 0x7f9d00107fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009900 tx=0x7f9cf402bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 -- 172.21.15.18:0/1613944548 shutdown_connections 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 --2- 172.21.15.18:0/1613944548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00109770 0x7f9d00110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 --2- 172.21.15.18:0/1613944548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00108db0 0x7f9d00109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 --2- 172.21.15.18:0/1613944548 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00107bc0 0x7f9d00107fe0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 -- 172.21.15.18:0/1613944548 >> 172.21.15.18:0/1613944548 conn(0x7f9d00076b80 msgr2=0x7f9d00078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:48.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.508+0000 7f9d06000640 1 -- 172.21.15.18:0/1613944548 shutdown_connections 2024-04-21T22:33:48.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.509+0000 7f9d06000640 1 -- 172.21.15.18:0/1613944548 wait complete. 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.509+0000 7f9d06000640 1 Processor -- start 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 -- start start 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00108db0 0x7f9d0019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 0x7f9d001a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00113860 con 0x7f9d00108db0 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001136e0 con 0x7f9d00107bc0 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d06000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001139e0 con 0x7f9d00109770 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9cffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00108db0 0x7f9d0019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d05600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 0x7f9d001a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49634/0 (socket says 172.21.15.18:49634) 2024-04-21T22:33:48.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.510+0000 7f9d04c00640 1 -- 172.21.15.18:0/3570890224 learned_addr learned my addr 172.21.15.18:0/3570890224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 -- 172.21.15.18:0/3570890224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 msgr2=0x7f9d0019df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 -- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00108db0 msgr2=0x7f9d0019e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00108db0 0x7f9d0019e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 -- 172.21.15.18:0/3570890224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d001a5b30 con 0x7f9d00109770 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d04c00640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d05600640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 0x7f9d001a54c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009fd0 tx=0x7f9cf800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800ce20 con 0x7f9d00109770 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001a5e20 con 0x7f9d00109770 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cf8005020 con 0x7f9d00109770 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8010720 con 0x7f9d00109770 2024-04-21T22:33:48.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.511+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d001a62e0 con 0x7f9d00109770 2024-04-21T22:33:48.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.513+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0010ef60 con 0x7f9d00109770 2024-04-21T22:33:48.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.514+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9cf8005540 con 0x7f9d00109770 2024-04-21T22:33:48.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.516+0000 7f9cfd600640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 0x7f9ce80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.516+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f9cf80cf730 con 0x7f9d00109770 2024-04-21T22:33:48.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.516+0000 7f9d04c00640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 0x7f9ce80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.517+0000 7f9d04c00640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 0x7f9ce80a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.520+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f9cf809c610 con 0x7f9d00109770 2024-04-21T22:33:48.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:48 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3904603451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:48.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:48 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/804583148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:48 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2726017639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:48 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3904603451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:48.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:48 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/804583148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:48 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2726017639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:48 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3904603451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:48.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:48 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/804583148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:48 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2726017639' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:33:48.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.726+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9d00062340 con 0x7f9d00109770 2024-04-21T22:33:48.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.726+0000 7f9cfd600640 1 -- 172.21.15.18:0/3570890224 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f9cf809bf10 con 0x7f9d00109770 2024-04-21T22:33:48.726 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 msgr2=0x7f9ce80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 0x7f9ce80a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4006010 tx=0x7f9cf402df90 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 msgr2=0x7f9d001a54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 0x7f9d001a54c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009fd0 tx=0x7f9cf800ef10 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 shutdown_connections 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f9ce80a2b90 0x7f9ce80a5050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d00109770 0x7f9d001a54c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d00108db0 0x7f9d0019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 --2- 172.21.15.18:0/3570890224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d00107bc0 0x7f9d0019df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 >> 172.21.15.18:0/3570890224 conn(0x7f9d00076b80 msgr2=0x7f9d0010c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 shutdown_connections 2024-04-21T22:33:48.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.729+0000 7f9d06000640 1 -- 172.21.15.18:0/3570890224 wait complete. 2024-04-21T22:33:48.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:33:48.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1277361901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc104a90 msgr2=0x7fe3cc104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1277361901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc104a90 0x7fe3cc104f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009900 tx=0x7fe3b802bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1277361901 shutdown_connections 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1277361901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 0x7fe3cc10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1277361901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc104a90 0x7fe3cc104f10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1277361901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.953+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1277361901 >> 172.21.15.18:0/1277361901 conn(0x7fe3cc0fee10 msgr2=0x7fe3cc101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.954+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1277361901 shutdown_connections 2024-04-21T22:33:48.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.954+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1277361901 wait complete. 2024-04-21T22:33:48.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.955+0000 7fe3cbe00640 1 Processor -- start 2024-04-21T22:33:48.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.955+0000 7fe3cbe00640 1 -- start start 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc104a90 0x7fe3cc19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 0x7fe3cc1a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc10f520 con 0x7fe3cc1038a0 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc10f3a0 con 0x7fe3cc104a90 2024-04-21T22:33:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc10f6a0 con 0x7fe3cc105450 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56782/0 (socket says 172.21.15.18:56782) 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 -- 172.21.15.18:0/1021188353 learned_addr learned my addr 172.21.15.18:0/1021188353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3ca000640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc104a90 0x7fe3cc19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3cb400640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 0x7fe3cc1a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 -- 172.21.15.18:0/1021188353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 msgr2=0x7fe3cc1a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 0x7fe3cc1a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 -- 172.21.15.18:0/1021188353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc104a90 msgr2=0x7fe3cc19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc104a90 0x7fe3cc19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.956+0000 7fe3caa00640 1 -- 172.21.15.18:0/1021188353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc1a17e0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3caa00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e9c0 tx=0x7fe3bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00cd80 con 0x7fe3cc1038a0 2024-04-21T22:33:48.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3bc0035f0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc010690 con 0x7fe3cc1038a0 2024-04-21T22:33:48.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3cc1a1ad0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.957+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3cc1a2040 con 0x7fe3cc1038a0 2024-04-21T22:33:48.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.959+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3cc10abc0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.961+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe3bc0037a0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.962+0000 7fe3c3400640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 0x7fe3b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:48.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.962+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fe3bc0cf3d0 con 0x7fe3cc1038a0 2024-04-21T22:33:48.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.962+0000 7fe3ca000640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 0x7fe3b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:48.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.963+0000 7fe3ca000640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 0x7fe3b00a50c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe3b802c7b0 tx=0x7fe3b8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:48.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:48.967+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe3bc09c310 con 0x7fe3cc1038a0 2024-04-21T22:33:49.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.213+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3cc02d170 con 0x7fe3cc1038a0 2024-04-21T22:33:49.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.214+0000 7fe3c3400640 1 -- 172.21.15.18:0/1021188353 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11914 (secure 0 0 0) 0x7fe3bc09bc10 con 0x7fe3cc1038a0 2024-04-21T22:33:49.215 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:49.215 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:31:36.529368+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:33:49.215 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 27 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 msgr2=0x7fe3b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 0x7fe3b00a50c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe3b802c7b0 tx=0x7fe3b8005fd0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 msgr2=0x7fe3cc199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00e9c0 tx=0x7fe3bc00ee80 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 shutdown_connections 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fe3b00a2c00 0x7fe3b00a50c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3cc105450 0x7fe3cc1a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3cc104a90 0x7fe3cc19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 --2- 172.21.15.18:0/1021188353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3cc1038a0 0x7fe3cc199bc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.217+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 >> 172.21.15.18:0/1021188353 conn(0x7fe3cc0fee10 msgr2=0x7fe3cc107d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.218+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 shutdown_connections 2024-04-21T22:33:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.218+0000 7fe3cbe00640 1 -- 172.21.15.18:0/1021188353 wait complete. 2024-04-21T22:33:49.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:33:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 -- 172.21.15.18:0/1028670991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8104a30 msgr2=0x7f24c8106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 --2- 172.21.15.18:0/1028670991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8104a30 0x7f24c8106e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009900 tx=0x7f24b002bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 -- 172.21.15.18:0/1028670991 shutdown_connections 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 --2- 172.21.15.18:0/1028670991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 0x7f24c81097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 --2- 172.21.15.18:0/1028670991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8104a30 0x7f24c8106e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 --2- 172.21.15.18:0/1028670991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8102100 0x7f24c81044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 -- 172.21.15.18:0/1028670991 >> 172.21.15.18:0/1028670991 conn(0x7f24c80fbb10 msgr2=0x7f24c80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 -- 172.21.15.18:0/1028670991 shutdown_connections 2024-04-21T22:33:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.450+0000 7f24ccc00640 1 -- 172.21.15.18:0/1028670991 wait complete. 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.451+0000 7f24ccc00640 1 Processor -- start 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.451+0000 7f24ccc00640 1 -- start start 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 0x7f24c8199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 0x7f24c819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 0x7f24c81a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24c810d360 con 0x7f24c8107360 2024-04-21T22:33:49.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f24c810d1e0 con 0x7f24c8102100 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24ccc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24c810d4e0 con 0x7f24c8104a30 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 0x7f24c81a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24c7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 0x7f24c8199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 0x7f24c819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24c7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 0x7f24c8199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49674/0 (socket says 172.21.15.18:49674) 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24c7400640 1 -- 172.21.15.18:0/18821875 learned_addr learned my addr 172.21.15.18:0/18821875 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 -- 172.21.15.18:0/18821875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 msgr2=0x7f24c8199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 0x7f24c8199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 -- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 msgr2=0x7f24c81a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 0x7f24c81a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.452+0000 7f24bea00640 1 -- 172.21.15.18:0/18821875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c81a17f0 con 0x7f24c8104a30 2024-04-21T22:33:49.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.453+0000 7f24bea00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 0x7f24c819a110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009230 tx=0x7f24b002c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.453+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0043020 con 0x7f24c8104a30 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.453+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24b00054e0 con 0x7f24c8104a30 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.453+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b0003b60 con 0x7f24c8104a30 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.453+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c81a1a80 con 0x7f24c8104a30 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.454+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c81a1f50 con 0x7f24c8104a30 2024-04-21T22:33:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.455+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c8108eb0 con 0x7f24c8104a30 2024-04-21T22:33:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.456+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f24b0046020 con 0x7f24c8104a30 2024-04-21T22:33:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.458+0000 7f24c4c00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 0x7f24ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.458+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f24b00f1070 con 0x7f24c8104a30 2024-04-21T22:33:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.458+0000 7f24c7400640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 0x7f24ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.459+0000 7f24c7400640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 0x7f24ac0a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009cd0 tx=0x7f24b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.462+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f24b004d020 con 0x7f24c8104a30 2024-04-21T22:33:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:49 smithi018 ceph-mon[26614]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3570890224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:49 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1021188353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:49 smithi081 ceph-mon[31692]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3570890224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:49 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1021188353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:49.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.673+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24c8062340 con 0x7f24c8104a30 2024-04-21T22:33:49.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.675+0000 7f24c4c00640 1 -- 172.21.15.18:0/18821875 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22581 (secure 0 0 0) 0x7f24b00bdf50 con 0x7f24c8104a30 2024-04-21T22:33:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:33:49.676 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:32:17.548077+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 msgr2=0x7f24ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 0x7f24ac0a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009cd0 tx=0x7f24b8005f90 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 msgr2=0x7f24c819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 0x7f24c819a110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009230 tx=0x7f24b002c5d0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 shutdown_connections 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f24ac0a2c00 0x7f24ac0a50c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24c8107360 0x7f24c81a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24c8104a30 0x7f24c819a110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 --2- 172.21.15.18:0/18821875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24c8102100 0x7f24c8199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 >> 172.21.15.18:0/18821875 conn(0x7f24c80fbb10 msgr2=0x7f24c8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 shutdown_connections 2024-04-21T22:33:49.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.679+0000 7f24ccc00640 1 -- 172.21.15.18:0/18821875 wait complete. 2024-04-21T22:33:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:49 smithi047 ceph-mon[31561]: pgmap v393: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:33:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3570890224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:33:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:49 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1021188353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:33:49.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-21T22:31:28.985001+0000', 'modified': '2024-04-21T22:31:36.529368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24596, 'mds_1': 24568, 'mds_2': 24538, 'mds_3': 24509, 'mds_4': 24496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14475': {'gid': 14475, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6841/2953480850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6840', 'nonce': 2953480850}, {'type': 'v1', 'addr': '172.21.15.18:6841', 'nonce': 2953480850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6833/3754896489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6832', 'nonce': 3754896489}, {'type': 'v1', 'addr': '172.21.15.47:6833', 'nonce': 3754896489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6833/2486302783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 2486302783}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 2486302783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'j', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.18:6835/1168118848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 1168118848}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1168118848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.47:6835/877045007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 877045007}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 877045007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.81:6835/1298670178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1298670178}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1298670178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.47:6837/639724797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6836', 'nonce': 639724797}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 639724797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6837/2293229120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2293229120}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2293229120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.81:6839/3777779454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3777779454}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3777779454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6839/3521127091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6838', 'nonce': 3521127091}, {'type': 'v1', 'addr': '172.21.15.47:6839', 'nonce': 3521127091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24596, 'qdb_cluster': [24568, 24596, 24509, 24538, 24496]} 2024-04-21T22:33:49.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-21T22:33:49.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 -- 172.21.15.18:0/2678824593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8102980 msgr2=0x7f62b8102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 --2- 172.21.15.18:0/2678824593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8102980 0x7f62b8102e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009860 tx=0x7f62a002bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 -- 172.21.15.18:0/2678824593 shutdown_connections 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 --2- 172.21.15.18:0/2678824593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8103340 0x7f62b8109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 --2- 172.21.15.18:0/2678824593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8102980 0x7f62b8102e00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 --2- 172.21.15.18:0/2678824593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8101790 0x7f62b8101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 -- 172.21.15.18:0/2678824593 >> 172.21.15.18:0/2678824593 conn(0x7f62b80fcd00 msgr2=0x7f62b80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 -- 172.21.15.18:0/2678824593 shutdown_connections 2024-04-21T22:33:49.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.898+0000 7f62bd000640 1 -- 172.21.15.18:0/2678824593 wait complete. 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 Processor -- start 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 -- start start 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8101790 0x7f62b8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8103340 0x7f62b819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810d410 con 0x7f62b8102980 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810d290 con 0x7f62b8103340 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.899+0000 7f62bd000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810d590 con 0x7f62b8101790 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56814/0 (socket says 172.21.15.18:56814) 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 -- 172.21.15.18:0/2928445977 learned_addr learned my addr 172.21.15.18:0/2928445977 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8101790 0x7f62b8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62b6800640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8103340 0x7f62b819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 -- 172.21.15.18:0/2928445977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8101790 msgr2=0x7f62b8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8101790 0x7f62b8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 -- 172.21.15.18:0/2928445977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8103340 msgr2=0x7f62b819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8103340 0x7f62b819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 -- 172.21.15.18:0/2928445977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b819f6a0 con 0x7f62b8102980 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.900+0000 7f62afe00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62a00349e0 tx=0x7f62a0032450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.901+0000 7f62aea00640 1 -- 172.21.15.18:0/2928445977 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0041030 con 0x7f62b8102980 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.901+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b819f930 con 0x7f62b8102980 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.901+0000 7f62aea00640 1 -- 172.21.15.18:0/2928445977 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a002c510 con 0x7f62b8102980 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.901+0000 7f62aea00640 1 -- 172.21.15.18:0/2928445977 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0039040 con 0x7f62b8102980 2024-04-21T22:33:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.901+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b819fe20 con 0x7f62b8102980 2024-04-21T22:33:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.904+0000 7f62aea00640 1 -- 172.21.15.18:0/2928445977 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f62a0044070 con 0x7f62b8102980 2024-04-21T22:33:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62aea00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 0x7f629c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 Processor -- start 2024-04-21T22:33:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62aea00640 1 -- 172.21.15.18:0/2928445977 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f62a00f05e0 con 0x7f62b8102980 2024-04-21T22:33:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 -- start start 2024-04-21T22:33:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 0x7f629c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e2074f0 0x56232e207910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e20f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56232e108dc0 con 0x56232e207ee0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232e16bce0 con 0x56232e2074f0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.906+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56232e1147c0 con 0x56232e20d050 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56824/0 (socket says 172.21.15.18:56824) 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 -- 172.21.15.18:0/2391394675 learned_addr learned my addr 172.21.15.18:0/2391394675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e2074f0 0x56232e207910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62b6800640 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e20f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 0x7f629c0a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009530 tx=0x7f62a8011810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 -- 172.21.15.18:0/2391394675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 msgr2=0x56232e20f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e20f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 -- 172.21.15.18:0/2391394675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e2074f0 msgr2=0x56232e207910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e2074f0 0x56232e207910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 -- 172.21.15.18:0/2391394675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232de802d0 con 0x56232e207ee0 2024-04-21T22:33:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.907+0000 7f62afe00640 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b9280 tx=0x7f62a0005190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c04fa13270646 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.908+0000 7f62a7400640 1 -- 172.21.15.18:0/2391394675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00bce20 con 0x56232e207ee0 2024-04-21T22:33:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.908+0000 7f62a7400640 1 -- 172.21.15.18:0/2391394675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a00c11d0 con 0x56232e207ee0 2024-04-21T22:33:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.908+0000 7f62a7400640 1 -- 172.21.15.18:0/2391394675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00c5600 con 0x56232e207ee0 2024-04-21T22:33:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.908+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2391394675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 msgr2=0x56232e20c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.908+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b9280 tx=0x7f62a0005190 comp rx=0 tx=0).stop 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2391394675 shutdown_connections 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e20f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e20c9e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2391394675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e2074f0 0x56232e207910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2391394675 >> 172.21.15.18:0/2391394675 conn(0x56232e202a60 msgr2=0x56232e202e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2391394675 shutdown_connections 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2391394675 wait complete. 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.909+0000 7f62bfdc6740 1 -- start start 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 Processor -- start 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e2074f0 0x56232e2113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e218970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56232e127c10 con 0x56232e2074f0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232e167ca0 con 0x56232e207ee0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56232e108dc0 con 0x56232e20d050 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.910+0000 7f62bfdc6740 10 client.0 _ll_register_callbacks cb 0x56232e162e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49708/0 (socket says 172.21.15.18:49708) 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e2074f0 0x56232e2113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 -- 172.21.15.18:0/4216843018 learned_addr learned my addr 172.21.15.18:0/4216843018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62b6800640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e218970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 -- 172.21.15.18:0/4216843018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 msgr2=0x56232e218970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e218970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 -- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e2074f0 msgr2=0x56232e2113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e2074f0 0x56232e2113f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 -- 172.21.15.18:0/4216843018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232df4a6b0 con 0x56232e207ee0 2024-04-21T22:33:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f62afe00640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b97a0 tx=0x7f62a0005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b93448ad4be70b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.911+0000 7f629be00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00c5a90 con 0x56232e207ee0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f62a00bc270 con 0x56232e207ee0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a00c11d0 con 0x56232e207ee0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f62a00b9490 con 0x56232e207ee0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f62bfdc6740 10 client.25196 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56232e21bce0 con 0x56232e207ee0 2024-04-21T22:33:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a00c11d0 con 0x56232e207ee0 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f62a004e060 con 0x56232e207ee0 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f62bfdc6740 10 client.25196 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.912+0000 7f62bfdc6740 10 client.25196 resolve_mds: resolved name 'j' to daemon mds.j 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62bfdc6740 20 client.25196 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e21e090 0x56232e21f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62bfdc6740 4 client.25196 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56232e179220 con 0x56232e21e090 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62b5e00640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e21e090 0x56232e21f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f62b5e00640 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e21e090 0x56232e21f500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7104e1702ac7368c server_cookie=af0dfb26c194df9 in_seq=0 out_seq=0 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.913+0000 7f629be00640 10 client.25196 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.914+0000 7f629be00640 1 -- 172.21.15.18:0/4216843018 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56232e179220 con 0x56232e21e090 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.914+0000 7f629be00640 10 client.25196 handle_command_reply: tid=0 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.914+0000 7f62bfdc6740 1 client.25196 shutdown 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 msgr2=0x56232e211930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b97a0 tx=0x7f62a0005bd0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 shutdown_connections 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e21e090 0x56232e21f500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e20d050 0x56232e218970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e207ee0 0x56232e211930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/4216843018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e2074f0 0x56232e2113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 >> 172.21.15.18:0/4216843018 conn(0x56232e202a60 msgr2=0x56232e201c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f629be00640 0 client.25196 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 shutdown_connections 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 1 -- 172.21.15.18:0/4216843018 wait complete. 2024-04-21T22:33:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.915+0000 7f62bfdc6740 20 client.25196 trim_cache size 0 max 16384 2024-04-21T22:33:49.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.936+0000 7f62bfdc6740 1 Processor -- start 2024-04-21T22:33:49.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.936+0000 7f62bfdc6740 1 -- start start 2024-04-21T22:33:49.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e218930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56232e21d840 con 0x56232e207ee0 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232e21df10 con 0x56232e20d050 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56232e21e5e0 con 0x56232e2074f0 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56756/0 (socket says 172.21.15.18:56756) 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 -- 172.21.15.18:0/1992191528 learned_addr learned my addr 172.21.15.18:0/1992191528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62afe00640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e218930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b6800640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 -- 172.21.15.18:0/1992191528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 msgr2=0x56232e2104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 -- 172.21.15.18:0/1992191528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 msgr2=0x56232e218930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e218930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b5e00640 1 -- 172.21.15.18:0/1992191528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232e2037d0 con 0x56232e2074f0 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62b6800640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.937+0000 7f62afe00640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e218930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.938+0000 7f62b5e00640 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009a20 tx=0x7f62a8011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db39c125ec8bb858 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.938+0000 7f62a6a00640 1 -- 172.21.15.18:0/1992191528 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8017040 con 0x56232e2074f0 2024-04-21T22:33:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.938+0000 7f62a6a00640 1 -- 172.21.15.18:0/1992191528 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a8019050 con 0x56232e2074f0 2024-04-21T22:33:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62a6a00640 1 -- 172.21.15.18:0/1992191528 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a801da00 con 0x56232e2074f0 2024-04-21T22:33:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- 172.21.15.18:0/1992191528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 msgr2=0x56232e20ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009a20 tx=0x7f62a8011f90 comp rx=0 tx=0).stop 2024-04-21T22:33:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- 172.21.15.18:0/1992191528 shutdown_connections 2024-04-21T22:33:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e218930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/1992191528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e20ffa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- 172.21.15.18:0/1992191528 >> 172.21.15.18:0/1992191528 conn(0x56232e202a60 msgr2=0x56232e209340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- 172.21.15.18:0/1992191528 shutdown_connections 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- 172.21.15.18:0/1992191528 wait complete. 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 -- start start 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.939+0000 7f62bfdc6740 1 Processor -- start 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56232e21f380 con 0x56232e207ee0 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56232e21ecb0 con 0x56232e20d050 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56232e21fa50 con 0x56232e2074f0 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62bfdc6740 10 client.0 _ll_register_callbacks cb 0x7f62a8009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62b5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56854/0 (socket says 172.21.15.18:56854) 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62afe00640 1 -- 172.21.15.18:0/2812659938 learned_addr learned my addr 172.21.15.18:0/2812659938 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62b5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56772/0 (socket says 172.21.15.18:56772) 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.940+0000 7f62b6800640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 -- 172.21.15.18:0/2812659938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 msgr2=0x56232e2155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 -- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 msgr2=0x56232e215090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 -- 172.21.15.18:0/2812659938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232e215bc0 con 0x56232e2074f0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b6800640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62afe00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62b5e00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f62a801d650 tx=0x7f62a8029430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d623fe1c51883b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f629be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:33:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8039060 con 0x56232e2074f0 2024-04-21T22:33:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a8019050 con 0x56232e2074f0 2024-04-21T22:33:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.941+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f62a80296e0 con 0x56232e2074f0 2024-04-21T22:33:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f62a8017040 con 0x56232e2074f0 2024-04-21T22:33:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f62bfdc6740 10 client.25216 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56232e285100 con 0x56232e2074f0 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a8019050 con 0x56232e2074f0 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f62a8004ac0 con 0x56232e2074f0 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.942+0000 7f62bfdc6740 10 client.25216 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62bfdc6740 10 client.25216 resolve_mds: resolved name 'j' to daemon mds.j 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62bfdc6740 20 client.25216 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e2899c0 0x56232e2886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62bfdc6740 4 client.25216 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "status"}) -- 0x56232e208e50 con 0x56232e2899c0 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62afe00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e2899c0 0x56232e2886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f62afe00640 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e2899c0 0x56232e2886d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f340ae8dea08eab3 server_cookie=6db33da3ee5c762d in_seq=0 out_seq=0 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.943+0000 7f629be00640 10 client.25216 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f629be00640 1 -- 172.21.15.18:0/2812659938 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56232e208e50 con 0x56232e2899c0 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f629be00640 10 client.25216 handle_command_reply: tid=0 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 client.25216 shutdown 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 msgr2=0x56232e2185f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f62a801d650 tx=0x7f62a8029430 comp rx=0 tx=0).stop 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 shutdown_connections 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x56232e2899c0 0x56232e2886d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56232e20d050 0x56232e2155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56232e207ee0 0x56232e215090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 --2- 172.21.15.18:0/2812659938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56232e2074f0 0x56232e2185f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f629be00640 0 client.25216 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:33:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 >> 172.21.15.18:0/2812659938 conn(0x56232e202a60 msgr2=0x56232e205cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 shutdown_connections 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 1 -- 172.21.15.18:0/2812659938 wait complete. 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.944+0000 7f62bfdc6740 20 client.25216 trim_cache size 0 max 16384 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 4, 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24496, 2024-04-21T22:33:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 134.42166917899999, 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 177.25066533200001 2024-04-21T22:33:49.949 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 msgr2=0x7f629c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 0x7f629c0a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009530 tx=0x7f62a8011810 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 msgr2=0x7f62b8197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f62a00349e0 tx=0x7f62a0032450 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 shutdown_connections 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f629c0a2b90 0x7f629c0a5050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62b8103340 0x7f62b819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62b8102980 0x7f62b8197fc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 --2- 172.21.15.18:0/2928445977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b8101790 0x7f62b8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 >> 172.21.15.18:0/2928445977 conn(0x7f62b80fcd00 msgr2=0x7f62b8105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 shutdown_connections 2024-04-21T22:33:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:49.945+0000 7f62bd000640 1 -- 172.21.15.18:0/2928445977 wait complete. 2024-04-21T22:33:49.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 -- 172.21.15.18:0/3884886912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 msgr2=0x7f42a4100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3884886912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4100be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f428c009900 tx=0x7f428c02bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 -- 172.21.15.18:0/3884886912 shutdown_connections 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3884886912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a4101120 0x7f42a41015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3884886912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4100be0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3884886912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ffe20 0x7f42a4100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 -- 172.21.15.18:0/3884886912 >> 172.21.15.18:0/3884886912 conn(0x7f42a40fba20 msgr2=0x7f42a40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 -- 172.21.15.18:0/3884886912 shutdown_connections 2024-04-21T22:33:50.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.159+0000 7f42a8a00640 1 -- 172.21.15.18:0/3884886912 wait complete. 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.160+0000 7f42a8a00640 1 Processor -- start 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.160+0000 7f42a8a00640 1 -- start start 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.160+0000 7f42a8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a40ffe20 0x7f42a4199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.160+0000 7f42a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a4101120 0x7f42a41a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42a410f440 con 0x7f42a4100780 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42a410f2c0 con 0x7f42a40ffe20 2024-04-21T22:33:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a8a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f42a410f5c0 con 0x7f42a4101120 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56882/0 (socket says 172.21.15.18:56882) 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 -- 172.21.15.18:0/3315264740 learned_addr learned my addr 172.21.15.18:0/3315264740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a3200640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a4101120 0x7f42a41a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f42a2800640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a40ffe20 0x7f42a4199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 -- 172.21.15.18:0/3315264740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a4101120 msgr2=0x7f42a41a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a4101120 0x7f42a41a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 -- 172.21.15.18:0/3315264740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a40ffe20 msgr2=0x7f42a4199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a40ffe20 0x7f42a4199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.161+0000 7f4299e00640 1 -- 172.21.15.18:0/3315264740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41a16a0 con 0x7f42a4100780 2024-04-21T22:33:50.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f4299e00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f429be00640 1 -- 172.21.15.18:0/3315264740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c043020 con 0x7f42a4100780 2024-04-21T22:33:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f429be00640 1 -- 172.21.15.18:0/3315264740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428c0054e0 con 0x7f42a4100780 2024-04-21T22:33:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f429be00640 1 -- 172.21.15.18:0/3315264740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c003c40 con 0x7f42a4100780 2024-04-21T22:33:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a41a1930 con 0x7f42a4100780 2024-04-21T22:33:50.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.162+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41a1e30 con 0x7f42a4100780 2024-04-21T22:33:50.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.166+0000 7f429be00640 1 -- 172.21.15.18:0/3315264740 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f428c046020 con 0x7f42a4100780 2024-04-21T22:33:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.167+0000 7f429be00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 0x7f42880a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.167+0000 7f42ac1b6740 1 Processor -- start 2024-04-21T22:33:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.167+0000 7f429be00640 1 -- 172.21.15.18:0/3315264740 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f428c0f1090 con 0x7f42a4100780 2024-04-21T22:33:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 -- start start 2024-04-21T22:33:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42a2800640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 0x7f42880a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 0x563c37024af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c3702a230 0x563c3702c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c36f25dc0 con 0x563c370250c0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c36f88ce0 con 0x563c3702a230 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c36f317c0 con 0x563c370246d0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56884/0 (socket says 172.21.15.18:56884) 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f4299e00640 1 -- 172.21.15.18:0/307245275 learned_addr learned my addr 172.21.15.18:0/307245275 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.168+0000 7f42a2800640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 0x563c37024af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a3200640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c3702a230 0x563c3702c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 0x7f42880a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42940099a0 tx=0x7f4294009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 -- 172.21.15.18:0/307245275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c3702a230 msgr2=0x563c3702c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c3702a230 0x563c3702c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 -- 172.21.15.18:0/307245275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 msgr2=0x563c37029bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 -- 172.21.15.18:0/307245275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c36c9d2d0 con 0x563c370246d0 2024-04-21T22:33:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f4299e00640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f42a2800640 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 0x563c37024af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4294009d70 tx=0x7f4294014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540ab167c3e0dcde server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.169+0000 7f4293400640 1 -- 172.21.15.18:0/307245275 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294004b20 con 0x563c370246d0 2024-04-21T22:33:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f4293400640 1 -- 172.21.15.18:0/307245275 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4294003e50 con 0x563c370246d0 2024-04-21T22:33:50.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f4293400640 1 -- 172.21.15.18:0/307245275 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294005020 con 0x563c370246d0 2024-04-21T22:33:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 -- 172.21.15.18:0/307245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 msgr2=0x563c37024af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 0x563c37024af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4294009d70 tx=0x7f4294014000 comp rx=0 tx=0).stop 2024-04-21T22:33:50.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 -- 172.21.15.18:0/307245275 shutdown_connections 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c3702a230 0x563c3702c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37029bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/307245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370246d0 0x563c37024af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.170+0000 7f42ac1b6740 1 -- 172.21.15.18:0/307245275 >> 172.21.15.18:0/307245275 conn(0x563c3701fc40 msgr2=0x563c37020040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.171+0000 7f42ac1b6740 1 -- 172.21.15.18:0/307245275 shutdown_connections 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.171+0000 7f42ac1b6740 1 -- 172.21.15.18:0/307245275 wait complete. 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.171+0000 7f42ac1b6740 1 -- start start 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.171+0000 7f42ac1b6740 1 Processor -- start 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 0x563c3702efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c3702a230 0x563c37036010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c36f44c10 con 0x563c3702a230 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c36f84ca0 con 0x563c370246d0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c3702d1e0 con 0x563c370250c0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42ac1b6740 10 client.0 _ll_register_callbacks cb 0x563c36f7fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49774/0 (socket says 172.21.15.18:49774) 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 -- 172.21.15.18:0/973289779 learned_addr learned my addr 172.21.15.18:0/973289779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f4299e00640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 0x563c3702efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a3200640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c3702a230 0x563c37036010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 -- 172.21.15.18:0/973289779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 msgr2=0x563c3702efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 0x563c3702efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 -- 172.21.15.18:0/973289779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c3702a230 msgr2=0x563c37036010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c3702a230 0x563c37036010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f42a2800640 1 -- 172.21.15.18:0/973289779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c36d676b0 con 0x563c370246d0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.172+0000 7f4299e00640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 0x563c3702efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.173+0000 7f42a2800640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4294004320 tx=0x7f4294004000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9651b5c043a270e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.173+0000 7f4287e00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.173+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294003b70 con 0x563c370246d0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.173+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f4294004a40 con 0x563c370246d0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.173+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4294003e50 con 0x563c370246d0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.174+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4294004c80 con 0x563c370246d0 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.174+0000 7f42ac1b6740 10 client.25214 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.174+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563c37039380 con 0x563c370246d0 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.174+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4294003e50 con 0x563c370246d0 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.174+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f429402b070 con 0x563c370246d0 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 10 client.25214 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 10 client.25214 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 20 client.25214 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c3703b660 0x563c3703cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 4 client.25214 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c36f96220 con 0x563c3703b660 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.175+0000 7f4299e00640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c3703b660 0x563c3703cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.176+0000 7f4299e00640 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c3703b660 0x563c3703cad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a93965e0c9bc0f2a server_cookie=53bf42c4947536cd in_seq=0 out_seq=0 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.176+0000 7f4287e00640 10 client.25214 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.176+0000 7f4287e00640 1 -- 172.21.15.18:0/973289779 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563c36f96220 con 0x563c3703b660 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.176+0000 7f4287e00640 10 client.25214 handle_command_reply: tid=0 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 client.25214 shutdown 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 msgr2=0x563c3702ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4294004320 tx=0x7f4294004000 comp rx=0 tx=0).stop 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 shutdown_connections 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c3703b660 0x563c3703cad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c3702a230 0x563c37036010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c370250c0 0x563c3702efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/973289779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c3702ea90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f4287e00640 0 client.25214 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 >> 172.21.15.18:0/973289779 conn(0x563c3701fc40 msgr2=0x563c3701ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 shutdown_connections 2024-04-21T22:33:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 1 -- 172.21.15.18:0/973289779 wait complete. 2024-04-21T22:33:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.177+0000 7f42ac1b6740 20 client.25214 trim_cache size 0 max 16384 2024-04-21T22:33:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.218+0000 7f42ac1b6740 1 Processor -- start 2024-04-21T22:33:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.218+0000 7f42ac1b6740 1 -- start start 2024-04-21T22:33:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 0x563c37035fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37020020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c3703ae10 con 0x563c370246d0 2024-04-21T22:33:50.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c3703b4e0 con 0x563c370250c0 2024-04-21T22:33:50.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c3703bbb0 con 0x563c3702a230 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56898/0 (socket says 172.21.15.18:56898) 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a2800640 1 -- 172.21.15.18:0/488678163 learned_addr learned my addr 172.21.15.18:0/488678163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f4299e00640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 0x563c37035fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a3200640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37020020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a2800640 1 -- 172.21.15.18:0/488678163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 msgr2=0x563c37020020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.219+0000 7f42a2800640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37020020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f42a2800640 1 -- 172.21.15.18:0/488678163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 msgr2=0x563c37035fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f42a2800640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 0x563c37035fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f42a2800640 1 -- 172.21.15.18:0/488678163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c370298c0 con 0x563c370246d0 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f4299e00640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 0x563c37035fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f42a2800640 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4294009b90 tx=0x7f4294009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d820d59ec6d18b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f4292a00640 1 -- 172.21.15.18:0/488678163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294004350 con 0x563c370246d0 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f4292a00640 1 -- 172.21.15.18:0/488678163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4294031070 con 0x563c370246d0 2024-04-21T22:33:50.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.220+0000 7f4292a00640 1 -- 172.21.15.18:0/488678163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429402cdc0 con 0x563c370246d0 2024-04-21T22:33:50.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 -- 172.21.15.18:0/488678163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 msgr2=0x563c3702ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4294009b90 tx=0x7f4294009280 comp rx=0 tx=0).stop 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 -- 172.21.15.18:0/488678163 shutdown_connections 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37020020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370250c0 0x563c37035fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/488678163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370246d0 0x563c3702ef30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 -- 172.21.15.18:0/488678163 >> 172.21.15.18:0/488678163 conn(0x563c3701fc40 msgr2=0x563c3702d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 -- 172.21.15.18:0/488678163 shutdown_connections 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.221+0000 7f42ac1b6740 1 -- 172.21.15.18:0/488678163 wait complete. 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 -- start start 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 Processor -- start 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c37031aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37034fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c3703c950 con 0x563c370250c0 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563c3703c280 con 0x563c370246d0 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c3703d020 con 0x563c3702a230 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.222+0000 7f42ac1b6740 10 client.0 _ll_register_callbacks cb 0x7f428c0b94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56912/0 (socket says 172.21.15.18:56912) 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 -- 172.21.15.18:0/482791817 learned_addr learned my addr 172.21.15.18:0/482791817 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f42a3200640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37034fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f42a2800640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c37031aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 -- 172.21.15.18:0/482791817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 msgr2=0x563c37034fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37034fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 -- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 msgr2=0x563c37031aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c37031aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 -- 172.21.15.18:0/482791817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c370355a0 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4299e00640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f428c0b9c80 tx=0x7f428c0a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1943036c9821686 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.223+0000 7f4287e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c0db060 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f428c0bb910 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4294031070 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f428c0bdf70 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 10 client.15105 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563c370a19b0 con 0x563c370250c0 2024-04-21T22:33:50.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4294031070 con 0x563c370250c0 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f428c0b9ee0 con 0x563c370250c0 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 10 client.15105 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 20 client.15105 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c370a65c0 0x563c370a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 4 client.15105 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.224+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "status"}) -- 0x563c36f90570 con 0x563c370a65c0 2024-04-21T22:33:50.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.225+0000 7f42a2800640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c370a65c0 0x563c370a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.225+0000 7f42a2800640 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c370a65c0 0x563c370a52d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b0bf51ca7e2b0686 server_cookie=e92a16d8efdf6708 in_seq=0 out_seq=0 2024-04-21T22:33:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.225+0000 7f4287e00640 10 client.15105 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:50.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f4287e00640 1 -- 172.21.15.18:0/482791817 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563c36f90570 con 0x563c370a65c0 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f4287e00640 10 client.15105 handle_command_reply: tid=0 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 client.15105 shutdown 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 msgr2=0x563c37031fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f428c0b9c80 tx=0x7f428c0a8040 comp rx=0 tx=0).stop 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 shutdown_connections 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x563c370a65c0 0x563c370a52d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c3702a230 0x563c37034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c370250c0 0x563c37031fe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 --2- 172.21.15.18:0/482791817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563c370246d0 0x563c37031aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f4287e00640 0 client.15105 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 >> 172.21.15.18:0/482791817 conn(0x563c3701fc40 msgr2=0x563c37020020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 shutdown_connections 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 1 -- 172.21.15.18:0/482791817 wait complete. 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.226+0000 7f42ac1b6740 20 client.15105 trim_cache size 0 max 16384 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 3, 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24509, 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:50.231 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 135.71774433900001, 2024-04-21T22:33:50.232 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:50.232 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:50.232 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:50.232 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 170.07269694199999 2024-04-21T22:33:50.232 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 msgr2=0x7f42880a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 0x7f42880a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42940099a0 tx=0x7f4294009500 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 msgr2=0x7f42a4199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c02c650 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 shutdown_connections 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f42880a2b90 0x7f42880a5050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a4101120 0x7f42a41a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42a4100780 0x7f42a4199fc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 --2- 172.21.15.18:0/3315264740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a40ffe20 0x7f42a4199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 >> 172.21.15.18:0/3315264740 conn(0x7f42a40fba20 msgr2=0x7f42a40fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 shutdown_connections 2024-04-21T22:33:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.227+0000 7f42a8a00640 1 -- 172.21.15.18:0/3315264740 wait complete. 2024-04-21T22:33:50.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-21T22:33:50.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 -- 172.21.15.18:0/231895584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 msgr2=0x7eff14109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 --2- 172.21.15.18:0/231895584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff14109720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009be0 tx=0x7eff0c02bef0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 -- 172.21.15.18:0/231895584 shutdown_connections 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 --2- 172.21.15.18:0/231895584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff14109720 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 --2- 172.21.15.18:0/231895584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff14104a00 0x7eff14106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 --2- 172.21.15.18:0/231895584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff141020d0 0x7eff141044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 -- 172.21.15.18:0/231895584 >> 172.21.15.18:0/231895584 conn(0x7eff140fba20 msgr2=0x7eff140fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.441+0000 7eff1ae00640 1 -- 172.21.15.18:0/231895584 shutdown_connections 2024-04-21T22:33:50.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.442+0000 7eff1ae00640 1 -- 172.21.15.18:0/231895584 wait complete. 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 Processor -- start 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 -- start start 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff14104a00 0x7eff14100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff141005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7eff1410d290 con 0x7eff14104a00 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7eff1410d110 con 0x7eff14107330 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.443+0000 7eff1ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff1410d410 con 0x7eff141020d0 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff19a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff141005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff19000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff14104a00 0x7eff14100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff19a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56840/0 (socket says 172.21.15.18:56840) 2024-04-21T22:33:50.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff19a00640 1 -- 172.21.15.18:0/4097124289 learned_addr learned my addr 172.21.15.18:0/4097124289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 -- 172.21.15.18:0/4097124289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 msgr2=0x7eff14101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 -- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff14104a00 msgr2=0x7eff14100080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff14104a00 0x7eff14100080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 -- 172.21.15.18:0/4097124289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14100e50 con 0x7eff14107330 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff19a00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.444+0000 7eff1a400640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff141005c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02c430 tx=0x7eff0c0337b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.445+0000 7eff12000640 1 -- 172.21.15.18:0/4097124289 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c043020 con 0x7eff14107330 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.445+0000 7eff12000640 1 -- 172.21.15.18:0/4097124289 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0c02ca60 con 0x7eff14107330 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.445+0000 7eff12000640 1 -- 172.21.15.18:0/4097124289 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c034690 con 0x7eff14107330 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.445+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff141a1970 con 0x7eff14107330 2024-04-21T22:33:50.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.445+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff141a1f10 con 0x7eff14107330 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.450+0000 7eff1f1df740 1 Processor -- start 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.450+0000 7eff12000640 1 -- 172.21.15.18:0/4097124289 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7eff0c046020 con 0x7eff14107330 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.450+0000 7eff1f1df740 1 -- start start 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.450+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca13bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff1f1df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55740c90fdc0 con 0x55740ca0e6d0 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff1f1df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740c972ce0 con 0x55740ca0f0c0 2024-04-21T22:33:50.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff1f1df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55740c91b7c0 con 0x55740ca14230 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56934/0 (socket says 172.21.15.18:56934) 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca13bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19000640 1 -- 172.21.15.18:0/4081205683 learned_addr learned my addr 172.21.15.18:0/4081205683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19000640 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 -- 172.21.15.18:0/4081205683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 msgr2=0x55740ca166c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca166c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 -- 172.21.15.18:0/4081205683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 msgr2=0x55740ca0eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19a00640 1 -- 172.21.15.18:0/4081205683 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740c6872d0 con 0x55740ca0f0c0 2024-04-21T22:33:50.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.451+0000 7eff19000640 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff19a00640 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca13bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff08011510 tx=0x7eff080119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8971e143017008e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff06a00640 1 -- 172.21.15.18:0/4081205683 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0801e070 con 0x55740ca0f0c0 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff06a00640 1 -- 172.21.15.18:0/4081205683 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0800faa0 con 0x55740ca0f0c0 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff06a00640 1 -- 172.21.15.18:0/4081205683 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08019b60 con 0x55740ca0f0c0 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff12000640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 0x7efefc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.452+0000 7eff12000640 1 -- 172.21.15.18:0/4097124289 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7eff0c0f1560 con 0x7eff14107330 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff19000640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 0x7efefc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 -- 172.21.15.18:0/4081205683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 msgr2=0x55740ca13bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca13bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff08011510 tx=0x7eff080119d0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 -- 172.21.15.18:0/4081205683 shutdown_connections 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca13bc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 --2- 172.21.15.18:0/4081205683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca0eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 -- 172.21.15.18:0/4081205683 >> 172.21.15.18:0/4081205683 conn(0x55740ca09c40 msgr2=0x55740ca0a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff19000640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 0x7efefc0a50d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff00009710 tx=0x7eff00009830 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 -- 172.21.15.18:0/4081205683 shutdown_connections 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.453+0000 7eff1f1df740 1 -- 172.21.15.18:0/4081205683 wait complete. 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.454+0000 7eff1f1df740 1 -- start start 2024-04-21T22:33:50.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.454+0000 7eff1f1df740 1 Processor -- start 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca18fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca20010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55740c92ec10 con 0x55740ca0e6d0 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740c96eca0 con 0x55740ca0f0c0 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55740ca171e0 con 0x55740ca14230 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1f1df740 10 client.0 _ll_register_callbacks cb 0x55740c969e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff19a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff19a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56936/0 (socket says 172.21.15.18:56936) 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff19a00640 1 -- 172.21.15.18:0/3679360644 learned_addr learned my addr 172.21.15.18:0/3679360644 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff19000640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca18fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.455+0000 7eff1a400640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca20010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 -- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 msgr2=0x55740ca20010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca20010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 -- 172.21.15.18:0/3679360644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 msgr2=0x55740ca18fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca18fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 -- 172.21.15.18:0/3679360644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740c7516b0 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff1a400640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca20010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff19a00640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff08000c00 tx=0x7eff0800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bc06d9fddf49e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7efefb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08026030 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7eff08016070 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.456+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff0800faa0 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff0801e040 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7eff1f1df740 10 client.15117 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55740ca23380 con 0x55740ca0e6d0 2024-04-21T22:33:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0800faa0 con 0x55740ca0e6d0 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7eff08021030 con 0x55740ca0e6d0 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7eff1f1df740 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7eff1f1df740 10 client.15117 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.457+0000 7eff1f1df740 20 client.15117 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.458+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca257b0 0x55740ca26c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.458+0000 7eff1f1df740 4 client.15117 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.458+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55740c980220 con 0x55740ca257b0 2024-04-21T22:33:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.458+0000 7eff19000640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca257b0 0x55740ca26c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.459+0000 7eff19000640 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca257b0 0x55740ca26c20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22fae62b804f7241 server_cookie=f353497674aeab7b in_seq=0 out_seq=0 2024-04-21T22:33:50.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.459+0000 7efefb400640 10 client.15117 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:50.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7efefb400640 1 -- 172.21.15.18:0/3679360644 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55740c980220 con 0x55740ca257b0 2024-04-21T22:33:50.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7efefb400640 10 client.15117 handle_command_reply: tid=0 2024-04-21T22:33:50.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 client.15117 shutdown 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 msgr2=0x55740ca18a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff08000c00 tx=0x7eff0800f5c0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 shutdown_connections 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca257b0 0x55740ca26c20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca20010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca18fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 --2- 172.21.15.18:0/3679360644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca18a90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 >> 172.21.15.18:0/3679360644 conn(0x55740ca09c40 msgr2=0x55740ca08d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7efefb400640 0 client.15117 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 shutdown_connections 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 1 -- 172.21.15.18:0/3679360644 wait complete. 2024-04-21T22:33:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.460+0000 7eff1f1df740 20 client.15117 trim_cache size 0 max 16384 2024-04-21T22:33:50.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.480+0000 7eff1f1df740 1 Processor -- start 2024-04-21T22:33:50.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 -- start start 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0e6d0 0x55740ca0a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 0x55740ca1ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55740ca24f60 con 0x55740ca14230 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740ca25630 con 0x55740ca0e6d0 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1f1df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55740ca25d00 con 0x55740ca0f0c0 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56948/0 (socket says 172.21.15.18:56948) 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff1a400640 1 -- 172.21.15.18:0/650409326 learned_addr learned my addr 172.21.15.18:0/650409326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff19000640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 0x55740ca1ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.481+0000 7eff19a00640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0e6d0 0x55740ca0a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 -- 172.21.15.18:0/650409326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 msgr2=0x55740ca1ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 0x55740ca1ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 -- 172.21.15.18:0/650409326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0e6d0 msgr2=0x55740ca0a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0e6d0 0x55740ca0a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 -- 172.21.15.18:0/650409326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740ca21490 con 0x55740ca14230 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff19000640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 0x55740ca1ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff1a400640 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff0c004660 tx=0x7eff0c009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc52384302915aba server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff06000640 1 -- 172.21.15.18:0/650409326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0bd6a0 con 0x55740ca14230 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff06000640 1 -- 172.21.15.18:0/650409326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0c0be440 con 0x55740ca14230 2024-04-21T22:33:50.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.482+0000 7eff06000640 1 -- 172.21.15.18:0/650409326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ba3b0 con 0x55740ca14230 2024-04-21T22:33:50.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- 172.21.15.18:0/650409326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 msgr2=0x55740ca24730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff0c004660 tx=0x7eff0c009930 comp rx=0 tx=0).stop 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- 172.21.15.18:0/650409326 shutdown_connections 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca14230 0x55740ca24730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca0f0c0 0x55740ca1ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 --2- 172.21.15.18:0/650409326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0e6d0 0x55740ca0a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- 172.21.15.18:0/650409326 >> 172.21.15.18:0/650409326 conn(0x55740ca09c40 msgr2=0x55740ca08d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- 172.21.15.18:0/650409326 shutdown_connections 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- 172.21.15.18:0/650409326 wait complete. 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.483+0000 7eff1f1df740 1 -- start start 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 Processor -- start 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca1beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55740ca26aa0 con 0x55740ca0e6d0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55740ca263d0 con 0x55740ca0f0c0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55740ca27170 con 0x55740ca14230 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1f1df740 10 client.0 _ll_register_callbacks cb 0x7eff0801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff19a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff19a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56950/0 (socket says 172.21.15.18:56950) 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff19a00640 1 -- 172.21.15.18:0/1615787939 learned_addr learned my addr 172.21.15.18:0/1615787939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff19000640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca1beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.484+0000 7eff1a400640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 -- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 msgr2=0x55740ca1ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca1ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 -- 172.21.15.18:0/1615787939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 msgr2=0x55740ca1beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca1beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 -- 172.21.15.18:0/1615787939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740ca1f470 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff19a00640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff08011a10 tx=0x7eff0800f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef249b7adc33b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7efefb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08026040 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7eff08005070 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.485+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff0c0be440 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff08005290 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55740ca8b990 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff0c0be440 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7eff08021070 con 0x55740ca0e6d0 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 10 client.15123 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 20 client.15123 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca905a0 0x55740ca8f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 4 client.15123 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.486+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "status"}) -- 0x55740c97a570 con 0x55740ca905a0 2024-04-21T22:33:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7eff19000640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca905a0 0x55740ca8f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7eff19000640 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca905a0 0x55740ca8f2b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=73fa2cfe0b58baa1 server_cookie=5c31b6ba16e1a694 in_seq=0 out_seq=0 2024-04-21T22:33:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7efefb400640 10 client.15123 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7efefb400640 1 -- 172.21.15.18:0/1615787939 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55740c97a570 con 0x55740ca905a0 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7efefb400640 10 client.15123 handle_command_reply: tid=0 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.487+0000 7eff1f1df740 1 client.15123 shutdown 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 msgr2=0x55740ca1b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff08011a10 tx=0x7eff0800f860 comp rx=0 tx=0).stop 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 shutdown_connections 2024-04-21T22:33:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55740ca905a0 0x55740ca8f2b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55740ca14230 0x55740ca1ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55740ca0f0c0 0x55740ca1beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 --2- 172.21.15.18:0/1615787939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55740ca0e6d0 0x55740ca1b970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 >> 172.21.15.18:0/1615787939 conn(0x55740ca09c40 msgr2=0x55740ca084f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7efefb400640 0 client.15123 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 shutdown_connections 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 1 -- 172.21.15.18:0/1615787939 wait complete. 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.488+0000 7eff1f1df740 20 client.15123 trim_cache size 0 max 16384 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 2, 2024-04-21T22:33:50.492 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24538, 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 136.99032371800001, 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 167.397032298 2024-04-21T22:33:50.493 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 msgr2=0x7efefc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 0x7efefc0a50d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff00009710 tx=0x7eff00009830 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 msgr2=0x7eff141005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff141005c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02c430 tx=0x7eff0c0337b0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 shutdown_connections 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7efefc0a2c10 0x7efefc0a50d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff14107330 0x7eff141005c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff14104a00 0x7eff14100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 --2- 172.21.15.18:0/4097124289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141020d0 0x7eff14101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 >> 172.21.15.18:0/4097124289 conn(0x7eff140fba20 msgr2=0x7eff14102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 shutdown_connections 2024-04-21T22:33:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.489+0000 7eff1ae00640 1 -- 172.21.15.18:0/4097124289 wait complete. 2024-04-21T22:33:50.504 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:50 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/18821875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:50.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-21T22:33:50.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:50 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/18821875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:50.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:50 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/18821875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:33:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 -- 172.21.15.18:0/2804996543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0103990 msgr2=0x7f7fb0103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 --2- 172.21.15.18:0/2804996543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0103990 0x7f7fb0103db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009900 tx=0x7f7fa402bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 -- 172.21.15.18:0/2804996543 shutdown_connections 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 --2- 172.21.15.18:0/2804996543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 0x7f7fb010bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 --2- 172.21.15.18:0/2804996543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0104b80 0x7f7fb0105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 --2- 172.21.15.18:0/2804996543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0103990 0x7f7fb0103db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 -- 172.21.15.18:0/2804996543 >> 172.21.15.18:0/2804996543 conn(0x7f7fb00fef00 msgr2=0x7f7fb0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 -- 172.21.15.18:0/2804996543 shutdown_connections 2024-04-21T22:33:50.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.695+0000 7f7fb8000640 1 -- 172.21.15.18:0/2804996543 wait complete. 2024-04-21T22:33:50.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.696+0000 7f7fb8000640 1 Processor -- start 2024-04-21T22:33:50.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.696+0000 7f7fb8000640 1 -- start start 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 0x7f7fb0199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 0x7f7fb01a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010f650 con 0x7f7fb0104b80 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010f4d0 con 0x7f7fb0105540 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb8000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb010f7d0 con 0x7f7fb0103990 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56968/0 (socket says 172.21.15.18:56968) 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb4c00640 1 -- 172.21.15.18:0/205809351 learned_addr learned my addr 172.21.15.18:0/205809351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb6000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 0x7f7fb01a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb5600640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 0x7f7fb0199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb4c00640 1 -- 172.21.15.18:0/205809351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 msgr2=0x7f7fb0199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.697+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 0x7f7fb0199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb4c00640 1 -- 172.21.15.18:0/205809351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 msgr2=0x7f7fb01a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 0x7f7fb01a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb4c00640 1 -- 172.21.15.18:0/205809351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01a1920 con 0x7f7fb0104b80 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb5600640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 0x7f7fb0199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9f0 tx=0x7f7f9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fae000640 1 -- 172.21.15.18:0/205809351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00cd80 con 0x7f7fb0104b80 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fae000640 1 -- 172.21.15.18:0/205809351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f9c005500 con 0x7f7fb0104b80 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fae000640 1 -- 172.21.15.18:0/205809351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c010690 con 0x7f7fb0104b80 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb01a1c10 con 0x7f7fb0104b80 2024-04-21T22:33:50.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.698+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01a20e0 con 0x7f7fb0104b80 2024-04-21T22:33:50.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.701+0000 7f7fbae18740 1 Processor -- start 2024-04-21T22:33:50.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 -- start start 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f757918dc0 con 0x55f757a174f0 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f75797bce0 con 0x55f757a1d050 2024-04-21T22:33:50.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fbae18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f7579247c0 con 0x55f757a17ee0 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fb6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fb6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56976/0 (socket says 172.21.15.18:56976) 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fb6000640 1 -- 172.21.15.18:0/2515229841 learned_addr learned my addr 172.21.15.18:0/2515229841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.702+0000 7f7fb5600640 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 -- 172.21.15.18:0/2515229841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 msgr2=0x55f757a1c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a1c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 -- 172.21.15.18:0/2515229841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 msgr2=0x55f757a1f4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a1f4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 -- 172.21.15.18:0/2515229841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7576902d0 con 0x55f757a174f0 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fae000640 1 -- 172.21.15.18:0/205809351 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f9c0046c0 con 0x7f7fb0104b80 2024-04-21T22:33:50.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fb6000640 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8010370 tx=0x7f7fa8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fb99f682856a1f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fa2600640 1 -- 172.21.15.18:0/2515229841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8016070 con 0x55f757a174f0 2024-04-21T22:33:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fa2600640 1 -- 172.21.15.18:0/2515229841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa8004d20 con 0x55f757a174f0 2024-04-21T22:33:50.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.703+0000 7f7fa2600640 1 -- 172.21.15.18:0/2515229841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80053e0 con 0x55f757a174f0 2024-04-21T22:33:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fae000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 0x7f7f980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 -- 172.21.15.18:0/2515229841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 msgr2=0x55f757a17910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8010370 tx=0x7f7fa8010830 comp rx=0 tx=0).stop 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 -- 172.21.15.18:0/2515229841 shutdown_connections 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a1f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2515229841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a17910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fbae18740 1 -- 172.21.15.18:0/2515229841 >> 172.21.15.18:0/2515229841 conn(0x55f757a12a60 msgr2=0x55f757a12e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.704+0000 7f7fae000640 1 -- 172.21.15.18:0/205809351 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f7f9c0cf470 con 0x7f7fb0104b80 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.705+0000 7f7fb5600640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 0x7f7f980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.705+0000 7f7fbae18740 1 -- 172.21.15.18:0/2515229841 shutdown_connections 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.705+0000 7f7fbae18740 1 -- 172.21.15.18:0/2515229841 wait complete. 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.705+0000 7f7fbae18740 1 -- start start 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb5600640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 0x7f7f980a50d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402c170 tx=0x7f7fa402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 Processor -- start 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a21dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a28e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f757937c10 con 0x55f757a1d050 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f757977ca0 con 0x55f757a174f0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f757a20000 con 0x55f757a17ee0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fbae18740 10 client.0 _ll_register_callbacks cb 0x55f757972e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a28e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49876/0 (socket says 172.21.15.18:49876) 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb5600640 1 -- 172.21.15.18:0/250931284 learned_addr learned my addr 172.21.15.18:0/250931284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.706+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a21dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 -- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 msgr2=0x55f757a21dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a21dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 -- 172.21.15.18:0/250931284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 msgr2=0x55f757a21880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 -- 172.21.15.18:0/250931284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f75775a6b0 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb5600640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fb6000640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a28e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8010370 tx=0x7f7fa8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c039e67ab1b0a493 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7f96a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8029060 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa8004d20 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.707+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f7fa8003c80 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7fa8016070 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 10 client.15135 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f757a2c170 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa8004d20 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7fa800f040 con 0x55f757a1d050 2024-04-21T22:33:50.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 10 client.15135 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 10 client.15135 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 20 client.15135 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a2e3a0 0x55f757a2f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 4 client.15135 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.708+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f757989220 con 0x55f757a2e3a0 2024-04-21T22:33:50.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.709+0000 7f7fb5600640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a2e3a0 0x55f757a2f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.709+0000 7f7fb5600640 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a2e3a0 0x55f757a2f810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a09bf8ce3d6a077b server_cookie=9353853fd356a72a in_seq=0 out_seq=0 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.709+0000 7f7f96a00640 10 client.15135 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7f96a00640 1 -- 172.21.15.18:0/250931284 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f757989220 con 0x55f757a2e3a0 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7f96a00640 10 client.15135 handle_command_reply: tid=0 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 client.15135 shutdown 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 msgr2=0x55f757a28e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a28e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8010370 tx=0x7f7fa8004c70 comp rx=0 tx=0).stop 2024-04-21T22:33:50.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 shutdown_connections 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a2e3a0 0x55f757a2f810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a28e00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a21dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 --2- 172.21.15.18:0/250931284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a21880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.710+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 >> 172.21.15.18:0/250931284 conn(0x55f757a12a60 msgr2=0x55f757a11c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.711+0000 7f7f96a00640 0 client.15135 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.711+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 shutdown_connections 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.711+0000 7f7fbae18740 1 -- 172.21.15.18:0/250931284 wait complete. 2024-04-21T22:33:50.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.711+0000 7f7fbae18740 20 client.15135 trim_cache size 0 max 16384 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 Processor -- start 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 -- start start 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a28dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a19980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2db50 con 0x55f757a1d050 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2e220 con 0x55f757a174f0 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.730+0000 7f7fbae18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2e8f0 con 0x55f757a17ee0 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a28dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49882/0 (socket says 172.21.15.18:49882) 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a28dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56898/0 (socket says 172.21.15.18:56898) 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 -- 172.21.15.18:0/2399080431 learned_addr learned my addr 172.21.15.18:0/2399080431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb6000640 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a19980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 -- 172.21.15.18:0/2399080431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 msgr2=0x55f757a28dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a28dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 -- 172.21.15.18:0/2399080431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 msgr2=0x55f757a19980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a19980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb5600640 1 -- 172.21.15.18:0/2399080431 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f757a22720 con 0x55f757a174f0 2024-04-21T22:33:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.731+0000 7f7fb6000640 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a19980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.732+0000 7f7fb5600640 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402c7b0 tx=0x7f7fa4042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f3f24d2d818ffb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.732+0000 7f7fa1c00640 1 -- 172.21.15.18:0/2399080431 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa405e070 con 0x55f757a174f0 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.732+0000 7f7fa1c00640 1 -- 172.21.15.18:0/2399080431 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa40049c0 con 0x55f757a174f0 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.732+0000 7f7fa1c00640 1 -- 172.21.15.18:0/2399080431 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4046070 con 0x55f757a174f0 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- 172.21.15.18:0/2399080431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 msgr2=0x55f757a19440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402c7b0 tx=0x7f7fa4042000 comp rx=0 tx=0).stop 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- 172.21.15.18:0/2399080431 shutdown_connections 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a1d050 0x55f757a19980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a28dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 --2- 172.21.15.18:0/2399080431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a174f0 0x55f757a19440 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- 172.21.15.18:0/2399080431 >> 172.21.15.18:0/2399080431 conn(0x55f757a12a60 msgr2=0x55f757a203d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- 172.21.15.18:0/2399080431 shutdown_connections 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- 172.21.15.18:0/2399080431 wait complete. 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.733+0000 7f7fbae18740 1 -- start start 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 Processor -- start 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a26db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a92880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2f690 con 0x55f757a174f0 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2efc0 con 0x55f757a1d050 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f757a2fd60 con 0x55f757a17ee0 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fbae18740 10 client.0 _ll_register_callbacks cb 0x7f7fa4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fb4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56904/0 (socket says 172.21.15.18:56904) 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fb6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a92880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fb4c00640 1 -- 172.21.15.18:0/3354278615 learned_addr learned my addr 172.21.15.18:0/3354278615 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.734+0000 7f7fb5600640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a26db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 -- 172.21.15.18:0/3354278615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 msgr2=0x55f757a92880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a92880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 -- 172.21.15.18:0/3354278615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 msgr2=0x55f757a26db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a26db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 -- 172.21.15.18:0/3354278615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f757a92dc0 con 0x55f757a17ee0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb6000640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fb4c00640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c098080 tx=0x7f7f9c09b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=617af1451701b92e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7f96a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0b8070 con 0x55f757a17ee0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f7f9c0a4490 con 0x55f757a17ee0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa40049c0 con 0x55f757a17ee0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f9c0ab050 con 0x55f757a17ee0 2024-04-21T22:33:50.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fbae18740 10 client.25270 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.735+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f757a94050 con 0x55f757a17ee0 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fa40049c0 con 0x55f757a17ee0 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7f9c09b100 con 0x55f757a17ee0 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 10 client.25270 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 10 client.25270 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 20 client.25270 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a98c10 0x55f757a97920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 4 client.25270 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "status"}) -- 0x55f757983570 con 0x55f757a98c10 2024-04-21T22:33:50.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.736+0000 7f7fb5600640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a98c10 0x55f757a97920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7f96a00640 10 client.25270 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fb5600640 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a98c10 0x55f757a97920 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c59cf7d0724460c server_cookie=41e7dc8332de1111 in_seq=0 out_seq=0 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7f96a00640 1 -- 172.21.15.18:0/3354278615 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f757983570 con 0x55f757a98c10 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7f96a00640 10 client.25270 handle_command_reply: tid=0 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 client.25270 shutdown 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 msgr2=0x55f757a90330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c098080 tx=0x7f7f9c09b7f0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 shutdown_connections 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55f757a98c10 0x55f757a97920 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f757a1d050 0x55f757a92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f757a17ee0 0x55f757a90330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 --2- 172.21.15.18:0/3354278615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f757a174f0 0x55f757a26db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 >> 172.21.15.18:0/3354278615 conn(0x55f757a12a60 msgr2=0x55f757a203d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.737+0000 7f7f96a00640 0 client.25270 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 shutdown_connections 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fbae18740 1 -- 172.21.15.18:0/3354278615 wait complete. 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fbae18740 20 client.25270 trim_cache size 0 max 16384 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 1, 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24568, 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:50.742 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 137.84759170800001, 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 159.15541618099999 2024-04-21T22:33:50.743 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 msgr2=0x7f7f980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 0x7f7f980a50d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402c170 tx=0x7f7fa402df90 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 msgr2=0x7f7fb019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9f0 tx=0x7f7f9c00edf0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 shutdown_connections 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f7f980a2c10 0x7f7f980a50d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb0105540 0x7f7fb01a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fb0104b80 0x7f7fb019a250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 --2- 172.21.15.18:0/205809351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb0103990 0x7f7fb0199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.738+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 >> 172.21.15.18:0/205809351 conn(0x7f7fb00fef00 msgr2=0x7f7fb0107e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.739+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 shutdown_connections 2024-04-21T22:33:50.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.739+0000 7f7fb8000640 1 -- 172.21.15.18:0/205809351 wait complete. 2024-04-21T22:33:50.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 -- 172.21.15.18:0/2418605191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d700ffe20 msgr2=0x7f3d70100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 --2- 172.21.15.18:0/2418605191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d700ffe20 0x7f3d70100240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009860 tx=0x7f3d6402bb70 comp rx=0 tx=0).stop 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 -- 172.21.15.18:0/2418605191 shutdown_connections 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 --2- 172.21.15.18:0/2418605191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70101120 0x7f3d701015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 --2- 172.21.15.18:0/2418605191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 0x7f3d70100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 --2- 172.21.15.18:0/2418605191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d700ffe20 0x7f3d70100240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 -- 172.21.15.18:0/2418605191 >> 172.21.15.18:0/2418605191 conn(0x7f3d700fba20 msgr2=0x7f3d700fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 -- 172.21.15.18:0/2418605191 shutdown_connections 2024-04-21T22:33:50.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.952+0000 7f3d76a00640 1 -- 172.21.15.18:0/2418605191 wait complete. 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.953+0000 7f3d76a00640 1 Processor -- start 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.953+0000 7f3d76a00640 1 -- start start 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.953+0000 7f3d76a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.953+0000 7f3d76a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 0x7f3d7019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d76a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d70101120 0x7f3d701a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d76a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7010f410 con 0x7f3d700ffe20 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d76a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7010f290 con 0x7f3d70101120 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d76a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7010f590 con 0x7f3d70100780 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57014/0 (socket says 172.21.15.18:57014) 2024-04-21T22:33:50.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 -- 172.21.15.18:0/208143219 learned_addr learned my addr 172.21.15.18:0/208143219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d74c00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 0x7f3d7019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d76000640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d70101120 0x7f3d701a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 -- 172.21.15.18:0/208143219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 msgr2=0x7f3d7019a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 0x7f3d7019a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 -- 172.21.15.18:0/208143219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d70101120 msgr2=0x7f3d701a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d70101120 0x7f3d701a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 -- 172.21.15.18:0/208143219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d701a1760 con 0x7f3d700ffe20 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.954+0000 7f3d75600640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d64037040 tx=0x7f3d64034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.955+0000 7f3d6e000640 1 -- 172.21.15.18:0/208143219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64041020 con 0x7f3d700ffe20 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.955+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d701a19f0 con 0x7f3d700ffe20 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.955+0000 7f3d6e000640 1 -- 172.21.15.18:0/208143219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6402c9f0 con 0x7f3d700ffe20 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.955+0000 7f3d6e000640 1 -- 172.21.15.18:0/208143219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64039040 con 0x7f3d700ffe20 2024-04-21T22:33:50.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.955+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d701a1ee0 con 0x7f3d700ffe20 2024-04-21T22:33:50.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 Processor -- start 2024-04-21T22:33:50.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d6e000640 1 -- 172.21.15.18:0/208143219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3d64044020 con 0x7f3d700ffe20 2024-04-21T22:33:50.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 -- start start 2024-04-21T22:33:50.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcff0c0 0x55605bd03bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 0x55605bd066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55605bbffdc0 con 0x55605bcfe6d0 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55605bc62ce0 con 0x55605bcff0c0 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.958+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55605bc0b7c0 con 0x55605bd04230 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57024/0 (socket says 172.21.15.18:57024) 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 -- 172.21.15.18:0/832592233 learned_addr learned my addr 172.21.15.18:0/832592233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d74c00640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 0x55605bd066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d75600640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcff0c0 0x55605bd03bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 -- 172.21.15.18:0/832592233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 msgr2=0x55605bd066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 0x55605bd066c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 -- 172.21.15.18:0/832592233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcff0c0 msgr2=0x55605bd03bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcff0c0 0x55605bd03bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d76000640 1 -- 172.21.15.18:0/832592233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605b9772d0 con 0x55605bcfe6d0 2024-04-21T22:33:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.959+0000 7f3d74c00640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 0x55605bd066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d76000640 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009f60 tx=0x7f3d68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78add8c2d82e3566 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d6e000640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 0x7f3d580a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d5e600640 1 -- 172.21.15.18:0/832592233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6801d070 con 0x55605bcfe6d0 2024-04-21T22:33:50.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d5e600640 1 -- 172.21.15.18:0/832592233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6800dad0 con 0x55605bcfe6d0 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d6e000640 1 -- 172.21.15.18:0/208143219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3d640f09e0 con 0x7f3d700ffe20 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d5e600640 1 -- 172.21.15.18:0/832592233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68018bd0 con 0x55605bcfe6d0 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.960+0000 7f3d75600640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 0x7f3d580a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- 172.21.15.18:0/832592233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 msgr2=0x55605bcfeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009f60 tx=0x7f3d68009f90 comp rx=0 tx=0).stop 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d75600640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 0x7f3d580a5050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55605bcffb30 tx=0x7f3d640f6550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- 172.21.15.18:0/832592233 shutdown_connections 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bd04230 0x55605bd066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcff0c0 0x55605bd03bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/832592233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bcfeaf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- 172.21.15.18:0/832592233 >> 172.21.15.18:0/832592233 conn(0x55605bcf9c40 msgr2=0x55605bcfa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- 172.21.15.18:0/832592233 shutdown_connections 2024-04-21T22:33:50.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- 172.21.15.18:0/832592233 wait complete. 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.961+0000 7f3d7ac53740 1 -- start start 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 Processor -- start 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd08fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd10020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55605bc1ec10 con 0x55605bcfe6d0 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55605bc5eca0 con 0x55605bd04230 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55605bd071e0 con 0x55605bcff0c0 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d7ac53740 10 client.0 _ll_register_callbacks cb 0x55605bc59e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57040/0 (socket says 172.21.15.18:57040) 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d76000640 1 -- 172.21.15.18:0/4116713172 learned_addr learned my addr 172.21.15.18:0/4116713172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d76000640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd10020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.962+0000 7f3d74c00640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd08fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 -- 172.21.15.18:0/4116713172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 msgr2=0x55605bd08fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd08fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 -- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 msgr2=0x55605bd10020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd10020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 -- 172.21.15.18:0/4116713172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605ba416b0 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d76000640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800fd20 tx=0x7f3d68005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebe92670804cdcd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d52a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6801d070 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3d68018b00 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.963+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6800dad0 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d68018d00 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55605bd13390 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6800dad0 con 0x55605bcfe6d0 2024-04-21T22:33:50.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3d6800b040 con 0x55605bcfe6d0 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 10 client.15153 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 20 client.15153 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd15510 0x55605bd16980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 4 client.15153 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.964+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55605bc70220 con 0x55605bd15510 2024-04-21T22:33:50.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.965+0000 7f3d74c00640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd15510 0x55605bd16980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.965+0000 7f3d74c00640 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd15510 0x55605bd16980 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb3618134c03893 server_cookie=118a048e323a4eb0 in_seq=0 out_seq=0 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.965+0000 7f3d52a00640 10 client.15153 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.966+0000 7f3d52a00640 1 -- 172.21.15.18:0/4116713172 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55605bc70220 con 0x55605bd15510 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.966+0000 7f3d52a00640 10 client.15153 handle_command_reply: tid=0 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.966+0000 7f3d7ac53740 1 client.15153 shutdown 2024-04-21T22:33:50.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 msgr2=0x55605bd08aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800fd20 tx=0x7f3d68005ac0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 shutdown_connections 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd10020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd15510 0x55605bd16980 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd08fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/4116713172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd08aa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d52a00640 0 client.15153 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 >> 172.21.15.18:0/4116713172 conn(0x55605bcf9c40 msgr2=0x55605bcf8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 shutdown_connections 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 1 -- 172.21.15.18:0/4116713172 wait complete. 2024-04-21T22:33:50.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.967+0000 7f3d7ac53740 20 client.15153 trim_cache size 0 max 16384 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 Processor -- start 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 -- start start 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55605bd14cc0 con 0x55605bcfe6d0 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55605bd15390 con 0x55605bd04230 2024-04-21T22:33:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.986+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55605bd15a60 con 0x55605bcff0c0 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57054/0 (socket says 172.21.15.18:57054) 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 -- 172.21.15.18:0/3631772709 learned_addr learned my addr 172.21.15.18:0/3631772709 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d74c00640 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 -- 172.21.15.18:0/3631772709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 msgr2=0x55605bd0ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 -- 172.21.15.18:0/3631772709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 msgr2=0x55605bd086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 -- 172.21.15.18:0/3631772709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55605bcfe310 con 0x55605bcfe6d0 2024-04-21T22:33:50.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d76000640 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d68032fd0 tx=0x7f3d68005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645cd61b046763ff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.987+0000 7f3d5dc00640 1 -- 172.21.15.18:0/3631772709 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6801d040 con 0x55605bcfe6d0 2024-04-21T22:33:50.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d5dc00640 1 -- 172.21.15.18:0/3631772709 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d68039070 con 0x55605bcfe6d0 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d5dc00640 1 -- 172.21.15.18:0/3631772709 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d680096d0 con 0x55605bcfe6d0 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3631772709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 msgr2=0x55605bd07580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d68032fd0 tx=0x7f3d68005a10 comp rx=0 tx=0).stop 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3631772709 shutdown_connections 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bd04230 0x55605bd086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3631772709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bcfe6d0 0x55605bd07580 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3631772709 >> 172.21.15.18:0/3631772709 conn(0x55605bcf9c40 msgr2=0x55605bcfa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3631772709 shutdown_connections 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.988+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3631772709 wait complete. 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 -- start start 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 Processor -- start 2024-04-21T22:33:50.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 0x55605bd0b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bd04230 0x55605bd0ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55605bd16800 con 0x55605bd04230 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55605bd16130 con 0x55605bcfe6d0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55605bd16ed0 con 0x55605bcff0c0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.989+0000 7f3d7ac53740 10 client.0 _ll_register_callbacks cb 0x7f3d6801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bd04230 0x55605bd0ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d76000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 0x55605bd0b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d76000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 0x55605bd0b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49922/0 (socket says 172.21.15.18:49922) 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d76000640 1 -- 172.21.15.18:0/3460487603 learned_addr learned my addr 172.21.15.18:0/3460487603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 -- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 msgr2=0x55605bd0b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 0x55605bd0b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 -- 172.21.15.18:0/3460487603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bd04230 msgr2=0x55605bd0ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bd04230 0x55605bd0ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 -- 172.21.15.18:0/3460487603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605bd0f3d0 con 0x55605bcff0c0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d74c00640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0bdc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55605bd17310 tx=0x7f3d600109b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488c4b93433b6281 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.990+0000 7f3d52a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60020600 con 0x55605bcff0c0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d68039070 con 0x55605bcff0c0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3d600207a0 con 0x55605bcff0c0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d60005020 con 0x55605bcff0c0 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 10 client.25288 fetch_fsmap learned FSMap version 27 2024-04-21T22:33:50.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55605bd7b770 con 0x55605bcff0c0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d68039070 con 0x55605bcff0c0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3d60028450 con 0x55605bcff0c0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 10 client.25288 fetch_fsmap finished waiting for FSMap version 27 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 10 client.25288 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 20 client.25288 populate_metadata read hostname 'smithi018' 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd803c0 0x55605bd7f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 4 client.25288 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.991+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "status"}) -- 0x55605bc6a570 con 0x55605bd803c0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.992+0000 7f3d76000640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd803c0 0x55605bd7f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.992+0000 7f3d76000640 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd803c0 0x55605bd7f0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac9015e59cf8702 server_cookie=182bc936649f67b3 in_seq=0 out_seq=0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.992+0000 7f3d52a00640 10 client.25288 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.992+0000 7f3d52a00640 1 -- 172.21.15.18:0/3460487603 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55605bc6a570 con 0x55605bd803c0 2024-04-21T22:33:50.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.992+0000 7f3d52a00640 10 client.25288 handle_command_reply: tid=0 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 client.25288 shutdown 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 msgr2=0x55605bd0bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0bdc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55605bd17310 tx=0x7f3d600109b0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 shutdown_connections 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55605bd04230 0x55605bd0ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55605bd803c0 0x55605bd7f0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55605bcff0c0 0x55605bd0bdc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 --2- 172.21.15.18:0/3460487603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55605bcfe6d0 0x55605bd0b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d52a00640 0 client.25288 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 >> 172.21.15.18:0/3460487603 conn(0x55605bcf9c40 msgr2=0x55605bd07580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 shutdown_connections 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 1 -- 172.21.15.18:0/3460487603 wait complete. 2024-04-21T22:33:50.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.993+0000 7f3d7ac53740 20 client.25288 trim_cache size 0 max 16384 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "6ef0a334-002d-11ef-bc93-c7b262605968", 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 24596, 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 141.14243465199999, 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 27, 2024-04-21T22:33:50.999 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 87, 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 85, 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 148.00663417000001 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 msgr2=0x7f3d580a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 0x7f3d580a5050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55605bcffb30 tx=0x7f3d640f6550 comp rx=0 tx=0).stop 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 msgr2=0x7f3d70199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3d64037040 tx=0x7f3d64034760 comp rx=0 tx=0).stop 2024-04-21T22:33:51.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 shutdown_connections 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3d580a2b90 0x7f3d580a5050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d70101120 0x7f3d701a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d70100780 0x7f3d7019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 --2- 172.21.15.18:0/208143219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d700ffe20 0x7f3d70199b40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 >> 172.21.15.18:0/208143219 conn(0x7f3d700fba20 msgr2=0x7f3d700fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 shutdown_connections 2024-04-21T22:33:51.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:50.994+0000 7f3d76a00640 1 -- 172.21.15.18:0/208143219 wait complete. 2024-04-21T22:33:51.009 INFO:teuthology.run_tasks:Running task sequential... 2024-04-21T22:33:51.020 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-21T22:33:51.020 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-21T22:33:51.020 INFO:teuthology.task.print:Enabling mgr modules 2024-04-21T22:33:51.020 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-21T22:33:51.021 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T22:33:51.021 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:33:51.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-21T22:33:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 -- 172.21.15.18:0/331886226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17300ffe60 msgr2=0x7f1730100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 --2- 172.21.15.18:0/331886226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17300ffe60 0x7f1730100280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1720009900 tx=0x7f172002bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 -- 172.21.15.18:0/331886226 shutdown_connections 2024-04-21T22:33:51.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 --2- 172.21.15.18:0/331886226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1730101160 0x7f17301015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 --2- 172.21.15.18:0/331886226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17301007c0 0x7f1730100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 --2- 172.21.15.18:0/331886226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17300ffe60 0x7f1730100280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 -- 172.21.15.18:0/331886226 >> 172.21.15.18:0/331886226 conn(0x7f17300fba20 msgr2=0x7f17300fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.209+0000 7f1735600640 1 -- 172.21.15.18:0/331886226 shutdown_connections 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.210+0000 7f1735600640 1 -- 172.21.15.18:0/331886226 wait complete. 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 Processor -- start 2024-04-21T22:33:51.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 -- start start 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1730101160 0x7f17301a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f173010f450 con 0x7f17301007c0 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f173010f2d0 con 0x7f1730101160 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.211+0000 7f1735600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f173010f5d0 con 0x7f17300ffe60 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:56982/0 (socket says 172.21.15.18:56982) 2024-04-21T22:33:51.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57094/0 (socket says 172.21.15.18:57094) 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172fe00640 1 -- 172.21.15.18:0/371021596 learned_addr learned my addr 172.21.15.18:0/371021596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f1734c00640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1730101160 0x7f17301a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 -- 172.21.15.18:0/371021596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 msgr2=0x7f1730199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 -- 172.21.15.18:0/371021596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1730101160 msgr2=0x7f17301a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1730101160 0x7f17301a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 -- 172.21.15.18:0/371021596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301a16f0 con 0x7f17301007c0 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172fe00640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:51.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.212+0000 7f172f400640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9f0 tx=0x7f171800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.213+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171800ccc0 con 0x7f17301007c0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.213+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1718005020 con 0x7f17301007c0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.213+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17301a19e0 con 0x7f17301007c0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.213+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718004a00 con 0x7f17301007c0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.213+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a1ee0 con 0x7f17301007c0 2024-04-21T22:33:51.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.214+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173010ad90 con 0x7f17301007c0 2024-04-21T22:33:51.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.216+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17180051d0 con 0x7f17301007c0 2024-04-21T22:33:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.218+0000 7f172cc00640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 0x7f17100a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.218+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f17180ceff0 con 0x7f17301007c0 2024-04-21T22:33:51.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.219+0000 7f172fe00640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 0x7f17100a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:51.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.219+0000 7f172fe00640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 0x7f17100a5030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f172002c880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:51.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.223+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f171809bed0 con 0x7f17301007c0 2024-04-21T22:33:51.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:51.482+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f1730062340 con 0x7f17301007c0 2024-04-21T22:33:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:51 smithi081 ceph-mon[31692]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:51 smithi047 ceph-mon[31561]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:51 smithi018 ceph-mon[26614]: pgmap v394: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-21T22:33:52.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.362+0000 7f172cc00640 1 -- 172.21.15.18:0/371021596 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f171809b7d0 con 0x7f17301007c0 2024-04-21T22:33:52.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.366+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 msgr2=0x7f17100a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.366+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 0x7f17100a5030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f172002c880 comp rx=0 tx=0).stop 2024-04-21T22:33:52.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.366+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 msgr2=0x7f173019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.366+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f171800e9f0 tx=0x7f171800edf0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 shutdown_connections 2024-04-21T22:33:52.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f17100a2b70 0x7f17100a5030 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1730101160 0x7f17301a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17301007c0 0x7f173019a010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 --2- 172.21.15.18:0/371021596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300ffe60 0x7f1730199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.367+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 >> 172.21.15.18:0/371021596 conn(0x7f17300fba20 msgr2=0x7f17300fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:52.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.370+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 shutdown_connections 2024-04-21T22:33:52.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.370+0000 7f1735600640 1 -- 172.21.15.18:0/371021596 wait complete. 2024-04-21T22:33:52.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-21T22:33:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 -- 172.21.15.18:0/61207179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d0104bc0 msgr2=0x7f70d0105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 --2- 172.21.15.18:0/61207179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d0104bc0 0x7f70d0105040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009900 tx=0x7f70b802bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 -- 172.21.15.18:0/61207179 shutdown_connections 2024-04-21T22:33:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 --2- 172.21.15.18:0/61207179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0105580 0x7f70d010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 --2- 172.21.15.18:0/61207179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d0104bc0 0x7f70d0105040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 --2- 172.21.15.18:0/61207179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d01039d0 0x7f70d0103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 -- 172.21.15.18:0/61207179 >> 172.21.15.18:0/61207179 conn(0x7f70d00fef60 msgr2=0x7f70d0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 -- 172.21.15.18:0/61207179 shutdown_connections 2024-04-21T22:33:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.582+0000 7f70d5000640 1 -- 172.21.15.18:0/61207179 wait complete. 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.583+0000 7f70d5000640 1 Processor -- start 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.583+0000 7f70d5000640 1 -- start start 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0104bc0 0x7f70d019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 0x7f70d01a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70d010f680 con 0x7f70d0104bc0 2024-04-21T22:33:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70d010f500 con 0x7f70d01039d0 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70d5000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70d010f800 con 0x7f70d0105580 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49980/0 (socket says 172.21.15.18:49980) 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 -- 172.21.15.18:0/3597705424 learned_addr learned my addr 172.21.15.18:0/3597705424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70c5400640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0104bc0 0x7f70d019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70ce800640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 0x7f70d01a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 msgr2=0x7f70d01a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 0x7f70d01a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0104bc0 msgr2=0x7f70d019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0104bc0 0x7f70d019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70cde00640 1 -- 172.21.15.18:0/3597705424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d01a18d0 con 0x7f70d01039d0 2024-04-21T22:33:52.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.584+0000 7f70ce800640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 0x7f70d01a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70cde00640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70c000ebc0 tx=0x7f70c000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0003b70 con 0x7f70d01039d0 2024-04-21T22:33:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70c0003d10 con 0x7f70d01039d0 2024-04-21T22:33:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d01a1bc0 con 0x7f70d01039d0 2024-04-21T22:33:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0019980 con 0x7f70d01039d0 2024-04-21T22:33:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.585+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d01a2130 con 0x7f70d01039d0 2024-04-21T22:33:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.586+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d010acf0 con 0x7f70d01039d0 2024-04-21T22:33:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.588+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f70c0019b20 con 0x7f70d01039d0 2024-04-21T22:33:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.589+0000 7f70c7400640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 0x7f70b40a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.590+0000 7f70c5400640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 msgr2=0x7f70b40a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.590+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f70c00cf8b0 con 0x7f70d01039d0 2024-04-21T22:33:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.590+0000 7f70c5400640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 0x7f70b40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:33:52.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.593+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f70c009c790 con 0x7f70d01039d0 2024-04-21T22:33:52.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T22:33:52.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: ignoring --setuser ceph since I am not root 2024-04-21T22:33:52.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: ignoring --setgroup ceph since I am not root 2024-04-21T22:33:52.639 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-mgr[33559]: -- 172.21.15.81:0/3317142257 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565016c2a5a0 con 0x565016bff000 2024-04-21T22:33:52.639 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:52.544+0000 7f97621d0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:33:52.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T22:33:52.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: ignoring --setuser ceph since I am not root 2024-04-21T22:33:52.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: ignoring --setgroup ceph since I am not root 2024-04-21T22:33:52.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-mgr[32955]: -- 172.21.15.47:0/2382030289 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d9855c5a0 con 0x561d98530800 2024-04-21T22:33:52.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:52.555+0000 7fbf07132200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:33:52.725 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:52 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-21T22:33:52.725 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setuser ceph since I am not root 2024-04-21T22:33:52.726 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: ignoring --setgroup ceph since I am not root 2024-04-21T22:33:52.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.791+0000 7f70c5400640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 msgr2=0x7f70b40a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:52.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.791+0000 7f70c5400640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 0x7f70b40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:33:52.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.828+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f70d002d170 con 0x7f70d01039d0 2024-04-21T22:33:52.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.834+0000 7f70c7400640 1 -- 172.21.15.18:0/3597705424 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f70c009c090 con 0x7f70d01039d0 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 msgr2=0x7f70b40a5110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 0x7f70b40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 msgr2=0x7f70d0199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70c000ebc0 tx=0x7f70c000c6a0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 shutdown_connections 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f70b40a2c50 0x7f70b40a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70d0105580 0x7f70d01a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d0104bc0 0x7f70d019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 --2- 172.21.15.18:0/3597705424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70d01039d0 0x7f70d0199c90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:52.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 >> 172.21.15.18:0/3597705424 conn(0x7f70d00fef60 msgr2=0x7f70d0107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 shutdown_connections 2024-04-21T22:33:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:52.838+0000 7f70d5000640 1 -- 172.21.15.18:0/3597705424 wait complete. 2024-04-21T22:33:52.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-21T22:33:52.991 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:52.725+0000 7f6930b1d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 -- 172.21.15.18:0/2972985192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac4102070 msgr2=0x7f3ac4104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/2972985192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac4102070 0x7f3ac4104460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009900 tx=0x7f3ab802bc30 comp rx=0 tx=0).stop 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 -- 172.21.15.18:0/2972985192 shutdown_connections 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/2972985192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41072d0 0x7f3ac4109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/2972985192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac41049a0 0x7f3ac4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/2972985192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac4102070 0x7f3ac4104460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 -- 172.21.15.18:0/2972985192 >> 172.21.15.18:0/2972985192 conn(0x7f3ac40fba20 msgr2=0x7f3ac40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 -- 172.21.15.18:0/2972985192 shutdown_connections 2024-04-21T22:33:53.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.059+0000 7f3ac9e00640 1 -- 172.21.15.18:0/2972985192 wait complete. 2024-04-21T22:33:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.060+0000 7f3ac9e00640 1 Processor -- start 2024-04-21T22:33:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.060+0000 7f3ac9e00640 1 -- start start 2024-04-21T22:33:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 0x7f3ac419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:53.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 0x7f3ac41a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410d280 con 0x7f3ac4102070 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410d100 con 0x7f3ac41072d0 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac410d400 con 0x7f3ac41049a0 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 0x7f3ac41a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57138/0 (socket says 172.21.15.18:57138) 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac8a00640 1 -- 172.21.15.18:0/1225277247 learned_addr learned my addr 172.21.15.18:0/1225277247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac3e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 0x7f3ac419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 msgr2=0x7f3ac419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 0x7f3ac419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 msgr2=0x7f3ac4199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac9400640 1 -- 172.21.15.18:0/1225277247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac41a1730 con 0x7f3ac41072d0 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac3e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 0x7f3ac419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.061+0000 7f3ac8a00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac9400640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 0x7f3ac41a10c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009fd0 tx=0x7f3abc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00ce20 con 0x7f3ac41072d0 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3abc005020 con 0x7f3ac41072d0 2024-04-21T22:33:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc010720 con 0x7f3ac41072d0 2024-04-21T22:33:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac41a1a20 con 0x7f3ac41072d0 2024-04-21T22:33:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.062+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac41a1f70 con 0x7f3ac41072d0 2024-04-21T22:33:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.064+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac4108e20 con 0x7f3ac41072d0 2024-04-21T22:33:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.065+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f3abc005540 con 0x7f3ac41072d0 2024-04-21T22:33:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.067+0000 7f3ac1600640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 0x7f3aac0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.067+0000 7f3ac8a00640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 msgr2=0x7f3aac0a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.067+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f3abc0cf720 con 0x7f3ac41072d0 2024-04-21T22:33:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.067+0000 7f3ac8a00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 0x7f3aac0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:33:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.070+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f3abc09c600 con 0x7f3ac41072d0 2024-04-21T22:33:53.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:52.727+0000 7f97621d0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:53.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:52.829+0000 7f97621d0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:33:53.176 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:52.747+0000 7fbf07132200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:53.176 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:52.854+0000 7fbf07132200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:33:53.177 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:53.176+0000 7fbf07132200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:33:53.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.268+0000 7f3ac8a00640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 msgr2=0x7f3aac0a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:53.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.268+0000 7f3ac8a00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 0x7f3aac0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:33:53.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.274+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3ac4062340 con 0x7f3ac41072d0 2024-04-21T22:33:53.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.280+0000 7f3ac1600640 1 -- 172.21.15.18:0/1225277247 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f3abc09bf00 con 0x7f3ac41072d0 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 msgr2=0x7f3aac0a5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 0x7f3aac0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 msgr2=0x7f3ac41a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 0x7f3ac41a10c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009fd0 tx=0x7f3abc00ef10 comp rx=0 tx=0).stop 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 shutdown_connections 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f3aac0a2bc0 0x7f3aac0a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac41072d0 0x7f3ac41a10c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac41049a0 0x7f3ac419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 --2- 172.21.15.18:0/1225277247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac4102070 0x7f3ac4199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 >> 172.21.15.18:0/1225277247 conn(0x7f3ac40fba20 msgr2=0x7f3ac4101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 shutdown_connections 2024-04-21T22:33:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:53.283+0000 7f3ac9e00640 1 -- 172.21.15.18:0/1225277247 wait complete. 2024-04-21T22:33:53.298 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:52.990+0000 7f6930b1d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:53.298 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:53.131+0000 7f6930b1d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T22:33:53.301 INFO:teuthology.run_tasks:Running task kclient... 2024-04-21T22:33:53.325 INFO:tasks.kclient:Mounting kernel clients... 2024-04-21T22:33:53.325 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-21T22:33:53.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:53.326 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-21T22:33:53.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:53.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-21T22:33:53.444 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:53.265+0000 7fbf07132200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:33:53.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T22:33:53.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-mon[31561]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-21T22:33:53.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:53 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.445 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-04-21T22:33:53.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:33:53.448 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-04-21T22:33:53.449 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-21T22:33:53.449 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T22:33:53.449 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-21T22:33:53.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T22:33:53.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-mon[26614]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-21T22:33:53.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:53.137+0000 7f97621d0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:33:53.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:53.221+0000 7f97621d0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:33:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/371021596' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-21T22:33:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-mon[31692]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-21T22:33:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:53 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' 2024-04-21T22:33:53.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:53.548+0000 7f6930b1d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T22:33:53.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:53 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:53.666+0000 7f6930b1d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T22:33:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:33:54.747 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:54.407+0000 7f97621d0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:33:54.747 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:54.577+0000 7f97621d0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:33:54.748 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:54.746+0000 7f97621d0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:33:54.868 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:54 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:54.513+0000 7fbf07132200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:33:54.869 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:54 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:54.691+0000 7fbf07132200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:33:54.869 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:54 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:54.868+0000 7fbf07132200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:33:55.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:55.032+0000 7f97621d0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:33:55.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:55.124+0000 7f97621d0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:33:55.326 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:55.325+0000 7f97621d0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:33:55.444 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:55 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:55.169+0000 7fbf07132200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:33:55.444 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:55 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:55.265+0000 7fbf07132200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:33:55.551 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:55 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:55.289+0000 7f6930b1d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T22:33:55.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:55.517+0000 7f97621d0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:55.820 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:55 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:55.551+0000 7f6930b1d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T22:33:55.820 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:55 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:55.793+0000 7f6930b1d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T22:33:55.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:55 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:55.476+0000 7fbf07132200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:33:55.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:55 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:55.678+0000 7fbf07132200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 -- 172.21.15.18:0/2157899266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc10a4d0 msgr2=0x7f06dc10a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 --2- 172.21.15.18:0/2157899266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc10a4d0 0x7f06dc10a8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0098f0 tx=0x7f06cc009c00 comp rx=0 tx=0).stop 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 -- 172.21.15.18:0/2157899266 shutdown_connections 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 --2- 172.21.15.18:0/2157899266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc104e00 0x7f06dc111310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 --2- 172.21.15.18:0/2157899266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc10a4d0 0x7f06dc10a8b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 --2- 172.21.15.18:0/2157899266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104440 0x7f06dc1048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 -- 172.21.15.18:0/2157899266 >> 172.21.15.18:0/2157899266 conn(0x7f06dc0fff30 msgr2=0x7f06dc102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.141+0000 7f06e1a00700 1 -- 172.21.15.18:0/2157899266 shutdown_connections 2024-04-21T22:33:56.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.142+0000 7f06e1a00700 1 -- 172.21.15.18:0/2157899266 wait complete. 2024-04-21T22:33:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.143+0000 7f06e1a00700 1 Processor -- start 2024-04-21T22:33:56.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.143+0000 7f06e1a00700 1 -- start start 2024-04-21T22:33:56.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:56.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104e00 0x7f06dc1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:56.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 0x7f06dc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:56.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc114780 con 0x7f06dc104e00 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc114600 con 0x7f06dc104440 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06e1a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc114900 con 0x7f06dc10a4d0 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39682/0 (socket says 172.21.15.18:39682) 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 -- 172.21.15.18:0/4213934136 learned_addr learned my addr 172.21.15.18:0/4213934136 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06da000700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104e00 0x7f06dc1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06db400700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 0x7f06dc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 msgr2=0x7f06dc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 0x7f06dc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104e00 msgr2=0x7f06dc1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104e00 0x7f06dc1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06daa00700 1 -- 172.21.15.18:0/4213934136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc19b200 con 0x7f06dc104440 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.144+0000 7f06db400700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 0x7f06dc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:33:56.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06daa00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005950 tx=0x7f06cc00fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:33:56.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0051f0 con 0x7f06dc104440 2024-04-21T22:33:56.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc19b490 con 0x7f06dc104440 2024-04-21T22:33:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06cc00b560 con 0x7f06dc104440 2024-04-21T22:33:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc003ba0 con 0x7f06dc104440 2024-04-21T22:33:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.145+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc1a77b0 con 0x7f06dc104440 2024-04-21T22:33:56.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.146+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc10c9d0 con 0x7f06dc104440 2024-04-21T22:33:56.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.148+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f06cc00ba80 con 0x7f06dc104440 2024-04-21T22:33:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.150+0000 7f06d3400700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 0x7f06c00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:33:56.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.150+0000 7f06da000700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 msgr2=0x7f06c00a5130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.150+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7f06cc0d0080 con 0x7f06dc104440 2024-04-21T22:33:56.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.151+0000 7f06da000700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 0x7f06c00a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:33:56.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.153+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f06cc013030 con 0x7f06dc104440 2024-04-21T22:33:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.352+0000 7f06da000700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 msgr2=0x7f06c00a5130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:33:56.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.352+0000 7f06da000700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 0x7f06c00a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:33:56.388 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:56.115+0000 7f97621d0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:33:56.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.429+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06dc19bfd0 con 0x7f06dc104440 2024-04-21T22:33:56.429 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:56.213+0000 7f6930b1d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T22:33:56.430 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:56.342+0000 7f6930b1d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T22:33:56.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.430+0000 7f06d3400700 1 -- 172.21.15.18:0/4213934136 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f06cc09d050 con 0x7f06dc104440 2024-04-21T22:33:56.430 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-21T22:33:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.432+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 msgr2=0x7f06c00a5130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:33:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.432+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 0x7f06c00a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 msgr2=0x7f06dc1a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:33:56.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005950 tx=0x7f06cc00fb20 comp rx=0 tx=0).stop 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 shutdown_connections 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06dc10a4d0 0x7f06dc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7f06c00a2c70 0x7f06c00a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06dc104440 0x7f06dc1a08e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 --2- 172.21.15.18:0/4213934136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc104e00 0x7f06dc1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:33:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 >> 172.21.15.18:0/4213934136 conn(0x7f06dc0fff30 msgr2=0x7f06dc1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:33:56.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 shutdown_connections 2024-04-21T22:33:56.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:56.433+0000 7f06e1a00700 1 -- 172.21.15.18:0/4213934136 wait complete. 2024-04-21T22:33:56.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:56 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4213934136' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T22:33:56.695 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:56.306+0000 7fbf07132200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:33:56.833 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:56 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4213934136' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T22:33:56.834 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:56.536+0000 7f97621d0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:33:56.834 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:56.632+0000 7f97621d0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:33:56.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:56 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4213934136' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-21T22:33:56.845 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:56.615+0000 7f6930b1d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T22:33:57.056 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:56.747+0000 7fbf07132200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:33:57.056 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:56.847+0000 7fbf07132200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:33:57.056 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:57.056+0000 7fbf07132200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:33:57.138 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:56.832+0000 7f97621d0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:33:57.345 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:56.881+0000 7f6930b1d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T22:33:57.405 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-21T22:33:57.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-21T22:33:57.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-21T22:33:57.406 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-21T22:33:57.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:57.406 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:33:57.455 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41953sec preferred_lft 41953sec 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link noprefixroute 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-21T22:33:57.456 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-21T22:33:57.457 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-21T22:33:57.458 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-21T22:33:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:33:57.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:57.348+0000 7f97621d0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:33:57.638 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:57.438+0000 7f97621d0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:33:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:33:57.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:57.943 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-21T22:33:57.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:57.601+0000 7fbf07132200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:33:57.944 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:57.697+0000 7fbf07132200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:33:57.962 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:57 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:57.709+0000 7f6930b1d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-21T22:33:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-21T22:33:58.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:58.011 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-21T22:33:58.023 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:57.678+0000 7f97621d0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:33:58.023 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:57.811+0000 7f97621d0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:33:58.023 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:57.907+0000 7f97621d0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:33:58.109 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-21T22:33:58.109 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-21T22:33:58.109 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-21T22:33:58.109 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-21T22:33:58.109 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-21T22:33:58.110 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-21T22:33:58.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:33:58.309 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:57.951+0000 7fbf07132200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:33:58.309 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:58.089+0000 7fbf07132200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:33:58.309 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:58.189+0000 7fbf07132200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:33:58.309 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:58.309+0000 7fbf07132200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:33:58.388 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:58.022+0000 7f97621d0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:33:58.388 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:58.113+0000 7f97621d0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:33:58.477 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:58.330+0000 7f6930b1d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T22:33:58.477 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:58.477+0000 7f6930b1d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T22:33:58.694 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:58.404+0000 7fbf07132200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:33:58.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:33:58.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:58.867 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-21T22:33:58.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:58.917 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-21T22:33:59.010 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:33:59.010 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-21T22:33:59.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:33:59.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-21T22:33:59.010 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-21T22:33:59.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:58.759+0000 7f6930b1d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-21T22:33:59.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:33:59.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:33:59.192 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-21T22:33:59.192 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-21T22:33:59.200 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:58.918+0000 7f97621d0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:33:59.200 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z[33500]: 2024-04-21T22:33:59.130+0000 7f97621d0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:33:59.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: Standby manager daemon z restarted 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: Standby manager daemon z started 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:33:59.390 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:33:59.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:33:59.466 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T22:33:59.466 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-21T22:33:59.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-21T22:33:59.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-21T22:33:59.466 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: Standby manager daemon z restarted 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: Standby manager daemon z started 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:33:59.477 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:33:59.478 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:59.254+0000 7fbf07132200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:33:59.478 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:33:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y[32951]: 2024-04-21T22:33:59.477+0000 7fbf07132200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:33:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:33:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: Standby manager daemon z restarted 2024-04-21T22:33:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: Standby manager daemon z started 2024-04-21T22:33:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-21T22:33:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:33:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-21T22:33:59.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:33:59 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.81:0/3794079920' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:33:59.649 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:59.463+0000 7f6930b1d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T22:33:59.649 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:59.597+0000 7f6930b1d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T22:33:59.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:33:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:33:59.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T22:33:59.663 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-21T22:33:59.701 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-21T22:33:59.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T22:33:59.701 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-21T22:33:59.792 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-21T22:33:59.792 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-21T22:33:59.792 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/d6410d01-5098-4c61-a72a-04923b90ffe5 2024-04-21T22:33:59.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:33:59.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/d6410d01-5098-4c61-a72a-04923b90ffe5 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-21T22:33:59.903 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-21T22:33:59.904 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-21T22:34:00.194 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:33:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:33:59.938+0000 7f6930b1d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T22:34:00.194 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:00.132+0000 7f6930b1d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: Standby manager daemon y restarted 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: Standby manager daemon y started 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-mon[26614]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:00.271+0000 7f6930b1d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:00.435+0000 7f6930b1d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T22:34:00.578 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:00.576+0000 7f6930b1d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T22:34:00.637 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-21T22:34:00.638 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-21T22:34:00.638 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.47:6789,172.21.15.81:6789" 2024-04-21T22:34:00.638 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@6ef0a334-002d-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/d6410d01-5098-4c61-a72a-04923b90ffe5 2024-04-21T22:34:00.638 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.18:6789/172.21.15.47:6789/172.21.15.81:6789" will pass to kernel 2024-04-21T22:34:00.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-21T22:34:00.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: Standby manager daemon y restarted 2024-04-21T22:34:00.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: Standby manager daemon y started 2024-04-21T22:34:00.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:34:00.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:34:00.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:34:00.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:00 smithi081 ceph-mon[31692]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:34:00.641 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-21T22:34:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-04-21T22:34:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-21T22:34:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-04-21T22:34:00.641 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-21T22:34:00.645 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-21T22:34:00.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:34:00.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-21T22:34:00.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-21T22:34:00.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: Standby manager daemon y restarted 2024-04-21T22:34:00.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: Standby manager daemon y started 2024-04-21T22:34:00.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-21T22:34:00.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-21T22:34:00.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-21T22:34:00.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:00 smithi047 ceph-mon[31561]: from='mgr.? 172.21.15.47:0/901295889' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-21T22:34:00.712 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T22:34:00.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T22:34:00.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:34:00.819 INFO:teuthology.orchestra.run.smithi018.stdout:client25313 2024-04-21T22:34:00.819 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:34:00.819 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T22:34:00.869 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T22:34:01.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T22:34:01.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:34:01.024 INFO:teuthology.orchestra.run.smithi018.stdout:client25313 2024-04-21T22:34:01.025 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-21T22:34:01.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-21T22:34:01.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:34:01.132 INFO:teuthology.orchestra.run.smithi018.stdout:client25313 2024-04-21T22:34:01.132 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6ef0a334-002d-11ef-bc93-c7b262605968.client25313/status') 2024-04-21T22:34:01.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T22:34:01.253 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.25313 (3)172.21.15.18:0/1115974230 2024-04-21T22:34:01.253 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-04-21T22:34:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-04-21T22:34:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-04-21T22:34:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:71 bytes copied, 8.378e-05 s, 847 kB/s 2024-04-21T22:34:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T22:34:01.264 INFO:teuthology.run_tasks:Running task exec... 2024-04-21T22:34:01.274 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T22:34:01.274 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:34:01.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 -- 172.21.15.18:0/32810605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701020a0 msgr2=0x7fca70108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 --2- 172.21.15.18:0/32810605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701020a0 0x7fca70108930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca68009be0 tx=0x7fca6802bef0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 -- 172.21.15.18:0/32810605 shutdown_connections 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 --2- 172.21.15.18:0/32810605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701020a0 0x7fca70108930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 --2- 172.21.15.18:0/32810605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701016e0 0x7fca70101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 --2- 172.21.15.18:0/32810605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 -- 172.21.15.18:0/32810605 >> 172.21.15.18:0/32810605 conn(0x7fca700fba20 msgr2=0x7fca700fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 -- 172.21.15.18:0/32810605 shutdown_connections 2024-04-21T22:34:01.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.450+0000 7fca76200640 1 -- 172.21.15.18:0/32810605 wait complete. 2024-04-21T22:34:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.451+0000 7fca76200640 1 Processor -- start 2024-04-21T22:34:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.451+0000 7fca76200640 1 -- start start 2024-04-21T22:34:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701020a0 0x7fca7019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010c1a0 con 0x7fca701004f0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010c020 con 0x7fca701020a0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca76200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca7010c320 con 0x7fca701016e0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55782/0 (socket says 172.21.15.18:55782) 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 -- 172.21.15.18:0/2114009445 learned_addr learned my addr 172.21.15.18:0/2114009445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48942/0 (socket says 172.21.15.18:48942) 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca75800640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701020a0 0x7fca7019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 msgr2=0x7fca70197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701020a0 msgr2=0x7fca7019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.452+0000 7fca74e00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701020a0 0x7fca7019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:01.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca74e00640 1 -- 172.21.15.18:0/2114009445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7019f4d0 con 0x7fca701004f0 2024-04-21T22:34:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca6fe00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca74e00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fca6400e9a0 tx=0x7fca6400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6400cd80 con 0x7fca701004f0 2024-04-21T22:34:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7019f7c0 con 0x7fca701004f0 2024-04-21T22:34:01.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca64010910 con 0x7fca701004f0 2024-04-21T22:34:01.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7019fd60 con 0x7fca701004f0 2024-04-21T22:34:01.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.453+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64018a00 con 0x7fca701004f0 2024-04-21T22:34:01.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.455+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7019ffc0 con 0x7fca701004f0 2024-04-21T22:34:01.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.456+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 137850+0+0 (secure 0 0 0) 0x7fca64010ac0 con 0x7fca701004f0 2024-04-21T22:34:01.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.458+0000 7fca6d600640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 0x7fca580a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:01.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.458+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8269+0+0 (secure 0 0 0) 0x7fca640cf410 con 0x7fca701004f0 2024-04-21T22:34:01.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.458+0000 7fca6fe00640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 msgr2=0x7fca580a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:34:01.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.458+0000 7fca6fe00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 0x7fca580a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T22:34:01.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.463+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fca640536f0 con 0x7fca701004f0 2024-04-21T22:34:01.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:01 smithi018 ceph-mon[26614]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-04-21T22:34:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:01 smithi081 ceph-mon[31692]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-04-21T22:34:01.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.659+0000 7fca6fe00640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 msgr2=0x7fca580a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.18:6800/1190552149 2024-04-21T22:34:01.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.659+0000 7fca6fe00640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 0x7fca580a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T22:34:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:01 smithi047 ceph-mon[31561]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-04-21T22:34:01.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:01.766+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fca701a0190 con 0x7fca701004f0 2024-04-21T22:34:02.006 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:01 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:01.704+0000 7f6930b1d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T22:34:02.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.037+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7fca64098260 con 0x7fca701004f0 2024-04-21T22:34:02.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.038+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 msgr2=0x7fca580a5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T22:34:02.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.038+0000 7fca6d600640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 0x7fca580a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.225+0000 7fca6d600640 1 -- 172.21.15.18:0/2114009445 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fca6409c2f0 con 0x7fca701004f0 2024-04-21T22:34:02.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 msgr2=0x7fca70197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fca6400e9a0 tx=0x7fca6400ee60 comp rx=0 tx=0).stop 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 shutdown_connections 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:6800/1190552149,v1:172.21.15.18:6801/1190552149] conn(0x7fca580a2bc0 0x7fca580a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca701020a0 0x7fca7019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca701016e0 0x7fca70197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 --2- 172.21.15.18:0/2114009445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca701004f0 0x7fca70197900 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 >> 172.21.15.18:0/2114009445 conn(0x7fca700fba20 msgr2=0x7fca700fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:02.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 shutdown_connections 2024-04-21T22:34:02.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.229+0000 7fca76200640 1 -- 172.21.15.18:0/2114009445 wait complete. 2024-04-21T22:34:02.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-21T22:34:02.318 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.005+0000 7f6930b1d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: Active manager daemon x restarted 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: Activating manager daemon x 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:34:02.319 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: mgrmap e22: x(active, starting, since 0.0295276s), standbys: y, z 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:34:02.320 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:34:02.321 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: Manager daemon x is now available 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:02.322 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 -- 172.21.15.18:0/2018593533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041037e0 msgr2=0x7fe304103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 --2- 172.21.15.18:0/2018593533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041037e0 0x7fe304103c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009900 tx=0x7fe2f802bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 -- 172.21.15.18:0/2018593533 shutdown_connections 2024-04-21T22:34:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 --2- 172.21.15.18:0/2018593533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe30410bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 --2- 172.21.15.18:0/2018593533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041049d0 0x7fe304104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 --2- 172.21.15.18:0/2018593533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041037e0 0x7fe304103c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 -- 172.21.15.18:0/2018593533 >> 172.21.15.18:0/2018593533 conn(0x7fe3040fed50 msgr2=0x7fe304101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 -- 172.21.15.18:0/2018593533 shutdown_connections 2024-04-21T22:34:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.451+0000 7fe30b000640 1 -- 172.21.15.18:0/2018593533 wait complete. 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.452+0000 7fe30b000640 1 Processor -- start 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.452+0000 7fe30b000640 1 -- start start 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 0x7fe304199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe3041a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410f4a0 con 0x7fe3041049d0 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410f320 con 0x7fe304105390 2024-04-21T22:34:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe30410f620 con 0x7fe3041037e0 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe309200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe309200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55918/0 (socket says 172.21.15.18:55918) 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe309200640 1 -- 172.21.15.18:0/654555018 learned_addr learned my addr 172.21.15.18:0/654555018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe309c00640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 0x7fe304199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.453+0000 7fe30a600640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe3041a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 -- 172.21.15.18:0/654555018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 msgr2=0x7fe3041a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe3041a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 -- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 msgr2=0x7fe30419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 -- 172.21.15.18:0/654555018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3041a1730 con 0x7fe3041037e0 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309200640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe30a600640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe3041a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe309c00640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 0x7fe304199b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009230 tx=0x7fe2f802c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8043020 con 0x7fe3041037e0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3041a19c0 con 0x7fe3041037e0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2f80054e0 con 0x7fe3041037e0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8003b60 con 0x7fe3041037e0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.454+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3041a1ee0 con 0x7fe3041037e0 2024-04-21T22:34:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.456+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30410ab80 con 0x7fe3041037e0 2024-04-21T22:34:02.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.457+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7fe2f8046020 con 0x7fe3041037e0 2024-04-21T22:34:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.459+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe2f80f0d10 con 0x7fe3041037e0 2024-04-21T22:34:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:02.463+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe2f80f6020 con 0x7fe3041037e0 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.351+0000 7f6885c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.351+0000 7f6885c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.351+0000 7f6885c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.351+0000 7f6885c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.351+0000 7f6885c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.353+0000 7f6882000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.353+0000 7f6882000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.596 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.353+0000 7f6882000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.597 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.353+0000 7f6882000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.597 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:02.353+0000 7f6882000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:02.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: Active manager daemon x restarted 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: Activating manager daemon x 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: mgrmap e22: x(active, starting, since 0.0295276s), standbys: y, z 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:34:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:34:02.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: Manager daemon x is now available 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.642 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:02.642 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:02 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: Active manager daemon x restarted 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: Activating manager daemon x 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: osdmap e88: 12 total, 12 up, 12 in 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: mgrmap e22: x(active, starting, since 0.0295276s), standbys: y, z 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:34:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-21T22:34:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: Manager daemon x is now available 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-21T22:34:02.697 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:02.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:02 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-21T22:34:03.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.041+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7fe2f8003d00 con 0x7fe3041037e0 2024-04-21T22:34:03.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.047+0000 7fe302000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 0x7fe2ec0abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.047+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fe2f800b0b0 con 0x7fe2ec0a9840 2024-04-21T22:34:03.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.052+0000 7fe309200640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 0x7fe2ec0abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.059+0000 7fe309200640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 0x7fe2ec0abc30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe30419b020 tx=0x7fe2f0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:03.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.081+0000 7fe302000640 1 -- 172.21.15.18:0/654555018 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fe2f800b0b0 con 0x7fe2ec0a9840 2024-04-21T22:34:03.081 INFO:teuthology.orchestra.run.smithi018.stdout:{} 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 msgr2=0x7fe2ec0abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 0x7fe2ec0abc30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe30419b020 tx=0x7fe2f0005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 msgr2=0x7fe304199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 0x7fe304199b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009230 tx=0x7fe2f802c5d0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 shutdown_connections 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe2ec0a9840 0x7fe2ec0abc30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe304105390 0x7fe3041a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3041049d0 0x7fe30419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 --2- 172.21.15.18:0/654555018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3041037e0 0x7fe304199b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 >> 172.21.15.18:0/654555018 conn(0x7fe3040fed50 msgr2=0x7fe304107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 shutdown_connections 2024-04-21T22:34:03.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.084+0000 7fe30b000640 1 -- 172.21.15.18:0/654555018 wait complete. 2024-04-21T22:34:03.100 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-21T22:34:03.111 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-21T22:34:03.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.342+0000 7f8c03000640 1 -- 172.21.15.18:0/3920826698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc0fff50 msgr2=0x7f8bfc100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.342+0000 7f8c03000640 1 --2- 172.21.15.18:0/3920826698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc100370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009900 tx=0x7f8bf002bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 -- 172.21.15.18:0/3920826698 shutdown_connections 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 --2- 172.21.15.18:0/3920826698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc101250 0x7f8bfc1016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 --2- 172.21.15.18:0/3920826698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 --2- 172.21.15.18:0/3920826698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc100370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 -- 172.21.15.18:0/3920826698 >> 172.21.15.18:0/3920826698 conn(0x7f8bfc0fbb10 msgr2=0x7f8bfc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 -- 172.21.15.18:0/3920826698 shutdown_connections 2024-04-21T22:34:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.343+0000 7f8c03000640 1 -- 172.21.15.18:0/3920826698 wait complete. 2024-04-21T22:34:03.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 Processor -- start 2024-04-21T22:34:03.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 -- start start 2024-04-21T22:34:03.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc101250 0x7f8bfc1a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10f530 con 0x7f8bfc101250 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10f3b0 con 0x7f8bfc0fff50 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c03000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10f6b0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c02600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc101250 0x7f8bfc1a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c01c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c01c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39872/0 (socket says 172.21.15.18:39872) 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c01200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49098/0 (socket says 172.21.15.18:49098) 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.344+0000 7f8c01c00640 1 -- 172.21.15.18:0/839144164 learned_addr learned my addr 172.21.15.18:0/839144164 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 -- 172.21.15.18:0/839144164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 msgr2=0x7f8bfc199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 -- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc101250 msgr2=0x7f8bfc1a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc101250 0x7f8bfc1a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 -- 172.21.15.18:0/839144164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc1a1760 con 0x7f8bfc1008b0 2024-04-21T22:34:03.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8c01200640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e9f0 tx=0x7f8be800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:03.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cd80 con 0x7f8bfc1008b0 2024-04-21T22:34:03.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be80035f0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.345+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8010690 con 0x7f8bfc1008b0 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: mgrmap e23: x(active, since 1.04291s), standbys: y, z 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.347 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.346+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc1a1a50 con 0x7f8bfc1008b0 2024-04-21T22:34:03.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.346+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc1a1f50 con 0x7f8bfc1008b0 2024-04-21T22:34:03.348 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:03.068+0000 7f687f800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:03.348 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:03.068+0000 7f687f800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:03.348 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:03.068+0000 7f687f800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:03.348 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:03.068+0000 7f687f800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:03.348 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:34:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:34:03.068+0000 7f687f800700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:34:03.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.347+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc10aca0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.350+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f8be8003b30 con 0x7f8bfc1008b0 2024-04-21T22:34:03.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.351+0000 7f8bfa000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 0x7f8be40a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.351+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8be80cef90 con 0x7f8bfc1008b0 2024-04-21T22:34:03.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.351+0000 7f8c01c00640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 0x7f8be40a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.352+0000 7f8c01c00640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 0x7f8be40a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8bf002c8e0 tx=0x7f8bf002df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:03.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.353+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8be809c0c0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.554+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bfc02d3c0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.556+0000 7f8bfa000640 1 -- 172.21.15.18:0/839144164 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22959 (secure 0 0 0) 0x7f8be809b9c0 con 0x7f8bfc1008b0 2024-04-21T22:34:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:03.557 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":88,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:34:02.010219+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:34:03.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.560+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 msgr2=0x7f8be40a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.560+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 0x7f8be40a4eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8bf002c8e0 tx=0x7f8bf002df90 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.560+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 msgr2=0x7f8bfc19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.560+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e9f0 tx=0x7f8be800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 shutdown_connections 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8be40a29f0 0x7f8be40a4eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bfc101250 0x7f8bfc1a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bfc1008b0 0x7f8bfc19a080 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 --2- 172.21.15.18:0/839144164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8bfc0fff50 0x7f8bfc199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 >> 172.21.15.18:0/839144164 conn(0x7f8bfc0fbb10 msgr2=0x7f8bfc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 shutdown_connections 2024-04-21T22:34:03.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.561+0000 7f8c03000640 1 -- 172.21.15.18:0/839144164 wait complete. 2024-04-21T22:34:03.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:34:03.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: mgrmap e23: x(active, since 1.04291s), standbys: y, z 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:03 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2114009445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-21T22:34:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:34:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: mgrmap e23: x(active, since 1.04291s), standbys: y, z 2024-04-21T22:34:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:03 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:03.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 -- 172.21.15.18:0/576001324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce0103180 msgr2=0x7fcce0109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 --2- 172.21.15.18:0/576001324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce0103180 0x7fcce0109a10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009ca0 tx=0x7fccd802c100 comp rx=0 tx=0).stop 2024-04-21T22:34:03.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 -- 172.21.15.18:0/576001324 shutdown_connections 2024-04-21T22:34:03.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 --2- 172.21.15.18:0/576001324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce0103180 0x7fcce0109a10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 --2- 172.21.15.18:0/576001324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce01027c0 0x7fcce0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 --2- 172.21.15.18:0/576001324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 0x7fcce01019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 -- 172.21.15.18:0/576001324 >> 172.21.15.18:0/576001324 conn(0x7fcce00fcb40 msgr2=0x7fcce00fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:03.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.766+0000 7fcce6e00640 1 -- 172.21.15.18:0/576001324 shutdown_connections 2024-04-21T22:34:03.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.767+0000 7fcce6e00640 1 -- 172.21.15.18:0/576001324 wait complete. 2024-04-21T22:34:03.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.767+0000 7fcce6e00640 1 Processor -- start 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 -- start start 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 0x7fcce0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcce010d250 con 0x7fcce0103180 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcce010d0d0 con 0x7fcce01027c0 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcce010d3d0 con 0x7fcce01015d0 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55972/0 (socket says 172.21.15.18:55972) 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39894/0 (socket says 172.21.15.18:39894) 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce6400640 1 -- 172.21.15.18:0/489108982 learned_addr learned my addr 172.21.15.18:0/489108982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.768+0000 7fcce5a00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 0x7fcce0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 -- 172.21.15.18:0/489108982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 msgr2=0x7fcce0197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 0x7fcce0197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 -- 172.21.15.18:0/489108982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 msgr2=0x7fcce0197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 -- 172.21.15.18:0/489108982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce019f490 con 0x7fcce0103180 2024-04-21T22:34:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce5000640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6400640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fccd802c640 tx=0x7fccd8035d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8039040 con 0x7fcce0103180 2024-04-21T22:34:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd8044070 con 0x7fcce0103180 2024-04-21T22:34:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce019f720 con 0x7fcce0103180 2024-04-21T22:34:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.769+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd80043c0 con 0x7fcce0103180 2024-04-21T22:34:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.770+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce019fc60 con 0x7fcce0103180 2024-04-21T22:34:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.771+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce01088f0 con 0x7fcce0103180 2024-04-21T22:34:03.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.773+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7fccd8004560 con 0x7fcce0103180 2024-04-21T22:34:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.774+0000 7fccde000640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 0x7fccc80a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.774+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fccd80f12b0 con 0x7fcce0103180 2024-04-21T22:34:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.774+0000 7fcce5a00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 0x7fccc80a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.775+0000 7fcce5a00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 0x7fccc80a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcce0102620 tx=0x7fccd4005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.779+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fccd80be3a0 con 0x7fcce0103180 2024-04-21T22:34:03.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.977+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcce0062340 con 0x7fcce0103180 2024-04-21T22:34:03.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.978+0000 7fccde000640 1 -- 172.21.15.18:0/489108982 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fccd80bdca0 con 0x7fcce0103180 2024-04-21T22:34:03.978 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 msgr2=0x7fccc80a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 0x7fccc80a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcce0102620 tx=0x7fccd4005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 msgr2=0x7fcce019ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fccd802c640 tx=0x7fccd8035d10 comp rx=0 tx=0).stop 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 shutdown_connections 2024-04-21T22:34:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fccc80a2a10 0x7fccc80a4ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce0103180 0x7fcce019ee20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcce01027c0 0x7fcce0197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 --2- 172.21.15.18:0/489108982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce01015d0 0x7fcce0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.981+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 >> 172.21.15.18:0/489108982 conn(0x7fcce00fcb40 msgr2=0x7fcce0105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.982+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 shutdown_connections 2024-04-21T22:34:03.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:03.982+0000 7fcce6e00640 1 -- 172.21.15.18:0/489108982 wait complete. 2024-04-21T22:34:04.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:34:04.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 -- 172.21.15.18:0/1127442405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328102200 msgr2=0x7f13281045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 --2- 172.21.15.18:0/1127442405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328102200 0x7f13281045f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1318009860 tx=0x7f131802bb70 comp rx=0 tx=0).stop 2024-04-21T22:34:04.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 -- 172.21.15.18:0/1127442405 shutdown_connections 2024-04-21T22:34:04.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 --2- 172.21.15.18:0/1127442405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328107460 0x7f13281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 --2- 172.21.15.18:0/1127442405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328104b30 0x7f1328106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 --2- 172.21.15.18:0/1127442405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328102200 0x7f13281045f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 -- 172.21.15.18:0/1127442405 >> 172.21.15.18:0/1127442405 conn(0x7f13280fbc10 msgr2=0x7f13280fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 -- 172.21.15.18:0/1127442405 shutdown_connections 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.189+0000 7f132e400640 1 -- 172.21.15.18:0/1127442405 wait complete. 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 Processor -- start 2024-04-21T22:34:04.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 -- start start 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 0x7f1328199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 0x7f13281a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f132810d400 con 0x7f1328104b30 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f132810d280 con 0x7f1328107460 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.191+0000 7f132e400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f132810d580 con 0x7f1328102200 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1326a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1326a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56010/0 (socket says 172.21.15.18:56010) 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1326a00640 1 -- 172.21.15.18:0/1272904688 learned_addr learned my addr 172.21.15.18:0/1272904688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 0x7f1328199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327e00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 0x7f13281a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 -- 172.21.15.18:0/1272904688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 msgr2=0x7f13281a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 0x7f13281a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 -- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 msgr2=0x7f132819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327400640 1 -- 172.21.15.18:0/1272904688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13281a1920 con 0x7f1328102200 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1327e00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 0x7f13281a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.192+0000 7f1326a00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f1327400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 0x7f1328199d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f131802c0b0 tx=0x7f1318032430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318041020 con 0x7f1328102200 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f131802c9f0 con 0x7f1328102200 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318039040 con 0x7f1328102200 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13281a1bb0 con 0x7f1328102200 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.193+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13281a20c0 con 0x7f1328102200 2024-04-21T22:34:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.195+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1328108fb0 con 0x7f1328102200 2024-04-21T22:34:04.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.196+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f1318044020 con 0x7f1328102200 2024-04-21T22:34:04.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.197+0000 7f131fe00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 0x7f130c0a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.198+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f13180effd0 con 0x7f1328102200 2024-04-21T22:34:04.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.198+0000 7f1326a00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 0x7f130c0a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.198+0000 7f1326a00640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 0x7f130c0a4ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13140096c0 tx=0x7f1314009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:04.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.201+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f131804b070 con 0x7f1328102200 2024-04-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.354+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f131802c510 con 0x7f1328102200 2024-04-21T22:34:04.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.424+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f132802d170 con 0x7f1328102200 2024-04-21T22:34:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.425+0000 7f131fe00640 1 -- 172.21.15.18:0/1272904688 <== mon.1 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f13180acb80 con 0x7f1328102200 2024-04-21T22:34:04.425 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 msgr2=0x7f130c0a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 0x7f130c0a4ed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13140096c0 tx=0x7f1314009260 comp rx=0 tx=0).stop 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 msgr2=0x7f1328199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 0x7f1328199d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f131802c0b0 tx=0x7f1318032430 comp rx=0 tx=0).stop 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 shutdown_connections 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f130c0a2a10 0x7f130c0a4ed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1328107460 0x7f13281a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1328104b30 0x7f132819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 --2- 172.21.15.18:0/1272904688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1328102200 0x7f1328199d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 >> 172.21.15.18:0/1272904688 conn(0x7f13280fbc10 msgr2=0x7f1328101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:04.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 shutdown_connections 2024-04-21T22:34:04.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.428+0000 7f132e400640 1 -- 172.21.15.18:0/1272904688 wait complete. 2024-04-21T22:34:04.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: [21/Apr/2024:22:34:03] ENGINE Bus STARTING 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: [21/Apr/2024:22:34:03] ENGINE Serving on https://172.21.15.18:7150 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: [21/Apr/2024:22:34:03] ENGINE Serving on http://172.21.15.18:8765 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: [21/Apr/2024:22:34:03] ENGINE Bus STARTED 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/839144164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:04.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/489108982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: [21/Apr/2024:22:34:03] ENGINE Bus STARTING 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: [21/Apr/2024:22:34:03] ENGINE Serving on https://172.21.15.18:7150 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: [21/Apr/2024:22:34:03] ENGINE Serving on http://172.21.15.18:8765 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: [21/Apr/2024:22:34:03] ENGINE Bus STARTED 2024-04-21T22:34:04.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/839144164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:04.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:04 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/489108982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 -- 172.21.15.18:0/2928577269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701027c0 msgr2=0x7ff970102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 --2- 172.21.15.18:0/2928577269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701027c0 0x7ff970102c40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff960009900 tx=0x7ff96002bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 -- 172.21.15.18:0/2928577269 shutdown_connections 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 --2- 172.21.15.18:0/2928577269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff970103180 0x7ff970109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 --2- 172.21.15.18:0/2928577269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701027c0 0x7ff970102c40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 --2- 172.21.15.18:0/2928577269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9701015d0 0x7ff9701019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 -- 172.21.15.18:0/2928577269 >> 172.21.15.18:0/2928577269 conn(0x7ff9700fcb40 msgr2=0x7ff9700fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:04.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 -- 172.21.15.18:0/2928577269 shutdown_connections 2024-04-21T22:34:04.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.641+0000 7ff977200640 1 -- 172.21.15.18:0/2928577269 wait complete. 2024-04-21T22:34:04.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.642+0000 7ff977200640 1 Processor -- start 2024-04-21T22:34:04.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 -- start start 2024-04-21T22:34:04.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701015d0 0x7ff970075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff970103180 0x7ff970074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff97010d290 con 0x7ff970103180 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff97010d110 con 0x7ff9701015d0 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff977200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff97010d410 con 0x7ff9701027c0 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff975400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff975400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49184/0 (socket says 172.21.15.18:49184) 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff975400640 1 -- 172.21.15.18:0/1297374234 learned_addr learned my addr 172.21.15.18:0/1297374234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff975e00640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701015d0 0x7ff970075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.643+0000 7ff976800640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff970103180 0x7ff970074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 -- 172.21.15.18:0/1297374234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701015d0 msgr2=0x7ff970075450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701015d0 0x7ff970075450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 -- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff970103180 msgr2=0x7ff970074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff970103180 0x7ff970074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 -- 172.21.15.18:0/1297374234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff970074870 con 0x7ff9701027c0 2024-04-21T22:34:04.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff975400640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff960000c00 tx=0x7ff96002c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:04.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960043020 con 0x7ff9701027c0 2024-04-21T22:34:04.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.644+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9701a19c0 con 0x7ff9701027c0 2024-04-21T22:34:04.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.645+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9600054e0 con 0x7ff9701027c0 2024-04-21T22:34:04.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.645+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960003c40 con 0x7ff9701027c0 2024-04-21T22:34:04.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.645+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9701a1f30 con 0x7ff9701027c0 2024-04-21T22:34:04.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.646+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9701088f0 con 0x7ff9701027c0 2024-04-21T22:34:04.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.649+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7ff960046020 con 0x7ff9701027c0 2024-04-21T22:34:04.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.650+0000 7ff96aa00640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 0x7ff9580a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:04.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.651+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff9600f1570 con 0x7ff9701027c0 2024-04-21T22:34:04.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.651+0000 7ff975e00640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 0x7ff9580a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:04.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.652+0000 7ff975e00640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 0x7ff9580a5250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff970102620 tx=0x7ff964005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:04.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.655+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff96004d020 con 0x7ff9701027c0 2024-04-21T22:34:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: [21/Apr/2024:22:34:03] ENGINE Bus STARTING 2024-04-21T22:34:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: [21/Apr/2024:22:34:03] ENGINE Serving on https://172.21.15.18:7150 2024-04-21T22:34:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:04.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: [21/Apr/2024:22:34:03] ENGINE Serving on http://172.21.15.18:8765 2024-04-21T22:34:04.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: [21/Apr/2024:22:34:03] ENGINE Bus STARTED 2024-04-21T22:34:04.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/839144164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:04.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:04 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/489108982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:04.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.863+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff97002d340 con 0x7ff9701027c0 2024-04-21T22:34:04.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.863+0000 7ff96aa00640 1 -- 172.21.15.18:0/1297374234 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7ff9600be0d0 con 0x7ff9701027c0 2024-04-21T22:34:04.863 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:34:04.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 msgr2=0x7ff9580a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 0x7ff9580a5250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff970102620 tx=0x7ff964005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:04.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 msgr2=0x7ff970073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:04.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff960000c00 tx=0x7ff96002c650 comp rx=0 tx=0).stop 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 shutdown_connections 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9580a2d90 0x7ff9580a5250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff970103180 0x7ff970074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9701027c0 0x7ff970073b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 --2- 172.21.15.18:0/1297374234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9701015d0 0x7ff970075450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.866+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 >> 172.21.15.18:0/1297374234 conn(0x7ff9700fcb40 msgr2=0x7ff970105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.867+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 shutdown_connections 2024-04-21T22:34:04.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:04.867+0000 7ff977200640 1 -- 172.21.15.18:0/1297374234 wait complete. 2024-04-21T22:34:04.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:34:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 -- 172.21.15.18:0/3866108128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c105550 msgr2=0x7f7a0c10bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 --2- 172.21.15.18:0/3866108128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c105550 0x7f7a0c10bde0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009ca0 tx=0x7f7a0402c100 comp rx=0 tx=0).stop 2024-04-21T22:34:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 -- 172.21.15.18:0/3866108128 shutdown_connections 2024-04-21T22:34:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 --2- 172.21.15.18:0/3866108128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c105550 0x7f7a0c10bde0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 --2- 172.21.15.18:0/3866108128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c104b90 0x7f7a0c105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 --2- 172.21.15.18:0/3866108128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 -- 172.21.15.18:0/3866108128 >> 172.21.15.18:0/3866108128 conn(0x7f7a0c0fef30 msgr2=0x7f7a0c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 -- 172.21.15.18:0/3866108128 shutdown_connections 2024-04-21T22:34:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.095+0000 7f7a11400640 1 -- 172.21.15.18:0/3866108128 wait complete. 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.096+0000 7f7a11400640 1 Processor -- start 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 -- start start 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 0x7f7a0c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c105550 0x7f7a0c1a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c10f620 con 0x7f7a0c105550 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c10f4a0 con 0x7f7a0c1039a0 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a11400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c10f7a0 con 0x7f7a0c104b90 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a0a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a09e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 0x7f7a0c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a0a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39980/0 (socket says 172.21.15.18:39980) 2024-04-21T22:34:05.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a0a800640 1 -- 172.21.15.18:0/3025889311 learned_addr learned my addr 172.21.15.18:0/3025889311 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:05.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.097+0000 7f7a0b200640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c105550 0x7f7a0c1a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 -- 172.21.15.18:0/3025889311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 msgr2=0x7f7a0c19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 0x7f7a0c19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 -- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c105550 msgr2=0x7f7a0c1a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c105550 0x7f7a0c1a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 -- 172.21.15.18:0/3025889311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c1a1860 con 0x7f7a0c1039a0 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a09e00640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 0x7f7a0c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a0a800640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e9c0 tx=0x7f79fc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00cd80 con 0x7f7a0c1039a0 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c1a1b50 con 0x7f7a0c1039a0 2024-04-21T22:34:05.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79fc0035f0 con 0x7f7a0c1039a0 2024-04-21T22:34:05.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.098+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc010690 con 0x7f7a0c1039a0 2024-04-21T22:34:05.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.099+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c1a20a0 con 0x7f7a0c1039a0 2024-04-21T22:34:05.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.100+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c10ac60 con 0x7f7a0c1039a0 2024-04-21T22:34:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.101+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f79fc0037a0 con 0x7f7a0c1039a0 2024-04-21T22:34:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.103+0000 7f7a03400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 0x7f79f00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.103+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f79fc0cf9e0 con 0x7f7a0c1039a0 2024-04-21T22:34:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.103+0000 7f7a09e00640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 0x7f79f00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.104+0000 7f7a09e00640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 0x7f79f00a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009fc0 tx=0x7f79f8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.107+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f79fc09c430 con 0x7f7a0c1039a0 2024-04-21T22:34:05.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.339+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a0c02d170 con 0x7f7a0c1039a0 2024-04-21T22:34:05.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.341+0000 7f7a03400640 1 -- 172.21.15.18:0/3025889311 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22959 (secure 0 0 0) 0x7f79fc09bd30 con 0x7f7a0c1039a0 2024-04-21T22:34:05.341 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:05.341 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":88,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:34:02.010219+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 msgr2=0x7f79f00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 0x7f79f00a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009fc0 tx=0x7f79f8005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 msgr2=0x7f7a0c199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e9c0 tx=0x7f79fc00ee80 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 shutdown_connections 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f79f00a2e10 0x7f79f00a52d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a0c105550 0x7f7a0c1a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a0c104b90 0x7f7a0c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 --2- 172.21.15.18:0/3025889311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a0c1039a0 0x7f7a0c199c50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 >> 172.21.15.18:0/3025889311 conn(0x7f7a0c0fef30 msgr2=0x7f7a0c107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:05.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 shutdown_connections 2024-04-21T22:34:05.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.345+0000 7f7a11400640 1 -- 172.21.15.18:0/3025889311 wait complete. 2024-04-21T22:34:05.374 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:34:05.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.590+0000 7f6d68600640 1 -- 172.21.15.18:0/3474946605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 msgr2=0x7f6d60104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.590+0000 7f6d68600640 1 --2- 172.21.15.18:0/3474946605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60104670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009900 tx=0x7f6d5402bc50 comp rx=0 tx=0).stop 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 -- 172.21.15.18:0/3474946605 shutdown_connections 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 --2- 172.21.15.18:0/3474946605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d601074e0 0x7f6d601098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 --2- 172.21.15.18:0/3474946605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d60104bb0 0x7f6d60106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 --2- 172.21.15.18:0/3474946605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60104670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 -- 172.21.15.18:0/3474946605 >> 172.21.15.18:0/3474946605 conn(0x7f6d600fbc10 msgr2=0x7f6d600fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 -- 172.21.15.18:0/3474946605 shutdown_connections 2024-04-21T22:34:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.591+0000 7f6d68600640 1 -- 172.21.15.18:0/3474946605 wait complete. 2024-04-21T22:34:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.592+0000 7f6d68600640 1 Processor -- start 2024-04-21T22:34:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.592+0000 7f6d68600640 1 -- start start 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d60104bb0 0x7f6d601980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6010d460 con 0x7f6d60104bb0 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6010d2e0 con 0x7f6d60102280 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d68600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6010d5e0 con 0x7f6d601074e0 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d66600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d65200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d60104bb0 0x7f6d601980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d66600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49214/0 (socket says 172.21.15.18:49214) 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d65c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d66600640 1 -- 172.21.15.18:0/127003416 learned_addr learned my addr 172.21.15.18:0/127003416 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.593+0000 7f6d66600640 1 -- 172.21.15.18:0/127003416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 msgr2=0x7f6d60197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d66600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d66600640 1 -- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d60104bb0 msgr2=0x7f6d601980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d66600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d60104bb0 0x7f6d601980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d66600640 1 -- 172.21.15.18:0/127003416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601001a0 con 0x7f6d601074e0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d66600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009fd0 tx=0x7f6d5800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58017070 con 0x7f6d601074e0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d58003e50 con 0x7f6d601074e0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d60100490 con 0x7f6d601074e0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.594+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d580106c0 con 0x7f6d601074e0 2024-04-21T22:34:05.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.595+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601009e0 con 0x7f6d601074e0 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1272904688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1297374234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:05 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.596+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60101dc0 con 0x7f6d601074e0 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1272904688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1297374234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:05 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.598+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f6d58003970 con 0x7f6d601074e0 2024-04-21T22:34:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.599+0000 7f6d5e000640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 0x7f6d480a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.599+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6d580cf2d0 con 0x7f6d601074e0 2024-04-21T22:34:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.599+0000 7f6d65c00640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 0x7f6d480a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.600+0000 7f6d65c00640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 0x7f6d480a52d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5402c260 tx=0x7f6d54000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.603+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6d5809b6d0 con 0x7f6d601074e0 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1272904688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1297374234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:05 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:05.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.822+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d600fd3c0 con 0x7f6d601074e0 2024-04-21T22:34:05.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.822+0000 7f6d5e000640 1 -- 172.21.15.18:0/127003416 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f6d5809f9d0 con 0x7f6d601074e0 2024-04-21T22:34:05.822 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 msgr2=0x7f6d480a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 0x7f6d480a52d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d5402c260 tx=0x7f6d54000bc0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 msgr2=0x7f6d6019f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009fd0 tx=0x7f6d5800b260 comp rx=0 tx=0).stop 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 shutdown_connections 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d480a2e10 0x7f6d480a52d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d601074e0 0x7f6d6019f120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d60104bb0 0x7f6d601980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 --2- 172.21.15.18:0/127003416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60102280 0x7f6d60197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 >> 172.21.15.18:0/127003416 conn(0x7f6d600fbc10 msgr2=0x7f6d60102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 shutdown_connections 2024-04-21T22:34:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:05.826+0000 7f6d68600640 1 -- 172.21.15.18:0/127003416 wait complete. 2024-04-21T22:34:05.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.074+0000 7f012c600640 1 -- 172.21.15.18:0/336648381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124075720 msgr2=0x7f0124073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.074+0000 7f012c600640 1 --2- 172.21.15.18:0/336648381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124075720 0x7f0124073b70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0118009900 tx=0x7f011802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 -- 172.21.15.18:0/336648381 shutdown_connections 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 --2- 172.21.15.18:0/336648381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124109630 0x7f012410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 --2- 172.21.15.18:0/336648381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124074140 0x7f01240745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 --2- 172.21.15.18:0/336648381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124075720 0x7f0124073b70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 -- 172.21.15.18:0/336648381 >> 172.21.15.18:0/336648381 conn(0x7f01240fcd10 msgr2=0x7f01240ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 -- 172.21.15.18:0/336648381 shutdown_connections 2024-04-21T22:34:06.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.075+0000 7f012c600640 1 -- 172.21.15.18:0/336648381 wait complete. 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.076+0000 7f012c600640 1 Processor -- start 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.076+0000 7f012c600640 1 -- start start 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.076+0000 7f012c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124074140 0x7f0124199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.076+0000 7f012c600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.076+0000 7f012c600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124109630 0x7f01241a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f012c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f012410f640 con 0x7f0124074140 2024-04-21T22:34:06.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f012c600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f012410f4c0 con 0x7f0124075720 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f012c600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f012410f7c0 con 0x7f0124109630 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124074140 0x7f0124199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55170/0 (socket says 172.21.15.18:55170) 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 -- 172.21.15.18:0/4038838343 learned_addr learned my addr 172.21.15.18:0/4038838343 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f012a600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124109630 0x7f01241a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 -- 172.21.15.18:0/4038838343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124109630 msgr2=0x7f01241a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124109630 0x7f01241a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 -- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124074140 msgr2=0x7f0124199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124074140 0x7f0124199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.077+0000 7f0129200640 1 -- 172.21.15.18:0/4038838343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241a1900 con 0x7f0124075720 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f0129200640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f011000e9f0 tx=0x7f011000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011000cd80 con 0x7f0124075720 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0110010910 con 0x7f0124075720 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110018990 con 0x7f0124075720 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241a1bf0 con 0x7f0124075720 2024-04-21T22:34:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.078+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01241a2160 con 0x7f0124075720 2024-04-21T22:34:06.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.080+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01241083f0 con 0x7f0124075720 2024-04-21T22:34:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.083+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f0110010ac0 con 0x7f0124075720 2024-04-21T22:34:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.085+0000 7f0122000640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 0x7f010c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.086+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f01100cf860 con 0x7f0124075720 2024-04-21T22:34:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.086+0000 7f0129c00640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 0x7f010c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.087+0000 7f0129c00640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 0x7f010c0a52d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f011802c2e0 tx=0x7f011802c920 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.088+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f011009bcc0 con 0x7f0124075720 2024-04-21T22:34:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.315+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f012402d320 con 0x7f0124075720 2024-04-21T22:34:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.315+0000 7f0122000640 1 -- 172.21.15.18:0/4038838343 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f011009ffc0 con 0x7f0124075720 2024-04-21T22:34:06.315 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 msgr2=0x7f010c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 0x7f010c0a52d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f011802c2e0 tx=0x7f011802c920 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 msgr2=0x7f012419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f011000e9f0 tx=0x7f011000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 shutdown_connections 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f010c0a2e10 0x7f010c0a52d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0124109630 0x7f01241a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0124075720 0x7f012419a250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 --2- 172.21.15.18:0/4038838343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0124074140 0x7f0124199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 >> 172.21.15.18:0/4038838343 conn(0x7f01240fcd10 msgr2=0x7f01241055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:06.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 shutdown_connections 2024-04-21T22:34:06.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.318+0000 7f012c600640 1 -- 172.21.15.18:0/4038838343 wait complete. 2024-04-21T22:34:06.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.535+0000 7f0aa0200640 1 -- 172.21.15.18:0/1697950919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 msgr2=0x7f0a981004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.535+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1697950919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a981004b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009900 tx=0x7f0a8c02bc40 comp rx=0 tx=0).stop 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 -- 172.21.15.18:0/1697950919 shutdown_connections 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1697950919 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a98101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1697950919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a98100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1697950919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a981004b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 -- 172.21.15.18:0/1697950919 >> 172.21.15.18:0/1697950919 conn(0x7f0a980fbc30 msgr2=0x7f0a980fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 -- 172.21.15.18:0/1697950919 shutdown_connections 2024-04-21T22:34:06.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.536+0000 7f0aa0200640 1 -- 172.21.15.18:0/1697950919 wait complete. 2024-04-21T22:34:06.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.537+0000 7f0aa0200640 1 Processor -- start 2024-04-21T22:34:06.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.537+0000 7f0aa0200640 1 -- start start 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a98199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9810f650 con 0x7f0a98100090 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9810f4d0 con 0x7f0a98101390 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0aa0200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9810f7d0 con 0x7f0a981009f0 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55192/0 (socket says 172.21.15.18:55192) 2024-04-21T22:34:06.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51808/0 (socket says 172.21.15.18:51808) 2024-04-21T22:34:06.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a98199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.538+0000 7f0a9e200640 1 -- 172.21.15.18:0/1672422037 learned_addr learned my addr 172.21.15.18:0/1672422037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 -- 172.21.15.18:0/1672422037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 msgr2=0x7f0a9819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 -- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 msgr2=0x7f0a98199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a98199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 -- 172.21.15.18:0/1672422037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a981a1900 con 0x7f0a98101390 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9ce00640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.539+0000 7f0a9e200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000eb10 tx=0x7f0a9000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.540+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90004b20 con 0x7f0a98101390 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.540+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a90004cc0 con 0x7f0a98101390 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.540+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a981a1bf0 con 0x7f0a98101390 2024-04-21T22:34:06.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.540+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90010760 con 0x7f0a98101390 2024-04-21T22:34:06.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.540+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a981a20c0 con 0x7f0a98101390 2024-04-21T22:34:06.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.541+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9810afa0 con 0x7f0a98101390 2024-04-21T22:34:06.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.543+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f0a90005020 con 0x7f0a98101390 2024-04-21T22:34:06.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.544+0000 7f0a96000640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 0x7f0a800a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.544+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0a900cfc00 con 0x7f0a98101390 2024-04-21T22:34:06.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.545+0000 7f0a9d800640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 0x7f0a800a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.545+0000 7f0a9d800640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 0x7f0a800a5250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02c250 tx=0x7f0a8c02cf90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:06.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.548+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0a9009c650 con 0x7f0a98101390 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3025889311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/127003416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4038838343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3025889311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/127003416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4038838343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3025889311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:06.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/127003416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:06.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4038838343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:06.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.758+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0a9802d3c0 con 0x7f0a98101390 2024-04-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.759+0000 7f0a96000640 1 -- 172.21.15.18:0/1672422037 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f0a9009bf50 con 0x7f0a98101390 2024-04-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 msgr2=0x7f0a800a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 0x7f0a800a5250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c02c250 tx=0x7f0a8c02cf90 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 msgr2=0x7f0a981a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000eb10 tx=0x7f0a9000c2d0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 shutdown_connections 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0a800a2d90 0x7f0a800a5250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0a98101390 0x7f0a981a1260 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a981009f0 0x7f0a9819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 --2- 172.21.15.18:0/1672422037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a98100090 0x7f0a98199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 >> 172.21.15.18:0/1672422037 conn(0x7f0a980fbc30 msgr2=0x7f0a980fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:06.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 shutdown_connections 2024-04-21T22:34:06.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.762+0000 7f0aa0200640 1 -- 172.21.15.18:0/1672422037 wait complete. 2024-04-21T22:34:06.780 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-21T22:34:06.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 -- 172.21.15.18:0/1274672317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 msgr2=0x7fcd20103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 --2- 172.21.15.18:0/1274672317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20103e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009900 tx=0x7fcd1802bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 -- 172.21.15.18:0/1274672317 shutdown_connections 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 --2- 172.21.15.18:0/1274672317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd201055c0 0x7fcd2010be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 --2- 172.21.15.18:0/1274672317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd20104c00 0x7fcd20105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 --2- 172.21.15.18:0/1274672317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20103e30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 -- 172.21.15.18:0/1274672317 >> 172.21.15.18:0/1274672317 conn(0x7fcd200fefc0 msgr2=0x7fcd201013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 -- 172.21.15.18:0/1274672317 shutdown_connections 2024-04-21T22:34:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.994+0000 7fcd27000640 1 -- 172.21.15.18:0/1274672317 wait complete. 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 Processor -- start 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 -- start start 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd201055c0 0x7fcd201a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f670 con 0x7fcd201055c0 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f4f0 con 0x7fcd20104c00 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.995+0000 7fcd27000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010f7f0 con 0x7fcd20103a10 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55212/0 (socket says 172.21.15.18:55212) 2024-04-21T22:34:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 -- 172.21.15.18:0/4250786329 learned_addr learned my addr 172.21.15.18:0/4250786329 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd25000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd201055c0 0x7fcd201a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 -- 172.21.15.18:0/4250786329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 msgr2=0x7fcd20199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 -- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd201055c0 msgr2=0x7fcd201a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd201055c0 0x7fcd201a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1f400640 1 -- 172.21.15.18:0/4250786329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd201a18f0 con 0x7fcd20104c00 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.996+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd1f400640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800ebc0 tx=0x7fcd0800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08010630 con 0x7fcd20104c00 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd201a1be0 con 0x7fcd20104c00 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08010cb0 con 0x7fcd20104c00 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08018bd0 con 0x7fcd20104c00 2024-04-21T22:34:06.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.997+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd201a2100 con 0x7fcd20104c00 2024-04-21T22:34:06.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:06.998+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2010acd0 con 0x7fcd20104c00 2024-04-21T22:34:06.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.000+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fcd080107d0 con 0x7fcd20104c00 2024-04-21T22:34:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.001+0000 7fcd1cc00640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 0x7fcd040a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.002+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcd080cfd80 con 0x7fcd20104c00 2024-04-21T22:34:07.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.002+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 0x7fcd040a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.003+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 0x7fcd040a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802c170 tx=0x7fcd1802df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:07.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.005+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fcd0809c0a0 con 0x7fcd20104c00 2024-04-21T22:34:07.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.270+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd2002d3c0 con 0x7fcd20104c00 2024-04-21T22:34:07.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.271+0000 7fcd1cc00640 1 -- 172.21.15.18:0/4250786329 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7fcd080a03a0 con 0x7fcd20104c00 2024-04-21T22:34:07.271 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:07.271 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:34:01.767520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:34:07.272 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-04-21T22:34:07.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 msgr2=0x7fcd040a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 0x7fcd040a52e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802c170 tx=0x7fcd1802df90 comp rx=0 tx=0).stop 2024-04-21T22:34:07.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 msgr2=0x7fcd2019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800ebc0 tx=0x7fcd0800c6a0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 shutdown_connections 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcd040a2e20 0x7fcd040a52e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd201055c0 0x7fcd201a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcd20104c00 0x7fcd2019a1f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 --2- 172.21.15.18:0/4250786329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd20103a10 0x7fcd20199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 >> 172.21.15.18:0/4250786329 conn(0x7fcd200fefc0 msgr2=0x7fcd20107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 shutdown_connections 2024-04-21T22:34:07.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.274+0000 7fcd27000640 1 -- 172.21.15.18:0/4250786329 wait complete. 2024-04-21T22:34:07.293 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-21T22:34:07.294 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-21T22:34:07.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:34:07.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 -- 172.21.15.18:0/1643658387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 msgr2=0x7f47241044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 --2- 172.21.15.18:0/1643658387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241044f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4718009900 tx=0x7f471802bc40 comp rx=0 tx=0).stop 2024-04-21T22:34:07.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 -- 172.21.15.18:0/1643658387 shutdown_connections 2024-04-21T22:34:07.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 --2- 172.21.15.18:0/1643658387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724107360 0x7f47241097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 --2- 172.21.15.18:0/1643658387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724104a30 0x7f4724106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 --2- 172.21.15.18:0/1643658387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241044f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 -- 172.21.15.18:0/1643658387 >> 172.21.15.18:0/1643658387 conn(0x7f47240fbb10 msgr2=0x7f47240fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.480+0000 7f472b000640 1 -- 172.21.15.18:0/1643658387 shutdown_connections 2024-04-21T22:34:07.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.481+0000 7f472b000640 1 -- 172.21.15.18:0/1643658387 wait complete. 2024-04-21T22:34:07.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.482+0000 7f472b000640 1 Processor -- start 2024-04-21T22:34:07.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.482+0000 7f472b000640 1 -- start start 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.482+0000 7f472b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.482+0000 7f472b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 0x7f47241000b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f472b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724107360 0x7f47241005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f472b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f472410d380 con 0x7f4724107360 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f472b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f472410d200 con 0x7f4724102100 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f472b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f472410d500 con 0x7f4724104a30 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f472a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724107360 0x7f47241005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 0x7f47241000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 0x7f47241000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51854/0 (socket says 172.21.15.18:51854) 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729200640 1 -- 172.21.15.18:0/3910326456 learned_addr learned my addr 172.21.15.18:0/3910326456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 -- 172.21.15.18:0/3910326456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 msgr2=0x7f47241000b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 0x7f47241000b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 -- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724107360 msgr2=0x7f47241005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724107360 0x7f47241005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.483+0000 7f4729c00640 1 -- 172.21.15.18:0/3910326456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4724100df0 con 0x7f4724102100 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f4729c00640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241019d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4718036040 tx=0x7f4718005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718041070 con 0x7f4724102100 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241a1af0 con 0x7f4724102100 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47180044d0 con 0x7f4724102100 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718034440 con 0x7f4724102100 2024-04-21T22:34:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.484+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a1fb0 con 0x7f4724102100 2024-04-21T22:34:07.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.485+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47240fd600 con 0x7f4724102100 2024-04-21T22:34:07.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.487+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f4718044070 con 0x7f4724102100 2024-04-21T22:34:07.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.488+0000 7f4722000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 0x7f470c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.489+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f47180f1680 con 0x7f4724102100 2024-04-21T22:34:07.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.489+0000 7f4729200640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 0x7f470c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.490+0000 7f4729200640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 0x7f470c0a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4724101740 tx=0x7f471000b410 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:07.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.491+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f47180bdab0 con 0x7f4724102100 2024-04-21T22:34:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:34:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1672422037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-04-21T22:34:07.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4250786329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1672422037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-04-21T22:34:07.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4250786329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:07.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.693+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4724061b80 con 0x7f470c0a2e10 2024-04-21T22:34:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:34:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:34:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:34:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:34:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1672422037' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-04-21T22:34:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4250786329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:07.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.706+0000 7f4722000640 1 -- 172.21.15.18:0/3910326456 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257824 (secure 0 0 0) 0x7f4724061b80 con 0x7f470c0a2e10 2024-04-21T22:34:07.710 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:07.711 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:34:07.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 msgr2=0x7f470c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 0x7f470c0a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4724101740 tx=0x7f471000b410 comp rx=0 tx=0).stop 2024-04-21T22:34:07.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 msgr2=0x7f47241019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241019d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4718036040 tx=0x7f4718005d50 comp rx=0 tx=0).stop 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 shutdown_connections 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f470c0a2e10 0x7f470c0a52d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4724107360 0x7f47241005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4724104a30 0x7f47241000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 --2- 172.21.15.18:0/3910326456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4724102100 0x7f47241019d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 >> 172.21.15.18:0/3910326456 conn(0x7f47240fbb10 msgr2=0x7f4724102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 shutdown_connections 2024-04-21T22:34:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.711+0000 7f472b000640 1 -- 172.21.15.18:0/3910326456 wait complete. 2024-04-21T22:34:07.730 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-21T22:34:06.044357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192897,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1711,"num_read_kb":1046,"num_write":563,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181749,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":947,"ondisk_log_size":947,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372228,"kb_used_data":14604,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569596,"statfs":{"total":1151940427776,"available":1151559266304,"internally_reserved":0,"allocated":14954496,"data_stored":8599998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.976196"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368197+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:34:02.368197+0000","last_peered":"2024-04-21T22:34:02.368197+0000","last_clean":"2024-04-21T22:34:02.368197+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:34:02.368197+0000","last_undegraded":"2024-04-21T22:34:02.368197+0000","last_fullsized":"2024-04-21T22:34:02.368197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028530+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:34:02.028530+0000","last_peered":"2024-04-21T22:34:02.028530+0000","last_clean":"2024-04-21T22:34:02.028530+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:34:02.028530+0000","last_undegraded":"2024-04-21T22:34:02.028530+0000","last_fullsized":"2024-04-21T22:34:02.028530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028381+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:34:02.028381+0000","last_peered":"2024-04-21T22:34:02.028381+0000","last_clean":"2024-04-21T22:34:02.028381+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:34:02.028381+0000","last_undegraded":"2024-04-21T22:34:02.028381+0000","last_fullsized":"2024-04-21T22:34:02.028381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361050+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:34:02.361050+0000","last_peered":"2024-04-21T22:34:02.361050+0000","last_clean":"2024-04-21T22:34:02.361050+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:34:02.361050+0000","last_undegraded":"2024-04-21T22:34:02.361050+0000","last_fullsized":"2024-04-21T22:34:02.361050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152014+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:34:02.152014+0000","last_peered":"2024-04-21T22:34:02.152014+0000","last_clean":"2024-04-21T22:34:02.152014+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:34:02.152014+0000","last_undegraded":"2024-04-21T22:34:02.152014+0000","last_fullsized":"2024-04-21T22:34:02.152014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363047+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:34:02.363047+0000","last_peered":"2024-04-21T22:34:02.363047+0000","last_clean":"2024-04-21T22:34:02.363047+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:34:02.363047+0000","last_undegraded":"2024-04-21T22:34:02.363047+0000","last_fullsized":"2024-04-21T22:34:02.363047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152461+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:34:02.152461+0000","last_peered":"2024-04-21T22:34:02.152461+0000","last_clean":"2024-04-21T22:34:02.152461+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:34:02.152461+0000","last_undegraded":"2024-04-21T22:34:02.152461+0000","last_fullsized":"2024-04-21T22:34:02.152461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363317+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:34:02.363317+0000","last_peered":"2024-04-21T22:34:02.363317+0000","last_clean":"2024-04-21T22:34:02.363317+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:34:02.363317+0000","last_undegraded":"2024-04-21T22:34:02.363317+0000","last_fullsized":"2024-04-21T22:34:02.363317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.164106+0000","last_change":"2024-04-21T22:32:17.561622+0000","last_active":"2024-04-21T22:34:02.164106+0000","last_peered":"2024-04-21T22:34:02.164106+0000","last_clean":"2024-04-21T22:34:02.164106+0000","last_became_active":"2024-04-21T22:32:17.561139+0000","last_became_peered":"2024-04-21T22:32:17.561139+0000","last_unstale":"2024-04-21T22:34:02.164106+0000","last_undegraded":"2024-04-21T22:34:02.164106+0000","last_fullsized":"2024-04-21T22:34:02.164106+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:52:09.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363594+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:34:02.363594+0000","last_peered":"2024-04-21T22:34:02.363594+0000","last_clean":"2024-04-21T22:34:02.363594+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:34:02.363594+0000","last_undegraded":"2024-04-21T22:34:02.363594+0000","last_fullsized":"2024-04-21T22:34:02.363594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360929+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:34:02.360929+0000","last_peered":"2024-04-21T22:34:02.360929+0000","last_clean":"2024-04-21T22:34:02.360929+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:34:02.360929+0000","last_undegraded":"2024-04-21T22:34:02.360929+0000","last_fullsized":"2024-04-21T22:34:02.360929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362279+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:34:02.362279+0000","last_peered":"2024-04-21T22:34:02.362279+0000","last_clean":"2024-04-21T22:34:02.362279+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:34:02.362279+0000","last_undegraded":"2024-04-21T22:34:02.362279+0000","last_fullsized":"2024-04-21T22:34:02.362279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027942+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:34:02.027942+0000","last_peered":"2024-04-21T22:34:02.027942+0000","last_clean":"2024-04-21T22:34:02.027942+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:34:02.027942+0000","last_undegraded":"2024-04-21T22:34:02.027942+0000","last_fullsized":"2024-04-21T22:34:02.027942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027820+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:34:02.027820+0000","last_peered":"2024-04-21T22:34:02.027820+0000","last_clean":"2024-04-21T22:34:02.027820+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:34:02.027820+0000","last_undegraded":"2024-04-21T22:34:02.027820+0000","last_fullsized":"2024-04-21T22:34:02.027820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362328+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:34:02.362328+0000","last_peered":"2024-04-21T22:34:02.362328+0000","last_clean":"2024-04-21T22:34:02.362328+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:34:02.362328+0000","last_undegraded":"2024-04-21T22:34:02.362328+0000","last_fullsized":"2024-04-21T22:34:02.362328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368203+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:34:02.368203+0000","last_peered":"2024-04-21T22:34:02.368203+0000","last_clean":"2024-04-21T22:34:02.368203+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:34:02.368203+0000","last_undegraded":"2024-04-21T22:34:02.368203+0000","last_fullsized":"2024-04-21T22:34:02.368203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025715+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:34:02.025715+0000","last_peered":"2024-04-21T22:34:02.025715+0000","last_clean":"2024-04-21T22:34:02.025715+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:34:02.025715+0000","last_undegraded":"2024-04-21T22:34:02.025715+0000","last_fullsized":"2024-04-21T22:34:02.025715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362265+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:34:02.362265+0000","last_peered":"2024-04-21T22:34:02.362265+0000","last_clean":"2024-04-21T22:34:02.362265+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:34:02.362265+0000","last_undegraded":"2024-04-21T22:34:02.362265+0000","last_fullsized":"2024-04-21T22:34:02.362265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025960+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:34:02.025960+0000","last_peered":"2024-04-21T22:34:02.025960+0000","last_clean":"2024-04-21T22:34:02.025960+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:34:02.025960+0000","last_undegraded":"2024-04-21T22:34:02.025960+0000","last_fullsized":"2024-04-21T22:34:02.025960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153750+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:34:02.153750+0000","last_peered":"2024-04-21T22:34:02.153750+0000","last_clean":"2024-04-21T22:34:02.153750+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:34:02.153750+0000","last_undegraded":"2024-04-21T22:34:02.153750+0000","last_fullsized":"2024-04-21T22:34:02.153750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153887+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:34:02.153887+0000","last_peered":"2024-04-21T22:34:02.153887+0000","last_clean":"2024-04-21T22:34:02.153887+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:34:02.153887+0000","last_undegraded":"2024-04-21T22:34:02.153887+0000","last_fullsized":"2024-04-21T22:34:02.153887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028872+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:34:02.028872+0000","last_peered":"2024-04-21T22:34:02.028872+0000","last_clean":"2024-04-21T22:34:02.028872+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:34:02.028872+0000","last_undegraded":"2024-04-21T22:34:02.028872+0000","last_fullsized":"2024-04-21T22:34:02.028872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'13","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.554355+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:34:02.554355+0000","last_peered":"2024-04-21T22:34:02.554355+0000","last_clean":"2024-04-21T22:34:02.554355+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:34:02.554355+0000","last_undegraded":"2024-04-21T22:34:02.554355+0000","last_fullsized":"2024-04-21T22:34:02.554355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362886+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:34:02.362886+0000","last_peered":"2024-04-21T22:34:02.362886+0000","last_clean":"2024-04-21T22:34:02.362886+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:34:02.362886+0000","last_undegraded":"2024-04-21T22:34:02.362886+0000","last_fullsized":"2024-04-21T22:34:02.362886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152249+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:34:02.152249+0000","last_peered":"2024-04-21T22:34:02.152249+0000","last_clean":"2024-04-21T22:34:02.152249+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:34:02.152249+0000","last_undegraded":"2024-04-21T22:34:02.152249+0000","last_fullsized":"2024-04-21T22:34:02.152249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159819+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:34:02.159819+0000","last_peered":"2024-04-21T22:34:02.159819+0000","last_clean":"2024-04-21T22:34:02.159819+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:34:02.159819+0000","last_undegraded":"2024-04-21T22:34:02.159819+0000","last_fullsized":"2024-04-21T22:34:02.159819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724607+0000","last_change":"2024-04-21T22:32:17.565781+0000","last_active":"2024-04-21T22:34:02.724607+0000","last_peered":"2024-04-21T22:34:02.724607+0000","last_clean":"2024-04-21T22:34:02.724607+0000","last_became_active":"2024-04-21T22:32:17.560490+0000","last_became_peered":"2024-04-21T22:32:17.560490+0000","last_unstale":"2024-04-21T22:34:02.724607+0000","last_undegraded":"2024-04-21T22:34:02.724607+0000","last_fullsized":"2024-04-21T22:34:02.724607+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:20.976913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151946+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:34:02.151946+0000","last_peered":"2024-04-21T22:34:02.151946+0000","last_clean":"2024-04-21T22:34:02.151946+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:34:02.151946+0000","last_undegraded":"2024-04-21T22:34:02.151946+0000","last_fullsized":"2024-04-21T22:34:02.151946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163525+0000","last_change":"2024-04-21T22:32:17.568151+0000","last_active":"2024-04-21T22:34:02.163525+0000","last_peered":"2024-04-21T22:34:02.163525+0000","last_clean":"2024-04-21T22:34:02.163525+0000","last_became_active":"2024-04-21T22:32:17.560167+0000","last_became_peered":"2024-04-21T22:32:17.560167+0000","last_unstale":"2024-04-21T22:34:02.163525+0000","last_undegraded":"2024-04-21T22:34:02.163525+0000","last_fullsized":"2024-04-21T22:34:02.163525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:08.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159880+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:34:02.159880+0000","last_peered":"2024-04-21T22:34:02.159880+0000","last_clean":"2024-04-21T22:34:02.159880+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:34:02.159880+0000","last_undegraded":"2024-04-21T22:34:02.159880+0000","last_fullsized":"2024-04-21T22:34:02.159880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361435+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:34:02.361435+0000","last_peered":"2024-04-21T22:34:02.361435+0000","last_clean":"2024-04-21T22:34:02.361435+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:34:02.361435+0000","last_undegraded":"2024-04-21T22:34:02.361435+0000","last_fullsized":"2024-04-21T22:34:02.361435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152402+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:34:02.152402+0000","last_peered":"2024-04-21T22:34:02.152402+0000","last_clean":"2024-04-21T22:34:02.152402+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:34:02.152402+0000","last_undegraded":"2024-04-21T22:34:02.152402+0000","last_fullsized":"2024-04-21T22:34:02.152402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159385+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:34:02.159385+0000","last_peered":"2024-04-21T22:34:02.159385+0000","last_clean":"2024-04-21T22:34:02.159385+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:34:02.159385+0000","last_undegraded":"2024-04-21T22:34:02.159385+0000","last_fullsized":"2024-04-21T22:34:02.159385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024896+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:34:02.024896+0000","last_peered":"2024-04-21T22:34:02.024896+0000","last_clean":"2024-04-21T22:34:02.024896+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:34:02.024896+0000","last_undegraded":"2024-04-21T22:34:02.024896+0000","last_fullsized":"2024-04-21T22:34:02.024896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'8","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749157+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:34:02.749157+0000","last_peered":"2024-04-21T22:34:02.749157+0000","last_clean":"2024-04-21T22:34:02.749157+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:34:02.749157+0000","last_undegraded":"2024-04-21T22:34:02.749157+0000","last_fullsized":"2024-04-21T22:34:02.749157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":296,"num_read_kb":296,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362853+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:34:02.362853+0000","last_peered":"2024-04-21T22:34:02.362853+0000","last_clean":"2024-04-21T22:34:02.362853+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:34:02.362853+0000","last_undegraded":"2024-04-21T22:34:02.362853+0000","last_fullsized":"2024-04-21T22:34:02.362853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363600+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:34:02.363600+0000","last_peered":"2024-04-21T22:34:02.363600+0000","last_clean":"2024-04-21T22:34:02.363600+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:34:02.363600+0000","last_undegraded":"2024-04-21T22:34:02.363600+0000","last_fullsized":"2024-04-21T22:34:02.363600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028813+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:34:02.028813+0000","last_peered":"2024-04-21T22:34:02.028813+0000","last_clean":"2024-04-21T22:34:02.028813+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:34:02.028813+0000","last_undegraded":"2024-04-21T22:34:02.028813+0000","last_fullsized":"2024-04-21T22:34:02.028813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159993+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:34:02.159993+0000","last_peered":"2024-04-21T22:34:02.159993+0000","last_clean":"2024-04-21T22:34:02.159993+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:34:02.159993+0000","last_undegraded":"2024-04-21T22:34:02.159993+0000","last_fullsized":"2024-04-21T22:34:02.159993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363015+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:34:02.363015+0000","last_peered":"2024-04-21T22:34:02.363015+0000","last_clean":"2024-04-21T22:34:02.363015+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:34:02.363015+0000","last_undegraded":"2024-04-21T22:34:02.363015+0000","last_fullsized":"2024-04-21T22:34:02.363015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":371,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724945+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:34:02.724945+0000","last_peered":"2024-04-21T22:34:02.724945+0000","last_clean":"2024-04-21T22:34:02.724945+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:34:02.724945+0000","last_undegraded":"2024-04-21T22:34:02.724945+0000","last_fullsized":"2024-04-21T22:34:02.724945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67587,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":222,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152202+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:34:02.152202+0000","last_peered":"2024-04-21T22:34:02.152202+0000","last_clean":"2024-04-21T22:34:02.152202+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:34:02.152202+0000","last_undegraded":"2024-04-21T22:34:02.152202+0000","last_fullsized":"2024-04-21T22:34:02.152202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362136+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:34:02.362136+0000","last_peered":"2024-04-21T22:34:02.362136+0000","last_clean":"2024-04-21T22:34:02.362136+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:34:02.362136+0000","last_undegraded":"2024-04-21T22:34:02.362136+0000","last_fullsized":"2024-04-21T22:34:02.362136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361723+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:34:02.361723+0000","last_peered":"2024-04-21T22:34:02.361723+0000","last_clean":"2024-04-21T22:34:02.361723+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:34:02.361723+0000","last_undegraded":"2024-04-21T22:34:02.361723+0000","last_fullsized":"2024-04-21T22:34:02.361723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159510+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:34:02.159510+0000","last_peered":"2024-04-21T22:34:02.159510+0000","last_clean":"2024-04-21T22:34:02.159510+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:34:02.159510+0000","last_undegraded":"2024-04-21T22:34:02.159510+0000","last_fullsized":"2024-04-21T22:34:02.159510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363523+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:34:02.363523+0000","last_peered":"2024-04-21T22:34:02.363523+0000","last_clean":"2024-04-21T22:34:02.363523+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:34:02.363523+0000","last_undegraded":"2024-04-21T22:34:02.363523+0000","last_fullsized":"2024-04-21T22:34:02.363523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.863600+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:34:02.863600+0000","last_peered":"2024-04-21T22:34:02.863600+0000","last_clean":"2024-04-21T22:34:02.863600+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:34:02.863600+0000","last_undegraded":"2024-04-21T22:34:02.863600+0000","last_fullsized":"2024-04-21T22:34:02.863600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362955+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:34:02.362955+0000","last_peered":"2024-04-21T22:34:02.362955+0000","last_clean":"2024-04-21T22:34:02.362955+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:34:02.362955+0000","last_undegraded":"2024-04-21T22:34:02.362955+0000","last_fullsized":"2024-04-21T22:34:02.362955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151839+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:34:02.151839+0000","last_peered":"2024-04-21T22:34:02.151839+0000","last_clean":"2024-04-21T22:34:02.151839+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:34:02.151839+0000","last_undegraded":"2024-04-21T22:34:02.151839+0000","last_fullsized":"2024-04-21T22:34:02.151839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159534+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:34:02.159534+0000","last_peered":"2024-04-21T22:34:02.159534+0000","last_clean":"2024-04-21T22:34:02.159534+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:34:02.159534+0000","last_undegraded":"2024-04-21T22:34:02.159534+0000","last_fullsized":"2024-04-21T22:34:02.159534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152215+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:34:02.152215+0000","last_peered":"2024-04-21T22:34:02.152215+0000","last_clean":"2024-04-21T22:34:02.152215+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:34:02.152215+0000","last_undegraded":"2024-04-21T22:34:02.152215+0000","last_fullsized":"2024-04-21T22:34:02.152215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368038+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:34:02.368038+0000","last_peered":"2024-04-21T22:34:02.368038+0000","last_clean":"2024-04-21T22:34:02.368038+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:34:02.368038+0000","last_undegraded":"2024-04-21T22:34:02.368038+0000","last_fullsized":"2024-04-21T22:34:02.368038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025238+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:34:02.025238+0000","last_peered":"2024-04-21T22:34:02.025238+0000","last_clean":"2024-04-21T22:34:02.025238+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:34:02.025238+0000","last_undegraded":"2024-04-21T22:34:02.025238+0000","last_fullsized":"2024-04-21T22:34:02.025238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163927+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:34:02.163927+0000","last_peered":"2024-04-21T22:34:02.163927+0000","last_clean":"2024-04-21T22:34:02.163927+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:34:02.163927+0000","last_undegraded":"2024-04-21T22:34:02.163927+0000","last_fullsized":"2024-04-21T22:34:02.163927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'7","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.864523+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:34:02.864523+0000","last_peered":"2024-04-21T22:34:02.864523+0000","last_clean":"2024-04-21T22:34:02.864523+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:34:02.864523+0000","last_undegraded":"2024-04-21T22:34:02.864523+0000","last_fullsized":"2024-04-21T22:34:02.864523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1289,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024485+0000","last_change":"2024-04-21T22:32:17.633622+0000","last_active":"2024-04-21T22:34:02.024485+0000","last_peered":"2024-04-21T22:34:02.024485+0000","last_clean":"2024-04-21T22:34:02.024485+0000","last_became_active":"2024-04-21T22:32:17.633145+0000","last_became_peered":"2024-04-21T22:32:17.633145+0000","last_unstale":"2024-04-21T22:34:02.024485+0000","last_undegraded":"2024-04-21T22:34:02.024485+0000","last_fullsized":"2024-04-21T22:34:02.024485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:23:14.639799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"88'7","reported_seq":177,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.366089+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:34:02.366089+0000","last_peered":"2024-04-21T22:34:02.366089+0000","last_clean":"2024-04-21T22:34:02.366089+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:34:02.366089+0000","last_undegraded":"2024-04-21T22:34:02.366089+0000","last_fullsized":"2024-04-21T22:34:02.366089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153631+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:34:02.153631+0000","last_peered":"2024-04-21T22:34:02.153631+0000","last_clean":"2024-04-21T22:34:02.153631+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:34:02.153631+0000","last_undegraded":"2024-04-21T22:34:02.153631+0000","last_fullsized":"2024-04-21T22:34:02.153631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360615+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:34:02.360615+0000","last_peered":"2024-04-21T22:34:02.360615+0000","last_clean":"2024-04-21T22:34:02.360615+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:34:02.360615+0000","last_undegraded":"2024-04-21T22:34:02.360615+0000","last_fullsized":"2024-04-21T22:34:02.360615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363132+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:34:02.363132+0000","last_peered":"2024-04-21T22:34:02.363132+0000","last_clean":"2024-04-21T22:34:02.363132+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:34:02.363132+0000","last_undegraded":"2024-04-21T22:34:02.363132+0000","last_fullsized":"2024-04-21T22:34:02.363132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361136+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:34:02.361136+0000","last_peered":"2024-04-21T22:34:02.361136+0000","last_clean":"2024-04-21T22:34:02.361136+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:34:02.361136+0000","last_undegraded":"2024-04-21T22:34:02.361136+0000","last_fullsized":"2024-04-21T22:34:02.361136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363229+0000","last_change":"2024-04-21T22:32:17.636128+0000","last_active":"2024-04-21T22:34:02.363229+0000","last_peered":"2024-04-21T22:34:02.363229+0000","last_clean":"2024-04-21T22:34:02.363229+0000","last_became_active":"2024-04-21T22:32:17.633263+0000","last_became_peered":"2024-04-21T22:32:17.633263+0000","last_unstale":"2024-04-21T22:34:02.363229+0000","last_undegraded":"2024-04-21T22:34:02.363229+0000","last_fullsized":"2024-04-21T22:34:02.363229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:10:53.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152189+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:34:02.152189+0000","last_peered":"2024-04-21T22:34:02.152189+0000","last_clean":"2024-04-21T22:34:02.152189+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:34:02.152189+0000","last_undegraded":"2024-04-21T22:34:02.152189+0000","last_fullsized":"2024-04-21T22:34:02.152189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362476+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:34:02.362476+0000","last_peered":"2024-04-21T22:34:02.362476+0000","last_clean":"2024-04-21T22:34:02.362476+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:34:02.362476+0000","last_undegraded":"2024-04-21T22:34:02.362476+0000","last_fullsized":"2024-04-21T22:34:02.362476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'50","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.313071+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:34:02.313071+0000","last_peered":"2024-04-21T22:34:02.313071+0000","last_clean":"2024-04-21T22:34:02.313071+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:34:02.313071+0000","last_undegraded":"2024-04-21T22:34:02.313071+0000","last_fullsized":"2024-04-21T22:34:02.313071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.154317+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:34:02.154317+0000","last_peered":"2024-04-21T22:34:02.154317+0000","last_clean":"2024-04-21T22:34:02.154317+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:34:02.154317+0000","last_undegraded":"2024-04-21T22:34:02.154317+0000","last_fullsized":"2024-04-21T22:34:02.154317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360915+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:34:02.360915+0000","last_peered":"2024-04-21T22:34:02.360915+0000","last_clean":"2024-04-21T22:34:02.360915+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:34:02.360915+0000","last_undegraded":"2024-04-21T22:34:02.360915+0000","last_fullsized":"2024-04-21T22:34:02.360915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028602+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:34:02.028602+0000","last_peered":"2024-04-21T22:34:02.028602+0000","last_clean":"2024-04-21T22:34:02.028602+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:34:02.028602+0000","last_undegraded":"2024-04-21T22:34:02.028602+0000","last_fullsized":"2024-04-21T22:34:02.028602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362346+0000","last_change":"2024-04-21T22:32:17.566661+0000","last_active":"2024-04-21T22:34:02.362346+0000","last_peered":"2024-04-21T22:34:02.362346+0000","last_clean":"2024-04-21T22:34:02.362346+0000","last_became_active":"2024-04-21T22:32:17.563348+0000","last_became_peered":"2024-04-21T22:32:17.563348+0000","last_unstale":"2024-04-21T22:34:02.362346+0000","last_undegraded":"2024-04-21T22:34:02.362346+0000","last_fullsized":"2024-04-21T22:34:02.362346+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:05:28.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151846+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:34:02.151846+0000","last_peered":"2024-04-21T22:34:02.151846+0000","last_clean":"2024-04-21T22:34:02.151846+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:34:02.151846+0000","last_undegraded":"2024-04-21T22:34:02.151846+0000","last_fullsized":"2024-04-21T22:34:02.151846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153160+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:34:02.153160+0000","last_peered":"2024-04-21T22:34:02.153160+0000","last_clean":"2024-04-21T22:34:02.153160+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:34:02.153160+0000","last_undegraded":"2024-04-21T22:34:02.153160+0000","last_fullsized":"2024-04-21T22:34:02.153160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367691+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:34:02.367691+0000","last_peered":"2024-04-21T22:34:02.367691+0000","last_clean":"2024-04-21T22:34:02.367691+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:34:02.367691+0000","last_undegraded":"2024-04-21T22:34:02.367691+0000","last_fullsized":"2024-04-21T22:34:02.367691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362095+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:34:02.362095+0000","last_peered":"2024-04-21T22:34:02.362095+0000","last_clean":"2024-04-21T22:34:02.362095+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:34:02.362095+0000","last_undegraded":"2024-04-21T22:34:02.362095+0000","last_fullsized":"2024-04-21T22:34:02.362095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153632+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:34:02.153632+0000","last_peered":"2024-04-21T22:34:02.153632+0000","last_clean":"2024-04-21T22:34:02.153632+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:34:02.153632+0000","last_undegraded":"2024-04-21T22:34:02.153632+0000","last_fullsized":"2024-04-21T22:34:02.153632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151949+0000","last_change":"2024-04-21T22:32:17.571734+0000","last_active":"2024-04-21T22:34:02.151949+0000","last_peered":"2024-04-21T22:34:02.151949+0000","last_clean":"2024-04-21T22:34:02.151949+0000","last_became_active":"2024-04-21T22:32:17.559276+0000","last_became_peered":"2024-04-21T22:32:17.559276+0000","last_unstale":"2024-04-21T22:34:02.151949+0000","last_undegraded":"2024-04-21T22:34:02.151949+0000","last_fullsized":"2024-04-21T22:34:02.151949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:45.969569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363278+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:34:02.363278+0000","last_peered":"2024-04-21T22:34:02.363278+0000","last_clean":"2024-04-21T22:34:02.363278+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:34:02.363278+0000","last_undegraded":"2024-04-21T22:34:02.363278+0000","last_fullsized":"2024-04-21T22:34:02.363278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749755+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:34:02.749755+0000","last_peered":"2024-04-21T22:34:02.749755+0000","last_clean":"2024-04-21T22:34:02.749755+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:34:02.749755+0000","last_undegraded":"2024-04-21T22:34:02.749755+0000","last_fullsized":"2024-04-21T22:34:02.749755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363746+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:34:02.363746+0000","last_peered":"2024-04-21T22:34:02.363746+0000","last_clean":"2024-04-21T22:34:02.363746+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:34:02.363746+0000","last_undegraded":"2024-04-21T22:34:02.363746+0000","last_fullsized":"2024-04-21T22:34:02.363746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'41","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.306334+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:34:02.306334+0000","last_peered":"2024-04-21T22:34:02.306334+0000","last_clean":"2024-04-21T22:34:02.306334+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:34:02.306334+0000","last_undegraded":"2024-04-21T22:34:02.306334+0000","last_fullsized":"2024-04-21T22:34:02.306334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363387+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:34:02.363387+0000","last_peered":"2024-04-21T22:34:02.363387+0000","last_clean":"2024-04-21T22:34:02.363387+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:34:02.363387+0000","last_undegraded":"2024-04-21T22:34:02.363387+0000","last_fullsized":"2024-04-21T22:34:02.363387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362932+0000","last_change":"2024-04-21T22:32:17.639229+0000","last_active":"2024-04-21T22:34:02.362932+0000","last_peered":"2024-04-21T22:34:02.362932+0000","last_clean":"2024-04-21T22:34:02.362932+0000","last_became_active":"2024-04-21T22:32:17.633285+0000","last_became_peered":"2024-04-21T22:32:17.633285+0000","last_unstale":"2024-04-21T22:34:02.362932+0000","last_undegraded":"2024-04-21T22:34:02.362932+0000","last_fullsized":"2024-04-21T22:34:02.362932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:12:41.023954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363591+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:34:02.363591+0000","last_peered":"2024-04-21T22:34:02.363591+0000","last_clean":"2024-04-21T22:34:02.363591+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:34:02.363591+0000","last_undegraded":"2024-04-21T22:34:02.363591+0000","last_fullsized":"2024-04-21T22:34:02.363591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367734+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:34:02.367734+0000","last_peered":"2024-04-21T22:34:02.367734+0000","last_clean":"2024-04-21T22:34:02.367734+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:34:02.367734+0000","last_undegraded":"2024-04-21T22:34:02.367734+0000","last_fullsized":"2024-04-21T22:34:02.367734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362029+0000","last_change":"2024-04-21T22:32:17.562956+0000","last_active":"2024-04-21T22:34:02.362029+0000","last_peered":"2024-04-21T22:34:02.362029+0000","last_clean":"2024-04-21T22:34:02.362029+0000","last_became_active":"2024-04-21T22:32:17.562432+0000","last_became_peered":"2024-04-21T22:32:17.562432+0000","last_unstale":"2024-04-21T22:34:02.362029+0000","last_undegraded":"2024-04-21T22:34:02.362029+0000","last_fullsized":"2024-04-21T22:34:02.362029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:37:08.467907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361983+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:34:02.361983+0000","last_peered":"2024-04-21T22:34:02.361983+0000","last_clean":"2024-04-21T22:34:02.361983+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:34:02.361983+0000","last_undegraded":"2024-04-21T22:34:02.361983+0000","last_fullsized":"2024-04-21T22:34:02.361983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.029064+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:34:02.029064+0000","last_peered":"2024-04-21T22:34:02.029064+0000","last_clean":"2024-04-21T22:34:02.029064+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:34:02.029064+0000","last_undegraded":"2024-04-21T22:34:02.029064+0000","last_fullsized":"2024-04-21T22:34:02.029064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362622+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:34:02.362622+0000","last_peered":"2024-04-21T22:34:02.362622+0000","last_clean":"2024-04-21T22:34:02.362622+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:34:02.362622+0000","last_undegraded":"2024-04-21T22:34:02.362622+0000","last_fullsized":"2024-04-21T22:34:02.362622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367929+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:34:02.367929+0000","last_peered":"2024-04-21T22:34:02.367929+0000","last_clean":"2024-04-21T22:34:02.367929+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:34:02.367929+0000","last_undegraded":"2024-04-21T22:34:02.367929+0000","last_fullsized":"2024-04-21T22:34:02.367929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362394+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:34:02.362394+0000","last_peered":"2024-04-21T22:34:02.362394+0000","last_clean":"2024-04-21T22:34:02.362394+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:34:02.362394+0000","last_undegraded":"2024-04-21T22:34:02.362394+0000","last_fullsized":"2024-04-21T22:34:02.362394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025854+0000","last_change":"2024-04-21T22:32:17.632654+0000","last_active":"2024-04-21T22:34:02.025854+0000","last_peered":"2024-04-21T22:34:02.025854+0000","last_clean":"2024-04-21T22:34:02.025854+0000","last_became_active":"2024-04-21T22:32:17.632354+0000","last_became_peered":"2024-04-21T22:32:17.632354+0000","last_unstale":"2024-04-21T22:34:02.025854+0000","last_undegraded":"2024-04-21T22:34:02.025854+0000","last_fullsized":"2024-04-21T22:34:02.025854+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:51.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159429+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:34:02.159429+0000","last_peered":"2024-04-21T22:34:02.159429+0000","last_clean":"2024-04-21T22:34:02.159429+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:34:02.159429+0000","last_undegraded":"2024-04-21T22:34:02.159429+0000","last_fullsized":"2024-04-21T22:34:02.159429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153094+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:34:02.153094+0000","last_peered":"2024-04-21T22:34:02.153094+0000","last_clean":"2024-04-21T22:34:02.153094+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:34:02.153094+0000","last_undegraded":"2024-04-21T22:34:02.153094+0000","last_fullsized":"2024-04-21T22:34:02.153094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362627+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:34:02.362627+0000","last_peered":"2024-04-21T22:34:02.362627+0000","last_clean":"2024-04-21T22:34:02.362627+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:34:02.362627+0000","last_undegraded":"2024-04-21T22:34:02.362627+0000","last_fullsized":"2024-04-21T22:34:02.362627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362069+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:34:02.362069+0000","last_peered":"2024-04-21T22:34:02.362069+0000","last_clean":"2024-04-21T22:34:02.362069+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:34:02.362069+0000","last_undegraded":"2024-04-21T22:34:02.362069+0000","last_fullsized":"2024-04-21T22:34:02.362069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367869+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:34:02.367869+0000","last_peered":"2024-04-21T22:34:02.367869+0000","last_clean":"2024-04-21T22:34:02.367869+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:34:02.367869+0000","last_undegraded":"2024-04-21T22:34:02.367869+0000","last_fullsized":"2024-04-21T22:34:02.367869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602295,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1575,"num_read_kb":927,"num_write":380,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1806885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383726,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":468458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645361,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37224,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707928,"statfs":{"total":95995035648,"available":95956918272,"internally_reserved":0,"allocated":1810432,"data_stored":1250583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1392640,"data_stored":859136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070526,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1388544,"data_stored":859514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1593344,"data_stored":1060972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495689,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":467899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1073152,"data_stored":535812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182490,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":466421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32868,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712284,"statfs":{"total":95995035648,"available":95961378816,"internally_reserved":0,"allocated":1732608,"data_stored":1189081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":133798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:34:07.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 -- 172.21.15.18:0/2693498326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c101690 msgr2=0x7f590c101ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 --2- 172.21.15.18:0/2693498326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c101690 0x7f590c101ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009900 tx=0x7f58fc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 -- 172.21.15.18:0/2693498326 shutdown_connections 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 --2- 172.21.15.18:0/2693498326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c103240 0x7f590c109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 --2- 172.21.15.18:0/2693498326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 0x7f590c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 --2- 172.21.15.18:0/2693498326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c101690 0x7f590c101ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 -- 172.21.15.18:0/2693498326 >> 172.21.15.18:0/2693498326 conn(0x7f590c0fcc00 msgr2=0x7f590c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 -- 172.21.15.18:0/2693498326 shutdown_connections 2024-04-21T22:34:07.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.972+0000 7f5911000640 1 -- 172.21.15.18:0/2693498326 wait complete. 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.973+0000 7f5911000640 1 Processor -- start 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.973+0000 7f5911000640 1 -- start start 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.973+0000 7f5911000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 0x7f590c0754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5911000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 0x7f590c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5911000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5911000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d330 con 0x7f590c101690 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5911000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d1b0 con 0x7f590c102880 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5911000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f590c10d4b0 con 0x7f590c103240 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 0x7f590c0754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51874/0 (socket says 172.21.15.18:51874) 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 0x7f590c0754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33400/0 (socket says 172.21.15.18:33400) 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 -- 172.21.15.18:0/4065099408 learned_addr learned my addr 172.21.15.18:0/4065099408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f5903e00640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 0x7f590c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 -- 172.21.15.18:0/4065099408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 msgr2=0x7f590c073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 0x7f590c073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 -- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 msgr2=0x7f590c0754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 0x7f590c0754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.974+0000 7f590be00640 1 -- 172.21.15.18:0/4065099408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c074900 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f590be00640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f590400eb10 tx=0x7f590400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904004b20 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c1a1ac0 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5904004cc0 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904010760 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.975+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c1a1fc0 con 0x7f590c103240 2024-04-21T22:34:07.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.976+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c1089b0 con 0x7f590c103240 2024-04-21T22:34:07.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.978+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f5904010900 con 0x7f590c103240 2024-04-21T22:34:07.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.980+0000 7f5908c00640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 0x7f58f00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:07.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.980+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f59040d0160 con 0x7f590c103240 2024-04-21T22:34:07.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.980+0000 7f590b400640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 0x7f58f00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:07.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.981+0000 7f590b400640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 0x7f58f00a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58fc02c170 tx=0x7f58fc02df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:07.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:07.982+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f590409cb30 con 0x7f590c103240 2024-04-21T22:34:08.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.185+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f590c061b80 con 0x7f58f00a2e10 2024-04-21T22:34:08.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.194+0000 7f5908c00640 1 -- 172.21.15.18:0/4065099408 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257812 (secure 0 0 0) 0x7f590c061b80 con 0x7f58f00a2e10 2024-04-21T22:34:08.196 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:08.197 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:34:08.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 msgr2=0x7f58f00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 0x7f58f00a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f58fc02c170 tx=0x7f58fc02df90 comp rx=0 tx=0).stop 2024-04-21T22:34:08.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 msgr2=0x7f590c074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f590400eb10 tx=0x7f590400c2d0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 shutdown_connections 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58f00a2e10 0x7f58f00a52d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590c103240 0x7f590c074070 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c102880 0x7f590c073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 --2- 172.21.15.18:0/4065099408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f590c101690 0x7f590c0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 >> 172.21.15.18:0/4065099408 conn(0x7f590c0fcc00 msgr2=0x7f590c105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.197+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 shutdown_connections 2024-04-21T22:34:08.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.198+0000 7f5911000640 1 -- 172.21.15.18:0/4065099408 wait complete. 2024-04-21T22:34:08.216 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-21T22:34:08.044819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192897,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1711,"num_read_kb":1046,"num_write":563,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181749,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":947,"ondisk_log_size":947,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372228,"kb_used_data":14604,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569596,"statfs":{"total":1151940427776,"available":1151559266304,"internally_reserved":0,"allocated":14954496,"data_stored":8600389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.976658"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368197+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:34:02.368197+0000","last_peered":"2024-04-21T22:34:02.368197+0000","last_clean":"2024-04-21T22:34:02.368197+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:34:02.368197+0000","last_undegraded":"2024-04-21T22:34:02.368197+0000","last_fullsized":"2024-04-21T22:34:02.368197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028530+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:34:02.028530+0000","last_peered":"2024-04-21T22:34:02.028530+0000","last_clean":"2024-04-21T22:34:02.028530+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:34:02.028530+0000","last_undegraded":"2024-04-21T22:34:02.028530+0000","last_fullsized":"2024-04-21T22:34:02.028530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028381+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:34:02.028381+0000","last_peered":"2024-04-21T22:34:02.028381+0000","last_clean":"2024-04-21T22:34:02.028381+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:34:02.028381+0000","last_undegraded":"2024-04-21T22:34:02.028381+0000","last_fullsized":"2024-04-21T22:34:02.028381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361050+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:34:02.361050+0000","last_peered":"2024-04-21T22:34:02.361050+0000","last_clean":"2024-04-21T22:34:02.361050+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:34:02.361050+0000","last_undegraded":"2024-04-21T22:34:02.361050+0000","last_fullsized":"2024-04-21T22:34:02.361050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152014+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:34:02.152014+0000","last_peered":"2024-04-21T22:34:02.152014+0000","last_clean":"2024-04-21T22:34:02.152014+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:34:02.152014+0000","last_undegraded":"2024-04-21T22:34:02.152014+0000","last_fullsized":"2024-04-21T22:34:02.152014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363047+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:34:02.363047+0000","last_peered":"2024-04-21T22:34:02.363047+0000","last_clean":"2024-04-21T22:34:02.363047+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:34:02.363047+0000","last_undegraded":"2024-04-21T22:34:02.363047+0000","last_fullsized":"2024-04-21T22:34:02.363047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152461+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:34:02.152461+0000","last_peered":"2024-04-21T22:34:02.152461+0000","last_clean":"2024-04-21T22:34:02.152461+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:34:02.152461+0000","last_undegraded":"2024-04-21T22:34:02.152461+0000","last_fullsized":"2024-04-21T22:34:02.152461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363317+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:34:02.363317+0000","last_peered":"2024-04-21T22:34:02.363317+0000","last_clean":"2024-04-21T22:34:02.363317+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:34:02.363317+0000","last_undegraded":"2024-04-21T22:34:02.363317+0000","last_fullsized":"2024-04-21T22:34:02.363317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.164106+0000","last_change":"2024-04-21T22:32:17.561622+0000","last_active":"2024-04-21T22:34:02.164106+0000","last_peered":"2024-04-21T22:34:02.164106+0000","last_clean":"2024-04-21T22:34:02.164106+0000","last_became_active":"2024-04-21T22:32:17.561139+0000","last_became_peered":"2024-04-21T22:32:17.561139+0000","last_unstale":"2024-04-21T22:34:02.164106+0000","last_undegraded":"2024-04-21T22:34:02.164106+0000","last_fullsized":"2024-04-21T22:34:02.164106+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:52:09.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363594+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:34:02.363594+0000","last_peered":"2024-04-21T22:34:02.363594+0000","last_clean":"2024-04-21T22:34:02.363594+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:34:02.363594+0000","last_undegraded":"2024-04-21T22:34:02.363594+0000","last_fullsized":"2024-04-21T22:34:02.363594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360929+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:34:02.360929+0000","last_peered":"2024-04-21T22:34:02.360929+0000","last_clean":"2024-04-21T22:34:02.360929+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:34:02.360929+0000","last_undegraded":"2024-04-21T22:34:02.360929+0000","last_fullsized":"2024-04-21T22:34:02.360929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362279+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:34:02.362279+0000","last_peered":"2024-04-21T22:34:02.362279+0000","last_clean":"2024-04-21T22:34:02.362279+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:34:02.362279+0000","last_undegraded":"2024-04-21T22:34:02.362279+0000","last_fullsized":"2024-04-21T22:34:02.362279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027942+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:34:02.027942+0000","last_peered":"2024-04-21T22:34:02.027942+0000","last_clean":"2024-04-21T22:34:02.027942+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:34:02.027942+0000","last_undegraded":"2024-04-21T22:34:02.027942+0000","last_fullsized":"2024-04-21T22:34:02.027942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027820+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:34:02.027820+0000","last_peered":"2024-04-21T22:34:02.027820+0000","last_clean":"2024-04-21T22:34:02.027820+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:34:02.027820+0000","last_undegraded":"2024-04-21T22:34:02.027820+0000","last_fullsized":"2024-04-21T22:34:02.027820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362328+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:34:02.362328+0000","last_peered":"2024-04-21T22:34:02.362328+0000","last_clean":"2024-04-21T22:34:02.362328+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:34:02.362328+0000","last_undegraded":"2024-04-21T22:34:02.362328+0000","last_fullsized":"2024-04-21T22:34:02.362328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368203+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:34:02.368203+0000","last_peered":"2024-04-21T22:34:02.368203+0000","last_clean":"2024-04-21T22:34:02.368203+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:34:02.368203+0000","last_undegraded":"2024-04-21T22:34:02.368203+0000","last_fullsized":"2024-04-21T22:34:02.368203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025715+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:34:02.025715+0000","last_peered":"2024-04-21T22:34:02.025715+0000","last_clean":"2024-04-21T22:34:02.025715+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:34:02.025715+0000","last_undegraded":"2024-04-21T22:34:02.025715+0000","last_fullsized":"2024-04-21T22:34:02.025715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362265+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:34:02.362265+0000","last_peered":"2024-04-21T22:34:02.362265+0000","last_clean":"2024-04-21T22:34:02.362265+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:34:02.362265+0000","last_undegraded":"2024-04-21T22:34:02.362265+0000","last_fullsized":"2024-04-21T22:34:02.362265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025960+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:34:02.025960+0000","last_peered":"2024-04-21T22:34:02.025960+0000","last_clean":"2024-04-21T22:34:02.025960+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:34:02.025960+0000","last_undegraded":"2024-04-21T22:34:02.025960+0000","last_fullsized":"2024-04-21T22:34:02.025960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153750+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:34:02.153750+0000","last_peered":"2024-04-21T22:34:02.153750+0000","last_clean":"2024-04-21T22:34:02.153750+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:34:02.153750+0000","last_undegraded":"2024-04-21T22:34:02.153750+0000","last_fullsized":"2024-04-21T22:34:02.153750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153887+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:34:02.153887+0000","last_peered":"2024-04-21T22:34:02.153887+0000","last_clean":"2024-04-21T22:34:02.153887+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:34:02.153887+0000","last_undegraded":"2024-04-21T22:34:02.153887+0000","last_fullsized":"2024-04-21T22:34:02.153887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028872+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:34:02.028872+0000","last_peered":"2024-04-21T22:34:02.028872+0000","last_clean":"2024-04-21T22:34:02.028872+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:34:02.028872+0000","last_undegraded":"2024-04-21T22:34:02.028872+0000","last_fullsized":"2024-04-21T22:34:02.028872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'13","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.554355+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:34:02.554355+0000","last_peered":"2024-04-21T22:34:02.554355+0000","last_clean":"2024-04-21T22:34:02.554355+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:34:02.554355+0000","last_undegraded":"2024-04-21T22:34:02.554355+0000","last_fullsized":"2024-04-21T22:34:02.554355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362886+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:34:02.362886+0000","last_peered":"2024-04-21T22:34:02.362886+0000","last_clean":"2024-04-21T22:34:02.362886+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:34:02.362886+0000","last_undegraded":"2024-04-21T22:34:02.362886+0000","last_fullsized":"2024-04-21T22:34:02.362886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152249+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:34:02.152249+0000","last_peered":"2024-04-21T22:34:02.152249+0000","last_clean":"2024-04-21T22:34:02.152249+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:34:02.152249+0000","last_undegraded":"2024-04-21T22:34:02.152249+0000","last_fullsized":"2024-04-21T22:34:02.152249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159819+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:34:02.159819+0000","last_peered":"2024-04-21T22:34:02.159819+0000","last_clean":"2024-04-21T22:34:02.159819+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:34:02.159819+0000","last_undegraded":"2024-04-21T22:34:02.159819+0000","last_fullsized":"2024-04-21T22:34:02.159819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724607+0000","last_change":"2024-04-21T22:32:17.565781+0000","last_active":"2024-04-21T22:34:02.724607+0000","last_peered":"2024-04-21T22:34:02.724607+0000","last_clean":"2024-04-21T22:34:02.724607+0000","last_became_active":"2024-04-21T22:32:17.560490+0000","last_became_peered":"2024-04-21T22:32:17.560490+0000","last_unstale":"2024-04-21T22:34:02.724607+0000","last_undegraded":"2024-04-21T22:34:02.724607+0000","last_fullsized":"2024-04-21T22:34:02.724607+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:20.976913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151946+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:34:02.151946+0000","last_peered":"2024-04-21T22:34:02.151946+0000","last_clean":"2024-04-21T22:34:02.151946+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:34:02.151946+0000","last_undegraded":"2024-04-21T22:34:02.151946+0000","last_fullsized":"2024-04-21T22:34:02.151946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163525+0000","last_change":"2024-04-21T22:32:17.568151+0000","last_active":"2024-04-21T22:34:02.163525+0000","last_peered":"2024-04-21T22:34:02.163525+0000","last_clean":"2024-04-21T22:34:02.163525+0000","last_became_active":"2024-04-21T22:32:17.560167+0000","last_became_peered":"2024-04-21T22:32:17.560167+0000","last_unstale":"2024-04-21T22:34:02.163525+0000","last_undegraded":"2024-04-21T22:34:02.163525+0000","last_fullsized":"2024-04-21T22:34:02.163525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:08.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159880+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:34:02.159880+0000","last_peered":"2024-04-21T22:34:02.159880+0000","last_clean":"2024-04-21T22:34:02.159880+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:34:02.159880+0000","last_undegraded":"2024-04-21T22:34:02.159880+0000","last_fullsized":"2024-04-21T22:34:02.159880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361435+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:34:02.361435+0000","last_peered":"2024-04-21T22:34:02.361435+0000","last_clean":"2024-04-21T22:34:02.361435+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:34:02.361435+0000","last_undegraded":"2024-04-21T22:34:02.361435+0000","last_fullsized":"2024-04-21T22:34:02.361435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152402+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:34:02.152402+0000","last_peered":"2024-04-21T22:34:02.152402+0000","last_clean":"2024-04-21T22:34:02.152402+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:34:02.152402+0000","last_undegraded":"2024-04-21T22:34:02.152402+0000","last_fullsized":"2024-04-21T22:34:02.152402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159385+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:34:02.159385+0000","last_peered":"2024-04-21T22:34:02.159385+0000","last_clean":"2024-04-21T22:34:02.159385+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:34:02.159385+0000","last_undegraded":"2024-04-21T22:34:02.159385+0000","last_fullsized":"2024-04-21T22:34:02.159385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024896+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:34:02.024896+0000","last_peered":"2024-04-21T22:34:02.024896+0000","last_clean":"2024-04-21T22:34:02.024896+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:34:02.024896+0000","last_undegraded":"2024-04-21T22:34:02.024896+0000","last_fullsized":"2024-04-21T22:34:02.024896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'8","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749157+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:34:02.749157+0000","last_peered":"2024-04-21T22:34:02.749157+0000","last_clean":"2024-04-21T22:34:02.749157+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:34:02.749157+0000","last_undegraded":"2024-04-21T22:34:02.749157+0000","last_fullsized":"2024-04-21T22:34:02.749157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":296,"num_read_kb":296,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362853+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:34:02.362853+0000","last_peered":"2024-04-21T22:34:02.362853+0000","last_clean":"2024-04-21T22:34:02.362853+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:34:02.362853+0000","last_undegraded":"2024-04-21T22:34:02.362853+0000","last_fullsized":"2024-04-21T22:34:02.362853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363600+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:34:02.363600+0000","last_peered":"2024-04-21T22:34:02.363600+0000","last_clean":"2024-04-21T22:34:02.363600+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:34:02.363600+0000","last_undegraded":"2024-04-21T22:34:02.363600+0000","last_fullsized":"2024-04-21T22:34:02.363600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028813+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:34:02.028813+0000","last_peered":"2024-04-21T22:34:02.028813+0000","last_clean":"2024-04-21T22:34:02.028813+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:34:02.028813+0000","last_undegraded":"2024-04-21T22:34:02.028813+0000","last_fullsized":"2024-04-21T22:34:02.028813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159993+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:34:02.159993+0000","last_peered":"2024-04-21T22:34:02.159993+0000","last_clean":"2024-04-21T22:34:02.159993+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:34:02.159993+0000","last_undegraded":"2024-04-21T22:34:02.159993+0000","last_fullsized":"2024-04-21T22:34:02.159993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363015+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:34:02.363015+0000","last_peered":"2024-04-21T22:34:02.363015+0000","last_clean":"2024-04-21T22:34:02.363015+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:34:02.363015+0000","last_undegraded":"2024-04-21T22:34:02.363015+0000","last_fullsized":"2024-04-21T22:34:02.363015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":371,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724945+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:34:02.724945+0000","last_peered":"2024-04-21T22:34:02.724945+0000","last_clean":"2024-04-21T22:34:02.724945+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:34:02.724945+0000","last_undegraded":"2024-04-21T22:34:02.724945+0000","last_fullsized":"2024-04-21T22:34:02.724945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67587,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":222,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152202+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:34:02.152202+0000","last_peered":"2024-04-21T22:34:02.152202+0000","last_clean":"2024-04-21T22:34:02.152202+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:34:02.152202+0000","last_undegraded":"2024-04-21T22:34:02.152202+0000","last_fullsized":"2024-04-21T22:34:02.152202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362136+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:34:02.362136+0000","last_peered":"2024-04-21T22:34:02.362136+0000","last_clean":"2024-04-21T22:34:02.362136+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:34:02.362136+0000","last_undegraded":"2024-04-21T22:34:02.362136+0000","last_fullsized":"2024-04-21T22:34:02.362136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361723+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:34:02.361723+0000","last_peered":"2024-04-21T22:34:02.361723+0000","last_clean":"2024-04-21T22:34:02.361723+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:34:02.361723+0000","last_undegraded":"2024-04-21T22:34:02.361723+0000","last_fullsized":"2024-04-21T22:34:02.361723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159510+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:34:02.159510+0000","last_peered":"2024-04-21T22:34:02.159510+0000","last_clean":"2024-04-21T22:34:02.159510+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:34:02.159510+0000","last_undegraded":"2024-04-21T22:34:02.159510+0000","last_fullsized":"2024-04-21T22:34:02.159510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363523+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:34:02.363523+0000","last_peered":"2024-04-21T22:34:02.363523+0000","last_clean":"2024-04-21T22:34:02.363523+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:34:02.363523+0000","last_undegraded":"2024-04-21T22:34:02.363523+0000","last_fullsized":"2024-04-21T22:34:02.363523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.863600+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:34:02.863600+0000","last_peered":"2024-04-21T22:34:02.863600+0000","last_clean":"2024-04-21T22:34:02.863600+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:34:02.863600+0000","last_undegraded":"2024-04-21T22:34:02.863600+0000","last_fullsized":"2024-04-21T22:34:02.863600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362955+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:34:02.362955+0000","last_peered":"2024-04-21T22:34:02.362955+0000","last_clean":"2024-04-21T22:34:02.362955+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:34:02.362955+0000","last_undegraded":"2024-04-21T22:34:02.362955+0000","last_fullsized":"2024-04-21T22:34:02.362955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151839+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:34:02.151839+0000","last_peered":"2024-04-21T22:34:02.151839+0000","last_clean":"2024-04-21T22:34:02.151839+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:34:02.151839+0000","last_undegraded":"2024-04-21T22:34:02.151839+0000","last_fullsized":"2024-04-21T22:34:02.151839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159534+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:34:02.159534+0000","last_peered":"2024-04-21T22:34:02.159534+0000","last_clean":"2024-04-21T22:34:02.159534+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:34:02.159534+0000","last_undegraded":"2024-04-21T22:34:02.159534+0000","last_fullsized":"2024-04-21T22:34:02.159534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152215+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:34:02.152215+0000","last_peered":"2024-04-21T22:34:02.152215+0000","last_clean":"2024-04-21T22:34:02.152215+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:34:02.152215+0000","last_undegraded":"2024-04-21T22:34:02.152215+0000","last_fullsized":"2024-04-21T22:34:02.152215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368038+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:34:02.368038+0000","last_peered":"2024-04-21T22:34:02.368038+0000","last_clean":"2024-04-21T22:34:02.368038+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:34:02.368038+0000","last_undegraded":"2024-04-21T22:34:02.368038+0000","last_fullsized":"2024-04-21T22:34:02.368038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025238+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:34:02.025238+0000","last_peered":"2024-04-21T22:34:02.025238+0000","last_clean":"2024-04-21T22:34:02.025238+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:34:02.025238+0000","last_undegraded":"2024-04-21T22:34:02.025238+0000","last_fullsized":"2024-04-21T22:34:02.025238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163927+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:34:02.163927+0000","last_peered":"2024-04-21T22:34:02.163927+0000","last_clean":"2024-04-21T22:34:02.163927+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:34:02.163927+0000","last_undegraded":"2024-04-21T22:34:02.163927+0000","last_fullsized":"2024-04-21T22:34:02.163927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'7","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.864523+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:34:02.864523+0000","last_peered":"2024-04-21T22:34:02.864523+0000","last_clean":"2024-04-21T22:34:02.864523+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:34:02.864523+0000","last_undegraded":"2024-04-21T22:34:02.864523+0000","last_fullsized":"2024-04-21T22:34:02.864523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1289,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024485+0000","last_change":"2024-04-21T22:32:17.633622+0000","last_active":"2024-04-21T22:34:02.024485+0000","last_peered":"2024-04-21T22:34:02.024485+0000","last_clean":"2024-04-21T22:34:02.024485+0000","last_became_active":"2024-04-21T22:32:17.633145+0000","last_became_peered":"2024-04-21T22:32:17.633145+0000","last_unstale":"2024-04-21T22:34:02.024485+0000","last_undegraded":"2024-04-21T22:34:02.024485+0000","last_fullsized":"2024-04-21T22:34:02.024485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:23:14.639799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"88'7","reported_seq":177,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.366089+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:34:02.366089+0000","last_peered":"2024-04-21T22:34:02.366089+0000","last_clean":"2024-04-21T22:34:02.366089+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:34:02.366089+0000","last_undegraded":"2024-04-21T22:34:02.366089+0000","last_fullsized":"2024-04-21T22:34:02.366089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153631+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:34:02.153631+0000","last_peered":"2024-04-21T22:34:02.153631+0000","last_clean":"2024-04-21T22:34:02.153631+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:34:02.153631+0000","last_undegraded":"2024-04-21T22:34:02.153631+0000","last_fullsized":"2024-04-21T22:34:02.153631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360615+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:34:02.360615+0000","last_peered":"2024-04-21T22:34:02.360615+0000","last_clean":"2024-04-21T22:34:02.360615+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:34:02.360615+0000","last_undegraded":"2024-04-21T22:34:02.360615+0000","last_fullsized":"2024-04-21T22:34:02.360615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363132+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:34:02.363132+0000","last_peered":"2024-04-21T22:34:02.363132+0000","last_clean":"2024-04-21T22:34:02.363132+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:34:02.363132+0000","last_undegraded":"2024-04-21T22:34:02.363132+0000","last_fullsized":"2024-04-21T22:34:02.363132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361136+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:34:02.361136+0000","last_peered":"2024-04-21T22:34:02.361136+0000","last_clean":"2024-04-21T22:34:02.361136+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:34:02.361136+0000","last_undegraded":"2024-04-21T22:34:02.361136+0000","last_fullsized":"2024-04-21T22:34:02.361136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363229+0000","last_change":"2024-04-21T22:32:17.636128+0000","last_active":"2024-04-21T22:34:02.363229+0000","last_peered":"2024-04-21T22:34:02.363229+0000","last_clean":"2024-04-21T22:34:02.363229+0000","last_became_active":"2024-04-21T22:32:17.633263+0000","last_became_peered":"2024-04-21T22:32:17.633263+0000","last_unstale":"2024-04-21T22:34:02.363229+0000","last_undegraded":"2024-04-21T22:34:02.363229+0000","last_fullsized":"2024-04-21T22:34:02.363229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:10:53.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152189+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:34:02.152189+0000","last_peered":"2024-04-21T22:34:02.152189+0000","last_clean":"2024-04-21T22:34:02.152189+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:34:02.152189+0000","last_undegraded":"2024-04-21T22:34:02.152189+0000","last_fullsized":"2024-04-21T22:34:02.152189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362476+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:34:02.362476+0000","last_peered":"2024-04-21T22:34:02.362476+0000","last_clean":"2024-04-21T22:34:02.362476+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:34:02.362476+0000","last_undegraded":"2024-04-21T22:34:02.362476+0000","last_fullsized":"2024-04-21T22:34:02.362476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'50","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.313071+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:34:02.313071+0000","last_peered":"2024-04-21T22:34:02.313071+0000","last_clean":"2024-04-21T22:34:02.313071+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:34:02.313071+0000","last_undegraded":"2024-04-21T22:34:02.313071+0000","last_fullsized":"2024-04-21T22:34:02.313071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.154317+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:34:02.154317+0000","last_peered":"2024-04-21T22:34:02.154317+0000","last_clean":"2024-04-21T22:34:02.154317+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:34:02.154317+0000","last_undegraded":"2024-04-21T22:34:02.154317+0000","last_fullsized":"2024-04-21T22:34:02.154317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360915+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:34:02.360915+0000","last_peered":"2024-04-21T22:34:02.360915+0000","last_clean":"2024-04-21T22:34:02.360915+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:34:02.360915+0000","last_undegraded":"2024-04-21T22:34:02.360915+0000","last_fullsized":"2024-04-21T22:34:02.360915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028602+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:34:02.028602+0000","last_peered":"2024-04-21T22:34:02.028602+0000","last_clean":"2024-04-21T22:34:02.028602+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:34:02.028602+0000","last_undegraded":"2024-04-21T22:34:02.028602+0000","last_fullsized":"2024-04-21T22:34:02.028602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362346+0000","last_change":"2024-04-21T22:32:17.566661+0000","last_active":"2024-04-21T22:34:02.362346+0000","last_peered":"2024-04-21T22:34:02.362346+0000","last_clean":"2024-04-21T22:34:02.362346+0000","last_became_active":"2024-04-21T22:32:17.563348+0000","last_became_peered":"2024-04-21T22:32:17.563348+0000","last_unstale":"2024-04-21T22:34:02.362346+0000","last_undegraded":"2024-04-21T22:34:02.362346+0000","last_fullsized":"2024-04-21T22:34:02.362346+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:05:28.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151846+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:34:02.151846+0000","last_peered":"2024-04-21T22:34:02.151846+0000","last_clean":"2024-04-21T22:34:02.151846+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:34:02.151846+0000","last_undegraded":"2024-04-21T22:34:02.151846+0000","last_fullsized":"2024-04-21T22:34:02.151846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153160+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:34:02.153160+0000","last_peered":"2024-04-21T22:34:02.153160+0000","last_clean":"2024-04-21T22:34:02.153160+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:34:02.153160+0000","last_undegraded":"2024-04-21T22:34:02.153160+0000","last_fullsized":"2024-04-21T22:34:02.153160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367691+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:34:02.367691+0000","last_peered":"2024-04-21T22:34:02.367691+0000","last_clean":"2024-04-21T22:34:02.367691+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:34:02.367691+0000","last_undegraded":"2024-04-21T22:34:02.367691+0000","last_fullsized":"2024-04-21T22:34:02.367691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362095+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:34:02.362095+0000","last_peered":"2024-04-21T22:34:02.362095+0000","last_clean":"2024-04-21T22:34:02.362095+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:34:02.362095+0000","last_undegraded":"2024-04-21T22:34:02.362095+0000","last_fullsized":"2024-04-21T22:34:02.362095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153632+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:34:02.153632+0000","last_peered":"2024-04-21T22:34:02.153632+0000","last_clean":"2024-04-21T22:34:02.153632+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:34:02.153632+0000","last_undegraded":"2024-04-21T22:34:02.153632+0000","last_fullsized":"2024-04-21T22:34:02.153632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151949+0000","last_change":"2024-04-21T22:32:17.571734+0000","last_active":"2024-04-21T22:34:02.151949+0000","last_peered":"2024-04-21T22:34:02.151949+0000","last_clean":"2024-04-21T22:34:02.151949+0000","last_became_active":"2024-04-21T22:32:17.559276+0000","last_became_peered":"2024-04-21T22:32:17.559276+0000","last_unstale":"2024-04-21T22:34:02.151949+0000","last_undegraded":"2024-04-21T22:34:02.151949+0000","last_fullsized":"2024-04-21T22:34:02.151949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:45.969569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363278+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:34:02.363278+0000","last_peered":"2024-04-21T22:34:02.363278+0000","last_clean":"2024-04-21T22:34:02.363278+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:34:02.363278+0000","last_undegraded":"2024-04-21T22:34:02.363278+0000","last_fullsized":"2024-04-21T22:34:02.363278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749755+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:34:02.749755+0000","last_peered":"2024-04-21T22:34:02.749755+0000","last_clean":"2024-04-21T22:34:02.749755+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:34:02.749755+0000","last_undegraded":"2024-04-21T22:34:02.749755+0000","last_fullsized":"2024-04-21T22:34:02.749755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363746+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:34:02.363746+0000","last_peered":"2024-04-21T22:34:02.363746+0000","last_clean":"2024-04-21T22:34:02.363746+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:34:02.363746+0000","last_undegraded":"2024-04-21T22:34:02.363746+0000","last_fullsized":"2024-04-21T22:34:02.363746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'41","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.306334+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:34:02.306334+0000","last_peered":"2024-04-21T22:34:02.306334+0000","last_clean":"2024-04-21T22:34:02.306334+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:34:02.306334+0000","last_undegraded":"2024-04-21T22:34:02.306334+0000","last_fullsized":"2024-04-21T22:34:02.306334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363387+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:34:02.363387+0000","last_peered":"2024-04-21T22:34:02.363387+0000","last_clean":"2024-04-21T22:34:02.363387+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:34:02.363387+0000","last_undegraded":"2024-04-21T22:34:02.363387+0000","last_fullsized":"2024-04-21T22:34:02.363387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362932+0000","last_change":"2024-04-21T22:32:17.639229+0000","last_active":"2024-04-21T22:34:02.362932+0000","last_peered":"2024-04-21T22:34:02.362932+0000","last_clean":"2024-04-21T22:34:02.362932+0000","last_became_active":"2024-04-21T22:32:17.633285+0000","last_became_peered":"2024-04-21T22:32:17.633285+0000","last_unstale":"2024-04-21T22:34:02.362932+0000","last_undegraded":"2024-04-21T22:34:02.362932+0000","last_fullsized":"2024-04-21T22:34:02.362932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:12:41.023954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363591+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:34:02.363591+0000","last_peered":"2024-04-21T22:34:02.363591+0000","last_clean":"2024-04-21T22:34:02.363591+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:34:02.363591+0000","last_undegraded":"2024-04-21T22:34:02.363591+0000","last_fullsized":"2024-04-21T22:34:02.363591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367734+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:34:02.367734+0000","last_peered":"2024-04-21T22:34:02.367734+0000","last_clean":"2024-04-21T22:34:02.367734+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:34:02.367734+0000","last_undegraded":"2024-04-21T22:34:02.367734+0000","last_fullsized":"2024-04-21T22:34:02.367734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362029+0000","last_change":"2024-04-21T22:32:17.562956+0000","last_active":"2024-04-21T22:34:02.362029+0000","last_peered":"2024-04-21T22:34:02.362029+0000","last_clean":"2024-04-21T22:34:02.362029+0000","last_became_active":"2024-04-21T22:32:17.562432+0000","last_became_peered":"2024-04-21T22:32:17.562432+0000","last_unstale":"2024-04-21T22:34:02.362029+0000","last_undegraded":"2024-04-21T22:34:02.362029+0000","last_fullsized":"2024-04-21T22:34:02.362029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:37:08.467907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361983+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:34:02.361983+0000","last_peered":"2024-04-21T22:34:02.361983+0000","last_clean":"2024-04-21T22:34:02.361983+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:34:02.361983+0000","last_undegraded":"2024-04-21T22:34:02.361983+0000","last_fullsized":"2024-04-21T22:34:02.361983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.029064+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:34:02.029064+0000","last_peered":"2024-04-21T22:34:02.029064+0000","last_clean":"2024-04-21T22:34:02.029064+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:34:02.029064+0000","last_undegraded":"2024-04-21T22:34:02.029064+0000","last_fullsized":"2024-04-21T22:34:02.029064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362622+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:34:02.362622+0000","last_peered":"2024-04-21T22:34:02.362622+0000","last_clean":"2024-04-21T22:34:02.362622+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:34:02.362622+0000","last_undegraded":"2024-04-21T22:34:02.362622+0000","last_fullsized":"2024-04-21T22:34:02.362622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367929+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:34:02.367929+0000","last_peered":"2024-04-21T22:34:02.367929+0000","last_clean":"2024-04-21T22:34:02.367929+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:34:02.367929+0000","last_undegraded":"2024-04-21T22:34:02.367929+0000","last_fullsized":"2024-04-21T22:34:02.367929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362394+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:34:02.362394+0000","last_peered":"2024-04-21T22:34:02.362394+0000","last_clean":"2024-04-21T22:34:02.362394+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:34:02.362394+0000","last_undegraded":"2024-04-21T22:34:02.362394+0000","last_fullsized":"2024-04-21T22:34:02.362394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025854+0000","last_change":"2024-04-21T22:32:17.632654+0000","last_active":"2024-04-21T22:34:02.025854+0000","last_peered":"2024-04-21T22:34:02.025854+0000","last_clean":"2024-04-21T22:34:02.025854+0000","last_became_active":"2024-04-21T22:32:17.632354+0000","last_became_peered":"2024-04-21T22:32:17.632354+0000","last_unstale":"2024-04-21T22:34:02.025854+0000","last_undegraded":"2024-04-21T22:34:02.025854+0000","last_fullsized":"2024-04-21T22:34:02.025854+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:51.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159429+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:34:02.159429+0000","last_peered":"2024-04-21T22:34:02.159429+0000","last_clean":"2024-04-21T22:34:02.159429+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:34:02.159429+0000","last_undegraded":"2024-04-21T22:34:02.159429+0000","last_fullsized":"2024-04-21T22:34:02.159429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153094+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:34:02.153094+0000","last_peered":"2024-04-21T22:34:02.153094+0000","last_clean":"2024-04-21T22:34:02.153094+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:34:02.153094+0000","last_undegraded":"2024-04-21T22:34:02.153094+0000","last_fullsized":"2024-04-21T22:34:02.153094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362627+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:34:02.362627+0000","last_peered":"2024-04-21T22:34:02.362627+0000","last_clean":"2024-04-21T22:34:02.362627+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:34:02.362627+0000","last_undegraded":"2024-04-21T22:34:02.362627+0000","last_fullsized":"2024-04-21T22:34:02.362627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362069+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:34:02.362069+0000","last_peered":"2024-04-21T22:34:02.362069+0000","last_clean":"2024-04-21T22:34:02.362069+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:34:02.362069+0000","last_undegraded":"2024-04-21T22:34:02.362069+0000","last_fullsized":"2024-04-21T22:34:02.362069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367869+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:34:02.367869+0000","last_peered":"2024-04-21T22:34:02.367869+0000","last_clean":"2024-04-21T22:34:02.367869+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:34:02.367869+0000","last_undegraded":"2024-04-21T22:34:02.367869+0000","last_fullsized":"2024-04-21T22:34:02.367869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602295,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1575,"num_read_kb":927,"num_write":380,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1807276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383726,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":468458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645361,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37224,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707928,"statfs":{"total":95995035648,"available":95956918272,"internally_reserved":0,"allocated":1810432,"data_stored":1250583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1392640,"data_stored":859136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070526,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1388544,"data_stored":859514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1593344,"data_stored":1060972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495689,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":468290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1073152,"data_stored":535812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182490,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":466421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32868,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712284,"statfs":{"total":95995035648,"available":95961378816,"internally_reserved":0,"allocated":1732608,"data_stored":1189081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":133798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:34:08.220 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-21T22:34:08.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 -- 172.21.15.18:0/3362737550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c104c10 msgr2=0x7fc79c105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3362737550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c104c10 0x7fc79c105090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc788009900 tx=0x7fc78802bc40 comp rx=0 tx=0).stop 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 -- 172.21.15.18:0/3362737550 shutdown_connections 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3362737550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c1055d0 0x7fc79c10be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3362737550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c104c10 0x7fc79c105090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3362737550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 -- 172.21.15.18:0/3362737550 >> 172.21.15.18:0/3362737550 conn(0x7fc79c0fef90 msgr2=0x7fc79c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 -- 172.21.15.18:0/3362737550 shutdown_connections 2024-04-21T22:34:08.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.451+0000 7fc7a1800640 1 -- 172.21.15.18:0/3362737550 wait complete. 2024-04-21T22:34:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.453+0000 7fc7a1800640 1 Processor -- start 2024-04-21T22:34:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.453+0000 7fc7a1800640 1 -- start start 2024-04-21T22:34:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 0x7fc79c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c1055d0 0x7fc79c1a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10f660 con 0x7fc79c104c10 2024-04-21T22:34:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10f4e0 con 0x7fc79c103a20 2024-04-21T22:34:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc7a1800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10f7e0 con 0x7fc79c1055d0 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 0x7fc79c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55266/0 (socket says 172.21.15.18:55266) 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 0x7fc79c19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33418/0 (socket says 172.21.15.18:33418) 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79aa00640 1 -- 172.21.15.18:0/3561109201 learned_addr learned my addr 172.21.15.18:0/3561109201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.454+0000 7fc79b400640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c1055d0 0x7fc79c1a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 -- 172.21.15.18:0/3561109201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c1055d0 msgr2=0x7fc79c1a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c1055d0 0x7fc79c1a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 -- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 msgr2=0x7fc79c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 0x7fc79c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 -- 172.21.15.18:0/3561109201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c1a1940 con 0x7fc79c103a20 2024-04-21T22:34:08.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc79aa00640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00e9c0 tx=0x7fc78c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.455+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00cd80 con 0x7fc79c103a20 2024-04-21T22:34:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.456+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c1a1c30 con 0x7fc79c103a20 2024-04-21T22:34:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.456+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc78c0035f0 con 0x7fc79c103a20 2024-04-21T22:34:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.456+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c010690 con 0x7fc79c103a20 2024-04-21T22:34:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.456+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c1a2180 con 0x7fc79c103a20 2024-04-21T22:34:08.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.457+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c10ace0 con 0x7fc79c103a20 2024-04-21T22:34:08.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.459+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fc78c0037a0 con 0x7fc79c103a20 2024-04-21T22:34:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.461+0000 7fc793400640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 0x7fc7800a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.462+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc78c0cfbb0 con 0x7fc79c103a20 2024-04-21T22:34:08.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.462+0000 7fc79a000640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 0x7fc7800a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.462+0000 7fc79a000640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 0x7fc7800a52e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc78802efd0 tx=0x7fc78802cf90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.464+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc78c09c520 con 0x7fc79c103a20 2024-04-21T22:34:08.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.675+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc79c061b80 con 0x7fc7800a2e20 2024-04-21T22:34:08.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.686+0000 7fc793400640 1 -- 172.21.15.18:0/3561109201 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257812 (secure 0 0 0) 0x7fc79c061b80 con 0x7fc7800a2e20 2024-04-21T22:34:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:08.691 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 msgr2=0x7fc7800a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 0x7fc7800a52e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc78802efd0 tx=0x7fc78802cf90 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 msgr2=0x7fc79c199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00e9c0 tx=0x7fc78c00ee80 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 shutdown_connections 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7800a2e20 0x7fc7800a52e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc79c1055d0 0x7fc79c1a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc79c104c10 0x7fc79c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 --2- 172.21.15.18:0/3561109201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc79c103a20 0x7fc79c199d30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 >> 172.21.15.18:0/3561109201 conn(0x7fc79c0fef90 msgr2=0x7fc79c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 shutdown_connections 2024-04-21T22:34:08.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.693+0000 7fc7a1800640 1 -- 172.21.15.18:0/3561109201 wait complete. 2024-04-21T22:34:08.712 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-21T22:34:08.044819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192897,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1711,"num_read_kb":1046,"num_write":563,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181749,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":947,"ondisk_log_size":947,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":372228,"kb_used_data":14604,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124569596,"statfs":{"total":1151940427776,"available":1151559266304,"internally_reserved":0,"allocated":14954496,"data_stored":8600389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":365933883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.976658"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368197+0000","last_change":"2024-04-21T22:31:29.537382+0000","last_active":"2024-04-21T22:34:02.368197+0000","last_peered":"2024-04-21T22:34:02.368197+0000","last_clean":"2024-04-21T22:34:02.368197+0000","last_became_active":"2024-04-21T22:31:29.537070+0000","last_became_peered":"2024-04-21T22:31:29.537070+0000","last_unstale":"2024-04-21T22:34:02.368197+0000","last_undegraded":"2024-04-21T22:34:02.368197+0000","last_fullsized":"2024-04-21T22:34:02.368197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:34:00.573645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028530+0000","last_change":"2024-04-21T22:31:29.529902+0000","last_active":"2024-04-21T22:34:02.028530+0000","last_peered":"2024-04-21T22:34:02.028530+0000","last_clean":"2024-04-21T22:34:02.028530+0000","last_became_active":"2024-04-21T22:31:29.527666+0000","last_became_peered":"2024-04-21T22:31:29.527666+0000","last_unstale":"2024-04-21T22:34:02.028530+0000","last_undegraded":"2024-04-21T22:34:02.028530+0000","last_fullsized":"2024-04-21T22:34:02.028530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:09:25.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028381+0000","last_change":"2024-04-21T22:31:29.536183+0000","last_active":"2024-04-21T22:34:02.028381+0000","last_peered":"2024-04-21T22:34:02.028381+0000","last_clean":"2024-04-21T22:34:02.028381+0000","last_became_active":"2024-04-21T22:31:29.535867+0000","last_became_peered":"2024-04-21T22:31:29.535867+0000","last_unstale":"2024-04-21T22:34:02.028381+0000","last_undegraded":"2024-04-21T22:34:02.028381+0000","last_fullsized":"2024-04-21T22:34:02.028381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:58:36.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361050+0000","last_change":"2024-04-21T22:31:29.526502+0000","last_active":"2024-04-21T22:34:02.361050+0000","last_peered":"2024-04-21T22:34:02.361050+0000","last_clean":"2024-04-21T22:34:02.361050+0000","last_became_active":"2024-04-21T22:31:29.525724+0000","last_became_peered":"2024-04-21T22:31:29.525724+0000","last_unstale":"2024-04-21T22:34:02.361050+0000","last_undegraded":"2024-04-21T22:34:02.361050+0000","last_fullsized":"2024-04-21T22:34:02.361050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:42:20.333144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152014+0000","last_change":"2024-04-21T22:31:29.530505+0000","last_active":"2024-04-21T22:34:02.152014+0000","last_peered":"2024-04-21T22:34:02.152014+0000","last_clean":"2024-04-21T22:34:02.152014+0000","last_became_active":"2024-04-21T22:31:29.530133+0000","last_became_peered":"2024-04-21T22:31:29.530133+0000","last_unstale":"2024-04-21T22:34:02.152014+0000","last_undegraded":"2024-04-21T22:34:02.152014+0000","last_fullsized":"2024-04-21T22:34:02.152014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:13:11.928694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.525943+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.525505+0000","last_became_peered":"2024-04-21T22:31:29.525505+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:23:52.982716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363047+0000","last_change":"2024-04-21T22:31:29.524417+0000","last_active":"2024-04-21T22:34:02.363047+0000","last_peered":"2024-04-21T22:34:02.363047+0000","last_clean":"2024-04-21T22:34:02.363047+0000","last_became_active":"2024-04-21T22:31:29.524064+0000","last_became_peered":"2024-04-21T22:31:29.524064+0000","last_unstale":"2024-04-21T22:34:02.363047+0000","last_undegraded":"2024-04-21T22:34:02.363047+0000","last_fullsized":"2024-04-21T22:34:02.363047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:20.647770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152461+0000","last_change":"2024-04-21T22:31:29.526445+0000","last_active":"2024-04-21T22:34:02.152461+0000","last_peered":"2024-04-21T22:34:02.152461+0000","last_clean":"2024-04-21T22:34:02.152461+0000","last_became_active":"2024-04-21T22:31:29.526123+0000","last_became_peered":"2024-04-21T22:31:29.526123+0000","last_unstale":"2024-04-21T22:34:02.152461+0000","last_undegraded":"2024-04-21T22:34:02.152461+0000","last_fullsized":"2024-04-21T22:34:02.152461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:44:16.151637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363317+0000","last_change":"2024-04-21T22:31:29.520759+0000","last_active":"2024-04-21T22:34:02.363317+0000","last_peered":"2024-04-21T22:34:02.363317+0000","last_clean":"2024-04-21T22:34:02.363317+0000","last_became_active":"2024-04-21T22:31:29.520401+0000","last_became_peered":"2024-04-21T22:31:29.520401+0000","last_unstale":"2024-04-21T22:34:02.363317+0000","last_undegraded":"2024-04-21T22:34:02.363317+0000","last_fullsized":"2024-04-21T22:34:02.363317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:27:08.761809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.164106+0000","last_change":"2024-04-21T22:32:17.561622+0000","last_active":"2024-04-21T22:34:02.164106+0000","last_peered":"2024-04-21T22:34:02.164106+0000","last_clean":"2024-04-21T22:34:02.164106+0000","last_became_active":"2024-04-21T22:32:17.561139+0000","last_became_peered":"2024-04-21T22:32:17.561139+0000","last_unstale":"2024-04-21T22:34:02.164106+0000","last_undegraded":"2024-04-21T22:34:02.164106+0000","last_fullsized":"2024-04-21T22:34:02.164106+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:52:09.168145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363594+0000","last_change":"2024-04-21T22:31:29.519362+0000","last_active":"2024-04-21T22:34:02.363594+0000","last_peered":"2024-04-21T22:34:02.363594+0000","last_clean":"2024-04-21T22:34:02.363594+0000","last_became_active":"2024-04-21T22:31:29.518987+0000","last_became_peered":"2024-04-21T22:31:29.518987+0000","last_unstale":"2024-04-21T22:34:02.363594+0000","last_undegraded":"2024-04-21T22:34:02.363594+0000","last_fullsized":"2024-04-21T22:34:02.363594+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:16:26.690425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360929+0000","last_change":"2024-04-21T22:31:29.520840+0000","last_active":"2024-04-21T22:34:02.360929+0000","last_peered":"2024-04-21T22:34:02.360929+0000","last_clean":"2024-04-21T22:34:02.360929+0000","last_became_active":"2024-04-21T22:31:29.520463+0000","last_became_peered":"2024-04-21T22:31:29.520463+0000","last_unstale":"2024-04-21T22:34:02.360929+0000","last_undegraded":"2024-04-21T22:34:02.360929+0000","last_fullsized":"2024-04-21T22:34:02.360929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:13:08.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362279+0000","last_change":"2024-04-21T22:31:29.520339+0000","last_active":"2024-04-21T22:34:02.362279+0000","last_peered":"2024-04-21T22:34:02.362279+0000","last_clean":"2024-04-21T22:34:02.362279+0000","last_became_active":"2024-04-21T22:31:29.520019+0000","last_became_peered":"2024-04-21T22:31:29.520019+0000","last_unstale":"2024-04-21T22:34:02.362279+0000","last_undegraded":"2024-04-21T22:34:02.362279+0000","last_fullsized":"2024-04-21T22:34:02.362279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:52.512408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027942+0000","last_change":"2024-04-21T22:31:29.528226+0000","last_active":"2024-04-21T22:34:02.027942+0000","last_peered":"2024-04-21T22:34:02.027942+0000","last_clean":"2024-04-21T22:34:02.027942+0000","last_became_active":"2024-04-21T22:31:29.527717+0000","last_became_peered":"2024-04-21T22:31:29.527717+0000","last_unstale":"2024-04-21T22:34:02.027942+0000","last_undegraded":"2024-04-21T22:34:02.027942+0000","last_fullsized":"2024-04-21T22:34:02.027942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:39:12.405656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.027820+0000","last_change":"2024-04-21T22:31:29.539310+0000","last_active":"2024-04-21T22:34:02.027820+0000","last_peered":"2024-04-21T22:34:02.027820+0000","last_clean":"2024-04-21T22:34:02.027820+0000","last_became_active":"2024-04-21T22:31:29.538685+0000","last_became_peered":"2024-04-21T22:31:29.538685+0000","last_unstale":"2024-04-21T22:34:02.027820+0000","last_undegraded":"2024-04-21T22:34:02.027820+0000","last_fullsized":"2024-04-21T22:34:02.027820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:09:16.992065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362328+0000","last_change":"2024-04-21T22:31:29.534547+0000","last_active":"2024-04-21T22:34:02.362328+0000","last_peered":"2024-04-21T22:34:02.362328+0000","last_clean":"2024-04-21T22:34:02.362328+0000","last_became_active":"2024-04-21T22:31:29.534152+0000","last_became_peered":"2024-04-21T22:31:29.534152+0000","last_unstale":"2024-04-21T22:34:02.362328+0000","last_undegraded":"2024-04-21T22:34:02.362328+0000","last_fullsized":"2024-04-21T22:34:02.362328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:51:34.475575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368203+0000","last_change":"2024-04-21T22:31:29.537294+0000","last_active":"2024-04-21T22:34:02.368203+0000","last_peered":"2024-04-21T22:34:02.368203+0000","last_clean":"2024-04-21T22:34:02.368203+0000","last_became_active":"2024-04-21T22:31:29.537001+0000","last_became_peered":"2024-04-21T22:31:29.537001+0000","last_unstale":"2024-04-21T22:34:02.368203+0000","last_undegraded":"2024-04-21T22:34:02.368203+0000","last_fullsized":"2024-04-21T22:34:02.368203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:57:13.710945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025715+0000","last_change":"2024-04-21T22:31:29.534736+0000","last_active":"2024-04-21T22:34:02.025715+0000","last_peered":"2024-04-21T22:34:02.025715+0000","last_clean":"2024-04-21T22:34:02.025715+0000","last_became_active":"2024-04-21T22:31:29.534363+0000","last_became_peered":"2024-04-21T22:31:29.534363+0000","last_unstale":"2024-04-21T22:34:02.025715+0000","last_undegraded":"2024-04-21T22:34:02.025715+0000","last_fullsized":"2024-04-21T22:34:02.025715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:25:10.382561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362265+0000","last_change":"2024-04-21T22:31:29.527133+0000","last_active":"2024-04-21T22:34:02.362265+0000","last_peered":"2024-04-21T22:34:02.362265+0000","last_clean":"2024-04-21T22:34:02.362265+0000","last_became_active":"2024-04-21T22:31:29.526804+0000","last_became_peered":"2024-04-21T22:31:29.526804+0000","last_unstale":"2024-04-21T22:34:02.362265+0000","last_undegraded":"2024-04-21T22:34:02.362265+0000","last_fullsized":"2024-04-21T22:34:02.362265+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:52:43.466227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025960+0000","last_change":"2024-04-21T22:31:28.507406+0000","last_active":"2024-04-21T22:34:02.025960+0000","last_peered":"2024-04-21T22:34:02.025960+0000","last_clean":"2024-04-21T22:34:02.025960+0000","last_became_active":"2024-04-21T22:31:28.506989+0000","last_became_peered":"2024-04-21T22:31:28.506989+0000","last_unstale":"2024-04-21T22:34:02.025960+0000","last_undegraded":"2024-04-21T22:34:02.025960+0000","last_fullsized":"2024-04-21T22:34:02.025960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:28:18.087175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153750+0000","last_change":"2024-04-21T22:31:29.531863+0000","last_active":"2024-04-21T22:34:02.153750+0000","last_peered":"2024-04-21T22:34:02.153750+0000","last_clean":"2024-04-21T22:34:02.153750+0000","last_became_active":"2024-04-21T22:31:29.529160+0000","last_became_peered":"2024-04-21T22:31:29.529160+0000","last_unstale":"2024-04-21T22:34:02.153750+0000","last_undegraded":"2024-04-21T22:34:02.153750+0000","last_fullsized":"2024-04-21T22:34:02.153750+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:10:41.388969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153887+0000","last_change":"2024-04-21T22:31:28.513142+0000","last_active":"2024-04-21T22:34:02.153887+0000","last_peered":"2024-04-21T22:34:02.153887+0000","last_clean":"2024-04-21T22:34:02.153887+0000","last_became_active":"2024-04-21T22:31:28.511086+0000","last_became_peered":"2024-04-21T22:31:28.511086+0000","last_unstale":"2024-04-21T22:34:02.153887+0000","last_undegraded":"2024-04-21T22:34:02.153887+0000","last_fullsized":"2024-04-21T22:34:02.153887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:15:19.251288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028872+0000","last_change":"2024-04-21T22:31:29.542919+0000","last_active":"2024-04-21T22:34:02.028872+0000","last_peered":"2024-04-21T22:34:02.028872+0000","last_clean":"2024-04-21T22:34:02.028872+0000","last_became_active":"2024-04-21T22:31:29.542133+0000","last_became_peered":"2024-04-21T22:31:29.542133+0000","last_unstale":"2024-04-21T22:34:02.028872+0000","last_undegraded":"2024-04-21T22:34:02.028872+0000","last_fullsized":"2024-04-21T22:34:02.028872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:39:34.750633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'13","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.554355+0000","last_change":"2024-04-21T22:31:28.502522+0000","last_active":"2024-04-21T22:34:02.554355+0000","last_peered":"2024-04-21T22:34:02.554355+0000","last_clean":"2024-04-21T22:34:02.554355+0000","last_became_active":"2024-04-21T22:31:28.502227+0000","last_became_peered":"2024-04-21T22:31:28.502227+0000","last_unstale":"2024-04-21T22:34:02.554355+0000","last_undegraded":"2024-04-21T22:34:02.554355+0000","last_fullsized":"2024-04-21T22:34:02.554355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:08:24.319107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362886+0000","last_change":"2024-04-21T22:31:29.529598+0000","last_active":"2024-04-21T22:34:02.362886+0000","last_peered":"2024-04-21T22:34:02.362886+0000","last_clean":"2024-04-21T22:34:02.362886+0000","last_became_active":"2024-04-21T22:31:29.529091+0000","last_became_peered":"2024-04-21T22:31:29.529091+0000","last_unstale":"2024-04-21T22:34:02.362886+0000","last_undegraded":"2024-04-21T22:34:02.362886+0000","last_fullsized":"2024-04-21T22:34:02.362886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:50:51.430677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152249+0000","last_change":"2024-04-21T22:31:28.501982+0000","last_active":"2024-04-21T22:34:02.152249+0000","last_peered":"2024-04-21T22:34:02.152249+0000","last_clean":"2024-04-21T22:34:02.152249+0000","last_became_active":"2024-04-21T22:31:28.501647+0000","last_became_peered":"2024-04-21T22:31:28.501647+0000","last_unstale":"2024-04-21T22:34:02.152249+0000","last_undegraded":"2024-04-21T22:34:02.152249+0000","last_fullsized":"2024-04-21T22:34:02.152249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:50:49.869979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159819+0000","last_change":"2024-04-21T22:31:29.529865+0000","last_active":"2024-04-21T22:34:02.159819+0000","last_peered":"2024-04-21T22:34:02.159819+0000","last_clean":"2024-04-21T22:34:02.159819+0000","last_became_active":"2024-04-21T22:31:29.529427+0000","last_became_peered":"2024-04-21T22:31:29.529427+0000","last_unstale":"2024-04-21T22:34:02.159819+0000","last_undegraded":"2024-04-21T22:34:02.159819+0000","last_fullsized":"2024-04-21T22:34:02.159819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:36.143424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'8","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724607+0000","last_change":"2024-04-21T22:32:17.565781+0000","last_active":"2024-04-21T22:34:02.724607+0000","last_peered":"2024-04-21T22:34:02.724607+0000","last_clean":"2024-04-21T22:34:02.724607+0000","last_became_active":"2024-04-21T22:32:17.560490+0000","last_became_peered":"2024-04-21T22:32:17.560490+0000","last_unstale":"2024-04-21T22:34:02.724607+0000","last_undegraded":"2024-04-21T22:34:02.724607+0000","last_fullsized":"2024-04-21T22:34:02.724607+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:10:20.976913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":2,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151946+0000","last_change":"2024-04-21T22:31:29.524431+0000","last_active":"2024-04-21T22:34:02.151946+0000","last_peered":"2024-04-21T22:34:02.151946+0000","last_clean":"2024-04-21T22:34:02.151946+0000","last_became_active":"2024-04-21T22:31:29.524030+0000","last_became_peered":"2024-04-21T22:31:29.524030+0000","last_unstale":"2024-04-21T22:34:02.151946+0000","last_undegraded":"2024-04-21T22:34:02.151946+0000","last_fullsized":"2024-04-21T22:34:02.151946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:28:06.705615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163525+0000","last_change":"2024-04-21T22:32:17.568151+0000","last_active":"2024-04-21T22:34:02.163525+0000","last_peered":"2024-04-21T22:34:02.163525+0000","last_clean":"2024-04-21T22:34:02.163525+0000","last_became_active":"2024-04-21T22:32:17.560167+0000","last_became_peered":"2024-04-21T22:32:17.560167+0000","last_unstale":"2024-04-21T22:34:02.163525+0000","last_undegraded":"2024-04-21T22:34:02.163525+0000","last_fullsized":"2024-04-21T22:34:02.163525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:08.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159880+0000","last_change":"2024-04-21T22:31:29.521677+0000","last_active":"2024-04-21T22:34:02.159880+0000","last_peered":"2024-04-21T22:34:02.159880+0000","last_clean":"2024-04-21T22:34:02.159880+0000","last_became_active":"2024-04-21T22:31:29.521361+0000","last_became_peered":"2024-04-21T22:31:29.521361+0000","last_unstale":"2024-04-21T22:34:02.159880+0000","last_undegraded":"2024-04-21T22:34:02.159880+0000","last_fullsized":"2024-04-21T22:34:02.159880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:24:33.323733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361435+0000","last_change":"2024-04-21T22:31:28.508710+0000","last_active":"2024-04-21T22:34:02.361435+0000","last_peered":"2024-04-21T22:34:02.361435+0000","last_clean":"2024-04-21T22:34:02.361435+0000","last_became_active":"2024-04-21T22:31:28.508334+0000","last_became_peered":"2024-04-21T22:31:28.508334+0000","last_unstale":"2024-04-21T22:34:02.361435+0000","last_undegraded":"2024-04-21T22:34:02.361435+0000","last_fullsized":"2024-04-21T22:34:02.361435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:50:30.045583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152402+0000","last_change":"2024-04-21T22:31:29.531054+0000","last_active":"2024-04-21T22:34:02.152402+0000","last_peered":"2024-04-21T22:34:02.152402+0000","last_clean":"2024-04-21T22:34:02.152402+0000","last_became_active":"2024-04-21T22:31:29.530717+0000","last_became_peered":"2024-04-21T22:31:29.530717+0000","last_unstale":"2024-04-21T22:34:02.152402+0000","last_undegraded":"2024-04-21T22:34:02.152402+0000","last_fullsized":"2024-04-21T22:34:02.152402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:56:36.236191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159385+0000","last_change":"2024-04-21T22:31:28.497572+0000","last_active":"2024-04-21T22:34:02.159385+0000","last_peered":"2024-04-21T22:34:02.159385+0000","last_clean":"2024-04-21T22:34:02.159385+0000","last_became_active":"2024-04-21T22:31:28.497277+0000","last_became_peered":"2024-04-21T22:31:28.497277+0000","last_unstale":"2024-04-21T22:34:02.159385+0000","last_undegraded":"2024-04-21T22:34:02.159385+0000","last_fullsized":"2024-04-21T22:34:02.159385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:06:13.968655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024896+0000","last_change":"2024-04-21T22:31:29.537137+0000","last_active":"2024-04-21T22:34:02.024896+0000","last_peered":"2024-04-21T22:34:02.024896+0000","last_clean":"2024-04-21T22:34:02.024896+0000","last_became_active":"2024-04-21T22:31:29.533979+0000","last_became_peered":"2024-04-21T22:31:29.533979+0000","last_unstale":"2024-04-21T22:34:02.024896+0000","last_undegraded":"2024-04-21T22:34:02.024896+0000","last_fullsized":"2024-04-21T22:34:02.024896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:32:54.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'8","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749157+0000","last_change":"2024-04-21T22:31:28.509275+0000","last_active":"2024-04-21T22:34:02.749157+0000","last_peered":"2024-04-21T22:34:02.749157+0000","last_clean":"2024-04-21T22:34:02.749157+0000","last_became_active":"2024-04-21T22:31:28.508901+0000","last_became_peered":"2024-04-21T22:31:28.508901+0000","last_unstale":"2024-04-21T22:34:02.749157+0000","last_undegraded":"2024-04-21T22:34:02.749157+0000","last_fullsized":"2024-04-21T22:34:02.749157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:54:40.785653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":296,"num_read_kb":296,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362853+0000","last_change":"2024-04-21T22:31:29.529825+0000","last_active":"2024-04-21T22:34:02.362853+0000","last_peered":"2024-04-21T22:34:02.362853+0000","last_clean":"2024-04-21T22:34:02.362853+0000","last_became_active":"2024-04-21T22:31:29.529043+0000","last_became_peered":"2024-04-21T22:31:29.529043+0000","last_unstale":"2024-04-21T22:34:02.362853+0000","last_undegraded":"2024-04-21T22:34:02.362853+0000","last_fullsized":"2024-04-21T22:34:02.362853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:21:44.371514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363600+0000","last_change":"2024-04-21T22:31:28.497241+0000","last_active":"2024-04-21T22:34:02.363600+0000","last_peered":"2024-04-21T22:34:02.363600+0000","last_clean":"2024-04-21T22:34:02.363600+0000","last_became_active":"2024-04-21T22:31:28.496704+0000","last_became_peered":"2024-04-21T22:31:28.496704+0000","last_unstale":"2024-04-21T22:34:02.363600+0000","last_undegraded":"2024-04-21T22:34:02.363600+0000","last_fullsized":"2024-04-21T22:34:02.363600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:28:45.410238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028813+0000","last_change":"2024-04-21T22:31:29.536114+0000","last_active":"2024-04-21T22:34:02.028813+0000","last_peered":"2024-04-21T22:34:02.028813+0000","last_clean":"2024-04-21T22:34:02.028813+0000","last_became_active":"2024-04-21T22:31:29.535487+0000","last_became_peered":"2024-04-21T22:31:29.535487+0000","last_unstale":"2024-04-21T22:34:02.028813+0000","last_undegraded":"2024-04-21T22:34:02.028813+0000","last_fullsized":"2024-04-21T22:34:02.028813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:36:02.245786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159993+0000","last_change":"2024-04-21T22:31:28.500073+0000","last_active":"2024-04-21T22:34:02.159993+0000","last_peered":"2024-04-21T22:34:02.159993+0000","last_clean":"2024-04-21T22:34:02.159993+0000","last_became_active":"2024-04-21T22:31:28.499764+0000","last_became_peered":"2024-04-21T22:31:28.499764+0000","last_unstale":"2024-04-21T22:34:02.159993+0000","last_undegraded":"2024-04-21T22:34:02.159993+0000","last_fullsized":"2024-04-21T22:34:02.159993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:05:59.115303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363015+0000","last_change":"2024-04-21T22:31:29.521990+0000","last_active":"2024-04-21T22:34:02.363015+0000","last_peered":"2024-04-21T22:34:02.363015+0000","last_clean":"2024-04-21T22:34:02.363015+0000","last_became_active":"2024-04-21T22:31:29.521661+0000","last_became_peered":"2024-04-21T22:31:29.521661+0000","last_unstale":"2024-04-21T22:34:02.363015+0000","last_undegraded":"2024-04-21T22:34:02.363015+0000","last_fullsized":"2024-04-21T22:34:02.363015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:45:34.608728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":371,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.724945+0000","last_change":"2024-04-21T22:31:28.493566+0000","last_active":"2024-04-21T22:34:02.724945+0000","last_peered":"2024-04-21T22:34:02.724945+0000","last_clean":"2024-04-21T22:34:02.724945+0000","last_became_active":"2024-04-21T22:31:28.493254+0000","last_became_peered":"2024-04-21T22:31:28.493254+0000","last_unstale":"2024-04-21T22:34:02.724945+0000","last_undegraded":"2024-04-21T22:34:02.724945+0000","last_fullsized":"2024-04-21T22:34:02.724945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:10:27.926691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67587,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":222,"num_write":41,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152202+0000","last_change":"2024-04-21T22:31:29.518729+0000","last_active":"2024-04-21T22:34:02.152202+0000","last_peered":"2024-04-21T22:34:02.152202+0000","last_clean":"2024-04-21T22:34:02.152202+0000","last_became_active":"2024-04-21T22:31:29.518399+0000","last_became_peered":"2024-04-21T22:31:29.518399+0000","last_unstale":"2024-04-21T22:34:02.152202+0000","last_undegraded":"2024-04-21T22:34:02.152202+0000","last_fullsized":"2024-04-21T22:34:02.152202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:19:05.607745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362136+0000","last_change":"2024-04-21T22:31:28.514293+0000","last_active":"2024-04-21T22:34:02.362136+0000","last_peered":"2024-04-21T22:34:02.362136+0000","last_clean":"2024-04-21T22:34:02.362136+0000","last_became_active":"2024-04-21T22:31:28.513927+0000","last_became_peered":"2024-04-21T22:31:28.513927+0000","last_unstale":"2024-04-21T22:34:02.362136+0000","last_undegraded":"2024-04-21T22:34:02.362136+0000","last_fullsized":"2024-04-21T22:34:02.362136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:54:54.022413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361723+0000","last_change":"2024-04-21T22:31:29.531678+0000","last_active":"2024-04-21T22:34:02.361723+0000","last_peered":"2024-04-21T22:34:02.361723+0000","last_clean":"2024-04-21T22:34:02.361723+0000","last_became_active":"2024-04-21T22:31:29.531344+0000","last_became_peered":"2024-04-21T22:31:29.531344+0000","last_unstale":"2024-04-21T22:34:02.361723+0000","last_undegraded":"2024-04-21T22:34:02.361723+0000","last_fullsized":"2024-04-21T22:34:02.361723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:01:11.122047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159510+0000","last_change":"2024-04-21T22:31:28.513040+0000","last_active":"2024-04-21T22:34:02.159510+0000","last_peered":"2024-04-21T22:34:02.159510+0000","last_clean":"2024-04-21T22:34:02.159510+0000","last_became_active":"2024-04-21T22:31:28.512701+0000","last_became_peered":"2024-04-21T22:31:28.512701+0000","last_unstale":"2024-04-21T22:34:02.159510+0000","last_undegraded":"2024-04-21T22:34:02.159510+0000","last_fullsized":"2024-04-21T22:34:02.159510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:45:56.244134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363523+0000","last_change":"2024-04-21T22:31:29.529933+0000","last_active":"2024-04-21T22:34:02.363523+0000","last_peered":"2024-04-21T22:34:02.363523+0000","last_clean":"2024-04-21T22:34:02.363523+0000","last_became_active":"2024-04-21T22:31:29.529528+0000","last_became_peered":"2024-04-21T22:31:29.529528+0000","last_unstale":"2024-04-21T22:34:02.363523+0000","last_undegraded":"2024-04-21T22:34:02.363523+0000","last_fullsized":"2024-04-21T22:34:02.363523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:40:24.544647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.863600+0000","last_change":"2024-04-21T22:31:28.495585+0000","last_active":"2024-04-21T22:34:02.863600+0000","last_peered":"2024-04-21T22:34:02.863600+0000","last_clean":"2024-04-21T22:34:02.863600+0000","last_became_active":"2024-04-21T22:31:28.495291+0000","last_became_peered":"2024-04-21T22:31:28.495291+0000","last_unstale":"2024-04-21T22:34:02.863600+0000","last_undegraded":"2024-04-21T22:34:02.863600+0000","last_fullsized":"2024-04-21T22:34:02.863600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:25:38.428928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362955+0000","last_change":"2024-04-21T22:31:29.517739+0000","last_active":"2024-04-21T22:34:02.362955+0000","last_peered":"2024-04-21T22:34:02.362955+0000","last_clean":"2024-04-21T22:34:02.362955+0000","last_became_active":"2024-04-21T22:31:29.517187+0000","last_became_peered":"2024-04-21T22:31:29.517187+0000","last_unstale":"2024-04-21T22:34:02.362955+0000","last_undegraded":"2024-04-21T22:34:02.362955+0000","last_fullsized":"2024-04-21T22:34:02.362955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:45:28.863233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151839+0000","last_change":"2024-04-21T22:31:28.506845+0000","last_active":"2024-04-21T22:34:02.151839+0000","last_peered":"2024-04-21T22:34:02.151839+0000","last_clean":"2024-04-21T22:34:02.151839+0000","last_became_active":"2024-04-21T22:31:28.506498+0000","last_became_peered":"2024-04-21T22:31:28.506498+0000","last_unstale":"2024-04-21T22:34:02.151839+0000","last_undegraded":"2024-04-21T22:34:02.151839+0000","last_fullsized":"2024-04-21T22:34:02.151839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:07:10.077383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159534+0000","last_change":"2024-04-21T22:31:29.523742+0000","last_active":"2024-04-21T22:34:02.159534+0000","last_peered":"2024-04-21T22:34:02.159534+0000","last_clean":"2024-04-21T22:34:02.159534+0000","last_became_active":"2024-04-21T22:31:29.523420+0000","last_became_peered":"2024-04-21T22:31:29.523420+0000","last_unstale":"2024-04-21T22:34:02.159534+0000","last_undegraded":"2024-04-21T22:34:02.159534+0000","last_fullsized":"2024-04-21T22:34:02.159534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:31:38.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152215+0000","last_change":"2024-04-21T22:31:28.504430+0000","last_active":"2024-04-21T22:34:02.152215+0000","last_peered":"2024-04-21T22:34:02.152215+0000","last_clean":"2024-04-21T22:34:02.152215+0000","last_became_active":"2024-04-21T22:31:28.503188+0000","last_became_peered":"2024-04-21T22:31:28.503188+0000","last_unstale":"2024-04-21T22:34:02.152215+0000","last_undegraded":"2024-04-21T22:34:02.152215+0000","last_fullsized":"2024-04-21T22:34:02.152215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:31:55.412758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.368038+0000","last_change":"2024-04-21T22:31:29.516904+0000","last_active":"2024-04-21T22:34:02.368038+0000","last_peered":"2024-04-21T22:34:02.368038+0000","last_clean":"2024-04-21T22:34:02.368038+0000","last_became_active":"2024-04-21T22:31:29.516529+0000","last_became_peered":"2024-04-21T22:31:29.516529+0000","last_unstale":"2024-04-21T22:34:02.368038+0000","last_undegraded":"2024-04-21T22:34:02.368038+0000","last_fullsized":"2024-04-21T22:34:02.368038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:01:46.778392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025238+0000","last_change":"2024-04-21T22:31:28.506937+0000","last_active":"2024-04-21T22:34:02.025238+0000","last_peered":"2024-04-21T22:34:02.025238+0000","last_clean":"2024-04-21T22:34:02.025238+0000","last_became_active":"2024-04-21T22:31:28.501420+0000","last_became_peered":"2024-04-21T22:31:28.501420+0000","last_unstale":"2024-04-21T22:34:02.025238+0000","last_undegraded":"2024-04-21T22:34:02.025238+0000","last_fullsized":"2024-04-21T22:34:02.025238+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:02:03.849451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163927+0000","last_change":"2024-04-21T22:31:29.525171+0000","last_active":"2024-04-21T22:34:02.163927+0000","last_peered":"2024-04-21T22:34:02.163927+0000","last_clean":"2024-04-21T22:34:02.163927+0000","last_became_active":"2024-04-21T22:31:29.524822+0000","last_became_peered":"2024-04-21T22:31:29.524822+0000","last_unstale":"2024-04-21T22:34:02.163927+0000","last_undegraded":"2024-04-21T22:34:02.163927+0000","last_fullsized":"2024-04-21T22:34:02.163927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:39:26.641759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'7","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.864523+0000","last_change":"2024-04-21T22:31:28.502917+0000","last_active":"2024-04-21T22:34:02.864523+0000","last_peered":"2024-04-21T22:34:02.864523+0000","last_clean":"2024-04-21T22:34:02.864523+0000","last_became_active":"2024-04-21T22:31:28.502463+0000","last_became_peered":"2024-04-21T22:31:28.502463+0000","last_unstale":"2024-04-21T22:34:02.864523+0000","last_undegraded":"2024-04-21T22:34:02.864523+0000","last_fullsized":"2024-04-21T22:34:02.864523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:57:41.628049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1289,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.163630+0000","last_change":"2024-04-21T22:31:29.523626+0000","last_active":"2024-04-21T22:34:02.163630+0000","last_peered":"2024-04-21T22:34:02.163630+0000","last_clean":"2024-04-21T22:34:02.163630+0000","last_became_active":"2024-04-21T22:31:29.523265+0000","last_became_peered":"2024-04-21T22:31:29.523265+0000","last_unstale":"2024-04-21T22:34:02.163630+0000","last_undegraded":"2024-04-21T22:34:02.163630+0000","last_fullsized":"2024-04-21T22:34:02.163630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:21:25.596522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.024485+0000","last_change":"2024-04-21T22:32:17.633622+0000","last_active":"2024-04-21T22:34:02.024485+0000","last_peered":"2024-04-21T22:34:02.024485+0000","last_clean":"2024-04-21T22:34:02.024485+0000","last_became_active":"2024-04-21T22:32:17.633145+0000","last_became_peered":"2024-04-21T22:32:17.633145+0000","last_unstale":"2024-04-21T22:34:02.024485+0000","last_undegraded":"2024-04-21T22:34:02.024485+0000","last_fullsized":"2024-04-21T22:34:02.024485+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:23:14.639799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"88'7","reported_seq":177,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.366089+0000","last_change":"2024-04-21T22:31:28.517681+0000","last_active":"2024-04-21T22:34:02.366089+0000","last_peered":"2024-04-21T22:34:02.366089+0000","last_clean":"2024-04-21T22:34:02.366089+0000","last_became_active":"2024-04-21T22:31:28.517089+0000","last_became_peered":"2024-04-21T22:31:28.517089+0000","last_unstale":"2024-04-21T22:34:02.366089+0000","last_undegraded":"2024-04-21T22:34:02.366089+0000","last_fullsized":"2024-04-21T22:34:02.366089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:06:04.816613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":148,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153631+0000","last_change":"2024-04-21T22:31:29.526926+0000","last_active":"2024-04-21T22:34:02.153631+0000","last_peered":"2024-04-21T22:34:02.153631+0000","last_clean":"2024-04-21T22:34:02.153631+0000","last_became_active":"2024-04-21T22:31:29.525460+0000","last_became_peered":"2024-04-21T22:31:29.525460+0000","last_unstale":"2024-04-21T22:34:02.153631+0000","last_undegraded":"2024-04-21T22:34:02.153631+0000","last_fullsized":"2024-04-21T22:34:02.153631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:04:42.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360615+0000","last_change":"2024-04-21T22:31:28.504019+0000","last_active":"2024-04-21T22:34:02.360615+0000","last_peered":"2024-04-21T22:34:02.360615+0000","last_clean":"2024-04-21T22:34:02.360615+0000","last_became_active":"2024-04-21T22:31:28.503516+0000","last_became_peered":"2024-04-21T22:31:28.503516+0000","last_unstale":"2024-04-21T22:34:02.360615+0000","last_undegraded":"2024-04-21T22:34:02.360615+0000","last_fullsized":"2024-04-21T22:34:02.360615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:29:33.418039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363132+0000","last_change":"2024-04-21T22:30:03.990183+0000","last_active":"2024-04-21T22:34:02.363132+0000","last_peered":"2024-04-21T22:34:02.363132+0000","last_clean":"2024-04-21T22:34:02.363132+0000","last_became_active":"2024-04-21T22:30:03.989687+0000","last_became_peered":"2024-04-21T22:30:03.989687+0000","last_unstale":"2024-04-21T22:34:02.363132+0000","last_undegraded":"2024-04-21T22:34:02.363132+0000","last_fullsized":"2024-04-21T22:34:02.363132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:26:08.657919+0000","last_clean_scrub_stamp":"2024-04-21T22:26:08.657919+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:42:50.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361136+0000","last_change":"2024-04-21T22:31:29.520326+0000","last_active":"2024-04-21T22:34:02.361136+0000","last_peered":"2024-04-21T22:34:02.361136+0000","last_clean":"2024-04-21T22:34:02.361136+0000","last_became_active":"2024-04-21T22:31:29.519923+0000","last_became_peered":"2024-04-21T22:31:29.519923+0000","last_unstale":"2024-04-21T22:34:02.361136+0000","last_undegraded":"2024-04-21T22:34:02.361136+0000","last_fullsized":"2024-04-21T22:34:02.361136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:06:23.673185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363229+0000","last_change":"2024-04-21T22:32:17.636128+0000","last_active":"2024-04-21T22:34:02.363229+0000","last_peered":"2024-04-21T22:34:02.363229+0000","last_clean":"2024-04-21T22:34:02.363229+0000","last_became_active":"2024-04-21T22:32:17.633263+0000","last_became_peered":"2024-04-21T22:32:17.633263+0000","last_unstale":"2024-04-21T22:34:02.363229+0000","last_undegraded":"2024-04-21T22:34:02.363229+0000","last_fullsized":"2024-04-21T22:34:02.363229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:10:53.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.152189+0000","last_change":"2024-04-21T22:31:28.511264+0000","last_active":"2024-04-21T22:34:02.152189+0000","last_peered":"2024-04-21T22:34:02.152189+0000","last_clean":"2024-04-21T22:34:02.152189+0000","last_became_active":"2024-04-21T22:31:28.510968+0000","last_became_peered":"2024-04-21T22:31:28.510968+0000","last_unstale":"2024-04-21T22:34:02.152189+0000","last_undegraded":"2024-04-21T22:34:02.152189+0000","last_fullsized":"2024-04-21T22:34:02.152189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:22:12.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362476+0000","last_change":"2024-04-21T22:31:29.527643+0000","last_active":"2024-04-21T22:34:02.362476+0000","last_peered":"2024-04-21T22:34:02.362476+0000","last_clean":"2024-04-21T22:34:02.362476+0000","last_became_active":"2024-04-21T22:31:29.527240+0000","last_became_peered":"2024-04-21T22:31:29.527240+0000","last_unstale":"2024-04-21T22:34:02.362476+0000","last_undegraded":"2024-04-21T22:34:02.362476+0000","last_fullsized":"2024-04-21T22:34:02.362476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:11:58.835033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'50","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.313071+0000","last_change":"2024-04-21T22:31:28.518054+0000","last_active":"2024-04-21T22:34:02.313071+0000","last_peered":"2024-04-21T22:34:02.313071+0000","last_clean":"2024-04-21T22:34:02.313071+0000","last_became_active":"2024-04-21T22:31:28.517776+0000","last_became_peered":"2024-04-21T22:31:28.517776+0000","last_unstale":"2024-04-21T22:34:02.313071+0000","last_undegraded":"2024-04-21T22:34:02.313071+0000","last_fullsized":"2024-04-21T22:34:02.313071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:19:18.897696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.154317+0000","last_change":"2024-04-21T22:31:29.534255+0000","last_active":"2024-04-21T22:34:02.154317+0000","last_peered":"2024-04-21T22:34:02.154317+0000","last_clean":"2024-04-21T22:34:02.154317+0000","last_became_active":"2024-04-21T22:31:29.533215+0000","last_became_peered":"2024-04-21T22:31:29.533215+0000","last_unstale":"2024-04-21T22:34:02.154317+0000","last_undegraded":"2024-04-21T22:34:02.154317+0000","last_fullsized":"2024-04-21T22:34:02.154317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:04:31.284513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.360915+0000","last_change":"2024-04-21T22:31:28.501219+0000","last_active":"2024-04-21T22:34:02.360915+0000","last_peered":"2024-04-21T22:34:02.360915+0000","last_clean":"2024-04-21T22:34:02.360915+0000","last_became_active":"2024-04-21T22:31:28.500826+0000","last_became_peered":"2024-04-21T22:31:28.500826+0000","last_unstale":"2024-04-21T22:34:02.360915+0000","last_undegraded":"2024-04-21T22:34:02.360915+0000","last_fullsized":"2024-04-21T22:34:02.360915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:52:03.387905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.028602+0000","last_change":"2024-04-21T22:31:29.538499+0000","last_active":"2024-04-21T22:34:02.028602+0000","last_peered":"2024-04-21T22:34:02.028602+0000","last_clean":"2024-04-21T22:34:02.028602+0000","last_became_active":"2024-04-21T22:31:29.537147+0000","last_became_peered":"2024-04-21T22:31:29.537147+0000","last_unstale":"2024-04-21T22:34:02.028602+0000","last_undegraded":"2024-04-21T22:34:02.028602+0000","last_fullsized":"2024-04-21T22:34:02.028602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:40:52.119413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362346+0000","last_change":"2024-04-21T22:32:17.566661+0000","last_active":"2024-04-21T22:34:02.362346+0000","last_peered":"2024-04-21T22:34:02.362346+0000","last_clean":"2024-04-21T22:34:02.362346+0000","last_became_active":"2024-04-21T22:32:17.563348+0000","last_became_peered":"2024-04-21T22:32:17.563348+0000","last_unstale":"2024-04-21T22:34:02.362346+0000","last_undegraded":"2024-04-21T22:34:02.362346+0000","last_fullsized":"2024-04-21T22:34:02.362346+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:05:28.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151846+0000","last_change":"2024-04-21T22:31:29.518584+0000","last_active":"2024-04-21T22:34:02.151846+0000","last_peered":"2024-04-21T22:34:02.151846+0000","last_clean":"2024-04-21T22:34:02.151846+0000","last_became_active":"2024-04-21T22:31:29.517772+0000","last_became_peered":"2024-04-21T22:31:29.517772+0000","last_unstale":"2024-04-21T22:34:02.151846+0000","last_undegraded":"2024-04-21T22:34:02.151846+0000","last_fullsized":"2024-04-21T22:34:02.151846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T02:10:44.159996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153160+0000","last_change":"2024-04-21T22:31:28.516625+0000","last_active":"2024-04-21T22:34:02.153160+0000","last_peered":"2024-04-21T22:34:02.153160+0000","last_clean":"2024-04-21T22:34:02.153160+0000","last_became_active":"2024-04-21T22:31:28.516213+0000","last_became_peered":"2024-04-21T22:31:28.516213+0000","last_unstale":"2024-04-21T22:34:02.153160+0000","last_undegraded":"2024-04-21T22:34:02.153160+0000","last_fullsized":"2024-04-21T22:34:02.153160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:00:23.579576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367691+0000","last_change":"2024-04-21T22:31:29.523902+0000","last_active":"2024-04-21T22:34:02.367691+0000","last_peered":"2024-04-21T22:34:02.367691+0000","last_clean":"2024-04-21T22:34:02.367691+0000","last_became_active":"2024-04-21T22:31:29.522812+0000","last_became_peered":"2024-04-21T22:31:29.522812+0000","last_unstale":"2024-04-21T22:34:02.367691+0000","last_undegraded":"2024-04-21T22:34:02.367691+0000","last_fullsized":"2024-04-21T22:34:02.367691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:35:52.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362095+0000","last_change":"2024-04-21T22:31:28.514177+0000","last_active":"2024-04-21T22:34:02.362095+0000","last_peered":"2024-04-21T22:34:02.362095+0000","last_clean":"2024-04-21T22:34:02.362095+0000","last_became_active":"2024-04-21T22:31:28.513847+0000","last_became_peered":"2024-04-21T22:31:28.513847+0000","last_unstale":"2024-04-21T22:34:02.362095+0000","last_undegraded":"2024-04-21T22:34:02.362095+0000","last_fullsized":"2024-04-21T22:34:02.362095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:54.654764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153632+0000","last_change":"2024-04-21T22:31:29.537103+0000","last_active":"2024-04-21T22:34:02.153632+0000","last_peered":"2024-04-21T22:34:02.153632+0000","last_clean":"2024-04-21T22:34:02.153632+0000","last_became_active":"2024-04-21T22:31:29.535789+0000","last_became_peered":"2024-04-21T22:31:29.535789+0000","last_unstale":"2024-04-21T22:34:02.153632+0000","last_undegraded":"2024-04-21T22:34:02.153632+0000","last_fullsized":"2024-04-21T22:34:02.153632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T23:15:32.792684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.151949+0000","last_change":"2024-04-21T22:32:17.571734+0000","last_active":"2024-04-21T22:34:02.151949+0000","last_peered":"2024-04-21T22:34:02.151949+0000","last_clean":"2024-04-21T22:34:02.151949+0000","last_became_active":"2024-04-21T22:32:17.559276+0000","last_became_peered":"2024-04-21T22:32:17.559276+0000","last_unstale":"2024-04-21T22:34:02.151949+0000","last_undegraded":"2024-04-21T22:34:02.151949+0000","last_fullsized":"2024-04-21T22:34:02.151949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T01:26:45.969569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363278+0000","last_change":"2024-04-21T22:31:29.525105+0000","last_active":"2024-04-21T22:34:02.363278+0000","last_peered":"2024-04-21T22:34:02.363278+0000","last_clean":"2024-04-21T22:34:02.363278+0000","last_became_active":"2024-04-21T22:31:29.524693+0000","last_became_peered":"2024-04-21T22:31:29.524693+0000","last_unstale":"2024-04-21T22:34:02.363278+0000","last_undegraded":"2024-04-21T22:34:02.363278+0000","last_fullsized":"2024-04-21T22:34:02.363278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:30:32.127689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'8","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.749755+0000","last_change":"2024-04-21T22:31:28.496419+0000","last_active":"2024-04-21T22:34:02.749755+0000","last_peered":"2024-04-21T22:34:02.749755+0000","last_clean":"2024-04-21T22:34:02.749755+0000","last_became_active":"2024-04-21T22:31:28.496071+0000","last_became_peered":"2024-04-21T22:31:28.496071+0000","last_unstale":"2024-04-21T22:34:02.749755+0000","last_undegraded":"2024-04-21T22:34:02.749755+0000","last_fullsized":"2024-04-21T22:34:02.749755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:35:35.389971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363746+0000","last_change":"2024-04-21T22:31:29.518341+0000","last_active":"2024-04-21T22:34:02.363746+0000","last_peered":"2024-04-21T22:34:02.363746+0000","last_clean":"2024-04-21T22:34:02.363746+0000","last_became_active":"2024-04-21T22:31:29.517936+0000","last_became_peered":"2024-04-21T22:31:29.517936+0000","last_unstale":"2024-04-21T22:34:02.363746+0000","last_undegraded":"2024-04-21T22:34:02.363746+0000","last_fullsized":"2024-04-21T22:34:02.363746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:27:40.427115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'41","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.306334+0000","last_change":"2024-04-21T22:31:28.518243+0000","last_active":"2024-04-21T22:34:02.306334+0000","last_peered":"2024-04-21T22:34:02.306334+0000","last_clean":"2024-04-21T22:34:02.306334+0000","last_became_active":"2024-04-21T22:31:28.517969+0000","last_became_peered":"2024-04-21T22:31:28.517969+0000","last_unstale":"2024-04-21T22:34:02.306334+0000","last_undegraded":"2024-04-21T22:34:02.306334+0000","last_fullsized":"2024-04-21T22:34:02.306334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:57:24.760503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363387+0000","last_change":"2024-04-21T22:31:29.523716+0000","last_active":"2024-04-21T22:34:02.363387+0000","last_peered":"2024-04-21T22:34:02.363387+0000","last_clean":"2024-04-21T22:34:02.363387+0000","last_became_active":"2024-04-21T22:31:29.523363+0000","last_became_peered":"2024-04-21T22:31:29.523363+0000","last_unstale":"2024-04-21T22:34:02.363387+0000","last_undegraded":"2024-04-21T22:34:02.363387+0000","last_fullsized":"2024-04-21T22:34:02.363387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:08:21.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362932+0000","last_change":"2024-04-21T22:32:17.639229+0000","last_active":"2024-04-21T22:34:02.362932+0000","last_peered":"2024-04-21T22:34:02.362932+0000","last_clean":"2024-04-21T22:34:02.362932+0000","last_became_active":"2024-04-21T22:32:17.633285+0000","last_became_peered":"2024-04-21T22:32:17.633285+0000","last_unstale":"2024-04-21T22:34:02.362932+0000","last_undegraded":"2024-04-21T22:34:02.362932+0000","last_fullsized":"2024-04-21T22:34:02.362932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:27.450154+0000","last_clean_scrub_stamp":"2024-04-21T22:31:27.450154+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:12:41.023954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.363591+0000","last_change":"2024-04-21T22:31:29.521883+0000","last_active":"2024-04-21T22:34:02.363591+0000","last_peered":"2024-04-21T22:34:02.363591+0000","last_clean":"2024-04-21T22:34:02.363591+0000","last_became_active":"2024-04-21T22:31:29.521465+0000","last_became_peered":"2024-04-21T22:31:29.521465+0000","last_unstale":"2024-04-21T22:34:02.363591+0000","last_undegraded":"2024-04-21T22:34:02.363591+0000","last_fullsized":"2024-04-21T22:34:02.363591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:57:09.622406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367734+0000","last_change":"2024-04-21T22:31:29.527191+0000","last_active":"2024-04-21T22:34:02.367734+0000","last_peered":"2024-04-21T22:34:02.367734+0000","last_clean":"2024-04-21T22:34:02.367734+0000","last_became_active":"2024-04-21T22:31:29.526793+0000","last_became_peered":"2024-04-21T22:31:29.526793+0000","last_unstale":"2024-04-21T22:34:02.367734+0000","last_undegraded":"2024-04-21T22:34:02.367734+0000","last_fullsized":"2024-04-21T22:34:02.367734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:47:17.904723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362029+0000","last_change":"2024-04-21T22:32:17.562956+0000","last_active":"2024-04-21T22:34:02.362029+0000","last_peered":"2024-04-21T22:34:02.362029+0000","last_clean":"2024-04-21T22:34:02.362029+0000","last_became_active":"2024-04-21T22:32:17.562432+0000","last_became_peered":"2024-04-21T22:32:17.562432+0000","last_unstale":"2024-04-21T22:34:02.362029+0000","last_undegraded":"2024-04-21T22:34:02.362029+0000","last_fullsized":"2024-04-21T22:34:02.362029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:37:08.467907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.361983+0000","last_change":"2024-04-21T22:31:29.534480+0000","last_active":"2024-04-21T22:34:02.361983+0000","last_peered":"2024-04-21T22:34:02.361983+0000","last_clean":"2024-04-21T22:34:02.361983+0000","last_became_active":"2024-04-21T22:31:29.534177+0000","last_became_peered":"2024-04-21T22:31:29.534177+0000","last_unstale":"2024-04-21T22:34:02.361983+0000","last_undegraded":"2024-04-21T22:34:02.361983+0000","last_fullsized":"2024-04-21T22:34:02.361983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T03:56:19.538248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.029064+0000","last_change":"2024-04-21T22:31:29.541567+0000","last_active":"2024-04-21T22:34:02.029064+0000","last_peered":"2024-04-21T22:34:02.029064+0000","last_clean":"2024-04-21T22:34:02.029064+0000","last_became_active":"2024-04-21T22:31:29.540872+0000","last_became_peered":"2024-04-21T22:31:29.540872+0000","last_unstale":"2024-04-21T22:34:02.029064+0000","last_undegraded":"2024-04-21T22:34:02.029064+0000","last_fullsized":"2024-04-21T22:34:02.029064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T00:40:52.511145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362622+0000","last_change":"2024-04-21T22:31:29.536186+0000","last_active":"2024-04-21T22:34:02.362622+0000","last_peered":"2024-04-21T22:34:02.362622+0000","last_clean":"2024-04-21T22:34:02.362622+0000","last_became_active":"2024-04-21T22:31:29.535870+0000","last_became_peered":"2024-04-21T22:31:29.535870+0000","last_unstale":"2024-04-21T22:34:02.362622+0000","last_undegraded":"2024-04-21T22:34:02.362622+0000","last_fullsized":"2024-04-21T22:34:02.362622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:03:22.503677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367929+0000","last_change":"2024-04-21T22:31:29.520033+0000","last_active":"2024-04-21T22:34:02.367929+0000","last_peered":"2024-04-21T22:34:02.367929+0000","last_clean":"2024-04-21T22:34:02.367929+0000","last_became_active":"2024-04-21T22:31:29.519571+0000","last_became_peered":"2024-04-21T22:31:29.519571+0000","last_unstale":"2024-04-21T22:34:02.367929+0000","last_undegraded":"2024-04-21T22:34:02.367929+0000","last_fullsized":"2024-04-21T22:34:02.367929+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:29:26.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362394+0000","last_change":"2024-04-21T22:31:29.526275+0000","last_active":"2024-04-21T22:34:02.362394+0000","last_peered":"2024-04-21T22:34:02.362394+0000","last_clean":"2024-04-21T22:34:02.362394+0000","last_became_active":"2024-04-21T22:31:29.525945+0000","last_became_peered":"2024-04-21T22:31:29.525945+0000","last_unstale":"2024-04-21T22:34:02.362394+0000","last_undegraded":"2024-04-21T22:34:02.362394+0000","last_fullsized":"2024-04-21T22:34:02.362394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T06:32:46.739257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.025854+0000","last_change":"2024-04-21T22:32:17.632654+0000","last_active":"2024-04-21T22:34:02.025854+0000","last_peered":"2024-04-21T22:34:02.025854+0000","last_clean":"2024-04-21T22:34:02.025854+0000","last_became_active":"2024-04-21T22:32:17.632354+0000","last_became_peered":"2024-04-21T22:32:17.632354+0000","last_unstale":"2024-04-21T22:34:02.025854+0000","last_undegraded":"2024-04-21T22:34:02.025854+0000","last_fullsized":"2024-04-21T22:34:02.025854+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:02:51.421247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.159429+0000","last_change":"2024-04-21T22:31:29.524556+0000","last_active":"2024-04-21T22:34:02.159429+0000","last_peered":"2024-04-21T22:34:02.159429+0000","last_clean":"2024-04-21T22:34:02.159429+0000","last_became_active":"2024-04-21T22:31:29.524043+0000","last_became_peered":"2024-04-21T22:31:29.524043+0000","last_unstale":"2024-04-21T22:34:02.159429+0000","last_undegraded":"2024-04-21T22:34:02.159429+0000","last_fullsized":"2024-04-21T22:34:02.159429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:06:41.417037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.153094+0000","last_change":"2024-04-21T22:31:29.530364+0000","last_active":"2024-04-21T22:34:02.153094+0000","last_peered":"2024-04-21T22:34:02.153094+0000","last_clean":"2024-04-21T22:34:02.153094+0000","last_became_active":"2024-04-21T22:31:29.528466+0000","last_became_peered":"2024-04-21T22:31:29.528466+0000","last_unstale":"2024-04-21T22:34:02.153094+0000","last_undegraded":"2024-04-21T22:34:02.153094+0000","last_fullsized":"2024-04-21T22:34:02.153094+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T22:46:25.235536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362627+0000","last_change":"2024-04-21T22:31:29.519304+0000","last_active":"2024-04-21T22:34:02.362627+0000","last_peered":"2024-04-21T22:34:02.362627+0000","last_clean":"2024-04-21T22:34:02.362627+0000","last_became_active":"2024-04-21T22:31:29.518972+0000","last_became_peered":"2024-04-21T22:31:29.518972+0000","last_unstale":"2024-04-21T22:34:02.362627+0000","last_undegraded":"2024-04-21T22:34:02.362627+0000","last_fullsized":"2024-04-21T22:34:02.362627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T04:42:22.825273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.362069+0000","last_change":"2024-04-21T22:31:29.535347+0000","last_active":"2024-04-21T22:34:02.362069+0000","last_peered":"2024-04-21T22:34:02.362069+0000","last_clean":"2024-04-21T22:34:02.362069+0000","last_became_active":"2024-04-21T22:31:29.535012+0000","last_became_peered":"2024-04-21T22:31:29.535012+0000","last_unstale":"2024-04-21T22:34:02.362069+0000","last_undegraded":"2024-04-21T22:34:02.362069+0000","last_fullsized":"2024-04-21T22:34:02.362069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T05:31:28.583286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-21T22:34:02.367869+0000","last_change":"2024-04-21T22:31:29.519706+0000","last_active":"2024-04-21T22:34:02.367869+0000","last_peered":"2024-04-21T22:34:02.367869+0000","last_clean":"2024-04-21T22:34:02.367869+0000","last_became_active":"2024-04-21T22:31:29.519365+0000","last_became_peered":"2024-04-21T22:31:29.519365+0000","last_unstale":"2024-04-21T22:34:02.367869+0000","last_undegraded":"2024-04-21T22:34:02.367869+0000","last_fullsized":"2024-04-21T22:34:02.367869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T22:31:28.478037+0000","last_clean_scrub_stamp":"2024-04-21T22:31:28.478037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:39.636670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602295,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1575,"num_read_kb":927,"num_write":380,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1807276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383726,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":468458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645361,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37224,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707928,"statfs":{"total":95995035648,"available":95956918272,"internally_reserved":0,"allocated":1810432,"data_stored":1250583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808886,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28380,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716772,"statfs":{"total":95995035648,"available":95965974528,"internally_reserved":0,"allocated":1392640,"data_stored":859136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070526,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1388544,"data_stored":859514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1593344,"data_stored":1060972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495689,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":519307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":468290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1073152,"data_stored":535812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182490,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":456477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":466421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32868,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712284,"statfs":{"total":95995035648,"available":95961378816,"internally_reserved":0,"allocated":1732608,"data_stored":1189081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":133798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T22:34:08.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.935+0000 7f2e30c00640 1 -- 172.21.15.18:0/402417896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c104a90 msgr2=0x7f2e2c104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.935+0000 7f2e30c00640 1 --2- 172.21.15.18:0/402417896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c104a90 0x7f2e2c104f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009860 tx=0x7f2e1802bb70 comp rx=0 tx=0).stop 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 -- 172.21.15.18:0/402417896 shutdown_connections 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 --2- 172.21.15.18:0/402417896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c105450 0x7f2e2c10bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 --2- 172.21.15.18:0/402417896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c104a90 0x7f2e2c104f10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 --2- 172.21.15.18:0/402417896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 -- 172.21.15.18:0/402417896 >> 172.21.15.18:0/402417896 conn(0x7f2e2c0fee10 msgr2=0x7f2e2c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 -- 172.21.15.18:0/402417896 shutdown_connections 2024-04-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.936+0000 7f2e30c00640 1 -- 172.21.15.18:0/402417896 wait complete. 2024-04-21T22:34:08.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 Processor -- start 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 -- start start 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c104a90 0x7f2e2c195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 0x7f2e2c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c078780 con 0x7f2e2c1038a0 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c078600 con 0x7f2e2c105450 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.937+0000 7f2e30c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c078900 con 0x7f2e2c104a90 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33424/0 (socket says 172.21.15.18:33424) 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2b400640 1 -- 172.21.15.18:0/399648345 learned_addr learned my addr 172.21.15.18:0/399648345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 0x7f2e2c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2aa00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c104a90 0x7f2e2c195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 -- 172.21.15.18:0/399648345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c104a90 msgr2=0x7f2e2c195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c104a90 0x7f2e2c195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 -- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 msgr2=0x7f2e2c195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 -- 172.21.15.18:0/399648345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c19d370 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.938+0000 7f2e2be00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 0x7f2e2c19cd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e24011a80 tx=0x7f2e24015630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.939+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24022070 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.939+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24003b70 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.939+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401a8e0 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.939+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c19d660 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.939+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c19db30 con 0x7f2e2c105450 2024-04-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.940+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c04f570 con 0x7f2e2c105450 2024-04-21T22:34:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.944+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f2e24025070 con 0x7f2e2c105450 2024-04-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.945+0000 7f2e23e00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 0x7f2e100a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.946+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2e240d7530 con 0x7f2e2c105450 2024-04-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.946+0000 7f2e2b400640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 0x7f2e100a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.946+0000 7f2e2b400640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 0x7f2e100a5350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0096c0 tx=0x7f2e1c009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:08.950+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2e24018070 con 0x7f2e2c105450 2024-04-21T22:34:09.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.158+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e2c19df70 con 0x7f2e2c105450 2024-04-21T22:34:09.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.159+0000 7f2e23e00640 1 -- 172.21.15.18:0/399648345 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22959 (secure 0 0 0) 0x7f2e240a3850 con 0x7f2e2c105450 2024-04-21T22:34:09.159 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:09.160 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":88,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:34:02.010219+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 msgr2=0x7f2e100a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 0x7f2e100a5350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0096c0 tx=0x7f2e1c009260 comp rx=0 tx=0).stop 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 msgr2=0x7f2e2c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 0x7f2e2c19cd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e24011a80 tx=0x7f2e24015630 comp rx=0 tx=0).stop 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 shutdown_connections 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2e100a2e90 0x7f2e100a5350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e2c105450 0x7f2e2c19cd00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e2c104a90 0x7f2e2c195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 --2- 172.21.15.18:0/399648345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e2c1038a0 0x7f2e2c195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 >> 172.21.15.18:0/399648345 conn(0x7f2e2c0fee10 msgr2=0x7f2e2c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:09.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 shutdown_connections 2024-04-21T22:34:09.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.162+0000 7f2e30c00640 1 -- 172.21.15.18:0/399648345 wait complete. 2024-04-21T22:34:09.181 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:34:09.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 -- 172.21.15.18:0/1975236101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 msgr2=0x7f6420100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 --2- 172.21.15.18:0/1975236101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420100240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6414009900 tx=0x7f641402bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 -- 172.21.15.18:0/1975236101 shutdown_connections 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 --2- 172.21.15.18:0/1975236101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420101120 0x7f64201015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 --2- 172.21.15.18:0/1975236101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420100780 0x7f6420100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 --2- 172.21.15.18:0/1975236101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420100240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 -- 172.21.15.18:0/1975236101 >> 172.21.15.18:0/1975236101 conn(0x7f64200fba20 msgr2=0x7f64200fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 -- 172.21.15.18:0/1975236101 shutdown_connections 2024-04-21T22:34:09.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.374+0000 7f6426600640 1 -- 172.21.15.18:0/1975236101 wait complete. 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.375+0000 7f6426600640 1 Processor -- start 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.375+0000 7f6426600640 1 -- start start 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420100780 0x7f642019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420101120 0x7f64201a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f642010f460 con 0x7f6420101120 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f642010f2e0 con 0x7f6420100780 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6426600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f642010f5e0 con 0x7f64200ffe20 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51918/0 (socket says 172.21.15.18:51918) 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 -- 172.21.15.18:0/2567762631 learned_addr learned my addr 172.21.15.18:0/2567762631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425c00640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420101120 0x7f64201a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f641fe00640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420100780 0x7f642019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 -- 172.21.15.18:0/2567762631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420100780 msgr2=0x7f642019a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420100780 0x7f642019a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 -- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420101120 msgr2=0x7f64201a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420101120 0x7f64201a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.376+0000 7f6425200640 1 -- 172.21.15.18:0/2567762631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64201a1700 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f6425200640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f641402c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414043020 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64201a1990 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64140054e0 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414003c40 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.377+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201a1ee0 con 0x7f64200ffe20 2024-04-21T22:34:09.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.379+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642010ab70 con 0x7f64200ffe20 2024-04-21T22:34:09.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.381+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f6414046020 con 0x7f64200ffe20 2024-04-21T22:34:09.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.383+0000 7f641d600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 0x7f64080a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.383+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f64140f1870 con 0x7f64200ffe20 2024-04-21T22:34:09.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.383+0000 7f641fe00640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 0x7f64080a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.384+0000 7f641fe00640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 0x7f64080a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f642019aff0 tx=0x7f640c005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:09.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.384+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f641404d020 con 0x7f64200ffe20 2024-04-21T22:34:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='client.25427 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='client.25453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:09.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:34:09.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:34:09.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:34:09.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/399648345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:09.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.624+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f642002d3c0 con 0x7f64200ffe20 2024-04-21T22:34:09.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.624+0000 7f641d600640 1 -- 172.21.15.18:0/2567762631 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f64140be2f0 con 0x7f64200ffe20 2024-04-21T22:34:09.624 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:34:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.627+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 msgr2=0x7f64080a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.627+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 0x7f64080a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f642019aff0 tx=0x7f640c005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.627+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 msgr2=0x7f6420199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.627+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f641402c650 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 shutdown_connections 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64080a2e20 0x7f64080a52e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6420101120 0x7f64201a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6420100780 0x7f642019a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 --2- 172.21.15.18:0/2567762631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64200ffe20 0x7f6420199ae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 >> 172.21.15.18:0/2567762631 conn(0x7f64200fba20 msgr2=0x7f64200fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 shutdown_connections 2024-04-21T22:34:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.628+0000 7f6426600640 1 -- 172.21.15.18:0/2567762631 wait complete. 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='client.25427 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='client.25453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:34:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:09 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/399648345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:09.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='client.25427 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='client.25453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: Updating smithi018:/etc/ceph/ceph.conf 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: Updating smithi047:/etc/ceph/ceph.conf 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: Updating smithi081:/etc/ceph/ceph.conf 2024-04-21T22:34:09.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:09 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/399648345' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:09.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 -- 172.21.15.18:0/3947328962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 msgr2=0x7fb0f81019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 --2- 172.21.15.18:0/3947328962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f81019f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009900 tx=0x7fb0e802bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:09.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 -- 172.21.15.18:0/3947328962 shutdown_connections 2024-04-21T22:34:09.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 --2- 172.21.15.18:0/3947328962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 0x7fb0f8109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 --2- 172.21.15.18:0/3947328962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 --2- 172.21.15.18:0/3947328962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f81019f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 -- 172.21.15.18:0/3947328962 >> 172.21.15.18:0/3947328962 conn(0x7fb0f80fcb40 msgr2=0x7fb0f80fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 -- 172.21.15.18:0/3947328962 shutdown_connections 2024-04-21T22:34:09.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.845+0000 7fb0fce00640 1 -- 172.21.15.18:0/3947328962 wait complete. 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.846+0000 7fb0fce00640 1 Processor -- start 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.846+0000 7fb0fce00640 1 -- start start 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 0x7fb0f8074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f810d2a0 con 0x7fb0f8103180 2024-04-21T22:34:09.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f810d120 con 0x7fb0f81027c0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0fce00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f810d420 con 0x7fb0f81015d0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 0x7fb0f8074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55326/0 (socket says 172.21.15.18:55326) 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51940/0 (socket says 172.21.15.18:51940) 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 -- 172.21.15.18:0/256355400 learned_addr learned my addr 172.21.15.18:0/256355400 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 -- 172.21.15.18:0/256355400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 msgr2=0x7fb0f80754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 -- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 msgr2=0x7fb0f8074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 0x7fb0f8074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f6a00640 1 -- 172.21.15.18:0/256355400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f8074900 con 0x7fb0f81027c0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.847+0000 7fb0f7400640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0f6a00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400e9f0 tx=0x7fb0e400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:09.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e400cd80 con 0x7fb0f81027c0 2024-04-21T22:34:09.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0e4005500 con 0x7fb0f81027c0 2024-04-21T22:34:09.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f81a1a60 con 0x7fb0f81027c0 2024-04-21T22:34:09.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4010690 con 0x7fb0f81027c0 2024-04-21T22:34:09.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.848+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f81a1fb0 con 0x7fb0f81027c0 2024-04-21T22:34:09.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.849+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f81088f0 con 0x7fb0f81027c0 2024-04-21T22:34:09.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.852+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fb0e40046c0 con 0x7fb0f81027c0 2024-04-21T22:34:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.853+0000 7fb0efe00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 0x7fb0dc0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.853+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb0e40cfb40 con 0x7fb0f81027c0 2024-04-21T22:34:09.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.854+0000 7fb0f7400640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 0x7fb0dc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:09.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.854+0000 7fb0f7400640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 0x7fb0dc0a5360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0e802c170 tx=0x7fb0e802df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:09.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:09.857+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb0e409c4b0 con 0x7fb0f81027c0 2024-04-21T22:34:10.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.066+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb0f802d3c0 con 0x7fb0f81027c0 2024-04-21T22:34:10.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.067+0000 7fb0efe00640 1 -- 172.21.15.18:0/256355400 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fb0e409bdb0 con 0x7fb0f81027c0 2024-04-21T22:34:10.067 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:34:10.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 msgr2=0x7fb0dc0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 0x7fb0dc0a5360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0e802c170 tx=0x7fb0e802df90 comp rx=0 tx=0).stop 2024-04-21T22:34:10.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 msgr2=0x7fb0f8073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400e9f0 tx=0x7fb0e400edf0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 shutdown_connections 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb0dc0a2ea0 0x7fb0dc0a5360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0f8103180 0x7fb0f8074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0f81027c0 0x7fb0f8073b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 --2- 172.21.15.18:0/256355400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f81015d0 0x7fb0f80754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 >> 172.21.15.18:0/256355400 conn(0x7fb0f80fcb40 msgr2=0x7fb0f8105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 shutdown_connections 2024-04-21T22:34:10.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.069+0000 7fb0fce00640 1 -- 172.21.15.18:0/256355400 wait complete. 2024-04-21T22:34:10.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:34:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 -- 172.21.15.18:0/2856559639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c10107710 msgr2=0x7f4c10107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 --2- 172.21.15.18:0/2856559639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c10107710 0x7f4c10107af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009930 tx=0x7f4c0002bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 -- 172.21.15.18:0/2856559639 shutdown_connections 2024-04-21T22:34:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 --2- 172.21.15.18:0/2856559639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c101020c0 0x7f4c1010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 --2- 172.21.15.18:0/2856559639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 --2- 172.21.15.18:0/2856559639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c10107710 0x7f4c10107af0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 -- 172.21.15.18:0/2856559639 >> 172.21.15.18:0/2856559639 conn(0x7f4c100fd1f0 msgr2=0x7f4c100ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.276+0000 7f4c16c00640 1 -- 172.21.15.18:0/2856559639 shutdown_connections 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.277+0000 7f4c16c00640 1 -- 172.21.15.18:0/2856559639 wait complete. 2024-04-21T22:34:10.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.278+0000 7f4c16c00640 1 Processor -- start 2024-04-21T22:34:10.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.278+0000 7f4c16c00640 1 -- start start 2024-04-21T22:34:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c101020c0 0x7f4c10198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c10107710 0x7f4c1019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10111b70 con 0x7f4c101020c0 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c101119f0 con 0x7f4c10101700 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c16c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10111cf0 con 0x7f4c10107710 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c0fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c0fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55356/0 (socket says 172.21.15.18:55356) 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c0fe00640 1 -- 172.21.15.18:0/132806772 learned_addr learned my addr 172.21.15.18:0/132806772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c0f400640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c101020c0 0x7f4c10198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.279+0000 7f4c14c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c10107710 0x7f4c1019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 -- 172.21.15.18:0/132806772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c10107710 msgr2=0x7f4c1019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c10107710 0x7f4c1019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 -- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c101020c0 msgr2=0x7f4c10198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c101020c0 0x7f4c10198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 -- 172.21.15.18:0/132806772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1019d040 con 0x7f4c10101700 2024-04-21T22:34:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.280+0000 7f4c0fe00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009900 tx=0x7f4c00004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.281+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00043020 con 0x7f4c10101700 2024-04-21T22:34:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.281+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c000054e0 con 0x7f4c10101700 2024-04-21T22:34:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.281+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1019d2d0 con 0x7f4c10101700 2024-04-21T22:34:10.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.281+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00003b80 con 0x7f4c10101700 2024-04-21T22:34:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.281+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c101a4bc0 con 0x7f4c10101700 2024-04-21T22:34:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.282+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c10068a40 con 0x7f4c10101700 2024-04-21T22:34:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.284+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f4c00046020 con 0x7f4c10101700 2024-04-21T22:34:10.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.286+0000 7f4c0cc00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 0x7f4bf40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.286+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4c000f1830 con 0x7f4c10101700 2024-04-21T22:34:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.286+0000 7f4c0f400640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 0x7f4bf40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.287+0000 7f4c0f400640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 0x7f4bf40a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c100ff850 tx=0x7f4bfc00b410 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.288+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f4c0004d020 con 0x7f4c10101700 2024-04-21T22:34:10.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.502+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c10109c70 con 0x7f4c10101700 2024-04-21T22:34:10.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.503+0000 7f4c0cc00640 1 -- 172.21.15.18:0/132806772 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f4c000be2b0 con 0x7f4c10101700 2024-04-21T22:34:10.502 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:34:10.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 msgr2=0x7f4bf40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 0x7f4bf40a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c100ff850 tx=0x7f4bfc00b410 comp rx=0 tx=0).stop 2024-04-21T22:34:10.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 msgr2=0x7f4c10198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009900 tx=0x7f4c00004360 comp rx=0 tx=0).stop 2024-04-21T22:34:10.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 shutdown_connections 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4bf40a2e20 0x7f4bf40a52e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c10107710 0x7f4c1019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c101020c0 0x7f4c10198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 --2- 172.21.15.18:0/132806772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c10101700 0x7f4c10198050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 >> 172.21.15.18:0/132806772 conn(0x7f4c100fd1f0 msgr2=0x7f4c100fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.506+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 shutdown_connections 2024-04-21T22:34:10.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.507+0000 7f4c16c00640 1 -- 172.21.15.18:0/132806772 wait complete. 2024-04-21T22:34:10.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:34:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.703+0000 7f4276200640 1 -- 172.21.15.18:0/3441069386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 msgr2=0x7f4270101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.703+0000 7f4276200640 1 --2- 172.21.15.18:0/3441069386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f4270101a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4258009930 tx=0x7f425802bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 -- 172.21.15.18:0/3441069386 shutdown_connections 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 --2- 172.21.15.18:0/3441069386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 0x7f427010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 --2- 172.21.15.18:0/3441069386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f4270101a60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 --2- 172.21.15.18:0/3441069386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f4270107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 -- 172.21.15.18:0/3441069386 >> 172.21.15.18:0/3441069386 conn(0x7f42700fd150 msgr2=0x7f42700ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 -- 172.21.15.18:0/3441069386 shutdown_connections 2024-04-21T22:34:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.704+0000 7f4276200640 1 -- 172.21.15.18:0/3441069386 wait complete. 2024-04-21T22:34:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.705+0000 7f4276200640 1 Processor -- start 2024-04-21T22:34:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.705+0000 7f4276200640 1 -- start start 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f427019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 0x7f427019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4270111a10 con 0x7f42701015e0 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4270111890 con 0x7f4270101fa0 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4276200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4270111b90 con 0x7f4270107680 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4274e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f427019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51984/0 (socket says 172.21.15.18:51984) 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f426fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 0x7f427019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 -- 172.21.15.18:0/2322662203 learned_addr learned my addr 172.21.15.18:0/2322662203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 -- 172.21.15.18:0/2322662203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 msgr2=0x7f427019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 0x7f427019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 -- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 msgr2=0x7f427019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f427019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.706+0000 7f4275800640 1 -- 172.21.15.18:0/2322662203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427019f0b0 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f4275800640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f426800e9b0 tx=0x7f426800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426800cd80 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427019f3a0 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42680035f0 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268010670 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.707+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a6c30 con 0x7f4270107680 2024-04-21T22:34:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.709+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427004f570 con 0x7f4270107680 2024-04-21T22:34:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.710+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f42680037a0 con 0x7f4270107680 2024-04-21T22:34:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.712+0000 7f426d600640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 0x7f42540a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.712+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f42680cfa80 con 0x7f4270107680 2024-04-21T22:34:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.712+0000 7f4274e00640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 0x7f42540a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.713+0000 7f4274e00640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 0x7f42540a52d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4270102720 tx=0x7f4260009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.716+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f42680d1e20 con 0x7f4270107680 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='client.25439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2567762631' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:10 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/256355400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='client.25439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2567762631' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:10 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/256355400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='client.25439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: Updating smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2567762631' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:10 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/256355400' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:34:10.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.973+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42701a6e30 con 0x7f4270107680 2024-04-21T22:34:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.974+0000 7f426d600640 1 -- 172.21.15.18:0/2322662203 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7f426809c3f0 con 0x7f4270107680 2024-04-21T22:34:10.974 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:10.975 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:34:01.767520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:34:10.975 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.977+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 msgr2=0x7f42540a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.977+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 0x7f42540a52d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4270102720 tx=0x7f4260009500 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.977+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 msgr2=0x7f427019e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.977+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f426800e9b0 tx=0x7f426800ee70 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 shutdown_connections 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f42540a2e10 0x7f42540a52d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4270107680 0x7f427019e980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4270101fa0 0x7f427019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 --2- 172.21.15.18:0/2322662203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42701015e0 0x7f427019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 >> 172.21.15.18:0/2322662203 conn(0x7f42700fd150 msgr2=0x7f427010c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 shutdown_connections 2024-04-21T22:34:10.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:10.978+0000 7f4276200640 1 -- 172.21.15.18:0/2322662203 wait complete. 2024-04-21T22:34:10.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 -- 172.21.15.18:0/915230626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 msgr2=0x7f2ad81107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 --2- 172.21.15.18:0/915230626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad81107f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009cd0 tx=0x7f2ad002c0e0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 -- 172.21.15.18:0/915230626 shutdown_connections 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 --2- 172.21.15.18:0/915230626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad81107f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 --2- 172.21.15.18:0/915230626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8103920 0x7f2ad8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 --2- 172.21.15.18:0/915230626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8109930 0x7f2ad8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 -- 172.21.15.18:0/915230626 >> 172.21.15.18:0/915230626 conn(0x7f2ad80ff410 msgr2=0x7f2ad8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 -- 172.21.15.18:0/915230626 shutdown_connections 2024-04-21T22:34:11.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.214+0000 7f2adea00640 1 -- 172.21.15.18:0/915230626 wait complete. 2024-04-21T22:34:11.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 Processor -- start 2024-04-21T22:34:11.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 -- start start 2024-04-21T22:34:11.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8103920 0x7f2ad819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8109930 0x7f2ad819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8113d40 con 0x7f2ad81042e0 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8113bc0 con 0x7f2ad8109930 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.216+0000 7f2adea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad8113ec0 con 0x7f2ad8103920 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33502/0 (socket says 172.21.15.18:33502) 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 -- 172.21.15.18:0/613936882 learned_addr learned my addr 172.21.15.18:0/613936882 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8103920 0x7f2ad819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2adca00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8109930 0x7f2ad819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 -- 172.21.15.18:0/613936882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8103920 msgr2=0x7f2ad819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8103920 0x7f2ad819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 -- 172.21.15.18:0/613936882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8109930 msgr2=0x7f2ad819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8109930 0x7f2ad819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.217+0000 7f2acf400640 1 -- 172.21.15.18:0/613936882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad819f1f0 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2acf400640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000ea60 tx=0x7f2ac000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000cde0 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac00035f0 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0010670 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad819f4e0 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.218+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad81a6d70 con 0x7f2ad81042e0 2024-04-21T22:34:11.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.219+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad8068a40 con 0x7f2ad81042e0 2024-04-21T22:34:11.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.221+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f2ac00037a0 con 0x7f2ad81042e0 2024-04-21T22:34:11.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.223+0000 7f2ad5600640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 0x7f2abc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.223+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2ac00cfa30 con 0x7f2ad81042e0 2024-04-21T22:34:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.223+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 0x7f2abc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.224+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 0x7f2abc0a52e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009b50 tx=0x7f2ac8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.227+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f2ac009c3a0 con 0x7f2ad81042e0 2024-04-21T22:34:11.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.433+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ad810b920 con 0x7f2ad81042e0 2024-04-21T22:34:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.437+0000 7f2ad5600640 1 -- 172.21.15.18:0/613936882 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22959 (secure 0 0 0) 0x7f2ac009bca0 con 0x7f2ad81042e0 2024-04-21T22:34:11.437 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:11.437 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":88,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:34:02.010219+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 msgr2=0x7f2abc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 0x7f2abc0a52e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009b50 tx=0x7f2ac8005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 msgr2=0x7f2ad819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000ea60 tx=0x7f2ac000ef20 comp rx=0 tx=0).stop 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 shutdown_connections 2024-04-21T22:34:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2abc0a2e20 0x7f2abc0a52e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ad8109930 0x7f2ad819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad81042e0 0x7f2ad819a740 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 --2- 172.21.15.18:0/613936882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ad8103920 0x7f2ad819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 >> 172.21.15.18:0/613936882 conn(0x7f2ad80ff410 msgr2=0x7f2ad80ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 shutdown_connections 2024-04-21T22:34:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.440+0000 7f2adea00640 1 -- 172.21.15.18:0/613936882 wait complete. 2024-04-21T22:34:11.460 DEBUG:tasks.fwd_scrub:Yielding 2024-04-21T22:34:11.460 INFO:teuthology.run_tasks:Running task exec... 2024-04-21T22:34:11.470 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T22:34:11.470 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:34:11.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-21T22:34:11.471 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-21T22:34:11.471 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:34:11.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:34:11.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 -- 172.21.15.18:0/3313334298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb88107730 msgr2=0x7fbb88107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3313334298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb88107730 0x7fbb88107b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009930 tx=0x7fbb7802bc30 comp rx=0 tx=0).stop 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 -- 172.21.15.18:0/3313334298 shutdown_connections 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3313334298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb881020e0 0x7fbb8810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3313334298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb88101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3313334298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb88107730 0x7fbb88107b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 -- 172.21.15.18:0/3313334298 >> 172.21.15.18:0/3313334298 conn(0x7fbb880fd1d0 msgr2=0x7fbb880ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 -- 172.21.15.18:0/3313334298 shutdown_connections 2024-04-21T22:34:11.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.658+0000 7fbb8e200640 1 -- 172.21.15.18:0/3313334298 wait complete. 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.659+0000 7fbb8e200640 1 Processor -- start 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.659+0000 7fbb8e200640 1 -- start start 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 0x7fbb8819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb88107730 0x7fbb8819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88111b90 con 0x7fbb881020e0 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88111a10 con 0x7fbb88107730 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb8e200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb88111d10 con 0x7fbb88101720 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 0x7fbb8819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52034/0 (socket says 172.21.15.18:52034) 2024-04-21T22:34:11.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb87400640 1 -- 172.21.15.18:0/3201698372 learned_addr learned my addr 172.21.15.18:0/3201698372 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.660+0000 7fbb87e00640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb88107730 0x7fbb8819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 -- 172.21.15.18:0/3201698372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb88107730 msgr2=0x7fbb8819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb88107730 0x7fbb8819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 -- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 msgr2=0x7fbb8819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 0x7fbb8819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 -- 172.21.15.18:0/3201698372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8819f2a0 con 0x7fbb88101720 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb86a00640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 0x7fbb8819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb87400640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009900 tx=0x7fbb78004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78043020 con 0x7fbb88101720 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb780054e0 con 0x7fbb88101720 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8819f530 con 0x7fbb88101720 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003b90 con 0x7fbb88101720 2024-04-21T22:34:11.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.661+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb881a6e20 con 0x7fbb88101720 2024-04-21T22:34:11.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.663+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8804fd50 con 0x7fbb88101720 2024-04-21T22:34:11.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.665+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fbb78046020 con 0x7fbb88101720 2024-04-21T22:34:11.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.666+0000 7fbb7fe00640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 0x7fbb6c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.666+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbb780f16a0 con 0x7fbb88101720 2024-04-21T22:34:11.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.666+0000 7fbb86a00640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 0x7fbb6c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.667+0000 7fbb86a00640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 0x7fbb6c0a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb8810e9f0 tx=0x7fbb74005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.670+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fbb7804d020 con 0x7fbb88101720 2024-04-21T22:34:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 -- 172.21.15.18:0/537585211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c073b10 msgr2=0x7f1f5c073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 --2- 172.21.15.18:0/537585211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c073b10 0x7f1f5c073ef0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009ca0 tx=0x7f1f5402c180 comp rx=0 tx=0).stop 2024-04-21T22:34:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 -- 172.21.15.18:0/537585211 shutdown_connections 2024-04-21T22:34:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 --2- 172.21.15.18:0/537585211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c10dde0 0x7f1f5c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 --2- 172.21.15.18:0/537585211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c074430 0x7f1f5c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 --2- 172.21.15.18:0/537585211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c073b10 0x7f1f5c073ef0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 -- 172.21.15.18:0/537585211 >> 172.21.15.18:0/537585211 conn(0x7f1f5c0fd090 msgr2=0x7f1f5c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.674+0000 7f1f61600640 1 -- 172.21.15.18:0/537585211 shutdown_connections 2024-04-21T22:34:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.675+0000 7f1f61600640 1 -- 172.21.15.18:0/537585211 wait complete. 2024-04-21T22:34:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.675+0000 7f1f61600640 1 Processor -- start 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 -- start start 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 0x7f1f5c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c10dde0 0x7f1f5c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c113b60 con 0x7f1f5c10dde0 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1139e0 con 0x7f1f5c073b10 2024-04-21T22:34:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f61600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c113ce0 con 0x7f1f5c074430 2024-04-21T22:34:11.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 0x7f1f5c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c10dde0 0x7f1f5c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52052/0 (socket says 172.21.15.18:52052) 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.676+0000 7f1f5b400640 1 -- 172.21.15.18:0/640216330 learned_addr learned my addr 172.21.15.18:0/640216330 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 -- 172.21.15.18:0/640216330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 msgr2=0x7f1f5c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 0x7f1f5c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 -- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c10dde0 msgr2=0x7f1f5c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c10dde0 0x7f1f5c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 -- 172.21.15.18:0/640216330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c19f0b0 con 0x7f1f5c074430 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5be00640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 0x7f1f5c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f5b400640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9f0 tx=0x7f1f4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.677+0000 7f1f58c00640 1 -- 172.21.15.18:0/640216330 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800cd80 con 0x7f1f5c074430 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.678+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c19f3a0 con 0x7f1f5c074430 2024-04-21T22:34:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.678+0000 7f1f58c00640 1 -- 172.21.15.18:0/640216330 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f48010910 con 0x7f1f5c074430 2024-04-21T22:34:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.678+0000 7f1f58c00640 1 -- 172.21.15.18:0/640216330 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480188f0 con 0x7f1f5c074430 2024-04-21T22:34:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.678+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1a6c30 con 0x7f1f5c074430 2024-04-21T22:34:11.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f657ef740 1 Processor -- start 2024-04-21T22:34:11.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f657ef740 1 -- start start 2024-04-21T22:34:11.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f58c00640 1 -- 172.21.15.18:0/640216330 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f1f48010ac0 con 0x7f1f5c074430 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.681+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163f7de0 0x5604163fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f657ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56041634cdf0 con 0x5604163ee8e0 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f657ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560416352040 con 0x5604163f7de0 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f657ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604162fa8c0 con 0x5604163ef200 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33534/0 (socket says 172.21.15.18:33534) 2024-04-21T22:34:11.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 -- 172.21.15.18:0/1397502242 learned_addr learned my addr 172.21.15.18:0/1397502242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f5be00640 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f5b400640 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163f7de0 0x5604163fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 -- 172.21.15.18:0/1397502242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 msgr2=0x5604163f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 -- 172.21.15.18:0/1397502242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163f7de0 msgr2=0x5604163fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163f7de0 0x5604163fa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.682+0000 7f1f60c00640 1 -- 172.21.15.18:0/1397502242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041612e7e0 con 0x5604163ee8e0 2024-04-21T22:34:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.683+0000 7f1f60c00640 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009b80 tx=0x7f1f4c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be961cfa683b6098 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.683+0000 7f1f51200640 1 -- 172.21.15.18:0/1397502242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c004030 con 0x5604163ee8e0 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.683+0000 7f1f51200640 1 -- 172.21.15.18:0/1397502242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f4c0041d0 con 0x5604163ee8e0 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.683+0000 7f1f51200640 1 -- 172.21.15.18:0/1397502242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c019710 con 0x5604163ee8e0 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f58c00640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 0x7f1f400a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 -- 172.21.15.18:0/1397502242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 msgr2=0x5604163eecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009b80 tx=0x7f1f4c011810 comp rx=0 tx=0).stop 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f58c00640 1 -- 172.21.15.18:0/640216330 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1f480cfb10 con 0x7f1f5c074430 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f5be00640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 0x7f1f400a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 -- 172.21.15.18:0/1397502242 shutdown_connections 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163f7de0 0x5604163fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1397502242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163ee8e0 0x5604163eecc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 -- 172.21.15.18:0/1397502242 >> 172.21.15.18:0/1397502242 conn(0x5604163e9010 msgr2=0x5604163e93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 -- 172.21.15.18:0/1397502242 shutdown_connections 2024-04-21T22:34:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.684+0000 7f1f657ef740 1 -- 172.21.15.18:0/1397502242 wait complete. 2024-04-21T22:34:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.685+0000 7f1f5be00640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 0x7f1f400a52e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f54000f80 tx=0x7f1f54032580 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.685+0000 7f1f657ef740 1 -- start start 2024-04-21T22:34:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.685+0000 7f1f657ef740 1 Processor -- start 2024-04-21T22:34:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ee8e0 0x5604163f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56041630dd20 con 0x5604163f7de0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56041634e000 con 0x5604163ee8e0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5604163fabd0 con 0x5604163ef200 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f657ef740 10 client.0 _ll_register_callbacks cb 0x5604163490a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33540/0 (socket says 172.21.15.18:33540) 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f60c00640 1 -- 172.21.15.18:0/2794003713 learned_addr learned my addr 172.21.15.18:0/2794003713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f5b400640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f5be00640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ee8e0 0x5604163f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f5b400640 1 -- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ee8e0 msgr2=0x5604163f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.686+0000 7f1f5b400640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ee8e0 0x5604163f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f5b400640 1 -- 172.21.15.18:0/2794003713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 msgr2=0x5604163f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f5b400640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f5b400640 1 -- 172.21.15.18:0/2794003713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041618ef70 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f60c00640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f5b400640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f53a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cd050 tx=0x7f1f480980d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebf664434a9b307 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f45600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4809b790 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1f480cd360 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4c0041d0 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f4809be30 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f657ef740 10 client.25513 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.687+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560416026170 con 0x5604163ef200 2024-04-21T22:34:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f4c0041d0 con 0x5604163ef200 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1f4809b410 con 0x5604163ef200 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 10 client.25513 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 10 client.25513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 20 client.25513 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560416408110 0x56041640a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 4 client.25513 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56041635f580 con 0x560416408110 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.688+0000 7f1f5be00640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560416408110 0x56041640a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.689+0000 7f1f5be00640 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560416408110 0x56041640a500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c226eff60c28b85 server_cookie=1eaac2c4bf077d0e in_seq=0 out_seq=0 2024-04-21T22:34:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.689+0000 7f1f45600640 10 client.25513 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f45600640 1 -- 172.21.15.18:0/2794003713 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56041635f580 con 0x560416408110 2024-04-21T22:34:11.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f45600640 10 client.25513 handle_command_reply: tid=0 2024-04-21T22:34:11.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 client.25513 shutdown 2024-04-21T22:34:11.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 msgr2=0x5604163f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f53a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cd050 tx=0x7f1f480980d0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 shutdown_connections 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163f7de0 0x5604163f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560416408110 0x56041640a500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ef200 0x5604163f53a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 --2- 172.21.15.18:0/2794003713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ee8e0 0x5604163f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 >> 172.21.15.18:0/2794003713 conn(0x5604163e9010 msgr2=0x5604163ead60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f45600640 0 client.25513 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 shutdown_connections 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.690+0000 7f1f657ef740 1 -- 172.21.15.18:0/2794003713 wait complete. 2024-04-21T22:34:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.691+0000 7f1f657ef740 20 client.25513 trim_cache size 0 max 16384 2024-04-21T22:34:11.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.710+0000 7f1f657ef740 1 Processor -- start 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.710+0000 7f1f657ef740 1 -- start start 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x56041640fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1af4d0 con 0x5604163e9010 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b1010 con 0x5604163ef200 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f657ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1afba0 con 0x5604163ee8e0 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33550/0 (socket says 172.21.15.18:33550) 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 -- 172.21.15.18:0/1642787740 learned_addr learned my addr 172.21.15.18:0/1642787740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f60c00640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x56041640fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5b400640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 -- 172.21.15.18:0/1642787740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 msgr2=0x5604163f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 -- 172.21.15.18:0/1642787740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 msgr2=0x56041640fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.711+0000 7f1f5be00640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x56041640fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f5be00640 1 -- 172.21.15.18:0/1642787740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604163ef020 con 0x5604163e9010 2024-04-21T22:34:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f5b400640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f5be00640 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009a60 tx=0x7f1f54041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3727c047c8e328b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f47e00640 1 -- 172.21.15.18:0/1642787740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54039040 con 0x5604163e9010 2024-04-21T22:34:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f47e00640 1 -- 172.21.15.18:0/1642787740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f5405b070 con 0x5604163e9010 2024-04-21T22:34:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.712+0000 7f1f47e00640 1 -- 172.21.15.18:0/1642787740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54032700 con 0x5604163e9010 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 -- 172.21.15.18:0/1642787740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 msgr2=0x560416403910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009a60 tx=0x7f1f54041000 comp rx=0 tx=0).stop 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 -- 172.21.15.18:0/1642787740 shutdown_connections 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x56041640fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 --2- 172.21.15.18:0/1642787740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x560416403910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 -- 172.21.15.18:0/1642787740 >> 172.21.15.18:0/1642787740 conn(0x5604163f3aa0 msgr2=0x5604163f4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 -- 172.21.15.18:0/1642787740 shutdown_connections 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.713+0000 7f1f657ef740 1 -- 172.21.15.18:0/1642787740 wait complete. 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 -- start start 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 Processor -- start 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x5604163fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b0940 con 0x5604163e9010 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b0270 con 0x5604163ef200 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1ad4b0 con 0x5604163ee8e0 2024-04-21T22:34:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.714+0000 7f1f657ef740 10 client.0 _ll_register_callbacks cb 0x7f1f4800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33554/0 (socket says 172.21.15.18:33554) 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 -- 172.21.15.18:0/3871320032 learned_addr learned my addr 172.21.15.18:0/3871320032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5b400640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f60c00640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x5604163fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 -- 172.21.15.18:0/3871320032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 msgr2=0x5604163fcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163fcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 -- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 msgr2=0x5604163fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x5604163fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.715+0000 7f1f5be00640 1 -- 172.21.15.18:0/3871320032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56041646e560 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f5be00640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f540049d0 tx=0x7f1f54055ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf1c00929277219 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f45600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5406a060 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f5405b070 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1f54065b20 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1f54039070 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f657ef740 10 client.15390 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.716+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56041646f7a0 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f5405b070 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1f540328e0 con 0x5604163e9010 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 20 client.15390 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5604163f7de0 0x560416471e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 4 client.15390 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:34:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5604163598d0 con 0x5604163f7de0 2024-04-21T22:34:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.717+0000 7f1f5b400640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5604163f7de0 0x560416471e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.718+0000 7f1f5b400640 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5604163f7de0 0x560416471e80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dced37654001a2a server_cookie=3216379858dfd242 in_seq=0 out_seq=0 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.718+0000 7f1f45600640 10 client.15390 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.719+0000 7f1f45600640 1 -- 172.21.15.18:0/3871320032 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5604163598d0 con 0x5604163f7de0 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.719+0000 7f1f45600640 10 client.15390 handle_command_reply: tid=0 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.719+0000 7f1f657ef740 1 client.15390 shutdown 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 msgr2=0x5604163fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f540049d0 tx=0x7f1f54055ca0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 shutdown_connections 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5604163ef200 0x5604163fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5604163f7de0 0x560416471e80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604163ee8e0 0x5604163fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 --2- 172.21.15.18:0/3871320032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604163e9010 0x5604163fc7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 >> 172.21.15.18:0/3871320032 conn(0x5604163f3aa0 msgr2=0x5604163f56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f45600640 0 client.15390 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 shutdown_connections 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 1 -- 172.21.15.18:0/3871320032 wait complete. 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.720+0000 7f1f657ef740 20 client.15390 trim_cache size 0 max 16384 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:34:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "c4e526d8-c3d0-4cc1-8a3b-1cfe86115c51", 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 msgr2=0x7f1f400a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 0x7f1f400a52e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f54000f80 tx=0x7f1f54032580 comp rx=0 tx=0).stop 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 msgr2=0x7f1f5c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9f0 tx=0x7f1f4800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 shutdown_connections 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1f400a2e20 0x7f1f400a52e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f5c10dde0 0x7f1f5c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c074430 0x7f1f5c19a600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 --2- 172.21.15.18:0/640216330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1f5c073b10 0x7f1f5c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 >> 172.21.15.18:0/640216330 conn(0x7f1f5c0fd090 msgr2=0x7f1f5c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.721+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 shutdown_connections 2024-04-21T22:34:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.722+0000 7f1f61600640 1 -- 172.21.15.18:0/640216330 wait complete. 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 25 op/s 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/132806772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2322662203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:11.738 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.739 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:11 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/613936882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:34:11.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:34:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 25 op/s 2024-04-21T22:34:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/132806772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2322662203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:11 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/613936882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.913+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fbb880fde70 con 0x7fbb6c0a2e10 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 -- 172.21.15.18:0/133247318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8073af0 msgr2=0x7fd1e8073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 --2- 172.21.15.18:0/133247318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8073af0 0x7fd1e8073ed0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009900 tx=0x7fd1dc02bcd0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 -- 172.21.15.18:0/133247318 shutdown_connections 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 --2- 172.21.15.18:0/133247318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 0x7fd1e81101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 --2- 172.21.15.18:0/133247318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8074410 0x7fd1e810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 --2- 172.21.15.18:0/133247318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8073af0 0x7fd1e8073ed0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 -- 172.21.15.18:0/133247318 >> 172.21.15.18:0/133247318 conn(0x7fd1e80fd090 msgr2=0x7fd1e80ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.941+0000 7fd1eee00640 1 -- 172.21.15.18:0/133247318 shutdown_connections 2024-04-21T22:34:11.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.942+0000 7fd1eee00640 1 -- 172.21.15.18:0/133247318 wait complete. 2024-04-21T22:34:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.943+0000 7fd1eee00640 1 Processor -- start 2024-04-21T22:34:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.943+0000 7fd1eee00640 1 -- start start 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.943+0000 7fd1eee00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eee00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 0x7fd1e806c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 0x7fd1e806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8113b70 con 0x7fd1e810de00 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eee00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81139f0 con 0x7fd1e8074410 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eee00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8113cf0 con 0x7fd1e8073af0 2024-04-21T22:34:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52114/0 (socket says 172.21.15.18:52114) 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 -- 172.21.15.18:0/1774132582 learned_addr learned my addr 172.21.15.18:0/1774132582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1ee400640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 0x7fd1e806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1ed000640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 0x7fd1e806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 -- 172.21.15.18:0/1774132582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 msgr2=0x7fd1e806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 0x7fd1e806c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 -- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 msgr2=0x7fd1e806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 0x7fd1e806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1eda00640 1 -- 172.21.15.18:0/1774132582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e806cbc0 con 0x7fd1e8073af0 2024-04-21T22:34:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.944+0000 7fd1ed000640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 0x7fd1e806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.0 KiB/s wr, 25 op/s 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: Updating smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/132806772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2322662203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:34:11.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:34:11.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:34:11.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:11 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/613936882' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:34:11.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1e6000640 1 -- 172.21.15.18:0/1774132582 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc042020 con 0x7fd1e8073af0 2024-04-21T22:34:11.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1e6000640 1 -- 172.21.15.18:0/1774132582 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1dc0054e0 con 0x7fd1e8073af0 2024-04-21T22:34:11.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1e6000640 1 -- 172.21.15.18:0/1774132582 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc003af0 con 0x7fd1e8073af0 2024-04-21T22:34:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e806ce50 con 0x7fd1e8073af0 2024-04-21T22:34:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.945+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e8070d30 con 0x7fd1e8073af0 2024-04-21T22:34:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.949+0000 7fd1f316b740 1 Processor -- start 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.949+0000 7fd1f316b740 1 -- start start 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ad9fab0 0x56435ad9fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56435ad03410 con 0x56435ad9fab0 2024-04-21T22:34:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56435acab7e0 con 0x56435ada03d0 2024-04-21T22:34:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1f316b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56435acff3d0 con 0x56435ada8fb0 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1e6000640 1 -- 172.21.15.18:0/1774132582 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fd1dc045020 con 0x7fd1e8073af0 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52120/0 (socket says 172.21.15.18:52120) 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1ed000640 1 -- 172.21.15.18:0/4115594028 learned_addr learned my addr 172.21.15.18:0/4115594028 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1eda00640 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.950+0000 7fd1ed000640 1 -- 172.21.15.18:0/4115594028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 msgr2=0x56435ada8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1ed000640 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1ed000640 1 -- 172.21.15.18:0/4115594028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ad9fab0 msgr2=0x56435ad9fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1ed000640 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ad9fab0 0x56435ad9fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1ed000640 1 -- 172.21.15.18:0/4115594028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435aae17d0 con 0x56435ada8fb0 2024-04-21T22:34:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1ed000640 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40114f0 tx=0x7fd1d40119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed4060a28612dbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1daa00640 1 -- 172.21.15.18:0/4115594028 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4005020 con 0x56435ada8fb0 2024-04-21T22:34:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1daa00640 1 -- 172.21.15.18:0/4115594028 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1d40047a0 con 0x56435ada8fb0 2024-04-21T22:34:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.951+0000 7fd1daa00640 1 -- 172.21.15.18:0/4115594028 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400f950 con 0x56435ada8fb0 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1e6000640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 0x7fd1d00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1e6000640 1 -- 172.21.15.18:0/1774132582 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd1dc0f1280 con 0x7fd1e8073af0 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 -- 172.21.15.18:0/4115594028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 msgr2=0x56435adab3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40114f0 tx=0x7fd1d40119b0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 -- 172.21.15.18:0/4115594028 shutdown_connections 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435adab3a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 --2- 172.21.15.18:0/4115594028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ad9fab0 0x56435ad9fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.952+0000 7fd1f316b740 1 -- 172.21.15.18:0/4115594028 >> 172.21.15.18:0/4115594028 conn(0x56435ad9a1e0 msgr2=0x56435ad9a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.953+0000 7fd1ee400640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 0x7fd1d00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.953+0000 7fd1f316b740 1 -- 172.21.15.18:0/4115594028 shutdown_connections 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.953+0000 7fd1f316b740 1 -- 172.21.15.18:0/4115594028 wait complete. 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.953+0000 7fd1f316b740 1 -- start start 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.953+0000 7fd1ee400640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 0x7fd1d00a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0005fd0 tx=0x7fd1e0004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 Processor -- start 2024-04-21T22:34:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 0x56435ada6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56435adabda0 con 0x56435ada8fb0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56435acbec40 con 0x56435ada03d0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56435adabf20 con 0x56435ad9fab0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.954+0000 7fd1f316b740 10 client.0 _ll_register_callbacks cb 0x56435acbe630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52132/0 (socket says 172.21.15.18:52132) 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 -- 172.21.15.18:0/2661239171 learned_addr learned my addr 172.21.15.18:0/2661239171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1ed000640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1ee400640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 0x56435ada6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 -- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 msgr2=0x56435ada64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 -- 172.21.15.18:0/2661239171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 msgr2=0x56435ada6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 0x56435ada6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 -- 172.21.15.18:0/2661239171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435aa173f0 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1ee400640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 0x56435ada6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.955+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0eea70 tx=0x7fd1dc0b93d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54663335b1c0ccc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1cf400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0bd090 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd1dc02cc30 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1d40047a0 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1dc005690 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1f316b740 10 client.25531 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56435a9d70f0 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.956+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1d40047a0 con 0x56435ad9fab0 2024-04-21T22:34:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd1dc0bd990 con 0x56435ad9fab0 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 10 client.25531 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 10 client.25531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 20 client.25531 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435adb9270 0x56435adbb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 4 client.25531 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56435ad16c40 con 0x56435adb9270 2024-04-21T22:34:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.957+0000 7fd1ed000640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435adb9270 0x56435adbb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.958+0000 7fd1ed000640 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435adb9270 0x56435adbb6e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847d5ce972caab71 server_cookie=16c34c3684744441 in_seq=0 out_seq=0 2024-04-21T22:34:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.958+0000 7fd1cf400640 10 client.25531 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1cf400640 1 -- 172.21.15.18:0/2661239171 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56435ad16c40 con 0x56435adb9270 2024-04-21T22:34:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1cf400640 10 client.25531 handle_command_reply: tid=0 2024-04-21T22:34:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 client.25531 shutdown 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 msgr2=0x56435ada5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0eea70 tx=0x7fd1dc0b93d0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 shutdown_connections 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada8fb0 0x56435ada6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ada03d0 0x56435ada64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435adb9270 0x56435adbb6e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2661239171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ad9fab0 0x56435ada5fb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1cf400640 0 client.25531 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 >> 172.21.15.18:0/2661239171 conn(0x56435ad9a1e0 msgr2=0x56435ad99440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 shutdown_connections 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.959+0000 7fd1f316b740 1 -- 172.21.15.18:0/2661239171 wait complete. 2024-04-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.960+0000 7fd1f316b740 20 client.25531 trim_cache size 0 max 16384 2024-04-21T22:34:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 Processor -- start 2024-04-21T22:34:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 -- start start 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b7ca0 con 0x56435ada03d0 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b97e0 con 0x56435ad9fab0 2024-04-21T22:34:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.983+0000 7fd1f316b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b8370 con 0x56435ada8fb0 2024-04-21T22:34:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55516/0 (socket says 172.21.15.18:55516) 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 -- 172.21.15.18:0/2352895734 learned_addr learned my addr 172.21.15.18:0/2352895734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1ee400640 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 -- 172.21.15.18:0/2352895734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 msgr2=0x56435ada5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 -- 172.21.15.18:0/2352895734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 msgr2=0x56435adb4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.984+0000 7fd1eda00640 1 -- 172.21.15.18:0/2352895734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435adab3a0 con 0x56435ad9fab0 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.985+0000 7fd1eda00640 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ba100 tx=0x7fd1dc02c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224d713d0b55991e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.985+0000 7fd1da000640 1 -- 172.21.15.18:0/2352895734 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0db070 con 0x56435ad9fab0 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.985+0000 7fd1da000640 1 -- 172.21.15.18:0/2352895734 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1dc0f1070 con 0x56435ad9fab0 2024-04-21T22:34:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.985+0000 7fd1da000640 1 -- 172.21.15.18:0/2352895734 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0c63a0 con 0x56435ad9fab0 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 -- 172.21.15.18:0/2352895734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 msgr2=0x56435ada86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ba100 tx=0x7fd1dc02c4f0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 -- 172.21.15.18:0/2352895734 shutdown_connections 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 --2- 172.21.15.18:0/2352895734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435ada86e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 -- 172.21.15.18:0/2352895734 >> 172.21.15.18:0/2352895734 conn(0x56435ad9a1e0 msgr2=0x56435ad9a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 -- 172.21.15.18:0/2352895734 shutdown_connections 2024-04-21T22:34:11.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.986+0000 7fd1f316b740 1 -- 172.21.15.18:0/2352895734 wait complete. 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.987+0000 7fd1f316b740 1 -- start start 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.987+0000 7fd1f316b740 1 Processor -- start 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b9110 con 0x56435ada03d0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b8a40 con 0x56435ad9fab0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b5c80 con 0x56435ada8fb0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1f316b740 10 client.0 _ll_register_callbacks cb 0x7fd1dc009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1ee400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55526/0 (socket says 172.21.15.18:55526) 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 -- 172.21.15.18:0/1340751302 learned_addr learned my addr 172.21.15.18:0/1340751302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1ee400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52152/0 (socket says 172.21.15.18:52152) 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1ed000640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 -- 172.21.15.18:0/1340751302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 msgr2=0x56435ada2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 -- 172.21.15.18:0/1340751302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 msgr2=0x56435adb16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.988+0000 7fd1eda00640 1 -- 172.21.15.18:0/1340751302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435ada28f0 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1eda00640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ba0b0 tx=0x7fd1dc003f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7990f2d05028a6b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1cf400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0db070 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd1dc0c6110 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1dc0f1070 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1dc0bd090 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1f316b740 10 client.25517 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.989+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56435ada28f0 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1dc0f1070 con 0x56435ad9fab0 2024-04-21T22:34:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd1dc0bcd10 con 0x56435ad9fab0 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 10 client.25517 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 10 client.25517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 20 client.25517 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435ae1f430 0x56435ae21820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 4 client.25517 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56435ad10950 con 0x56435ae1f430 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.990+0000 7fd1ed000640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435ae1f430 0x56435ae21820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1ed000640 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435ae1f430 0x56435ae21820 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1748a2d86654359e server_cookie=6f44b1b8d0cec4db in_seq=0 out_seq=0 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1cf400640 10 client.25517 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1cf400640 1 -- 172.21.15.18:0/1340751302 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56435ad10950 con 0x56435ae1f430 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1cf400640 10 client.25517 handle_command_reply: tid=0 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1f316b740 1 client.25517 shutdown 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 msgr2=0x56435adb1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0ba0b0 tx=0x7fd1dc003f40 comp rx=0 tx=0).stop 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 shutdown_connections 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.991+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56435ae1f430 0x56435ae21820 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56435ada8fb0 0x56435ada2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56435ada03d0 0x56435adb16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1cf400640 0 client.25517 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 --2- 172.21.15.18:0/1340751302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56435ad9fab0 0x56435adb1170 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 >> 172.21.15.18:0/1340751302 conn(0x56435ad9a1e0 msgr2=0x56435ad98bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 shutdown_connections 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 1 -- 172.21.15.18:0/1340751302 wait complete. 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.992+0000 7fd1f316b740 20 client.25517 trim_cache size 0 max 16384 2024-04-21T22:34:11.994 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "c4e526d8-c3d0-4cc1-8a3b-1cfe86115c51": { 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "c4e526d8-c3d0-4cc1-8a3b-1cfe86115c51", 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:34:11.995 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 msgr2=0x7fd1d00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 0x7fd1d00a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0005fd0 tx=0x7fd1e0004a40 comp rx=0 tx=0).stop 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 msgr2=0x7fd1e8072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc0043c0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 shutdown_connections 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd1d00a2e20 0x7fd1d00a52e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1e810de00 0x7fd1e806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1e8074410 0x7fd1e806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 --2- 172.21.15.18:0/1774132582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1e8073af0 0x7fd1e8072f70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 >> 172.21.15.18:0/1774132582 conn(0x7fd1e80fd090 msgr2=0x7fd1e80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 shutdown_connections 2024-04-21T22:34:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:11.993+0000 7fd1eee00640 1 -- 172.21.15.18:0/1774132582 wait complete. 2024-04-21T22:34:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.004+0000 7fbb7fe00640 1 -- 172.21.15.18:0/3201698372 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbb880fde70 con 0x7fbb6c0a2e10 2024-04-21T22:34:12.003 INFO:teuthology.orchestra.run.smithi018.stdout:Schedule set for path / 2024-04-21T22:34:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 msgr2=0x7fbb6c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 0x7fbb6c0a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb8810e9f0 tx=0x7fbb74005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 msgr2=0x7fbb8819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009900 tx=0x7fbb78004360 comp rx=0 tx=0).stop 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 shutdown_connections 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb6c0a2e10 0x7fbb6c0a52d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb88107730 0x7fbb8819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb881020e0 0x7fbb8819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 --2- 172.21.15.18:0/3201698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb88101720 0x7fbb8819a2b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.006+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 >> 172.21.15.18:0/3201698372 conn(0x7fbb880fd1d0 msgr2=0x7fbb880fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.007+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 shutdown_connections 2024-04-21T22:34:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.007+0000 7fbb8e200640 1 -- 172.21.15.18:0/3201698372 wait complete. 2024-04-21T22:34:12.013 INFO:tasks.cephfs.filesystem:scrub status for tag:c4e526d8-c3d0-4cc1-8a3b-1cfe86115c51 - {'path': '/', 'tag': 'c4e526d8-c3d0-4cc1-8a3b-1cfe86115c51', 'options': 'recursive,force'} 2024-04-21T22:34:12.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.281+0000 7f0e78a00640 1 -- 172.21.15.18:0/2372343531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 msgr2=0x7f0e74105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.281+0000 7f0e78a00640 1 --2- 172.21.15.18:0/2372343531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e74105da0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009860 tx=0x7f0e6c02bc60 comp rx=0 tx=0).stop 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 -- 172.21.15.18:0/2372343531 shutdown_connections 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 --2- 172.21.15.18:0/2372343531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e74105da0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 --2- 172.21.15.18:0/2372343531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100e30 0x7f0e741052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 --2- 172.21.15.18:0/2372343531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100510 0x7f0e741008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 -- 172.21.15.18:0/2372343531 >> 172.21.15.18:0/2372343531 conn(0x7f0e740fbf20 msgr2=0x7f0e740fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 -- 172.21.15.18:0/2372343531 shutdown_connections 2024-04-21T22:34:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.282+0000 7f0e78a00640 1 -- 172.21.15.18:0/2372343531 wait complete. 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 Processor -- start 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 -- start start 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 0x7f0e7419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e741a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e74117f50 con 0x7f0e74100510 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e74117dd0 con 0x7f0e74100e30 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.283+0000 7f0e78a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e741180d0 con 0x7f0e74105910 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e72800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 0x7f0e7419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e73200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e741a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e72800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33628/0 (socket says 172.21.15.18:33628) 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e72800640 1 -- 172.21.15.18:0/1689853280 learned_addr learned my addr 172.21.15.18:0/1689853280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 -- 172.21.15.18:0/1689853280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 msgr2=0x7f0e741a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e741a2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 -- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 msgr2=0x7f0e7419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e69e00640 1 -- 172.21.15.18:0/1689853280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e741a3360 con 0x7f0e74100e30 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e73200640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e741a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.284+0000 7f0e72800640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e69e00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 0x7f0e7419e8b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00e6c0 tx=0x7f0e5c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00cab0 con 0x7f0e74100e30 2024-04-21T22:34:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741a3650 con 0x7f0e74100e30 2024-04-21T22:34:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e5c00cc50 con 0x7f0e74100e30 2024-04-21T22:34:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c018840 con 0x7f0e74100e30 2024-04-21T22:34:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.285+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e741aaee0 con 0x7f0e74100e30 2024-04-21T22:34:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.286+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e74067fe0 con 0x7f0e74100e30 2024-04-21T22:34:12.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.288+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f0e5c0189e0 con 0x7f0e74100e30 2024-04-21T22:34:12.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.290+0000 7f0e6be00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 0x7f0e580a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.290+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e5c0cfa30 con 0x7f0e74100e30 2024-04-21T22:34:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.290+0000 7f0e72800640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 0x7f0e580a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.291+0000 7f0e72800640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 0x7f0e580a52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400f7d0 tx=0x7f0e64009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:12.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.292+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f0e5c09bd50 con 0x7f0e74100e30 2024-04-21T22:34:12.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.523+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f0e740fd640 con 0x7f0e580a2e00 2024-04-21T22:34:12.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.668+0000 7f0e6be00640 1 -- 172.21.15.18:0/1689853280 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f0e740fd640 con 0x7f0e580a2e00 2024-04-21T22:34:12.668 INFO:teuthology.orchestra.run.smithi018.stdout:Retention added to path / 2024-04-21T22:34:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 msgr2=0x7f0e580a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 0x7f0e580a52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400f7d0 tx=0x7f0e64009500 comp rx=0 tx=0).stop 2024-04-21T22:34:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 msgr2=0x7f0e7419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 0x7f0e7419e8b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00e6c0 tx=0x7f0e5c00eb80 comp rx=0 tx=0).stop 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 shutdown_connections 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e580a2e00 0x7f0e580a52c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e74105910 0x7f0e741a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e74100e30 0x7f0e7419e8b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 --2- 172.21.15.18:0/1689853280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e74100510 0x7f0e7419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.671+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 >> 172.21.15.18:0/1689853280 conn(0x7f0e740fbf20 msgr2=0x7f0e740fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.672+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 shutdown_connections 2024-04-21T22:34:12.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.672+0000 7f0e78a00640 1 -- 172.21.15.18:0/1689853280 wait complete. 2024-04-21T22:34:12.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-21T22:34:12.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:12 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:34:12.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:12.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:12 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:34:12.765 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:12.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:12 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:34:12.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:12.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:12 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:34:12.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 -- 172.21.15.18:0/649553342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 msgr2=0x7f5844110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 --2- 172.21.15.18:0/649553342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f5844110640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f583c009cd0 tx=0x7f583c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 -- 172.21.15.18:0/649553342 shutdown_connections 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 --2- 172.21.15.18:0/649553342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f5844110640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 --2- 172.21.15.18:0/649553342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844103770 0x7f5844103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 --2- 172.21.15.18:0/649553342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844109780 0x7f5844109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 -- 172.21.15.18:0/649553342 >> 172.21.15.18:0/649553342 conn(0x7f58440ff240 msgr2=0x7f5844101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 -- 172.21.15.18:0/649553342 shutdown_connections 2024-04-21T22:34:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.893+0000 7f5848a00640 1 -- 172.21.15.18:0/649553342 wait complete. 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 Processor -- start 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 -- start start 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844103770 0x7f584419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844109780 0x7f584419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5844113b90 con 0x7f5844104130 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5844113a10 con 0x7f5844103770 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.894+0000 7f5848a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5844113d10 con 0x7f5844109780 2024-04-21T22:34:12.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33648/0 (socket says 172.21.15.18:33648) 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 -- 172.21.15.18:0/3717592006 learned_addr learned my addr 172.21.15.18:0/3717592006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5843400640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844103770 0x7f584419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5843e00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844109780 0x7f584419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 -- 172.21.15.18:0/3717592006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844109780 msgr2=0x7f584419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844109780 0x7f584419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 -- 172.21.15.18:0/3717592006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844103770 msgr2=0x7f584419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844103770 0x7f584419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 -- 172.21.15.18:0/3717592006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584419f000 con 0x7f5844104130 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.895+0000 7f5842a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f582c00eb30 tx=0x7f582c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.896+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c010430 con 0x7f5844104130 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.896+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f582c010ab0 con 0x7f5844104130 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.896+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584419f2f0 con 0x7f5844104130 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.896+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c018b20 con 0x7f5844104130 2024-04-21T22:34:12.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.896+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58441a6b80 con 0x7f5844104130 2024-04-21T22:34:12.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.897+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5844067fe0 con 0x7f5844104130 2024-04-21T22:34:12.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.899+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f582c018cc0 con 0x7f5844104130 2024-04-21T22:34:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.900+0000 7f583be00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 0x7f58280a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.901+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f582c0cfdb0 con 0x7f5844104130 2024-04-21T22:34:12.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.901+0000 7f5843400640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 0x7f58280a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:12.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.901+0000 7f5843400640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 0x7f58280a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58340095f0 tx=0x7f5834005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:12.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:12.905+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f582c0d4070 con 0x7f5844104130 2024-04-21T22:34:12.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:12 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:34:12.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:12.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:12 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:34:12.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:13.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.126+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f584410bd10 con 0x7f58280a2e00 2024-04-21T22:34:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.143+0000 7f583be00640 1 -- 172.21.15.18:0/3717592006 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f584410bd10 con 0x7f58280a2e00 2024-04-21T22:34:13.143 INFO:teuthology.orchestra.run.smithi018.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-21T00:00:00", "created": "2024-04-21T22:34:11", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-21T22:34:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 msgr2=0x7f58280a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 0x7f58280a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58340095f0 tx=0x7f5834005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 msgr2=0x7f584419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f582c00eb30 tx=0x7f582c00c2d0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 shutdown_connections 2024-04-21T22:34:13.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f58280a2e00 0x7f58280a52c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5844109780 0x7f584419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5844104130 0x7f584419a550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 --2- 172.21.15.18:0/3717592006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5844103770 0x7f584419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 >> 172.21.15.18:0/3717592006 conn(0x7f58440ff240 msgr2=0x7f58440ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 shutdown_connections 2024-04-21T22:34:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.146+0000 7f5848a00640 1 -- 172.21.15.18:0/3717592006 wait complete. 2024-04-21T22:34:13.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 -- 172.21.15.18:0/3101321509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb0073af0 msgr2=0x7f7eb0073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3101321509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb0073af0 0x7f7eb0073ed0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009ca0 tx=0x7f7ea002c190 comp rx=0 tx=0).stop 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 -- 172.21.15.18:0/3101321509 shutdown_connections 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3101321509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb010dff0 0x7f7eb01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3101321509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 0x7f7eb010dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3101321509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb0073af0 0x7f7eb0073ed0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 -- 172.21.15.18:0/3101321509 >> 172.21.15.18:0/3101321509 conn(0x7f7eb00fd200 msgr2=0x7f7eb00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 -- 172.21.15.18:0/3101321509 shutdown_connections 2024-04-21T22:34:13.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.370+0000 7f7eb5200640 1 -- 172.21.15.18:0/3101321509 wait complete. 2024-04-21T22:34:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.371+0000 7f7eb5200640 1 Processor -- start 2024-04-21T22:34:13.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.371+0000 7f7eb5200640 1 -- start start 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 0x7f7eb019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb010dff0 0x7f7eb019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0113d10 con 0x7f7eb010dff0 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0113b90 con 0x7f7eb0074410 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eb5200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0113e90 con 0x7f7eb0073af0 2024-04-21T22:34:13.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:52214/0 (socket says 172.21.15.18:52214) 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 -- 172.21.15.18:0/3279467381 learned_addr learned my addr 172.21.15.18:0/3279467381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7ead400640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 0x7f7eb019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb010dff0 0x7f7eb019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 -- 172.21.15.18:0/3279467381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 msgr2=0x7f7eb019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 0x7f7eb019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 -- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb010dff0 msgr2=0x7f7eb019eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb010dff0 0x7f7eb019eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.372+0000 7f7eade00640 1 -- 172.21.15.18:0/3279467381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb019f1f0 con 0x7f7eb0073af0 2024-04-21T22:34:13.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7eade00640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0005e30 tx=0x7f7ea0035d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0039040 con 0x7f7eb0073af0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ea0044070 con 0x7f7eb0073af0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb019f480 con 0x7f7eb0073af0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00328d0 con 0x7f7eb0073af0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.373+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb01a6d70 con 0x7f7eb0073af0 2024-04-21T22:34:13.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.374+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb004fd50 con 0x7f7eb0073af0 2024-04-21T22:34:13.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.376+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f7ea0032a70 con 0x7f7eb0073af0 2024-04-21T22:34:13.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.378+0000 7f7ea6a00640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 0x7f7e940a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:13.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.378+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7ea00f1ae0 con 0x7f7eb0073af0 2024-04-21T22:34:13.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.378+0000 7f7ead400640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 0x7f7e940a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:13.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.379+0000 7f7ead400640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 0x7f7e940a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ff900 tx=0x7f7e98005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:13.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.382+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f7ea00be560 con 0x7f7eb0073af0 2024-04-21T22:34:13.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.610+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7eb0061b80 con 0x7f7e940a2e10 2024-04-21T22:34:13.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.624+0000 7f7ea6a00640 1 -- 172.21.15.18:0/3279467381 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7eb0061b80 con 0x7f7e940a2e10 2024-04-21T22:34:13.624 INFO:teuthology.orchestra.run.smithi018.stdout:/ 1m 6m3h 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 msgr2=0x7f7e940a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 0x7f7e940a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ff900 tx=0x7f7e98005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 msgr2=0x7f7eb019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0005e30 tx=0x7f7ea0035d90 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 shutdown_connections 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7e940a2e10 0x7f7e940a52d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7eb010dff0 0x7f7eb019eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7eb0074410 0x7f7eb019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 --2- 172.21.15.18:0/3279467381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0073af0 0x7f7eb019a250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 >> 172.21.15.18:0/3279467381 conn(0x7f7eb00fd200 msgr2=0x7f7eb00feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 shutdown_connections 2024-04-21T22:34:13.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:13.627+0000 7f7eb5200640 1 -- 172.21.15.18:0/3279467381 wait complete. 2024-04-21T22:34:13.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-21T22:34:13.737 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-21T22:34:13.748 INFO:teuthology.run_tasks:Running task workunit... 2024-04-21T22:34:13.793 INFO:tasks.workunit:Pulling workunits from ref 430e09df97c8fc7dc2b2ae424f68ed11366c540f 2024-04-21T22:34:13.793 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-21T22:34:13.793 INFO:tasks.workunit:timeout=3h 2024-04-21T22:34:13.793 INFO:tasks.workunit:cleanup=True 2024-04-21T22:34:13.794 DEBUG:teuthology.orchestra.run.smithi018:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-21T22:34:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:13 smithi018 ceph-mon[26614]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:13 smithi018 ceph-mon[26614]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 798 B/s wr, 20 op/s 2024-04-21T22:34:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:13 smithi018 ceph-mon[26614]: from='client.25523 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:13 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-21 22:31:37.066265857 +0000 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-21 22:31:37.066265857 +0000 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-21 22:34:00.707531457 +0000 2024-04-21T22:34:13.855 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-21 22:31:37.066265857 +0000 2024-04-21T22:34:13.856 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-21T22:34:13.856 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-21T22:34:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:13 smithi081 ceph-mon[31692]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:13 smithi081 ceph-mon[31692]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 798 B/s wr, 20 op/s 2024-04-21T22:34:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:13 smithi081 ceph-mon[31692]: from='client.25523 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:13 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:34:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:13 smithi047 ceph-mon[31561]: from='client.25501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:13 smithi047 ceph-mon[31561]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 798 B/s wr, 20 op/s 2024-04-21T22:34:13.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:13 smithi047 ceph-mon[31561]: from='client.25523 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:13.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:13 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:34:13.960 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 430e09df97c8fc7dc2b2ae424f68ed11366c540f 2024-04-21T22:34:14.022 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-21T22:34:14.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:14 smithi018 ceph-mon[26614]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:14 smithi081 ceph-mon[31692]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:14.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:14 smithi047 ceph-mon[31561]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:15 smithi018 ceph-mon[26614]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:15.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:15 smithi018 ceph-mon[26614]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 53 op/s 2024-04-21T22:34:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:15 smithi081 ceph-mon[31692]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:15 smithi081 ceph-mon[31692]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 53 op/s 2024-04-21T22:34:15.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:15 smithi047 ceph-mon[31561]: from='client.25555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:34:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:15 smithi047 ceph-mon[31561]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 53 op/s 2024-04-21T22:34:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:17 smithi018 ceph-mon[26614]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:17 smithi081 ceph-mon[31692]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:17 smithi047 ceph-mon[31561]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:18.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:18 smithi018 ceph-mon[26614]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:18.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:18 smithi081 ceph-mon[31692]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:18.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:18 smithi047 ceph-mon[31561]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-04-21T22:34:21.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:21 smithi081 ceph-mon[31692]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-04-21T22:34:21.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:21 smithi047 ceph-mon[31561]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-04-21T22:34:21.549 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:21 smithi018 ceph-mon[26614]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-04-21T22:34:23.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:23 smithi081 ceph-mon[31692]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-21T22:34:23.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:23 smithi047 ceph-mon[31561]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-21T22:34:23.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:23 smithi018 ceph-mon[26614]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-21T22:34:25.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:25 smithi081 ceph-mon[31692]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-21T22:34:25.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:25 smithi047 ceph-mon[31561]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-21T22:34:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:25 smithi018 ceph-mon[26614]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-21T22:34:27.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:27 smithi081 ceph-mon[31692]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:27.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:27 smithi047 ceph-mon[31561]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:27.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:27 smithi018 ceph-mon[26614]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:29.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:29 smithi081 ceph-mon[31692]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:29.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:29 smithi047 ceph-mon[31561]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:29.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:29 smithi018 ceph-mon[26614]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-04-21T22:34:31.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:31 smithi081 ceph-mon[31692]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 767 B/s wr, 15 op/s 2024-04-21T22:34:31.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:31 smithi047 ceph-mon[31561]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 767 B/s wr, 15 op/s 2024-04-21T22:34:31.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:31 smithi018 ceph-mon[26614]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 767 B/s wr, 15 op/s 2024-04-21T22:34:33.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:33 smithi081 ceph-mon[31692]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:33.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:33 smithi047 ceph-mon[31561]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:33.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:33 smithi018 ceph-mon[26614]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:35.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:35 smithi047 ceph-mon[31561]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:35.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:35 smithi018 ceph-mon[26614]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:35 smithi081 ceph-mon[31692]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:37.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:37 smithi047 ceph-mon[31561]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:37 smithi018 ceph-mon[26614]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:37 smithi081 ceph-mon[31692]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:39.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:39 smithi047 ceph-mon[31561]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-21T22:34:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:39 smithi018 ceph-mon[26614]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-21T22:34:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:39 smithi081 ceph-mon[31692]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-04-21T22:34:41.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:41 smithi047 ceph-mon[31561]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:41 smithi018 ceph-mon[26614]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:41 smithi081 ceph-mon[31692]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:42.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:34:42.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:34:42.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 -- 172.21.15.18:0/4293389369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4109730 msgr2=0x7fb4a4109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 --2- 172.21.15.18:0/4293389369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4109730 0x7fb4a4109b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb498009860 tx=0x7fb49802bb70 comp rx=0 tx=0).stop 2024-04-21T22:34:42.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 -- 172.21.15.18:0/4293389369 shutdown_connections 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 --2- 172.21.15.18:0/4293389369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a41105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 --2- 172.21.15.18:0/4293389369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4103720 0x7fb4a4103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 --2- 172.21.15.18:0/4293389369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4109730 0x7fb4a4109b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 -- 172.21.15.18:0/4293389369 >> 172.21.15.18:0/4293389369 conn(0x7fb4a40ff210 msgr2=0x7fb4a4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 -- 172.21.15.18:0/4293389369 shutdown_connections 2024-04-21T22:34:42.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.250+0000 7fb4aa400640 1 -- 172.21.15.18:0/4293389369 wait complete. 2024-04-21T22:34:42.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.251+0000 7fb4aa400640 1 Processor -- start 2024-04-21T22:34:42.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.251+0000 7fb4aa400640 1 -- start start 2024-04-21T22:34:42.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4103720 0x7fb4a419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 0x7fb4a419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4113b40 con 0x7fb4a41040e0 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41139c0 con 0x7fb4a4103720 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4aa400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4113cc0 con 0x7fb4a4109730 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4a9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 0x7fb4a419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44140/0 (socket says 172.21.15.18:44140) 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4a3e00640 1 -- 172.21.15.18:0/2588060191 learned_addr learned my addr 172.21.15.18:0/2588060191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.252+0000 7fb4a9000640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4103720 0x7fb4a419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 -- 172.21.15.18:0/2588060191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4103720 msgr2=0x7fb4a419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4103720 0x7fb4a419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 -- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 msgr2=0x7fb4a419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 -- 172.21.15.18:0/2588060191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a419f020 con 0x7fb4a4109730 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a9a00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 0x7fb4a419e8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00ef00 tx=0x7fb49c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a1600640 1 -- 172.21.15.18:0/2588060191 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c004b20 con 0x7fb4a4109730 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a419f310 con 0x7fb4a4109730 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a1600640 1 -- 172.21.15.18:0/2588060191 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb49c003e50 con 0x7fb4a4109730 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4a1600640 1 -- 172.21.15.18:0/2588060191 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00b570 con 0x7fb4a4109730 2024-04-21T22:34:42.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.253+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a41a6ba0 con 0x7fb4a4109730 2024-04-21T22:34:42.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.257+0000 7fb4a1600640 1 -- 172.21.15.18:0/2588060191 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fb49c01d020 con 0x7fb4a4109730 2024-04-21T22:34:42.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.257+0000 7fb4ae7a6740 1 Processor -- start 2024-04-21T22:34:42.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.257+0000 7fb4ae7a6740 1 -- start start 2024-04-21T22:34:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbe9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbf2fb0 0x56237fbf53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56237fb4d410 con 0x56237fbea3d0 2024-04-21T22:34:42.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56237faf57e0 con 0x56237fbf2fb0 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56237fb493d0 con 0x56237fbe9ab0 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbe9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44150/0 (socket says 172.21.15.18:44150) 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbe9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45624/0 (socket says 172.21.15.18:45624) 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a9000640 1 -- 172.21.15.18:0/187500586 learned_addr learned my addr 172.21.15.18:0/187500586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.258+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbf2fb0 0x56237fbf53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 -- 172.21.15.18:0/187500586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 msgr2=0x56237fbe9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbe9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 -- 172.21.15.18:0/187500586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbf2fb0 msgr2=0x56237fbf53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbf2fb0 0x56237fbf53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a1600640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 0x7fb48c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 -- 172.21.15.18:0/187500586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237f92b7d0 con 0x56237fbea3d0 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a1600640 1 -- 172.21.15.18:0/2588060191 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb49c0cf520 con 0x7fb4a4109730 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9a00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 0x7fb48c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb4a9000640 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb498009780 tx=0x7fb498009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d38dcf50baf42e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.259+0000 7fb496000640 1 -- 172.21.15.18:0/187500586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498043020 con 0x56237fbea3d0 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.260+0000 7fb496000640 1 -- 172.21.15.18:0/187500586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb498034ce0 con 0x56237fbea3d0 2024-04-21T22:34:42.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.260+0000 7fb496000640 1 -- 172.21.15.18:0/187500586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498039040 con 0x56237fbea3d0 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.260+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/187500586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 msgr2=0x56237fbf2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.260+0000 7fb4a9a00640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 0x7fb48c0a52e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0ccaf0 tx=0x7fb49c00cf70 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.260+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb498009780 tx=0x7fb498009510 comp rx=0 tx=0).stop 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/187500586 shutdown_connections 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbf2fb0 0x56237fbf53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbf2a70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/187500586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbe9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/187500586 >> 172.21.15.18:0/187500586 conn(0x56237fbe41e0 msgr2=0x56237fbe45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/187500586 shutdown_connections 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/187500586 wait complete. 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 -- start start 2024-04-21T22:34:42.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.261+0000 7fb4ae7a6740 1 Processor -- start 2024-04-21T22:34:42.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbefed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbf0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56237fbf5d90 con 0x56237fbf2fb0 2024-04-21T22:34:42.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56237fb08c40 con 0x56237fbea3d0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56237fbf5f10 con 0x56237fbe9ab0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.262+0000 7fb4ae7a6740 10 client.0 _ll_register_callbacks cb 0x56237fb08630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbefed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbf0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44158/0 (socket says 172.21.15.18:44158) 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a3e00640 1 -- 172.21.15.18:0/4023135278 learned_addr learned my addr 172.21.15.18:0/4023135278 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 -- 172.21.15.18:0/4023135278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 msgr2=0x56237fbefed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbefed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 -- 172.21.15.18:0/4023135278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 msgr2=0x56237fbf0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a9000640 1 -- 172.21.15.18:0/4023135278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237f8613f0 con 0x56237fbea3d0 2024-04-21T22:34:42.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.263+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb4a9000640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbf0410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb49802c0b0 tx=0x7fb498034880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e84254fb14b7c8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb48aa00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498043030 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb498034ce0 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb498004250 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb49805a050 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb4ae7a6740 10 client.25547 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.264+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56237f8210f0 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb498034ce0 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb4980328a0 con 0x56237fbea3d0 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 10 client.25547 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 10 client.25547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 20 client.25547 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:42.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc030f0 0x56237fc054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 4 client.25547 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:42.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56237fb60c40 con 0x56237fc030f0 2024-04-21T22:34:42.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.265+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc030f0 0x56237fc054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.266+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc030f0 0x56237fc054e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9d49a31e25fea71 server_cookie=e9c051ac7b66a345 in_seq=0 out_seq=0 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.266+0000 7fb48aa00640 10 client.25547 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb48aa00640 1 -- 172.21.15.18:0/4023135278 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56237fb60c40 con 0x56237fc030f0 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb48aa00640 10 client.25547 handle_command_reply: tid=0 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 client.25547 shutdown 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 msgr2=0x56237fbf0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbf0410 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb49802c0b0 tx=0x7fb498034880 comp rx=0 tx=0).stop 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 shutdown_connections 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fbf0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbf0410 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc030f0 0x56237fc054e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4023135278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbefed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb48aa00640 0 client.25547 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 >> 172.21.15.18:0/4023135278 conn(0x56237fbe41e0 msgr2=0x56237fbe3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 shutdown_connections 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4023135278 wait complete. 2024-04-21T22:34:42.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.267+0000 7fb4ae7a6740 20 client.25547 trim_cache size 0 max 16384 2024-04-21T22:34:42.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.287+0000 7fb4ae7a6740 1 Processor -- start 2024-04-21T22:34:42.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.287+0000 7fb4ae7a6740 1 -- start start 2024-04-21T22:34:42.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbf2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbfeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41af440 con 0x56237fbf2fb0 2024-04-21T22:34:42.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41b0f80 con 0x56237fbea3d0 2024-04-21T22:34:42.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41afb10 con 0x56237fbe9ab0 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbf2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbfeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44174/0 (socket says 172.21.15.18:44174) 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 -- 172.21.15.18:0/4080499630 learned_addr learned my addr 172.21.15.18:0/4080499630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 -- 172.21.15.18:0/4080499630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 msgr2=0x56237fbf2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbf2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 -- 172.21.15.18:0/4080499630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 msgr2=0x56237fbfeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbfeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a3e00640 1 -- 172.21.15.18:0/4080499630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237fbe9480 con 0x56237fbf2fb0 2024-04-21T22:34:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.288+0000 7fb4a9000640 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbfeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.289+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb490013010 tx=0x7fb490005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbe2f46372cd71e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.289+0000 7fb495600640 1 -- 172.21.15.18:0/4080499630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490026030 con 0x56237fbf2fb0 2024-04-21T22:34:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.289+0000 7fb495600640 1 -- 172.21.15.18:0/4080499630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4900055f0 con 0x56237fbf2fb0 2024-04-21T22:34:42.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.289+0000 7fb495600640 1 -- 172.21.15.18:0/4080499630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490010830 con 0x56237fbf2fb0 2024-04-21T22:34:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4080499630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 msgr2=0x56237fc0ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb490013010 tx=0x7fb490005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4080499630 shutdown_connections 2024-04-21T22:34:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbf2fb0 0x56237fc0ab70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbea3d0 0x56237fbfeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/4080499630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbe9ab0 0x56237fbf2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4080499630 >> 172.21.15.18:0/4080499630 conn(0x56237fbe41e0 msgr2=0x56237fbe3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4080499630 shutdown_connections 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/4080499630 wait complete. 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.290+0000 7fb4ae7a6740 1 -- start start 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 Processor -- start 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbe9ab0 0x56237fbfb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbf2fb0 0x56237fbecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41b08b0 con 0x56237fbea3d0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41b01e0 con 0x56237fbe9ab0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a41ad420 con 0x56237fbf2fb0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.291+0000 7fb4ae7a6740 10 client.0 _ll_register_callbacks cb 0x7fb490005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44176/0 (socket says 172.21.15.18:44176) 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 -- 172.21.15.18:0/1157948655 learned_addr learned my addr 172.21.15.18:0/1157948655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbe9ab0 0x56237fbfb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbf2fb0 0x56237fbecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 -- 172.21.15.18:0/1157948655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbf2fb0 msgr2=0x56237fbecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbf2fb0 0x56237fbecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 -- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbe9ab0 msgr2=0x56237fbfb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbe9ab0 0x56237fbfb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 -- 172.21.15.18:0/1157948655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237fbed4d0 con 0x56237fbea3d0 2024-04-21T22:34:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb4a9000640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb498032cc0 tx=0x7fb49802c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28ddf979670e2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.292+0000 7fb48aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498043040 con 0x56237fbea3d0 2024-04-21T22:34:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb498032640 con 0x56237fbea3d0 2024-04-21T22:34:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4900055f0 con 0x56237fbea3d0 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb498039040 con 0x56237fbea3d0 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb4ae7a6740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56237fc69340 con 0x56237fbea3d0 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.293+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4900055f0 con 0x56237fbea3d0 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb498032880 con 0x56237fbea3d0 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:42.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 20 client.15441 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc69a10 0x56237fc6be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 4 client.15441 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56237fb5a950 con 0x56237fc69a10 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc69a10 0x56237fc6be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.294+0000 7fb4a3e00640 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc69a10 0x56237fc6be30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f026a52231afea4c server_cookie=f1c681bcf7c901c5 in_seq=0 out_seq=0 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb48aa00640 10 client.15441 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb48aa00640 1 -- 172.21.15.18:0/1157948655 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56237fb5a950 con 0x56237fc69a10 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb48aa00640 10 client.15441 handle_command_reply: tid=0 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 client.15441 shutdown 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 msgr2=0x56237fbec850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb498032cc0 tx=0x7fb49802c350 comp rx=0 tx=0).stop 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 shutdown_connections 2024-04-21T22:34:42.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56237fc69a10 0x56237fc6be30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237fbf2fb0 0x56237fbecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56237fbea3d0 0x56237fbec850 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb48aa00640 0 client.15441 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 --2- 172.21.15.18:0/1157948655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56237fbe9ab0 0x56237fbfb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 >> 172.21.15.18:0/1157948655 conn(0x56237fbe41e0 msgr2=0x56237fbee670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 shutdown_connections 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 1 -- 172.21.15.18:0/1157948655 wait complete. 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.295+0000 7fb4ae7a6740 20 client.15441 trim_cache size 0 max 16384 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:34:42.299 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 msgr2=0x7fb48c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 0x7fb48c0a52e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0ccaf0 tx=0x7fb49c00cf70 comp rx=0 tx=0).stop 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 msgr2=0x7fb4a419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 0x7fb4a419e8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00ef00 tx=0x7fb49c00c740 comp rx=0 tx=0).stop 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 shutdown_connections 2024-04-21T22:34:42.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb48c0a2e20 0x7fb48c0a52e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4a4109730 0x7fb4a419e8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a41040e0 0x7fb4a419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 --2- 172.21.15.18:0/2588060191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4a4103720 0x7fb4a419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 >> 172.21.15.18:0/2588060191 conn(0x7fb4a40ff210 msgr2=0x7fb4a40ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 shutdown_connections 2024-04-21T22:34:42.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.296+0000 7fb4aa400640 1 -- 172.21.15.18:0/2588060191 wait complete. 2024-04-21T22:34:42.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:34:42.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:34:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 -- 172.21.15.18:0/326945077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 msgr2=0x7f5f98107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/326945077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f98107a80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009cd0 tx=0x7f5f8802c0f0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 -- 172.21.15.18:0/326945077 shutdown_connections 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/326945077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 0x7f5f9810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/326945077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f98101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/326945077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f98107a80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.548+0000 7f5f9dc00640 1 -- 172.21.15.18:0/326945077 >> 172.21.15.18:0/326945077 conn(0x7f5f980fd130 msgr2=0x7f5f980ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.549+0000 7f5f9dc00640 1 -- 172.21.15.18:0/326945077 shutdown_connections 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.549+0000 7f5f9dc00640 1 -- 172.21.15.18:0/326945077 wait complete. 2024-04-21T22:34:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 Processor -- start 2024-04-21T22:34:42.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 -- start start 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 0x7f5f9819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f9819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98111a20 con 0x7f5f981076a0 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.550+0000 7f5f9dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981118a0 con 0x7f5f98101fc0 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f9dc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98111ba0 con 0x7f5f98101600 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45680/0 (socket says 172.21.15.18:45680) 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 -- 172.21.15.18:0/1988637967 learned_addr learned my addr 172.21.15.18:0/1988637967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f9d200640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f9819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97400640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 0x7f5f9819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 -- 172.21.15.18:0/1988637967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 msgr2=0x7f5f9819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 0x7f5f9819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 -- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 msgr2=0x7f5f9819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f9819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.551+0000 7f5f97e00640 1 -- 172.21.15.18:0/1988637967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9819f170 con 0x7f5f98101600 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f97e00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000f80 tx=0x7f5f88032ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88041020 con 0x7f5f98101600 2024-04-21T22:34:42.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f88034cd0 con 0x7f5f98101600 2024-04-21T22:34:42.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88039040 con 0x7f5f98101600 2024-04-21T22:34:42.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9819f400 con 0x7f5f98101600 2024-04-21T22:34:42.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.552+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f981a6cf0 con 0x7f5f98101600 2024-04-21T22:34:42.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.553+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9804f570 con 0x7f5f98101600 2024-04-21T22:34:42.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.555+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f5f88044020 con 0x7f5f98101600 2024-04-21T22:34:42.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.557+0000 7f5f94c00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 0x7f5f7c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:42.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.557+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5f880f1120 con 0x7f5f98101600 2024-04-21T22:34:42.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.557+0000 7f5f97400640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 0x7f5f7c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:42.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.558+0000 7f5f97400640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 0x7f5f7c0a5350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f9810e280 tx=0x7f5f80005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:42.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.559+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5f8804b020 con 0x7f5f98101600 2024-04-21T22:34:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.813+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f981a6ec0 con 0x7f5f98101600 2024-04-21T22:34:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.814+0000 7f5f94c00640 1 -- 172.21.15.18:0/1988637967 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7f5f880bdba0 con 0x7f5f98101600 2024-04-21T22:34:42.814 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:34:42.815 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:34:01.767520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:34:42.815 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 msgr2=0x7f5f7c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 0x7f5f7c0a5350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f9810e280 tx=0x7f5f80005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 msgr2=0x7f5f9819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000f80 tx=0x7f5f88032ea0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 shutdown_connections 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5f7c0a2e90 0x7f5f7c0a5350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f981076a0 0x7f5f9819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f98101fc0 0x7f5f9819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 --2- 172.21.15.18:0/1988637967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f98101600 0x7f5f9819a180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 >> 172.21.15.18:0/1988637967 conn(0x7f5f980fd130 msgr2=0x7f5f9810d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 shutdown_connections 2024-04-21T22:34:42.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:42.818+0000 7f5f9dc00640 1 -- 172.21.15.18:0/1988637967 wait complete. 2024-04-21T22:34:42.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 -- 172.21.15.18:0/2082071092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101ef0 msgr2=0x7faa3410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 --2- 172.21.15.18:0/2082071092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101ef0 0x7faa3410e3b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009ca0 tx=0x7faa2c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 -- 172.21.15.18:0/2082071092 shutdown_connections 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 --2- 172.21.15.18:0/2082071092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101ef0 0x7faa3410e3b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 --2- 172.21.15.18:0/2082071092 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa34101530 0x7faa341019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 --2- 172.21.15.18:0/2082071092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa341075f0 0x7faa341079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 -- 172.21.15.18:0/2082071092 >> 172.21.15.18:0/2082071092 conn(0x7faa340fd020 msgr2=0x7faa340ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 -- 172.21.15.18:0/2082071092 shutdown_connections 2024-04-21T22:34:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.061+0000 7faa39800640 1 -- 172.21.15.18:0/2082071092 wait complete. 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.062+0000 7faa39800640 1 Processor -- start 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.062+0000 7faa39800640 1 -- start start 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.062+0000 7faa39800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 0x7faa34199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa39800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa39800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa341075f0 0x7faa3419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa39800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa341118b0 con 0x7faa34101530 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa39800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa34111730 con 0x7faa341075f0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa39800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa34111a30 con 0x7faa34101ef0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 0x7faa34199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45690/0 (socket says 172.21.15.18:45690) 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 -- 172.21.15.18:0/369685753 learned_addr learned my addr 172.21.15.18:0/369685753 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa38e00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa341075f0 0x7faa3419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 -- 172.21.15.18:0/369685753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa341075f0 msgr2=0x7faa3419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa341075f0 0x7faa3419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 -- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 msgr2=0x7faa34199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 0x7faa34199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa2be00640 1 -- 172.21.15.18:0/369685753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3419efa0 con 0x7faa34101ef0 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.063+0000 7faa33e00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 0x7faa34199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa2be00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e9f0 tx=0x7faa1c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa31600640 1 -- 172.21.15.18:0/369685753 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00cd80 con 0x7faa34101ef0 2024-04-21T22:34:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa31600640 1 -- 172.21.15.18:0/369685753 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1c010910 con 0x7faa34101ef0 2024-04-21T22:34:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa31600640 1 -- 172.21.15.18:0/369685753 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c018990 con 0x7faa34101ef0 2024-04-21T22:34:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3419f290 con 0x7faa34101ef0 2024-04-21T22:34:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.064+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa341a6b20 con 0x7faa34101ef0 2024-04-21T22:34:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.069+0000 7faa31600640 1 -- 172.21.15.18:0/369685753 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7faa1c010ac0 con 0x7faa34101ef0 2024-04-21T22:34:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.069+0000 7faa3db75740 1 Processor -- start 2024-04-21T22:34:43.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.069+0000 7faa3db75740 1 -- start start 2024-04-21T22:34:43.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f36470 0x561947f38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561947e913a0 con 0x561947f2d890 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561947e39930 con 0x561947f36470 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa3db75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561947e8d360 con 0x561947f2cf70 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa38e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa38e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45704/0 (socket says 172.21.15.18:45704) 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa38e00640 1 -- 172.21.15.18:0/2938327852 learned_addr learned my addr 172.21.15.18:0/2938327852 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44212/0 (socket says 172.21.15.18:44212) 2024-04-21T22:34:43.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa2be00640 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f36470 0x561947f38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.070+0000 7faa31600640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 0x7faa180a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 -- 172.21.15.18:0/2938327852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f36470 msgr2=0x561947f38860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f36470 0x561947f38860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 -- 172.21.15.18:0/2938327852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 msgr2=0x561947f35f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 -- 172.21.15.18:0/2938327852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561947ba53f0 con 0x561947f2cf70 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa33e00640 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa31600640 1 -- 172.21.15.18:0/369685753 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7faa1c0cfa50 con 0x7faa34101ef0 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 0x7faa180a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.071+0000 7faa38e00640 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa2c02c700 tx=0x7faa2c005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c23da50db16e9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.072+0000 7faa29600640 1 -- 172.21.15.18:0/2938327852 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c045030 con 0x561947f2cf70 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.072+0000 7faa29600640 1 -- 172.21.15.18:0/2938327852 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa2c003e50 con 0x561947f2cf70 2024-04-21T22:34:43.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.072+0000 7faa29600640 1 -- 172.21.15.18:0/2938327852 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c039040 con 0x561947f2cf70 2024-04-21T22:34:43.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 -- 172.21.15.18:0/2938327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 msgr2=0x561947f2d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa2c02c700 tx=0x7faa2c005f80 comp rx=0 tx=0).stop 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa38e00640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 0x7faa180a52e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa2c004af0 tx=0x7faa2c04c000 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 -- 172.21.15.18:0/2938327852 shutdown_connections 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f36470 0x561947f38860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2d890 0x561947f35f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 --2- 172.21.15.18:0/2938327852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2cf70 0x561947f2d350 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 -- 172.21.15.18:0/2938327852 >> 172.21.15.18:0/2938327852 conn(0x561947f276a0 msgr2=0x561947f27a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 -- 172.21.15.18:0/2938327852 shutdown_connections 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.073+0000 7faa3db75740 1 -- 172.21.15.18:0/2938327852 wait complete. 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 -- start start 2024-04-21T22:34:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 Processor -- start 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f34020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561947f39260 con 0x561947f2cf70 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561947e4cd80 con 0x561947f2d890 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.074+0000 7faa3db75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561947f393e0 con 0x561947f36470 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa3db75740 10 client.0 _ll_register_callbacks cb 0x561947e892b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44220/0 (socket says 172.21.15.18:44220) 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 -- 172.21.15.18:0/1699664542 learned_addr learned my addr 172.21.15.18:0/1699664542 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa2be00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa38e00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f34020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 -- 172.21.15.18:0/1699664542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 msgr2=0x561947f34020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f34020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 -- 172.21.15.18:0/1699664542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 msgr2=0x561947f33ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.075+0000 7faa33e00640 1 -- 172.21.15.18:0/1699664542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561947c6f7d0 con 0x561947f2cf70 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa33e00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa24012a10 tx=0x7faa24012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942e34f9fa79a1ce server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa22000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2400fa40 con 0x561947f2cf70 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7faa2400fbe0 con 0x561947f2cf70 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa2c003e50 con 0x561947f2cf70 2024-04-21T22:34:43.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa2400fde0 con 0x561947f2cf70 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa3db75740 10 client.15459 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561947f45670 con 0x561947f2cf70 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.076+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa2c003e50 con 0x561947f2cf70 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faa2401c420 con 0x561947f2cf70 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 10 client.15459 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 20 client.15459 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947f46b80 0x561947f49010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 4 client.15459 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561947e9e8e0 con 0x561947f46b80 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.077+0000 7faa2be00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947f46b80 0x561947f49010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.078+0000 7faa2be00640 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947f46b80 0x561947f49010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9842386866042f6e server_cookie=567408755ddff1be in_seq=0 out_seq=0 2024-04-21T22:34:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.078+0000 7faa22000640 10 client.15459 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:34:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.078+0000 7faa22000640 1 -- 172.21.15.18:0/1699664542 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561947e9e8e0 con 0x561947f46b80 2024-04-21T22:34:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.078+0000 7faa22000640 10 client.15459 handle_command_reply: tid=0 2024-04-21T22:34:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.078+0000 7faa3db75740 1 client.15459 shutdown 2024-04-21T22:34:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 msgr2=0x561947f335a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa24012a10 tx=0x7faa24012ed0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 shutdown_connections 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947f46b80 0x561947f49010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f34020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa22000640 0 client.15459 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 --2- 172.21.15.18:0/1699664542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f335a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 >> 172.21.15.18:0/1699664542 conn(0x561947f276a0 msgr2=0x561947f293f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 shutdown_connections 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 1 -- 172.21.15.18:0/1699664542 wait complete. 2024-04-21T22:34:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.079+0000 7faa3db75740 20 client.15459 trim_cache size 0 max 16384 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.094+0000 7faa3db75740 1 Processor -- start 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.094+0000 7faa3db75740 1 -- start start 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f42120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f26510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa341af560 con 0x561947f2cf70 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa341b10a0 con 0x561947f2d890 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa3db75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa341afc30 con 0x561947f36470 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa2be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa2be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42886/0 (socket says 172.21.15.18:42886) 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa2be00640 1 -- 172.21.15.18:0/3438796003 learned_addr learned my addr 172.21.15.18:0/3438796003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.095+0000 7faa38e00640 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f26510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 -- 172.21.15.18:0/3438796003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 msgr2=0x561947f26510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f26510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 -- 172.21.15.18:0/3438796003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 msgr2=0x561947f42120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f42120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 -- 172.21.15.18:0/3438796003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561947f2d6c0 con 0x561947f2d890 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa33e00640 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f42120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa2be00640 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c6a0 tx=0x7faa1c0d34e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da8b768c8a1da8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa28c00640 1 -- 172.21.15.18:0/3438796003 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0a4930 con 0x561947f2d890 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa28c00640 1 -- 172.21.15.18:0/3438796003 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1c09bd70 con 0x561947f2d890 2024-04-21T22:34:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.096+0000 7faa28c00640 1 -- 172.21.15.18:0/3438796003 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c018b30 con 0x561947f2d890 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- 172.21.15.18:0/3438796003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 msgr2=0x561947f33e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c6a0 tx=0x7faa1c0d34e0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- 172.21.15.18:0/3438796003 shutdown_connections 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f36470 0x561947f26510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2d890 0x561947f33e40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 --2- 172.21.15.18:0/3438796003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f2cf70 0x561947f42120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- 172.21.15.18:0/3438796003 >> 172.21.15.18:0/3438796003 conn(0x561947f276a0 msgr2=0x561947f25e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- 172.21.15.18:0/3438796003 shutdown_connections 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- 172.21.15.18:0/3438796003 wait complete. 2024-04-21T22:34:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.097+0000 7faa3db75740 1 -- start start 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 Processor -- start 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2cf70 0x561947f3e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2d890 0x561947f39bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa341b09d0 con 0x561947f36470 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa341b0300 con 0x561947f2cf70 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa341ad540 con 0x561947f2d890 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa3db75740 10 client.0 _ll_register_callbacks cb 0x7faa24009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.098+0000 7faa38e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44226/0 (socket says 172.21.15.18:44226) 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 -- 172.21.15.18:0/1166065337 learned_addr learned my addr 172.21.15.18:0/1166065337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa2be00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2d890 0x561947f39bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa33e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2cf70 0x561947f3e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 -- 172.21.15.18:0/1166065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2d890 msgr2=0x561947f39bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2d890 0x561947f39bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 -- 172.21.15.18:0/1166065337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2cf70 msgr2=0x561947f3e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2cf70 0x561947f3e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 -- 172.21.15.18:0/1166065337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561947f3a6d0 con 0x561947f36470 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa38e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009a60 tx=0x7faa2c032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cbcd67cf07a719 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.099+0000 7faa22000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c039070 con 0x561947f36470 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7faa2c046040 con 0x561947f36470 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa1c09bd70 con 0x561947f36470 2024-04-21T22:34:43.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa2c04f070 con 0x561947f36470 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa3db75740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561947facf40 con 0x561947f36470 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1c09bd70 con 0x561947f36470 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.100+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faa2c057850 con 0x561947f36470 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 10 client.15465 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 20 client.15465 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947fad320 0x561947faf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 4 client.15465 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561947f2f1a0 con 0x561947fad320 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa33e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947fad320 0x561947faf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa33e00640 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947fad320 0x561947faf710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e1b7addc3d38be5 server_cookie=1ccb0c4739fa825b in_seq=0 out_seq=0 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.101+0000 7faa22000640 10 client.15465 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa22000640 1 -- 172.21.15.18:0/1166065337 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561947f2f1a0 con 0x561947fad320 2024-04-21T22:34:43.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa22000640 10 client.15465 handle_command_reply: tid=0 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 client.15465 shutdown 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 msgr2=0x561947f3a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009a60 tx=0x7faa2c032cb0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 shutdown_connections 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561947fad320 0x561947faf710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561947f36470 0x561947f3a110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561947f2d890 0x561947f39bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 --2- 172.21.15.18:0/1166065337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561947f2cf70 0x561947f3e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa22000640 0 client.15465 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 >> 172.21.15.18:0/1166065337 conn(0x561947f276a0 msgr2=0x561947f26690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 shutdown_connections 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 1 -- 172.21.15.18:0/1166065337 wait complete. 2024-04-21T22:34:43.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.102+0000 7faa3db75740 20 client.15465 trim_cache size 0 max 16384 2024-04-21T22:34:43.106 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:34:43.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 msgr2=0x7faa180a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 0x7faa180a52e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa2c004af0 tx=0x7faa2c04c000 comp rx=0 tx=0).stop 2024-04-21T22:34:43.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 msgr2=0x7faa3419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e9f0 tx=0x7faa1c00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 shutdown_connections 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faa180a2e20 0x7faa180a52e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa341075f0 0x7faa3419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa34101ef0 0x7faa3419a4f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 --2- 172.21.15.18:0/369685753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa34101530 0x7faa34199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 >> 172.21.15.18:0/369685753 conn(0x7faa340fd020 msgr2=0x7faa340fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 shutdown_connections 2024-04-21T22:34:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.103+0000 7faa39800640 1 -- 172.21.15.18:0/369685753 wait complete. 2024-04-21T22:34:43.121 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.316+0000 7fc31b200640 1 -- 172.21.15.18:0/217610040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc314073af0 msgr2=0x7fc314073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.316+0000 7fc31b200640 1 --2- 172.21.15.18:0/217610040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc314073af0 0x7fc314073ed0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc308009860 tx=0x7fc30802bc00 comp rx=0 tx=0).stop 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 -- 172.21.15.18:0/217610040 shutdown_connections 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 --2- 172.21.15.18:0/217610040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31410de00 0x7fc3141101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 --2- 172.21.15.18:0/217610040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314074410 0x7fc31410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 --2- 172.21.15.18:0/217610040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc314073af0 0x7fc314073ed0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 -- 172.21.15.18:0/217610040 >> 172.21.15.18:0/217610040 conn(0x7fc3140fd090 msgr2=0x7fc3140ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 -- 172.21.15.18:0/217610040 shutdown_connections 2024-04-21T22:34:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.317+0000 7fc31b200640 1 -- 172.21.15.18:0/217610040 wait complete. 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 Processor -- start 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 -- start start 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314073af0 0x7fc31419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31410de00 0x7fc31419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc314113ae0 con 0x7fc314073af0 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc314113960 con 0x7fc31410de00 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.318+0000 7fc31b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc314113c60 con 0x7fc314074410 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314073af0 0x7fc31419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45750/0 (socket says 172.21.15.18:45750) 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 -- 172.21.15.18:0/3542230008 learned_addr learned my addr 172.21.15.18:0/3542230008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc31a800640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31410de00 0x7fc31419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 -- 172.21.15.18:0/3542230008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31410de00 msgr2=0x7fc31419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31410de00 0x7fc31419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 -- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314073af0 msgr2=0x7fc31419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314073af0 0x7fc31419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.319+0000 7fc319400640 1 -- 172.21.15.18:0/3542230008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31419f0c0 con 0x7fc314074410 2024-04-21T22:34:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc319400640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e9c0 tx=0x7fc30400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc30ea00640 1 -- 172.21.15.18:0/3542230008 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30400cd80 con 0x7fc314074410 2024-04-21T22:34:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31419f3b0 con 0x7fc314074410 2024-04-21T22:34:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc30ea00640 1 -- 172.21.15.18:0/3542230008 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3040035f0 con 0x7fc314074410 2024-04-21T22:34:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc30ea00640 1 -- 172.21.15.18:0/3542230008 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304010670 con 0x7fc314074410 2024-04-21T22:34:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.320+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3141a6c40 con 0x7fc314074410 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.324+0000 7fc31f575740 1 Processor -- start 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 -- start start 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc30ea00640 1 -- 172.21.15.18:0/3542230008 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fc3040037a0 con 0x7fc314074410 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf39bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf39c470 0x555adf39e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555adf2f73a0 con 0x555adf392f70 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555adf29f930 con 0x555adf39c470 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31f575740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555adf2f3360 con 0x555adf393890 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44244/0 (socket says 172.21.15.18:44244) 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.325+0000 7fc31a800640 1 -- 172.21.15.18:0/3146949340 learned_addr learned my addr 172.21.15.18:0/3146949340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc319e00640 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf39bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc319400640 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf39c470 0x555adf39e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 -- 172.21.15.18:0/3146949340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 msgr2=0x555adf39bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf39bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 -- 172.21.15.18:0/3146949340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf39c470 msgr2=0x555adf39e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf39c470 0x555adf39e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 -- 172.21.15.18:0/3146949340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf00b3f0 con 0x555adf392f70 2024-04-21T22:34:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc31a800640 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc310009f60 tx=0x7fc310009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9503d7320a7afc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.326+0000 7fc30ea00640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 0x7fc2fc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.327+0000 7fc303000640 1 -- 172.21.15.18:0/3146949340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31001e070 con 0x555adf392f70 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.327+0000 7fc30ea00640 1 -- 172.21.15.18:0/3542230008 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc3040cf930 con 0x7fc314074410 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.327+0000 7fc303000640 1 -- 172.21.15.18:0/3146949340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310003c30 con 0x555adf392f70 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.327+0000 7fc303000640 1 -- 172.21.15.18:0/3146949340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31000f980 con 0x555adf392f70 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.327+0000 7fc319e00640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 0x7fc2fc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- 172.21.15.18:0/3146949340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 msgr2=0x555adf393350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc310009f60 tx=0x7fc310009f90 comp rx=0 tx=0).stop 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc319e00640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 0x7fc2fc0a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc30802c210 tx=0x7fc3080058d0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- 172.21.15.18:0/3146949340 shutdown_connections 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf39c470 0x555adf39e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf39bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 --2- 172.21.15.18:0/3146949340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf392f70 0x555adf393350 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- 172.21.15.18:0/3146949340 >> 172.21.15.18:0/3146949340 conn(0x555adf38d6a0 msgr2=0x555adf38da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- 172.21.15.18:0/3146949340 shutdown_connections 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- 172.21.15.18:0/3146949340 wait complete. 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.328+0000 7fc31f575740 1 -- start start 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 Processor -- start 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf399560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf399aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf399fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555adf39f260 con 0x555adf39c470 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555adf2b2d80 con 0x555adf392f70 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555adf39f3e0 con 0x555adf393890 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.329+0000 7fc31f575740 10 client.0 _ll_register_callbacks cb 0x555adf2ef2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf399560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc31a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf399fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf399aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf399560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42936/0 (socket says 172.21.15.18:42936) 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319e00640 1 -- 172.21.15.18:0/3908800063 learned_addr learned my addr 172.21.15.18:0/3908800063 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 -- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 msgr2=0x555adf399560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf399560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 -- 172.21.15.18:0/3908800063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 msgr2=0x555adf399fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf399fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 -- 172.21.15.18:0/3908800063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adf0d57d0 con 0x555adf393890 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc319400640 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf399aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3040ccf00 tx=0x7fc304009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fa5178140c1890d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc2f7400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.330+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30409b740 con 0x555adf393890 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc3040a45e0 con 0x555adf393890 2024-04-21T22:34:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc310003c30 con 0x555adf393890 2024-04-21T22:34:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc30409b560 con 0x555adf393890 2024-04-21T22:34:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc31f575740 10 client.25609 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555adf3ab5c0 con 0x555adf393890 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310003c30 con 0x555adf393890 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.331+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc3040cd300 con 0x555adf393890 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 10 client.25609 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 10 client.25609 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 20 client.25609 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf3acad0 0x555adf3aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 4 client.25609 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555adf3048e0 con 0x555adf3acad0 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.332+0000 7fc319e00640 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf3acad0 0x555adf3aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.333+0000 7fc319e00640 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf3acad0 0x555adf3aeec0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=617e2d373f9de325 server_cookie=8275c43d797883a4 in_seq=0 out_seq=0 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.333+0000 7fc2f7400640 10 client.25609 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.333+0000 7fc2f7400640 1 -- 172.21.15.18:0/3908800063 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555adf3048e0 con 0x555adf3acad0 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.333+0000 7fc2f7400640 10 client.25609 handle_command_reply: tid=0 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 client.25609 shutdown 2024-04-21T22:34:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 msgr2=0x555adf399aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf399aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3040ccf00 tx=0x7fc304009620 comp rx=0 tx=0).stop 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 shutdown_connections 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf3acad0 0x555adf3aeec0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf399fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf399aa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 --2- 172.21.15.18:0/3908800063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf399560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 >> 172.21.15.18:0/3908800063 conn(0x555adf38d6a0 msgr2=0x555adf38f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc2f7400640 0 client.25609 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 shutdown_connections 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 1 -- 172.21.15.18:0/3908800063 wait complete. 2024-04-21T22:34:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.334+0000 7fc31f575740 20 client.25609 trim_cache size 0 max 16384 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 Processor -- start 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 -- start start 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf3a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf38f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141af5d0 con 0x555adf39c470 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141b1110 con 0x555adf392f70 2024-04-21T22:34:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.351+0000 7fc31f575740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141afca0 con 0x555adf393890 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf38f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42946/0 (socket says 172.21.15.18:42946) 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319e00640 1 -- 172.21.15.18:0/4100396735 learned_addr learned my addr 172.21.15.18:0/4100396735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319400640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf3a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 -- 172.21.15.18:0/4100396735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 msgr2=0x555adf3a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf3a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 -- 172.21.15.18:0/4100396735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 msgr2=0x555adf39bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc31a800640 1 -- 172.21.15.18:0/4100396735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555adf3af230 con 0x555adf39c470 2024-04-21T22:34:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319e00640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.352+0000 7fc319400640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf3a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.353+0000 7fc31a800640 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf38f1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3100049d0 tx=0x7fc31000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff09e13ac72023cc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.353+0000 7fc302600640 1 -- 172.21.15.18:0/4100396735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31001e040 con 0x555adf39c470 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.353+0000 7fc302600640 1 -- 172.21.15.18:0/4100396735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310003e50 con 0x555adf39c470 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.353+0000 7fc302600640 1 -- 172.21.15.18:0/4100396735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31000f820 con 0x555adf39c470 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- 172.21.15.18:0/4100396735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 msgr2=0x555adf38f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf38f1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3100049d0 tx=0x7fc31000f520 comp rx=0 tx=0).stop 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- 172.21.15.18:0/4100396735 shutdown_connections 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf38f1e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf393890 0x555adf3a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 --2- 172.21.15.18:0/4100396735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf392f70 0x555adf39bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- 172.21.15.18:0/4100396735 >> 172.21.15.18:0/4100396735 conn(0x555adf38d6a0 msgr2=0x555adf38ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- 172.21.15.18:0/4100396735 shutdown_connections 2024-04-21T22:34:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- 172.21.15.18:0/4100396735 wait complete. 2024-04-21T22:34:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.354+0000 7fc31f575740 1 -- start start 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 Processor -- start 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf392f70 0x555adf3a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 0x555adf3a0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf411fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141b0a40 con 0x555adf39c470 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141b0370 con 0x555adf393890 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141ad590 con 0x555adf392f70 2024-04-21T22:34:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31f575740 10 client.0 _ll_register_callbacks cb 0x7fc3040046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc319400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 0x555adf3a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc31a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf411fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc319400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 0x555adf3a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42958/0 (socket says 172.21.15.18:42958) 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.355+0000 7fc319400640 1 -- 172.21.15.18:0/2580259176 learned_addr learned my addr 172.21.15.18:0/2580259176 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc319e00640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf392f70 0x555adf3a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 -- 172.21.15.18:0/2580259176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf392f70 msgr2=0x555adf3a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf392f70 0x555adf3a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 -- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 msgr2=0x555adf3a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 0x555adf3a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 -- 172.21.15.18:0/2580259176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555adf412520 con 0x555adf39c470 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc31a800640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf411fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555adf3a86f0 tx=0x7fc310011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e3b906e584d9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.356+0000 7fc2f7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31001e030 con 0x555adf39c470 2024-04-21T22:34:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc310004000 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc310003e50 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc310009bf0 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555adf4136c0 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc310003e50 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc31002b070 con 0x555adf39c470 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 10 client.15483 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.357+0000 7fc31f575740 20 client.15483 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf413ae0 0x555adf415ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc31f575740 4 client.15483 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:34:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555adf395160 con 0x555adf413ae0 2024-04-21T22:34:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc319e00640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf413ae0 0x555adf415ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc319e00640 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf413ae0 0x555adf415ed0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ef21e47177b5e4bc server_cookie=c2b98ece3dba09c6 in_seq=0 out_seq=0 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.358+0000 7fc2f7400640 10 client.15483 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc2f7400640 1 -- 172.21.15.18:0/2580259176 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555adf395160 con 0x555adf413ae0 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc2f7400640 10 client.15483 handle_command_reply: tid=0 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 client.15483 shutdown 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 msgr2=0x555adf411fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf411fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555adf3a86f0 tx=0x7fc310011d60 comp rx=0 tx=0).stop 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 shutdown_connections 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555adf413ae0 0x555adf415ed0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555adf39c470 0x555adf411fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555adf393890 0x555adf3a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 --2- 172.21.15.18:0/2580259176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555adf392f70 0x555adf3a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc2f7400640 0 client.15483 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:34:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 >> 172.21.15.18:0/2580259176 conn(0x555adf38d6a0 msgr2=0x555adf38c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 shutdown_connections 2024-04-21T22:34:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 1 -- 172.21.15.18:0/2580259176 wait complete. 2024-04-21T22:34:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.359+0000 7fc31f575740 20 client.15483 trim_cache size 0 max 16384 2024-04-21T22:34:43.362 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 msgr2=0x7fc2fc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 0x7fc2fc0a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc30802c210 tx=0x7fc3080058d0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 msgr2=0x7fc31419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e9c0 tx=0x7fc30400edc0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 shutdown_connections 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc2fc0a2e20 0x7fc2fc0a52e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31410de00 0x7fc31419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc314074410 0x7fc31419a660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 --2- 172.21.15.18:0/3542230008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc314073af0 0x7fc31419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 >> 172.21.15.18:0/3542230008 conn(0x7fc3140fd090 msgr2=0x7fc3140fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 shutdown_connections 2024-04-21T22:34:43.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.360+0000 7fc31b200640 1 -- 172.21.15.18:0/3542230008 wait complete. 2024-04-21T22:34:43.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:43 smithi018 ceph-mon[26614]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:43.377 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:43 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1988637967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:43.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:34:43.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:43 smithi047 ceph-mon[31561]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:43.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:43 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1988637967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:43.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 -- 172.21.15.18:0/1494988017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c1029b0 msgr2=0x7f051c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 --2- 172.21.15.18:0/1494988017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c1029b0 0x7f051c102d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f050c009900 tx=0x7f050c02bcd0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 -- 172.21.15.18:0/1494988017 shutdown_connections 2024-04-21T22:34:43.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 --2- 172.21.15.18:0/1494988017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c10bcf0 0x7f051c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 --2- 172.21.15.18:0/1494988017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1032d0 0x7f051c10b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 --2- 172.21.15.18:0/1494988017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c1029b0 0x7f051c102d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 -- 172.21.15.18:0/1494988017 >> 172.21.15.18:0/1494988017 conn(0x7f051c0777f0 msgr2=0x7f051c077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 -- 172.21.15.18:0/1494988017 shutdown_connections 2024-04-21T22:34:43.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.590+0000 7f0521a00640 1 -- 172.21.15.18:0/1494988017 wait complete. 2024-04-21T22:34:43.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.591+0000 7f0521a00640 1 Processor -- start 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 -- start start 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c1032d0 0x7f051c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 0x7f051c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f051c111b40 con 0x7f051c1029b0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1119c0 con 0x7f051c1032d0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0521a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f051c111cc0 con 0x7f051c10bcf0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f051aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f051aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44288/0 (socket says 172.21.15.18:44288) 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f051aa00640 1 -- 172.21.15.18:0/993320525 learned_addr learned my addr 172.21.15.18:0/993320525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.592+0000 7f0513e00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c1032d0 0x7f051c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051b400640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 0x7f051c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 -- 172.21.15.18:0/993320525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 msgr2=0x7f051c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 0x7f051c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 -- 172.21.15.18:0/993320525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c1032d0 msgr2=0x7f051c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c1032d0 0x7f051c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 -- 172.21.15.18:0/993320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c19f1e0 con 0x7f051c1029b0 2024-04-21T22:34:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051b400640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 0x7f051c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.593+0000 7f051aa00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f050c000c00 tx=0x7f050c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.594+0000 7f0513400640 1 -- 172.21.15.18:0/993320525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c042020 con 0x7f051c1029b0 2024-04-21T22:34:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.594+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c19f470 con 0x7f051c1029b0 2024-04-21T22:34:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.594+0000 7f0513400640 1 -- 172.21.15.18:0/993320525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050c0054e0 con 0x7f051c1029b0 2024-04-21T22:34:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.594+0000 7f0513400640 1 -- 172.21.15.18:0/993320525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c003b50 con 0x7f051c1029b0 2024-04-21T22:34:43.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.594+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c1a6d60 con 0x7f051c1029b0 2024-04-21T22:34:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.597+0000 7f05247df740 1 Processor -- start 2024-04-21T22:34:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.597+0000 7f05247df740 1 -- start start 2024-04-21T22:34:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f0513400640 1 -- 172.21.15.18:0/993320525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f050c045020 con 0x7f051c1029b0 2024-04-21T22:34:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e580a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5812d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5815670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5613e576e3a0 con 0x5613e580a6a0 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5613e5716930 con 0x5613e5809d80 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f05247df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5613e576a360 con 0x5613e5813280 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f051aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5812d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f051b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e580a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f051b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e580a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42990/0 (socket says 172.21.15.18:42990) 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f051b400640 1 -- 172.21.15.18:0/2133352265 learned_addr learned my addr 172.21.15.18:0/2133352265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.598+0000 7f0513e00640 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5815670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 -- 172.21.15.18:0/2133352265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 msgr2=0x5613e580a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e580a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 -- 172.21.15.18:0/2133352265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 msgr2=0x5613e5812d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5812d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 -- 172.21.15.18:0/2133352265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613e54823f0 con 0x5613e5813280 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f051aa00640 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5812d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513e00640 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5815670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0504009bf0 tx=0x7f0504011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e16d01a5f2f394 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f050be00640 1 -- 172.21.15.18:0/2133352265 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504009da0 con 0x5613e5813280 2024-04-21T22:34:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f0513400640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 0x7f05000a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f050be00640 1 -- 172.21.15.18:0/2133352265 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504005020 con 0x5613e5813280 2024-04-21T22:34:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.599+0000 7f050be00640 1 -- 172.21.15.18:0/2133352265 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504004bc0 con 0x5613e5813280 2024-04-21T22:34:43.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f0513400640 1 -- 172.21.15.18:0/993320525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f050c0f10c0 con 0x7f051c1029b0 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f051b400640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 0x7f05000a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 -- 172.21.15.18:0/2133352265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 msgr2=0x5613e5815670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5815670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0504009bf0 tx=0x7f0504011810 comp rx=0 tx=0).stop 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 -- 172.21.15.18:0/2133352265 shutdown_connections 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5815670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5812d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 --2- 172.21.15.18:0/2133352265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e580a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.600+0000 7f05247df740 1 -- 172.21.15.18:0/2133352265 >> 172.21.15.18:0/2133352265 conn(0x5613e58044b0 msgr2=0x5613e5804890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.601+0000 7f05247df740 1 -- 172.21.15.18:0/2133352265 shutdown_connections 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.601+0000 7f051b400640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 0x7f05000a5360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05140129e0 tx=0x7f0514009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.601+0000 7f05247df740 1 -- 172.21.15.18:0/2133352265 wait complete. 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.601+0000 7f05247df740 1 -- start start 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.601+0000 7f05247df740 1 Processor -- start 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e58107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5613e5816070 con 0x5613e5813280 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5613e5729d80 con 0x5613e580a6a0 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5613e58161f0 con 0x5613e5809d80 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f05247df740 10 client.0 _ll_register_callbacks cb 0x5613e57662b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f051aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f051b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f051aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45830/0 (socket says 172.21.15.18:45830) 2024-04-21T22:34:43.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f051aa00640 1 -- 172.21.15.18:0/2709247451 learned_addr learned my addr 172.21.15.18:0/2709247451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.602+0000 7f0513e00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e58107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 -- 172.21.15.18:0/2709247451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 msgr2=0x5613e58107c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e58107c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 -- 172.21.15.18:0/2709247451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 msgr2=0x5613e5810d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 -- 172.21.15.18:0/2709247451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613e554c7d0 con 0x5613e5809d80 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f0513e00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e58107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051b400640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f051aa00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f050c005ab0 tx=0x7f050c005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70822ae921d2178 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f0508c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0bd310 con 0x5613e5809d80 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f050c0b9bb0 con 0x5613e5809d80 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.603+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0504005020 con 0x5613e5809d80 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f050c0bcea0 con 0x5613e5809d80 2024-04-21T22:34:43.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 10 client.25627 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613e5816070 con 0x5613e5809d80 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504005020 con 0x5613e5809d80 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f050c0c5d20 con 0x5613e5809d80 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 10 client.25627 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 10 client.25627 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 20 client.25627 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5823630 0x5613e5825ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 4 client.25627 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.604+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613e577b8e0 con 0x5613e5823630 2024-04-21T22:34:43.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.605+0000 7f0513e00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5823630 0x5613e5825ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.605+0000 7f0508c00640 10 client.25627 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:34:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.605+0000 7f0513e00640 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5823630 0x5613e5825ab0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a985e8230681be32 server_cookie=cc808d55657efd79 in_seq=0 out_seq=0 2024-04-21T22:34:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f0508c00640 1 -- 172.21.15.18:0/2709247451 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5613e577b8e0 con 0x5613e5823630 2024-04-21T22:34:43.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f0508c00640 10 client.25627 handle_command_reply: tid=0 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 client.25627 shutdown 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 msgr2=0x5613e5810280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f050c005ab0 tx=0x7f050c005d50 comp rx=0 tx=0).stop 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 shutdown_connections 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5823630 0x5613e5825ab0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e58107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 --2- 172.21.15.18:0/2709247451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e5810280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f0508c00640 0 client.25627 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.606+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 >> 172.21.15.18:0/2709247451 conn(0x5613e58044b0 msgr2=0x5613e5806200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.607+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 shutdown_connections 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.607+0000 7f05247df740 1 -- 172.21.15.18:0/2709247451 wait complete. 2024-04-21T22:34:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.607+0000 7f05247df740 20 client.25627 trim_cache size 0 max 16384 2024-04-21T22:34:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.623+0000 7f05247df740 1 Processor -- start 2024-04-21T22:34:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 -- start start 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e581ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e580f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1af6f0 con 0x5613e5813280 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1b1230 con 0x5613e580a6a0 2024-04-21T22:34:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f05247df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1afdc0 con 0x5613e5809d80 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f051b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f051aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e581ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f051b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44316/0 (socket says 172.21.15.18:44316) 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f051b400640 1 -- 172.21.15.18:0/3356246948 learned_addr learned my addr 172.21.15.18:0/3356246948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.624+0000 7f0513e00640 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e580f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 -- 172.21.15.18:0/3356246948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 msgr2=0x5613e580f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e580f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 -- 172.21.15.18:0/3356246948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 msgr2=0x5613e5810b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 -- 172.21.15.18:0/3356246948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613e57ffb90 con 0x5613e5809d80 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f051aa00640 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e581ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f050c0b9f10 tx=0x7f050c004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e0241bcb44cd332 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f050b400640 1 -- 172.21.15.18:0/3356246948 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c0bd080 con 0x5613e5809d80 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f050b400640 1 -- 172.21.15.18:0/3356246948 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050c0dd040 con 0x5613e5809d80 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.625+0000 7f050b400640 1 -- 172.21.15.18:0/3356246948 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c005690 con 0x5613e5809d80 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 -- 172.21.15.18:0/3356246948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 msgr2=0x5613e581ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e581ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f050c0b9f10 tx=0x7f050c004610 comp rx=0 tx=0).stop 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 -- 172.21.15.18:0/3356246948 shutdown_connections 2024-04-21T22:34:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e5813280 0x5613e5810b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e580a6a0 0x5613e580f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 --2- 172.21.15.18:0/3356246948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5809d80 0x5613e581ef60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.626+0000 7f05247df740 1 -- 172.21.15.18:0/3356246948 >> 172.21.15.18:0/3356246948 conn(0x5613e58044b0 msgr2=0x5613e5802e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.627+0000 7f05247df740 1 -- 172.21.15.18:0/3356246948 shutdown_connections 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.627+0000 7f05247df740 1 -- 172.21.15.18:0/3356246948 wait complete. 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.627+0000 7f05247df740 1 -- start start 2024-04-21T22:34:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.627+0000 7f05247df740 1 Processor -- start 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5887be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1b0b60 con 0x5613e580a6a0 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1b0490 con 0x5613e5809d80 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1ad6d0 con 0x5613e5813280 2024-04-21T22:34:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f05247df740 10 client.0 _ll_register_callbacks cb 0x7f050c0b9120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.628+0000 7f0513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f051aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44318/0 (socket says 172.21.15.18:44318) 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 -- 172.21.15.18:0/2668937701 learned_addr learned my addr 172.21.15.18:0/2668937701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f051aa00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43010/0 (socket says 172.21.15.18:43010) 2024-04-21T22:34:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f051b400640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5887be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 -- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 msgr2=0x5613e5887be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5887be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 -- 172.21.15.18:0/2668937701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 msgr2=0x5613e5816620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 -- 172.21.15.18:0/2668937701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613e5888120 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f051aa00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0513e00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0504014040 tx=0x7f0504009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b62f20b6c8e008 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.629+0000 7f0508c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050402f020 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f05040054e0 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f050c0dd040 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f050403a050 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f05247df740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613e5889350 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.630+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f050c0dd040 con 0x5613e580a6a0 2024-04-21T22:34:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0504003680 con 0x5613e580a6a0 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 10 client.15501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 20 client.15501 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5889960 0x5613e588bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 4 client.15501 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613e5775c30 con 0x5613e5889960 2024-04-21T22:34:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.631+0000 7f051aa00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5889960 0x5613e588bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f051aa00640 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5889960 0x5613e588bd80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=abb49bc80def1d21 server_cookie=4e27fdaa8e5ee98d in_seq=0 out_seq=0 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f0508c00640 10 client.15501 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f0508c00640 1 -- 172.21.15.18:0/2668937701 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613e5775c30 con 0x5613e5889960 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f0508c00640 10 client.15501 handle_command_reply: tid=0 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 client.15501 shutdown 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 msgr2=0x5613e5816b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0504014040 tx=0x7f0504009680 comp rx=0 tx=0).stop 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 shutdown_connections 2024-04-21T22:34:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5613e5889960 0x5613e588bd80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5613e5813280 0x5613e5887be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5613e580a6a0 0x5613e5816b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 --2- 172.21.15.18:0/2668937701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5613e5809d80 0x5613e5816620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f0508c00640 0 client.15501 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 >> 172.21.15.18:0/2668937701 conn(0x5613e58044b0 msgr2=0x5613e5803690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 shutdown_connections 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.632+0000 7f05247df740 1 -- 172.21.15.18:0/2668937701 wait complete. 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f05247df740 20 client.15501 trim_cache size 0 max 16384 2024-04-21T22:34:43.634 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 msgr2=0x7f05000a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 0x7f05000a5360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05140129e0 tx=0x7f0514009500 comp rx=0 tx=0).stop 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 msgr2=0x7f051c19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f050c000c00 tx=0x7f050c004360 comp rx=0 tx=0).stop 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 shutdown_connections 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05000a2ea0 0x7f05000a5360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f051c10bcf0 0x7f051c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f051c1032d0 0x7f051c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 --2- 172.21.15.18:0/993320525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f051c1029b0 0x7f051c19a240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.633+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 >> 172.21.15.18:0/993320525 conn(0x7f051c0777f0 msgr2=0x7f051c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.634+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 shutdown_connections 2024-04-21T22:34:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.634+0000 7f0521a00640 1 -- 172.21.15.18:0/993320525 wait complete. 2024-04-21T22:34:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:43 smithi081 ceph-mon[31692]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:43 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1988637967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:34:43.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:34:43.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.865+0000 7f6dc7400640 1 -- 172.21.15.18:0/2778885136 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0032990 con 0x7f6dc8100df0 2024-04-21T22:34:43.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 -- 172.21.15.18:0/2778885136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100df0 msgr2=0x7f6dc810d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 --2- 172.21.15.18:0/2778885136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100df0 0x7f6dc810d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009cd0 tx=0x7f6dc002c0f0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 -- 172.21.15.18:0/2778885136 shutdown_connections 2024-04-21T22:34:43.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 --2- 172.21.15.18:0/2778885136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100df0 0x7f6dc810d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 --2- 172.21.15.18:0/2778885136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc8100430 0x7f6dc81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 --2- 172.21.15.18:0/2778885136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc81064d0 0x7f6dc81068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.866+0000 7f6dce000640 1 -- 172.21.15.18:0/2778885136 >> 172.21.15.18:0/2778885136 conn(0x7f6dc80771f0 msgr2=0x7f6dc80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.867+0000 7f6dce000640 1 -- 172.21.15.18:0/2778885136 shutdown_connections 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.867+0000 7f6dce000640 1 -- 172.21.15.18:0/2778885136 wait complete. 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 Processor -- start 2024-04-21T22:34:43.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 -- start start 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 0x7f6dc819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 0x7f6dc819e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111910 con 0x7f6dc81064d0 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111790 con 0x7f6dc8100df0 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.868+0000 7f6dce000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8111a90 con 0x7f6dc8100430 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 0x7f6dc819e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 0x7f6dc819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 0x7f6dc819e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44344/0 (socket says 172.21.15.18:44344) 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dcd600640 1 -- 172.21.15.18:0/4191446172 learned_addr learned my addr 172.21.15.18:0/4191446172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45876/0 (socket says 172.21.15.18:45876) 2024-04-21T22:34:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4191446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 msgr2=0x7f6dc8199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 msgr2=0x7f6dc819e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 0x7f6dc819e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4191446172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc819efd0 con 0x7f6dc8100df0 2024-04-21T22:34:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.869+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 0x7f6dc819a520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6db400e9f0 tx=0x7f6db400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.870+0000 7f6dc5600640 1 -- 172.21.15.18:0/4191446172 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db400ccc0 con 0x7f6dc8100df0 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.870+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc819f2c0 con 0x7f6dc8100df0 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.870+0000 7f6dc5600640 1 -- 172.21.15.18:0/4191446172 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6db4010910 con 0x7f6dc8100df0 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.870+0000 7f6dc5600640 1 -- 172.21.15.18:0/4191446172 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4018960 con 0x7f6dc8100df0 2024-04-21T22:34:43.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.870+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81a6b50 con 0x7f6dc8100df0 2024-04-21T22:34:43.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.873+0000 7f6dd238e740 1 Processor -- start 2024-04-21T22:34:43.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.873+0000 7f6dc5600640 1 -- 172.21.15.18:0/4191446172 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f6db4010ac0 con 0x7f6dc8100df0 2024-04-21T22:34:43.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.873+0000 7f6dd238e740 1 -- start start 2024-04-21T22:34:43.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2fd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aebb2563a0 con 0x55aebb2f1f70 2024-04-21T22:34:43.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aebb1fe930 con 0x55aebb2fb470 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dd238e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aebb252360 con 0x55aebb2f2890 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44348/0 (socket says 172.21.15.18:44348) 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dcd600640 1 -- 172.21.15.18:0/3622812925 learned_addr learned my addr 172.21.15.18:0/3622812925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dccc00640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.874+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 -- 172.21.15.18:0/3622812925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 msgr2=0x55aebb2faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 -- 172.21.15.18:0/3622812925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 msgr2=0x55aebb2fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 -- 172.21.15.18:0/3622812925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebaf6a3f0 con 0x55aebb2f1f70 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dc5600640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 0x7f6db00a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dcd600640 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0032370 tx=0x7f6dc00323a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d5e83943ae0c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dc5600640 1 -- 172.21.15.18:0/4191446172 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6db40cfa70 con 0x7f6dc8100df0 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 0x7f6db00a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.875+0000 7f6db9c00640 1 -- 172.21.15.18:0/3622812925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0043070 con 0x55aebb2f1f70 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6db9c00640 1 -- 172.21.15.18:0/3622812925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc002cca0 con 0x55aebb2f1f70 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6db9c00640 1 -- 172.21.15.18:0/3622812925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0039040 con 0x55aebb2f1f70 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 -- 172.21.15.18:0/3622812925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 msgr2=0x55aebb2f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0032370 tx=0x7f6dc00323a0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 0x7f6db00a5360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55aebb2f1a40 tx=0x7f6dbc005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 -- 172.21.15.18:0/3622812925 shutdown_connections 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 --2- 172.21.15.18:0/3622812925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb2f2350 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.876+0000 7f6dd238e740 1 -- 172.21.15.18:0/3622812925 >> 172.21.15.18:0/3622812925 conn(0x55aebb2ec6a0 msgr2=0x55aebb2eca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.877+0000 7f6dd238e740 1 -- 172.21.15.18:0/3622812925 shutdown_connections 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.877+0000 7f6dd238e740 1 -- 172.21.15.18:0/3622812925 wait complete. 2024-04-21T22:34:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.877+0000 7f6dd238e740 1 -- start start 2024-04-21T22:34:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.877+0000 7f6dd238e740 1 Processor -- start 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 0x55aebb2f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aebb2fe200 con 0x55aebb2fb470 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aebb211d80 con 0x55aebb2f1f70 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aebb2fe380 con 0x55aebb2f2890 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dd238e740 10 client.0 _ll_register_callbacks cb 0x55aebb24e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43048/0 (socket says 172.21.15.18:43048) 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dccc00640 1 -- 172.21.15.18:0/290548539 learned_addr learned my addr 172.21.15.18:0/290548539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.878+0000 7f6dcd600640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 0x55aebb2f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 -- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 msgr2=0x55aebb2f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 -- 172.21.15.18:0/290548539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 msgr2=0x55aebb2f8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 0x55aebb2f8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 -- 172.21.15.18:0/290548539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebb0347d0 con 0x55aebb2f1f70 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dcd600640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 0x55aebb2f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dccc00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00fac0 tx=0x7f6dbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdbe66e747b5053d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dae000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02e060 con 0x55aebb2f1f70 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc002cca0 con 0x55aebb2f1f70 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.879+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6dbc018030 con 0x55aebb2f1f70 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6dbc01e5a0 con 0x55aebb2f1f70 2024-04-21T22:34:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dd238e740 10 client.25625 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aebb30a560 con 0x55aebb2f1f70 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc002cca0 con 0x55aebb2f1f70 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6dbc029970 con 0x55aebb2f1f70 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dd238e740 10 client.25625 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.880+0000 7f6dd238e740 10 client.25625 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dd238e740 20 client.25625 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb30ba20 0x55aebb30de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dd238e740 4 client.25625 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aebb2638e0 con 0x55aebb30ba20 2024-04-21T22:34:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb30ba20 0x55aebb30de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb30ba20 0x55aebb30de90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37ca9bc0ce458551 server_cookie=b479c9a3fd65fbb8 in_seq=0 out_seq=0 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.881+0000 7f6dae000640 10 client.25625 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.882+0000 7f6dae000640 1 -- 172.21.15.18:0/290548539 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aebb2638e0 con 0x55aebb30ba20 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.882+0000 7f6dae000640 10 client.25625 handle_command_reply: tid=0 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.882+0000 7f6dd238e740 1 client.25625 shutdown 2024-04-21T22:34:43.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.882+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 msgr2=0x55aebb2f8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.882+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00fac0 tx=0x7f6dbc0046c0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 shutdown_connections 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb30ba20 0x55aebb30de90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2fb470 0x55aebb2f8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 --2- 172.21.15.18:0/290548539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2f1f70 0x55aebb2f8490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 >> 172.21.15.18:0/290548539 conn(0x55aebb2ec6a0 msgr2=0x55aebb2ee3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dae000640 0 client.25625 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 shutdown_connections 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 1 -- 172.21.15.18:0/290548539 wait complete. 2024-04-21T22:34:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.883+0000 7f6dd238e740 20 client.25625 trim_cache size 0 max 16384 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 Processor -- start 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 -- start start 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f2890 0x55aebb2f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb313760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81af480 con 0x55aebb2f2890 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81b0fc0 con 0x55aebb2fb470 2024-04-21T22:34:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.898+0000 7f6dd238e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81afb50 con 0x55aebb2f1f70 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f2890 0x55aebb2f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dcd600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb313760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45896/0 (socket says 172.21.15.18:45896) 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 -- 172.21.15.18:0/2425581785 learned_addr learned my addr 172.21.15.18:0/2425581785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 -- 172.21.15.18:0/2425581785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 msgr2=0x55aebb313760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb313760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 -- 172.21.15.18:0/2425581785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f2890 msgr2=0x55aebb2f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f2890 0x55aebb2f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 -- 172.21.15.18:0/2425581785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebb2ebec0 con 0x55aebb2f1f70 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.899+0000 7f6dccc00640 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00ffd0 tx=0x7f6dbc005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b575c2b7b6b13883 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6db9200640 1 -- 172.21.15.18:0/2425581785 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01c4e0 con 0x55aebb2f1f70 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6db9200640 1 -- 172.21.15.18:0/2425581785 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dbc005520 con 0x55aebb2f1f70 2024-04-21T22:34:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6db9200640 1 -- 172.21.15.18:0/2425581785 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004730 con 0x55aebb2f1f70 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 -- 172.21.15.18:0/2425581785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 msgr2=0x55aebb3070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00ffd0 tx=0x7f6dbc005be0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 -- 172.21.15.18:0/2425581785 shutdown_connections 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb313760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f2890 0x55aebb2f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 --2- 172.21.15.18:0/2425581785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f1f70 0x55aebb3070f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.900+0000 7f6dd238e740 1 -- 172.21.15.18:0/2425581785 >> 172.21.15.18:0/2425581785 conn(0x55aebb2ec6a0 msgr2=0x55aebb2eb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.901+0000 7f6dd238e740 1 -- 172.21.15.18:0/2425581785 shutdown_connections 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.901+0000 7f6dd238e740 1 -- 172.21.15.18:0/2425581785 wait complete. 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.901+0000 7f6dd238e740 1 -- start start 2024-04-21T22:34:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.901+0000 7f6dd238e740 1 Processor -- start 2024-04-21T22:34:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb3039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81b08f0 con 0x55aebb2f1f70 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81b0220 con 0x55aebb2fb470 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc81ad460 con 0x55aebb2f2890 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dd238e740 10 client.0 _ll_register_callbacks cb 0x7f6dbc005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dccc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb3039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45912/0 (socket says 172.21.15.18:45912) 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4028875949 learned_addr learned my addr 172.21.15.18:0/4028875949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dcd600640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4028875949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 msgr2=0x55aebb2f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4028875949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 msgr2=0x55aebb3039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb3039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dc7e00640 1 -- 172.21.15.18:0/4028875949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebb2f5b90 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.902+0000 7f6dcd600640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dc7e00640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6db4098760 tx=0x7f6db400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ab81a45aed70a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dae000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db40cfe60 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6db40cd4c0 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dbc005520 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6db40a0090 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dd238e740 10 client.25651 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.903+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aebb372040 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dbc005520 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6db4018b00 con 0x55aebb2f2890 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 10 client.25651 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 10 client.25651 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 20 client.25651 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb3726f0 0x55aebb374b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 4 client.25651 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aebb25dc30 con 0x55aebb3726f0 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.904+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb3726f0 0x55aebb374b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dccc00640 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb3726f0 0x55aebb374b10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3f7b520074d252a server_cookie=fe2f2073173e52c1 in_seq=0 out_seq=0 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dae000640 10 client.25651 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dae000640 1 -- 172.21.15.18:0/4028875949 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aebb25dc30 con 0x55aebb3726f0 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dae000640 10 client.25651 handle_command_reply: tid=0 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dd238e740 1 client.25651 shutdown 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 msgr2=0x55aebb2f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.905+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6db4098760 tx=0x7f6db400cf60 comp rx=0 tx=0).stop 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 shutdown_connections 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55aebb3726f0 0x55aebb374b10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aebb2fb470 0x55aebb2f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aebb2f2890 0x55aebb2f4e70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 --2- 172.21.15.18:0/4028875949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aebb2f1f70 0x55aebb3039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dae000640 0 client.25651 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 >> 172.21.15.18:0/4028875949 conn(0x55aebb2ec6a0 msgr2=0x55aebb2eae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 shutdown_connections 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 1 -- 172.21.15.18:0/4028875949 wait complete. 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dd238e740 20 client.25651 trim_cache size 0 max 16384 2024-04-21T22:34:43.908 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:34:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 msgr2=0x7f6db00a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 0x7f6db00a5360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55aebb2f1a40 tx=0x7f6dbc005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 msgr2=0x7f6dc819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.906+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 0x7f6dc819a520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6db400e9f0 tx=0x7f6db400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 shutdown_connections 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6db00a2ea0 0x7f6db00a5360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dc81064d0 0x7f6dc819e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dc8100df0 0x7f6dc819a520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 --2- 172.21.15.18:0/4191446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dc8100430 0x7f6dc8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 >> 172.21.15.18:0/4191446172 conn(0x7f6dc80771f0 msgr2=0x7f6dc8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 shutdown_connections 2024-04-21T22:34:43.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:43.907+0000 7f6dce000640 1 -- 172.21.15.18:0/4191446172 wait complete. 2024-04-21T22:34:43.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 -- 172.21.15.18:0/684441556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74102720 msgr2=0x7fad74102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 --2- 172.21.15.18:0/684441556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74102720 0x7fad74102b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad64009900 tx=0x7fad6402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 -- 172.21.15.18:0/684441556 shutdown_connections 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 --2- 172.21.15.18:0/684441556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 0x7fad7410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 --2- 172.21.15.18:0/684441556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74103040 0x7fad7410b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 --2- 172.21.15.18:0/684441556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74102720 0x7fad74102b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 -- 172.21.15.18:0/684441556 >> 172.21.15.18:0/684441556 conn(0x7fad740771f0 msgr2=0x7fad740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 -- 172.21.15.18:0/684441556 shutdown_connections 2024-04-21T22:34:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.131+0000 7fad78c00640 1 -- 172.21.15.18:0/684441556 wait complete. 2024-04-21T22:34:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 Processor -- start 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 -- start start 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74103040 0x7fad741008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 0x7fad74100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad741118d0 con 0x7fad74102720 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad74111750 con 0x7fad7410bb40 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.132+0000 7fad78c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad74111a50 con 0x7fad74103040 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44386/0 (socket says 172.21.15.18:44386) 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 -- 172.21.15.18:0/4104738794 learned_addr learned my addr 172.21.15.18:0/4104738794 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad72a00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74103040 0x7fad741008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73e00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 0x7fad74100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 -- 172.21.15.18:0/4104738794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74103040 msgr2=0x7fad741008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74103040 0x7fad741008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 -- 172.21.15.18:0/4104738794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 msgr2=0x7fad74100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 0x7fad74100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.133+0000 7fad73400640 1 -- 172.21.15.18:0/4104738794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad741a62f0 con 0x7fad74102720 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad73400640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad64005940 tx=0x7fad6402cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad6be00640 1 -- 172.21.15.18:0/4104738794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64041070 con 0x7fad74102720 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741a6580 con 0x7fad74102720 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad6be00640 1 -- 172.21.15.18:0/4104738794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad64004450 con 0x7fad74102720 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad741a6a70 con 0x7fad74102720 2024-04-21T22:34:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.134+0000 7fad6be00640 1 -- 172.21.15.18:0/4104738794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6404b060 con 0x7fad74102720 2024-04-21T22:34:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.138+0000 7fad7cf69740 1 Processor -- start 2024-04-21T22:34:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.138+0000 7fad7cf69740 1 -- start start 2024-04-21T22:34:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131c00f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131c03860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557131b5c3a0 con 0x557131bf7f70 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557131b04930 con 0x557131c01470 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad7cf69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557131b58360 con 0x557131bf8890 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad6be00640 1 -- 172.21.15.18:0/4104738794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fad64044070 con 0x7fad74102720 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44400/0 (socket says 172.21.15.18:44400) 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad73e00640 1 -- 172.21.15.18:0/4105890535 learned_addr learned my addr 172.21.15.18:0/4105890535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.139+0000 7fad72a00640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131c03860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 -- 172.21.15.18:0/4105890535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 msgr2=0x557131c00f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73400640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131c00f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131c00f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 -- 172.21.15.18:0/4105890535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 msgr2=0x557131c03860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131c03860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 -- 172.21.15.18:0/4105890535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571318703f0 con 0x557131bf7f70 2024-04-21T22:34:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad72a00640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131c03860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73400640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131c00f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:34:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad73e00640 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009f70 tx=0x7fad6c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ff200b0928a23c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad5fe00640 1 -- 172.21.15.18:0/4105890535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c016070 con 0x557131bf7f70 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad5fe00640 1 -- 172.21.15.18:0/4105890535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c004d20 con 0x557131bf7f70 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.140+0000 7fad5fe00640 1 -- 172.21.15.18:0/4105890535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c012950 con 0x557131bf7f70 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.141+0000 7fad6be00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 0x7fad580a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.141+0000 7fad6be00640 1 -- 172.21.15.18:0/4104738794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad640f14d0 con 0x7fad74102720 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.141+0000 7fad73400640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 0x7fad580a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.141+0000 7fad7cf69740 1 -- 172.21.15.18:0/4105890535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 msgr2=0x557131bf8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.141+0000 7fad7cf69740 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009f70 tx=0x7fad6c010800 comp rx=0 tx=0).stop 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 -- 172.21.15.18:0/4105890535 shutdown_connections 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131c03860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131c00f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 --2- 172.21.15.18:0/4105890535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bf8350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 -- 172.21.15.18:0/4105890535 >> 172.21.15.18:0/4105890535 conn(0x557131bf26a0 msgr2=0x557131bf2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 -- 172.21.15.18:0/4105890535 shutdown_connections 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad73400640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 0x7fad580a5310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad640eec10 tx=0x7fad64000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 -- 172.21.15.18:0/4105890535 wait complete. 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 -- start start 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.142+0000 7fad7cf69740 1 Processor -- start 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131bfeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bfeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557131c04260 con 0x557131bf7f70 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557131b17d80 con 0x557131c01470 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557131c043e0 con 0x557131bf8890 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad7cf69740 10 client.0 _ll_register_callbacks cb 0x557131b542b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44406/0 (socket says 172.21.15.18:44406) 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad73e00640 1 -- 172.21.15.18:0/707373351 learned_addr learned my addr 172.21.15.18:0/707373351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad72a00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131bfeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.143+0000 7fad73e00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bfeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 -- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 msgr2=0x557131bfeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bfeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 -- 172.21.15.18:0/707373351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 msgr2=0x557131bfe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 -- 172.21.15.18:0/707373351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713193a7d0 con 0x557131bf8890 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad73e00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad72a00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131bfeab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad74101db0 tx=0x7fad60012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5438caa9685439e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60004220 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad6c004d20 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.144+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad600043c0 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad60005020 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 10 client.25660 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557131c10600 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad6c004d20 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fad60010710 con 0x557131bf8890 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 10 client.25660 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 10 client.25660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 20 client.25660 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c11a10 0x557131c13e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 4 client.25660 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.145+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557131b698e0 con 0x557131c11a10 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.146+0000 7fad73e00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c11a10 0x557131c13e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.146+0000 7fad73e00640 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c11a10 0x557131c13e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15e39f3fce86640 server_cookie=792bfd78896db2de in_seq=0 out_seq=0 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.146+0000 7fad5cc00640 10 client.25660 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad5cc00640 1 -- 172.21.15.18:0/707373351 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557131b698e0 con 0x557131c11a10 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad5cc00640 10 client.25660 handle_command_reply: tid=0 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 client.25660 shutdown 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 msgr2=0x557131bfeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131bfeab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad74101db0 tx=0x7fad60012820 comp rx=0 tx=0).stop 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 shutdown_connections 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bfeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c11a10 0x557131c13e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf8890 0x557131bfeab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 --2- 172.21.15.18:0/707373351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf7f70 0x557131bfe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad5cc00640 0 client.25660 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 >> 172.21.15.18:0/707373351 conn(0x557131bf26a0 msgr2=0x557131bf43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.147+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 shutdown_connections 2024-04-21T22:34:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.148+0000 7fad7cf69740 1 -- 172.21.15.18:0/707373351 wait complete. 2024-04-21T22:34:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.148+0000 7fad7cf69740 20 client.25660 trim_cache size 0 max 16384 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.163+0000 7fad7cf69740 1 Processor -- start 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.163+0000 7fad7cf69740 1 -- start start 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131bfedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bf1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad741af500 con 0x557131bf8890 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad741b1040 con 0x557131c01470 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad7cf69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad741afbd0 con 0x557131bf7f70 2024-04-21T22:34:44.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad73e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad72a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131bfedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad73e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:45966/0 (socket says 172.21.15.18:45966) 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad73e00640 1 -- 172.21.15.18:0/2231085203 learned_addr learned my addr 172.21.15.18:0/2231085203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad73e00640 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bf1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad72a00640 1 -- 172.21.15.18:0/2231085203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 msgr2=0x557131c0d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad72a00640 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad72a00640 1 -- 172.21.15.18:0/2231085203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 msgr2=0x557131bf1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.164+0000 7fad72a00640 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bf1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.165+0000 7fad72a00640 1 -- 172.21.15.18:0/2231085203 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557131bfa140 con 0x557131bf8890 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.165+0000 7fad73e00640 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.165+0000 7fad72a00640 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131bfedc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fad60010d70 tx=0x7fad60005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe1b331edf3c413 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.168+0000 7fad5f400640 1 -- 172.21.15.18:0/2231085203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60028040 con 0x557131bf8890 2024-04-21T22:34:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.168+0000 7fad5f400640 1 -- 172.21.15.18:0/2231085203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad60005850 con 0x557131bf8890 2024-04-21T22:34:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.168+0000 7fad5f400640 1 -- 172.21.15.18:0/2231085203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60004cd0 con 0x557131bf8890 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 -- 172.21.15.18:0/2231085203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 msgr2=0x557131bfedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131bfedc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fad60010d70 tx=0x7fad60005c10 comp rx=0 tx=0).stop 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 -- 172.21.15.18:0/2231085203 shutdown_connections 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131c01470 0x557131bf1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131bfedc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 --2- 172.21.15.18:0/2231085203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131bf7f70 0x557131c0d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 -- 172.21.15.18:0/2231085203 >> 172.21.15.18:0/2231085203 conn(0x557131bf26a0 msgr2=0x557131bf0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 -- 172.21.15.18:0/2231085203 shutdown_connections 2024-04-21T22:34:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.169+0000 7fad7cf69740 1 -- 172.21.15.18:0/2231085203 wait complete. 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 -- start start 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 Processor -- start 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131bf7f70 0x557131c052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 0x557131c05d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad741b0970 con 0x557131bf8890 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad741b02a0 con 0x557131bf7f70 2024-04-21T22:34:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad741ad4e0 con 0x557131c01470 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.170+0000 7fad7cf69740 10 client.0 _ll_register_callbacks cb 0x7fad6000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44434/0 (socket says 172.21.15.18:44434) 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 -- 172.21.15.18:0/313909439 learned_addr learned my addr 172.21.15.18:0/313909439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad73e00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131bf7f70 0x557131c052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad73e00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 0x557131c05d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 -- 172.21.15.18:0/313909439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 msgr2=0x557131c05d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 0x557131c05d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 -- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131bf7f70 msgr2=0x557131c052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131bf7f70 0x557131c052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 -- 172.21.15.18:0/313909439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557131c77230 con 0x557131bf8890 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad73e00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 0x557131c05d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad72a00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad60005ca0 tx=0x7fad6000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd835b0a3f9265f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.171+0000 7fad5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60028040 con 0x557131bf8890 2024-04-21T22:34:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fad60010710 con 0x557131bf8890 2024-04-21T22:34:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad60005850 con 0x557131bf8890 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad60004020 con 0x557131bf8890 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557131c78510 con 0x557131bf8890 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad60005850 con 0x557131bf8890 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fad60037070 con 0x557131bf8890 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 20 client.15537 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.172+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c78bc0 0x557131c7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.173+0000 7fad7cf69740 4 client.15537 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.173+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557131b63c30 con 0x557131c78bc0 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.173+0000 7fad73e00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c78bc0 0x557131c7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.173+0000 7fad73e00640 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c78bc0 0x557131c7afe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1894c4913e3eaf server_cookie=f3145fddb0f5da00 in_seq=0 out_seq=0 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.173+0000 7fad5cc00640 10 client.15537 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad5cc00640 1 -- 172.21.15.18:0/313909439 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557131b63c30 con 0x557131c78bc0 2024-04-21T22:34:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad5cc00640 10 client.15537 handle_command_reply: tid=0 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 client.15537 shutdown 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 msgr2=0x557131c05810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad60005ca0 tx=0x7fad6000b920 comp rx=0 tx=0).stop 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 shutdown_connections 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557131c78bc0 0x557131c7afe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557131c01470 0x557131c05d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557131bf8890 0x557131c05810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 --2- 172.21.15.18:0/313909439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557131bf7f70 0x557131c052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad5cc00640 0 client.15537 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 >> 172.21.15.18:0/313909439 conn(0x557131bf26a0 msgr2=0x557131bfec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 shutdown_connections 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 1 -- 172.21.15.18:0/313909439 wait complete. 2024-04-21T22:34:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.174+0000 7fad7cf69740 20 client.15537 trim_cache size 0 max 16384 2024-04-21T22:34:44.177 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:34:44.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 msgr2=0x7fad580a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 0x7fad580a5310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad640eec10 tx=0x7fad64000bc0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 msgr2=0x7fad74100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad64005940 tx=0x7fad6402cd10 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 shutdown_connections 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fad580a2e50 0x7fad580a5310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad7410bb40 0x7fad74100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad74103040 0x7fad741008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 --2- 172.21.15.18:0/4104738794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad74102720 0x7fad74100370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 >> 172.21.15.18:0/4104738794 conn(0x7fad740771f0 msgr2=0x7fad740fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 shutdown_connections 2024-04-21T22:34:44.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:44.175+0000 7fad78c00640 1 -- 172.21.15.18:0/4104738794 wait complete. 2024-04-21T22:34:45.193 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:34:45.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:34:45.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:34:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 -- 172.21.15.18:0/3247961814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8107710 msgr2=0x7fc0c8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/3247961814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8107710 0x7fc0c8107af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009930 tx=0x7fc0bc02bc20 comp rx=0 tx=0).stop 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 -- 172.21.15.18:0/3247961814 shutdown_connections 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/3247961814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 0x7fc0c810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/3247961814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8101700 0x7fc0c8101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.410+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/3247961814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8107710 0x7fc0c8107af0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.411+0000 7fc0cfa00640 1 -- 172.21.15.18:0/3247961814 >> 172.21.15.18:0/3247961814 conn(0x7fc0c80fd1f0 msgr2=0x7fc0c80ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.411+0000 7fc0cfa00640 1 -- 172.21.15.18:0/3247961814 shutdown_connections 2024-04-21T22:34:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.411+0000 7fc0cfa00640 1 -- 172.21.15.18:0/3247961814 wait complete. 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 Processor -- start 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 -- start start 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 0x7fc0c8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 0x7fc0c81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8111b30 con 0x7fc0c8107710 2024-04-21T22:34:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81119b0 con 0x7fc0c81020c0 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.412+0000 7fc0cfa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8111cb0 con 0x7fc0c8101700 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44454/0 (socket says 172.21.15.18:44454) 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 -- 172.21.15.18:0/4127921625 learned_addr learned my addr 172.21.15.18:0/4127921625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cd000640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 0x7fc0c8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 0x7fc0c81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 -- 172.21.15.18:0/4127921625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 msgr2=0x7fc0c8198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 0x7fc0c8198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 -- 172.21.15.18:0/4127921625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 msgr2=0x7fc0c81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 0x7fc0c81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 -- 172.21.15.18:0/4127921625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c819d060 con 0x7fc0c8107710 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cd000640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 0x7fc0c8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.413+0000 7fc0cda00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009fd0 tx=0x7fc0c000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.414+0000 7fc0c5600640 1 -- 172.21.15.18:0/4127921625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0017070 con 0x7fc0c8107710 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.414+0000 7fc0c5600640 1 -- 172.21.15.18:0/4127921625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0c0003e50 con 0x7fc0c8107710 2024-04-21T22:34:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.414+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c819d350 con 0x7fc0c8107710 2024-04-21T22:34:45.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.414+0000 7fc0c5600640 1 -- 172.21.15.18:0/4127921625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00106c0 con 0x7fc0c8107710 2024-04-21T22:34:45.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.414+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c81a4be0 con 0x7fc0c8107710 2024-04-21T22:34:45.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.417+0000 7fc0c5600640 1 -- 172.21.15.18:0/4127921625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7fc0c0003970 con 0x7fc0c8107710 2024-04-21T22:34:45.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.417+0000 7fc0d27db740 1 Processor -- start 2024-04-21T22:34:45.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.417+0000 7fc0d27db740 1 -- start start 2024-04-21T22:34:45.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8eac20 0x55841d8ed010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55841d83fdf0 con 0x55841d8e2040 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55841d845040 con 0x55841d8eac20 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0d27db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841d7ed8c0 con 0x55841d8e1720 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0c7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44468/0 (socket says 172.21.15.18:44468) 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0cd000640 1 -- 172.21.15.18:0/1582065896 learned_addr learned my addr 172.21.15.18:0/1582065896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.418+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8eac20 0x55841d8ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 -- 172.21.15.18:0/1582065896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 msgr2=0x55841d8e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 -- 172.21.15.18:0/1582065896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8eac20 msgr2=0x55841d8ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8eac20 0x55841d8ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 -- 172.21.15.18:0/1582065896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841d6217e0 con 0x55841d8e2040 2024-04-21T22:34:45.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02c230 tx=0x7fc0bc009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8e0286ca5873c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0ba000640 1 -- 172.21.15.18:0/1582065896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc045070 con 0x55841d8e2040 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.419+0000 7fc0c5600640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 0x7fc0b00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0c5600640 1 -- 172.21.15.18:0/4127921625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0c00cf380 con 0x7fc0c8107710 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0ba000640 1 -- 172.21.15.18:0/1582065896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc004a70 con 0x55841d8e2040 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0ba000640 1 -- 172.21.15.18:0/1582065896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc004ec0 con 0x55841d8e2040 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 0x7fc0b00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0d27db740 1 -- 172.21.15.18:0/1582065896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 msgr2=0x55841d8ea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02c230 tx=0x7fc0bc009610 comp rx=0 tx=0).stop 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 0x7fc0b00a52e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55841d8dcfe0 tx=0x7fc0b4005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.420+0000 7fc0d27db740 1 -- 172.21.15.18:0/1582065896 shutdown_connections 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8eac20 0x55841d8ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8e2040 0x55841d8ea6e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1582065896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 -- 172.21.15.18:0/1582065896 >> 172.21.15.18:0/1582065896 conn(0x55841d8dbe50 msgr2=0x55841d8dc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 -- 172.21.15.18:0/1582065896 shutdown_connections 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 -- 172.21.15.18:0/1582065896 wait complete. 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 -- start start 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.421+0000 7fc0d27db740 1 Processor -- start 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55841d800d20 con 0x55841d8eac20 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55841d841000 con 0x55841d8e2040 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55841d8ed9b0 con 0x55841d8e1720 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0d27db740 10 client.0 _ll_register_callbacks cb 0x55841d83c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46004/0 (socket says 172.21.15.18:46004) 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 -- 172.21.15.18:0/3370783297 learned_addr learned my addr 172.21.15.18:0/3370783297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cda00640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 -- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 msgr2=0x55841d8e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 -- 172.21.15.18:0/3370783297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 msgr2=0x55841d8e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cd000640 1 -- 172.21.15.18:0/3370783297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841d681f70 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.422+0000 7fc0cda00640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc036040 tx=0x7fc0bc009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68b328b2f19f1062 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0aea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc045070 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0bc004a70 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0bc004450 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0bc058050 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.423+0000 7fc0d27db740 10 client.25678 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55841d519170 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc004a70 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc0bc0039d0 con 0x55841d8e1720 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 10 client.25678 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 10 client.25678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 20 client.25678 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d8faca0 0x55841d8fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 4 client.25678 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:45.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.424+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55841d852580 con 0x55841d8faca0 2024-04-21T22:34:45.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.425+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d8faca0 0x55841d8fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.426+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d8faca0 0x55841d8fd090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef1f8b72438e179 server_cookie=dfa2e2b07f194e67 in_seq=0 out_seq=0 2024-04-21T22:34:45.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.426+0000 7fc0aea00640 10 client.25678 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.426+0000 7fc0aea00640 1 -- 172.21.15.18:0/3370783297 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55841d852580 con 0x55841d8faca0 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.426+0000 7fc0aea00640 10 client.25678 handle_command_reply: tid=0 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.426+0000 7fc0d27db740 1 client.25678 shutdown 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 msgr2=0x55841d8e7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc036040 tx=0x7fc0bc009680 comp rx=0 tx=0).stop 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 shutdown_connections 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d8faca0 0x55841d8fd090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3370783297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8e7c60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0aea00640 0 client.25678 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 >> 172.21.15.18:0/3370783297 conn(0x55841d8dbe50 msgr2=0x55841d8ddba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 shutdown_connections 2024-04-21T22:34:45.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 1 -- 172.21.15.18:0/3370783297 wait complete. 2024-04-21T22:34:45.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.427+0000 7fc0d27db740 20 client.25678 trim_cache size 0 max 16384 2024-04-21T22:34:45.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:45 smithi047 ceph-mon[31561]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 Processor -- start 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 -- start start 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8ea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8f6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81ab350 con 0x55841d8eac20 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81ace90 con 0x55841d8e2040 2024-04-21T22:34:45.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.449+0000 7fc0d27db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81aba20 con 0x55841d8e1720 2024-04-21T22:34:45.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44484/0 (socket says 172.21.15.18:44484) 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cda00640 1 -- 172.21.15.18:0/1863291751 learned_addr learned my addr 172.21.15.18:0/1863291751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 -- 172.21.15.18:0/1863291751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 msgr2=0x55841d8f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 -- 172.21.15.18:0/1863291751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 msgr2=0x55841d902740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 -- 172.21.15.18:0/1863291751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841d8de090 con 0x55841d8e1720 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cda00640 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.450+0000 7fc0cd000640 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8ea390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02c160 tx=0x7fc0bc02c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=189ffda1fd0991bd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0b9600640 1 -- 172.21.15.18:0/1863291751 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc045070 con 0x55841d8e1720 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0b9600640 1 -- 172.21.15.18:0/1863291751 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc004a70 con 0x55841d8e1720 2024-04-21T22:34:45.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0b9600640 1 -- 172.21.15.18:0/1863291751 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc005120 con 0x55841d8e1720 2024-04-21T22:34:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 -- 172.21.15.18:0/1863291751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 msgr2=0x55841d8ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8ea390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02c160 tx=0x7fc0bc02c2a0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 -- 172.21.15.18:0/1863291751 shutdown_connections 2024-04-21T22:34:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d902740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 --2- 172.21.15.18:0/1863291751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8ea390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 -- 172.21.15.18:0/1863291751 >> 172.21.15.18:0/1863291751 conn(0x55841d8dbe50 msgr2=0x55841d8daeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.451+0000 7fc0d27db740 1 -- 172.21.15.18:0/1863291751 shutdown_connections 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.452+0000 7fc0d27db740 1 -- 172.21.15.18:0/1863291751 wait complete. 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.452+0000 7fc0d27db740 1 -- start start 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.452+0000 7fc0d27db740 1 Processor -- start 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81ac7c0 con 0x55841d8eac20 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81ac0f0 con 0x55841d8e2040 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81a9330 con 0x55841d8e1720 2024-04-21T22:34:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0d27db740 10 client.0 _ll_register_callbacks cb 0x7fc0b4015e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44496/0 (socket says 172.21.15.18:44496) 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 -- 172.21.15.18:0/3416403087 learned_addr learned my addr 172.21.15.18:0/3416403087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0c7e00640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 -- 172.21.15.18:0/3416403087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 msgr2=0x55841d8f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 -- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 msgr2=0x55841d8ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.453+0000 7fc0cda00640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8ef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0cda00640 1 -- 172.21.15.18:0/3416403087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841d8eff20 con 0x55841d8eac20 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0cda00640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0005c40 tx=0x7fc0c009b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d13a024b2a1023d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0aea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00b3020 con 0x55841d8eac20 2024-04-21T22:34:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0c0097d70 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0bc004a70 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0c0020040 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0d27db740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.454+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55841d961f30 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc004a70 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc0c00ccc30 con 0x55841d8eac20 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 20 client.15555 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d9626a0 0x55841d964a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 4 client.15555 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55841d84c8d0 con 0x55841d9626a0 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.455+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d9626a0 0x55841d964a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.456+0000 7fc0cd000640 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d9626a0 0x55841d964a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82dd900b34f0767 server_cookie=ca1db0ba9e07e538 in_seq=0 out_seq=0 2024-04-21T22:34:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.456+0000 7fc0aea00640 10 client.15555 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0aea00640 1 -- 172.21.15.18:0/3416403087 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55841d84c8d0 con 0x55841d9626a0 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0aea00640 10 client.15555 handle_command_reply: tid=0 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 client.15555 shutdown 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 msgr2=0x55841d8ef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0005c40 tx=0x7fc0c009b190 comp rx=0 tx=0).stop 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 shutdown_connections 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55841d8eac20 0x55841d8ef7e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55841d8e2040 0x55841d8ef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55841d9626a0 0x55841d964a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 --2- 172.21.15.18:0/3416403087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55841d8e1720 0x55841d8f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.457+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 >> 172.21.15.18:0/3416403087 conn(0x55841d8dbe50 msgr2=0x55841d8da620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0aea00640 0 client.15555 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 shutdown_connections 2024-04-21T22:34:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0d27db740 1 -- 172.21.15.18:0/3416403087 wait complete. 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0d27db740 20 client.15555 trim_cache size 0 max 16384 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "457daf47-3669-45f4-b739-416b83c6d037", 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:34:45.461 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 msgr2=0x7fc0b00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 0x7fc0b00a52e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55841d8dcfe0 tx=0x7fc0b4005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 msgr2=0x7fc0c819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.458+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009fd0 tx=0x7fc0c000b260 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 shutdown_connections 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0b00a2e20 0x7fc0b00a52e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0c8107710 0x7fc0c819c930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0c81020c0 0x7fc0c81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 --2- 172.21.15.18:0/4127921625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8101700 0x7fc0c8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 >> 172.21.15.18:0/4127921625 conn(0x7fc0c80fd1f0 msgr2=0x7fc0c80fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 shutdown_connections 2024-04-21T22:34:45.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.459+0000 7fc0cfa00640 1 -- 172.21.15.18:0/4127921625 wait complete. 2024-04-21T22:34:45.473 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:45 smithi018 ceph-mon[26614]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:45.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:34:45.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:34:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:45 smithi081 ceph-mon[31692]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 -- 172.21.15.18:0/3567038408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e101064d0 msgr2=0x7f4e101068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 --2- 172.21.15.18:0/3567038408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e101064d0 0x7f4e101068b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009be0 tx=0x7f4e0002bef0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 -- 172.21.15.18:0/3567038408 shutdown_connections 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 --2- 172.21.15.18:0/3567038408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100df0 0x7f4e1010d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 --2- 172.21.15.18:0/3567038408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e10100430 0x7f4e101008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 --2- 172.21.15.18:0/3567038408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e101064d0 0x7f4e101068b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 -- 172.21.15.18:0/3567038408 >> 172.21.15.18:0/3567038408 conn(0x7f4e100771f0 msgr2=0x7f4e100fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 -- 172.21.15.18:0/3567038408 shutdown_connections 2024-04-21T22:34:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.679+0000 7f4e14c00640 1 -- 172.21.15.18:0/3567038408 wait complete. 2024-04-21T22:34:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 Processor -- start 2024-04-21T22:34:45.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 -- start start 2024-04-21T22:34:45.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100430 0x7f4e1019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 0x7f4e1019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 0x7f4e1019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101119a0 con 0x7f4e101064d0 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e10111820 con 0x7f4e10100df0 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e14c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e10111b20 con 0x7f4e10100430 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 0x7f4e1019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 0x7f4e1019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44520/0 (socket says 172.21.15.18:44520) 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e0ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 0x7f4e1019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.681+0000 7f4e0fe00640 1 -- 172.21.15.18:0/2774725881 learned_addr learned my addr 172.21.15.18:0/2774725881 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0f400640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100430 0x7f4e1019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 -- 172.21.15.18:0/2774725881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100430 msgr2=0x7f4e1019a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100430 0x7f4e1019a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 -- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 msgr2=0x7f4e1019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 0x7f4e1019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 -- 172.21.15.18:0/2774725881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1019f000 con 0x7f4e10100df0 2024-04-21T22:34:45.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 0x7f4e1019a550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e790 tx=0x7f4df800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.682+0000 7f4e07e00640 1 -- 172.21.15.18:0/2774725881 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df800eea0 con 0x7f4e10100df0 2024-04-21T22:34:45.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.683+0000 7f4e07e00640 1 -- 172.21.15.18:0/2774725881 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df800ccc0 con 0x7f4e10100df0 2024-04-21T22:34:45.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.683+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1019f2f0 con 0x7f4e10100df0 2024-04-21T22:34:45.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.683+0000 7f4e07e00640 1 -- 172.21.15.18:0/2774725881 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8018780 con 0x7f4e10100df0 2024-04-21T22:34:45.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.683+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e101a6b80 con 0x7f4e10100df0 2024-04-21T22:34:45.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 Processor -- start 2024-04-21T22:34:45.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 -- start start 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af60fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af61b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5611af573410 con 0x5611af60fab0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611af51b7e0 con 0x5611af6103d0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.687+0000 7f4e18e03740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5611af56f3d0 con 0x5611af618fb0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e07e00640 1 -- 172.21.15.18:0/2774725881 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 25) ==== 138060+0+0 (secure 0 0 0) 0x7f4df8010430 con 0x7f4e10100df0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af60fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43158/0 (socket says 172.21.15.18:43158) 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 -- 172.21.15.18:0/1498203131 learned_addr learned my addr 172.21.15.18:0/1498203131 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af61b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 -- 172.21.15.18:0/1498203131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 msgr2=0x5611af61b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af61b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 -- 172.21.15.18:0/1498203131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 msgr2=0x5611af60fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af60fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.688+0000 7f4e0f400640 1 -- 172.21.15.18:0/1498203131 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611af3517d0 con 0x5611af6103d0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.689+0000 7f4e0f400640 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009be0 tx=0x7f4e00005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde0f8c9225a28c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.689+0000 7f4dffe00640 1 -- 172.21.15.18:0/1498203131 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00043030 con 0x5611af6103d0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.689+0000 7f4dffe00640 1 -- 172.21.15.18:0/1498203131 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e00033c00 con 0x5611af6103d0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.689+0000 7f4dffe00640 1 -- 172.21.15.18:0/1498203131 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0002c890 con 0x5611af6103d0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.689+0000 7f4e07e00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 0x7f4df40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e07e00640 1 -- 172.21.15.18:0/2774725881 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4df80cf8a0 con 0x7f4e10100df0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e0fe00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 0x7f4df40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 -- 172.21.15.18:0/1498203131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 msgr2=0x5611af618a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009be0 tx=0x7f4e00005ec0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 -- 172.21.15.18:0/1498203131 shutdown_connections 2024-04-21T22:34:45.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af61b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af6103d0 0x5611af618a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1498203131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af60fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 -- 172.21.15.18:0/1498203131 >> 172.21.15.18:0/1498203131 conn(0x5611af60a1e0 msgr2=0x5611af60a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 -- 172.21.15.18:0/1498203131 shutdown_connections 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e18e03740 1 -- 172.21.15.18:0/1498203131 wait complete. 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.690+0000 7f4e0fe00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 0x7f4df40a52e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009640 tx=0x7f4e08005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.691+0000 7f4e18e03740 1 -- start start 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.691+0000 7f4e18e03740 1 Processor -- start 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af616520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af616a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5611af61bd40 con 0x5611af60fab0 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5611af52ec40 con 0x5611af618fb0 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5611af61bec0 con 0x5611af6103d0 2024-04-21T22:34:45.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e18e03740 10 client.0 _ll_register_callbacks cb 0x5611af52e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44534/0 (socket says 172.21.15.18:44534) 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 -- 172.21.15.18:0/528381078 learned_addr learned my addr 172.21.15.18:0/528381078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0fe00640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af616a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af616520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 -- 172.21.15.18:0/528381078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 msgr2=0x5611af616520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af616520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 -- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 msgr2=0x5611af616a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af616a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0f400640 1 -- 172.21.15.18:0/528381078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611af2873f0 con 0x5611af60fab0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.692+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af616520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.693+0000 7f4e0f400640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f80 tx=0x7f4e00033940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a09c89ceb34dc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.693+0000 7f4dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.693+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0004c030 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.693+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4e00033db0 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.693+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e00033c00 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.694+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e00043070 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.694+0000 7f4e18e03740 10 client.15567 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.694+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5611af2470f0 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.694+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e00033c00 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4e0002c890 con 0x5611af60fab0 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 10 client.15567 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 20 client.15567 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af629160 0x5611af62b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 4 client.15567 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611af586c40 con 0x5611af629160 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.695+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af629160 0x5611af62b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.696+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af629160 0x5611af62b550 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afb949589c2d7a3 server_cookie=47884842ea607c57 in_seq=0 out_seq=0 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.696+0000 7f4dfcc00640 10 client.15567 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.696+0000 7f4dfcc00640 1 -- 172.21.15.18:0/528381078 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5611af586c40 con 0x5611af629160 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4dfcc00640 10 client.15567 handle_command_reply: tid=0 2024-04-21T22:34:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 client.15567 shutdown 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 msgr2=0x5611af615fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f80 tx=0x7f4e00033940 comp rx=0 tx=0).stop 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 shutdown_connections 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af616a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af629160 0x5611af62b550 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af616520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 --2- 172.21.15.18:0/528381078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af615fe0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 >> 172.21.15.18:0/528381078 conn(0x5611af60a1e0 msgr2=0x5611af609440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4dfcc00640 0 client.15567 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 shutdown_connections 2024-04-21T22:34:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 1 -- 172.21.15.18:0/528381078 wait complete. 2024-04-21T22:34:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.697+0000 7f4e18e03740 20 client.15567 trim_cache size 0 max 16384 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 Processor -- start 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 -- start start 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 0x5611af618710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af6137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101af4b0 con 0x5611af6103d0 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101b0ff0 con 0x5611af60fab0 2024-04-21T22:34:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.718+0000 7f4e18e03740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101afb80 con 0x5611af618fb0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44536/0 (socket says 172.21.15.18:44536) 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 -- 172.21.15.18:0/1849154783 learned_addr learned my addr 172.21.15.18:0/1849154783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0f400640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 0x5611af618710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0fe00640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af6137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 -- 172.21.15.18:0/1849154783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 msgr2=0x5611af6137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af6137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 -- 172.21.15.18:0/1849154783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 msgr2=0x5611af618710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 0x5611af618710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0ea00640 1 -- 172.21.15.18:0/1849154783 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611af60ee40 con 0x5611af6103d0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.719+0000 7f4e0f400640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 0x5611af618710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.720+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4df8098590 tx=0x7f4df80d1cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28e012347a549b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.720+0000 7f4dff400640 1 -- 172.21.15.18:0/1849154783 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df80d2e60 con 0x5611af6103d0 2024-04-21T22:34:45.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.720+0000 7f4dff400640 1 -- 172.21.15.18:0/1849154783 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df80a4780 con 0x5611af6103d0 2024-04-21T22:34:45.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.720+0000 7f4dff400640 1 -- 172.21.15.18:0/1849154783 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df80cd0f0 con 0x5611af6103d0 2024-04-21T22:34:45.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- 172.21.15.18:0/1849154783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 msgr2=0x5611af613280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4df8098590 tx=0x7f4df80d1cf0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- 172.21.15.18:0/1849154783 shutdown_connections 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af618fb0 0x5611af6137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af6103d0 0x5611af613280 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 --2- 172.21.15.18:0/1849154783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af60fab0 0x5611af618710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- 172.21.15.18:0/1849154783 >> 172.21.15.18:0/1849154783 conn(0x5611af60a1e0 msgr2=0x5611af6148d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- 172.21.15.18:0/1849154783 shutdown_connections 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- 172.21.15.18:0/1849154783 wait complete. 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 -- start start 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.721+0000 7f4e18e03740 1 Processor -- start 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af62bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af687370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101b0920 con 0x5611af60fab0 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101b0250 con 0x5611af618fb0 2024-04-21T22:34:45.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101ad490 con 0x5611af6103d0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e18e03740 10 client.0 _ll_register_callbacks cb 0x7f4e000337d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e0f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44540/0 (socket says 172.21.15.18:44540) 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e0f400640 1 -- 172.21.15.18:0/136515149 learned_addr learned my addr 172.21.15.18:0/136515149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af62bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.722+0000 7f4e0fe00640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af687370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 -- 172.21.15.18:0/136515149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 msgr2=0x5611af62bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af62bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 -- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 msgr2=0x5611af687370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af687370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 -- 172.21.15.18:0/136515149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611af687930 con 0x5611af60fab0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e0f400640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4e00002230 tx=0x7f4e00009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1792151e9109938 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:34:45.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:34:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0004c070 con 0x5611af60fab0 2024-04-21T22:34:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4df80a4780 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.723+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4e00003ed0 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e00056030 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5611af68ecf0 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df80a4780 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4e0003f810 con 0x5611af60fab0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 20 client.15573 populate_metadata read hostname 'smithi018' 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af68f400 0x5611af691820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 4 client.15573 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.724+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5611af580950 con 0x5611af68f400 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af68f400 0x5611af691820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4e0ea00640 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af68f400 0x5611af691820 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63ffdf83575853af server_cookie=36060cbeb64626ed in_seq=0 out_seq=0 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4dfcc00640 10 client.15573 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4dfcc00640 1 -- 172.21.15.18:0/136515149 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5611af580950 con 0x5611af68f400 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4dfcc00640 10 client.15573 handle_command_reply: tid=0 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.725+0000 7f4e18e03740 1 client.15573 shutdown 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 msgr2=0x5611af62b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4e00002230 tx=0x7f4e00009280 comp rx=0 tx=0).stop 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 shutdown_connections 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5611af618fb0 0x5611af687370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5611af68f400 0x5611af691820 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611af6103d0 0x5611af62bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 --2- 172.21.15.18:0/136515149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5611af60fab0 0x5611af62b840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 >> 172.21.15.18:0/136515149 conn(0x5611af60a1e0 msgr2=0x5611af624110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4dfcc00640 0 client.15573 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 shutdown_connections 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 1 -- 172.21.15.18:0/136515149 wait complete. 2024-04-21T22:34:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.726+0000 7f4e18e03740 20 client.15573 trim_cache size 0 max 16384 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "457daf47-3669-45f4-b739-416b83c6d037": { 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "457daf47-3669-45f4-b739-416b83c6d037", 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:34:45.729 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 msgr2=0x7f4df40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 0x7f4df40a52e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009640 tx=0x7f4e08005f90 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 msgr2=0x7f4e1019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 0x7f4e1019a550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e790 tx=0x7f4df800ec50 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 shutdown_connections 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4df40a2e20 0x7f4df40a52e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e101064d0 0x7f4e1019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e10100df0 0x7f4e1019a550 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 --2- 172.21.15.18:0/2774725881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e10100430 0x7f4e1019a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 >> 172.21.15.18:0/2774725881 conn(0x7f4e100771f0 msgr2=0x7f4e10103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 shutdown_connections 2024-04-21T22:34:45.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:34:45.727+0000 7f4e14c00640 1 -- 172.21.15.18:0/2774725881 wait complete. 2024-04-21T22:34:45.744 INFO:tasks.cephfs.filesystem:scrub status for tag:457daf47-3669-45f4-b739-416b83c6d037 - {'path': '/', 'tag': '457daf47-3669-45f4-b739-416b83c6d037', 'options': 'recursive,force'} 2024-04-21T22:34:46.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:46 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:34:46.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:46.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:46 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:34:46.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:46 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:34:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:46 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:34:46.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:46 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:34:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:46 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:34:46.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:34:47.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:47 smithi047 ceph-mon[31561]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:47.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:47 smithi018 ceph-mon[26614]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:47 smithi081 ceph-mon[31692]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:34:48.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:48 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:34:48.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:48 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:34:48.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:48 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:34:49.445 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:49 smithi047 ceph-mon[31561]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-21T22:34:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:49 smithi018 ceph-mon[26614]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-21T22:34:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:49 smithi081 ceph-mon[31692]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-04-21T22:34:51.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:51 smithi018 ceph-mon[26614]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-21T22:34:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:51 smithi081 ceph-mon[31692]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-21T22:34:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:51 smithi047 ceph-mon[31561]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-04-21T22:34:53.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:53 smithi018 ceph-mon[26614]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:34:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:53 smithi081 ceph-mon[31692]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:34:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:53 smithi047 ceph-mon[31561]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:34:55.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:55 smithi018 ceph-mon[26614]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-04-21T22:34:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:55 smithi081 ceph-mon[31692]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-04-21T22:34:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:55 smithi047 ceph-mon[31561]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 682 B/s wr, 13 op/s 2024-04-21T22:34:57.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:57 smithi018 ceph-mon[26614]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:34:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:57 smithi081 ceph-mon[31692]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:34:57.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:57 smithi047 ceph-mon[31561]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:34:59.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:34:59 smithi018 ceph-mon[26614]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:34:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:34:59 smithi081 ceph-mon[31692]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:34:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:34:59 smithi047 ceph-mon[31561]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:35:01.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:35:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:35:00.682+0000 7f6851e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:35:01.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:35:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:35:00.682+0000 7f6851e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:35:01.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:35:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:35:00.682+0000 7f6851e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:35:01.095 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:35:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:35:00.682+0000 7f6851e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:35:01.096 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:35:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:35:00.682+0000 7f6851e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-21T22:35:01.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:01 smithi018 ceph-mon[26614]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:35:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:01 smithi081 ceph-mon[31692]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:35:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:01 smithi047 ceph-mon[31561]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 11 op/s 2024-04-21T22:35:03.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:03 smithi018 ceph-mon[26614]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:35:03.506 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:03 smithi018 ceph-mon[26614]: mgrmap e26: x(active, since 60s), standbys: y, z 2024-04-21T22:35:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:03 smithi081 ceph-mon[31692]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:35:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:03 smithi081 ceph-mon[31692]: mgrmap e26: x(active, since 60s), standbys: y, z 2024-04-21T22:35:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:03 smithi047 ceph-mon[31561]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-21T22:35:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:03 smithi047 ceph-mon[31561]: mgrmap e26: x(active, since 60s), standbys: y, z 2024-04-21T22:35:05.497 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:05 smithi047 ceph-mon[31561]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:05 smithi018 ceph-mon[26614]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:05 smithi081 ceph-mon[31692]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:07 smithi018 ceph-mon[26614]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:07 smithi081 ceph-mon[31692]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:07 smithi047 ceph-mon[31561]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:09 smithi018 ceph-mon[26614]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:09 smithi081 ceph-mon[31692]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:09 smithi047 ceph-mon[31561]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:11 smithi018 ceph-mon[26614]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-21T22:35:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:11 smithi081 ceph-mon[31692]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-21T22:35:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:11 smithi047 ceph-mon[31561]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-21T22:35:12.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:12 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:35:12.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:12 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:35:12.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:12 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:35:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:13 smithi018 ceph-mon[26614]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:13 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:35:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:13 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:35:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:13 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:35:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:13 smithi081 ceph-mon[31692]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:13 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:35:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:13 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:35:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:13 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:35:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:13 smithi047 ceph-mon[31561]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-04-21T22:35:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:13 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:35:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:13 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:35:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:13 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:35:15.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:15 smithi018 ceph-mon[26614]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:15 smithi081 ceph-mon[31692]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:15.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:15 smithi047 ceph-mon[31561]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-21T22:35:15.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:35:15.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:35:16.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 -- 172.21.15.18:0/3453824077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 msgr2=0x7fb378109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 --2- 172.21.15.18:0/3453824077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb378109b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb368009900 tx=0x7fb36802bc40 comp rx=0 tx=0).stop 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 -- 172.21.15.18:0/3453824077 shutdown_connections 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 --2- 172.21.15.18:0/3453824077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb378110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 --2- 172.21.15.18:0/3453824077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 0x7fb378103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 --2- 172.21.15.18:0/3453824077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb378109b40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.022+0000 7fb37d800640 1 -- 172.21.15.18:0/3453824077 >> 172.21.15.18:0/3453824077 conn(0x7fb3780ff220 msgr2=0x7fb378101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.023+0000 7fb37d800640 1 -- 172.21.15.18:0/3453824077 shutdown_connections 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.023+0000 7fb37d800640 1 -- 172.21.15.18:0/3453824077 wait complete. 2024-04-21T22:35:16.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.024+0000 7fb37d800640 1 Processor -- start 2024-04-21T22:35:16.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.024+0000 7fb37d800640 1 -- start start 2024-04-21T22:35:16.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.024+0000 7fb37d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 0x7fb37810eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb37810f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb378076920 con 0x7fb378103750 2024-04-21T22:35:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3780767a0 con 0x7fb378109760 2024-04-21T22:35:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb378076aa0 con 0x7fb378104110 2024-04-21T22:35:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb377400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb377400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33024/0 (socket says 172.21.15.18:33024) 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb377400640 1 -- 172.21.15.18:0/3755492191 learned_addr learned my addr 172.21.15.18:0/3755492191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb377e00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 0x7fb37810eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.025+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb37810f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 -- 172.21.15.18:0/3755492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 msgr2=0x7fb37810f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb37810f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 -- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 msgr2=0x7fb37810eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 0x7fb37810eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 -- 172.21.15.18:0/3755492191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3781aa6d0 con 0x7fb378104110 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb37810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb377400640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb36400e9f0 tx=0x7fb36400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb374c00640 1 -- 172.21.15.18:0/3755492191 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36400cd80 con 0x7fb378104110 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb374c00640 1 -- 172.21.15.18:0/3755492191 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb364010910 con 0x7fb378104110 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb374c00640 1 -- 172.21.15.18:0/3755492191 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364018990 con 0x7fb378104110 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.026+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3781aa9c0 con 0x7fb378104110 2024-04-21T22:35:16.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.027+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3781aaec0 con 0x7fb378104110 2024-04-21T22:35:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.031+0000 7fb381a2a740 1 Processor -- start 2024-04-21T22:35:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.031+0000 7fb381a2a740 1 -- start start 2024-04-21T22:35:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.032+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.032+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c553d0 0x560174c5da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.032+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.032+0000 7fb381a2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560174bb8410 con 0x560174c54ab0 2024-04-21T22:35:16.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.032+0000 7fb381a2a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560174b607e0 con 0x560174c553d0 2024-04-21T22:35:16.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb381a2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560174bb43d0 con 0x560174c5dfb0 2024-04-21T22:35:16.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb377e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c553d0 0x560174c5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54116/0 (socket says 172.21.15.18:54116) 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 -- 172.21.15.18:0/3836362958 learned_addr learned my addr 172.21.15.18:0/3836362958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb374c00640 1 -- 172.21.15.18:0/3755492191 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fb364010ac0 con 0x7fb378104110 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 -- 172.21.15.18:0/3836362958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 msgr2=0x560174c603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 -- 172.21.15.18:0/3836362958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c553d0 msgr2=0x560174c5da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.033+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c553d0 0x560174c5da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.034+0000 7fb37ce00640 1 -- 172.21.15.18:0/3836362958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601749967d0 con 0x560174c54ab0 2024-04-21T22:35:16.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.034+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb370011790 tx=0x7fb370011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735219dcd8f94f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb36d600640 1 -- 172.21.15.18:0/3836362958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370004d20 con 0x560174c54ab0 2024-04-21T22:35:16.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb36d600640 1 -- 172.21.15.18:0/3836362958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb370003970 con 0x560174c54ab0 2024-04-21T22:35:16.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb36d600640 1 -- 172.21.15.18:0/3836362958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370004490 con 0x560174c54ab0 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb374c00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 0x7fb35c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb381a2a740 1 -- 172.21.15.18:0/3836362958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 msgr2=0x560174c54e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.035+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb370011790 tx=0x7fb370011c50 comp rx=0 tx=0).stop 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb374c00640 1 -- 172.21.15.18:0/3755492191 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb3640cfb60 con 0x7fb378104110 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb377e00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 0x7fb35c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 -- 172.21.15.18:0/3836362958 shutdown_connections 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c553d0 0x560174c5da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3836362958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c54ab0 0x560174c54e90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 -- 172.21.15.18:0/3836362958 >> 172.21.15.18:0/3836362958 conn(0x560174c4f1e0 msgr2=0x560174c4f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 -- 172.21.15.18:0/3836362958 shutdown_connections 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.036+0000 7fb381a2a740 1 -- 172.21.15.18:0/3836362958 wait complete. 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.037+0000 7fb381a2a740 1 -- start start 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.037+0000 7fb377e00640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 0x7fb35c0a53f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb368006010 tx=0x7fb368000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.037+0000 7fb381a2a740 1 Processor -- start 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c5b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 0x560174c5bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560174c60da0 con 0x560174c553d0 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560174b73c40 con 0x560174c5dfb0 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560174c60f20 con 0x560174c54ab0 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb381a2a740 10 client.0 _ll_register_callbacks cb 0x560174b73630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.038+0000 7fb377e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33036/0 (socket says 172.21.15.18:33036) 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 -- 172.21.15.18:0/3978276207 learned_addr learned my addr 172.21.15.18:0/3978276207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377400640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c5b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 0x560174c5bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 -- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 msgr2=0x560174c5bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 0x560174c5bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 -- 172.21.15.18:0/3978276207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 msgr2=0x560174c5b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c5b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377e00640 1 -- 172.21.15.18:0/3978276207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601748cc3f0 con 0x560174c54ab0 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb37ce00640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 0x560174c5bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:35:16.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.039+0000 7fb377400640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c5b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:16.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.040+0000 7fb377e00640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb368035000 tx=0x7fb368009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9959d72a4d155aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.040+0000 7fb362000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:16.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.040+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368004c50 con 0x560174c54ab0 2024-04-21T22:35:16.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.040+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb368004f80 con 0x560174c54ab0 2024-04-21T22:35:16.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.040+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb370003970 con 0x560174c54ab0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb368005180 con 0x560174c54ab0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 10 client.25717 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56017488c0f0 con 0x560174c54ab0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb370003970 con 0x560174c54ab0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb368051070 con 0x560174c54ab0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 10 client.25717 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 10 client.25717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 20 client.25717 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.041+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174c6e280 0x560174c70740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.042+0000 7fb381a2a740 4 client.25717 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.042+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560174bcbc40 con 0x560174c6e280 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.042+0000 7fb377400640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174c6e280 0x560174c70740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.043+0000 7fb362000640 10 client.25717 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:16.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.043+0000 7fb377400640 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174c6e280 0x560174c70740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cee417a4860fc3d server_cookie=ce203ef5958d3763 in_seq=0 out_seq=0 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.043+0000 7fb362000640 1 -- 172.21.15.18:0/3978276207 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560174bcbc40 con 0x560174c6e280 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.043+0000 7fb362000640 10 client.25717 handle_command_reply: tid=0 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.044+0000 7fb381a2a740 1 client.25717 shutdown 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.044+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 msgr2=0x560174c5b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.044+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb368035000 tx=0x7fb368009260 comp rx=0 tx=0).stop 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.044+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 shutdown_connections 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.044+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c5dfb0 0x560174c5bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c5b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174c6e280 0x560174c70740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb362000640 0 client.25717 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3978276207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c54ab0 0x560174c5b090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 >> 172.21.15.18:0/3978276207 conn(0x560174c4f1e0 msgr2=0x560174c4e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.045+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 shutdown_connections 2024-04-21T22:35:16.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.046+0000 7fb381a2a740 1 -- 172.21.15.18:0/3978276207 wait complete. 2024-04-21T22:35:16.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.046+0000 7fb381a2a740 20 client.25717 trim_cache size 0 max 16384 2024-04-21T22:35:16.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.082+0000 7fb381a2a740 1 Processor -- start 2024-04-21T22:35:16.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.082+0000 7fb381a2a740 1 -- start start 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c5d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c76010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b3900 con 0x560174c553d0 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b5440 con 0x560174c54ab0 2024-04-21T22:35:16.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb381a2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b3fd0 con 0x560174c5dfb0 2024-04-21T22:35:16.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb377400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb377400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54148/0 (socket says 172.21.15.18:54148) 2024-04-21T22:35:16.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb377e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c5d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb377400640 1 -- 172.21.15.18:0/2370404982 learned_addr learned my addr 172.21.15.18:0/2370404982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.083+0000 7fb37ce00640 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c76010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 -- 172.21.15.18:0/2370404982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 msgr2=0x560174c76010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c76010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 -- 172.21.15.18:0/2370404982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 msgr2=0x560174c69c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 -- 172.21.15.18:0/2370404982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560174c49660 con 0x560174c54ab0 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377400640 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb377e00640 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c5d7c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb368044040 tx=0x7fb368004540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4415255280374dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb36cc00640 1 -- 172.21.15.18:0/2370404982 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368005320 con 0x560174c54ab0 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb36cc00640 1 -- 172.21.15.18:0/2370404982 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3680054c0 con 0x560174c54ab0 2024-04-21T22:35:16.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.084+0000 7fb36cc00640 1 -- 172.21.15.18:0/2370404982 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368003bc0 con 0x560174c54ab0 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.085+0000 7fb381a2a740 1 -- 172.21.15.18:0/2370404982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 msgr2=0x560174c5d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.085+0000 7fb381a2a740 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c5d7c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb368044040 tx=0x7fb368004540 comp rx=0 tx=0).stop 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 -- 172.21.15.18:0/2370404982 shutdown_connections 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c5dfb0 0x560174c76010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c553d0 0x560174c69c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 --2- 172.21.15.18:0/2370404982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c5d7c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 -- 172.21.15.18:0/2370404982 >> 172.21.15.18:0/2370404982 conn(0x560174c4f1e0 msgr2=0x560174c557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 -- 172.21.15.18:0/2370404982 shutdown_connections 2024-04-21T22:35:16.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 -- 172.21.15.18:0/2370404982 wait complete. 2024-04-21T22:35:16.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.086+0000 7fb381a2a740 1 -- start start 2024-04-21T22:35:16.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 Processor -- start 2024-04-21T22:35:16.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c553d0 0x560174c61860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c5dfb0 0x560174cd2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b4d70 con 0x560174c5dfb0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b46a0 con 0x560174c54ab0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3781b18e0 con 0x560174c553d0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.087+0000 7fb381a2a740 10 client.0 _ll_register_callbacks cb 0x7fb368004490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52070/0 (socket says 172.21.15.18:52070) 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb37ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c5dfb0 0x560174cd2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 -- 172.21.15.18:0/3533923349 learned_addr learned my addr 172.21.15.18:0/3533923349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377400640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c553d0 0x560174c61860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 -- 172.21.15.18:0/3533923349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c553d0 msgr2=0x560174c61860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c553d0 0x560174c61860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 -- 172.21.15.18:0/3533923349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c5dfb0 msgr2=0x560174cd2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c5dfb0 0x560174cd2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 -- 172.21.15.18:0/3533923349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560174cd2db0 con 0x560174c54ab0 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb377e00640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb36802c250 tx=0x7fb368003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df326483ce040f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.088+0000 7fb362000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb368069060 con 0x560174c54ab0 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb368048ba0 con 0x560174c54ab0 2024-04-21T22:35:16.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3680054c0 con 0x560174c54ab0 2024-04-21T22:35:16.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb368005320 con 0x560174c54ab0 2024-04-21T22:35:16.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb381a2a740 10 client.25706 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:16.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.089+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560174cd4070 con 0x560174c54ab0 2024-04-21T22:35:16.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3680054c0 con 0x560174c54ab0 2024-04-21T22:35:16.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb368051040 con 0x560174c54ab0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 10 client.25706 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 20 client.25706 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174cd46d0 0x560174cd6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 4 client.25706 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560174bc5950 con 0x560174cd46d0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.090+0000 7fb377400640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174cd46d0 0x560174cd6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.091+0000 7fb377400640 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174cd46d0 0x560174cd6af0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc8c32bd7e95584 server_cookie=3477280523ecd98f in_seq=0 out_seq=0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.091+0000 7fb362000640 10 client.25706 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.091+0000 7fb362000640 1 -- 172.21.15.18:0/3533923349 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560174bc5950 con 0x560174cd46d0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.091+0000 7fb362000640 10 client.25706 handle_command_reply: tid=0 2024-04-21T22:35:16.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.091+0000 7fb381a2a740 1 client.25706 shutdown 2024-04-21T22:35:16.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 msgr2=0x560174c61320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb36802c250 tx=0x7fb368003c80 comp rx=0 tx=0).stop 2024-04-21T22:35:16.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 shutdown_connections 2024-04-21T22:35:16.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560174c5dfb0 0x560174cd2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560174cd46d0 0x560174cd6af0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560174c553d0 0x560174c61860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 --2- 172.21.15.18:0/3533923349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560174c54ab0 0x560174c61320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 >> 172.21.15.18:0/3533923349 conn(0x560174c4f1e0 msgr2=0x560174c56350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb362000640 0 client.25706 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.092+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 shutdown_connections 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb381a2a740 1 -- 172.21.15.18:0/3533923349 wait complete. 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb381a2a740 20 client.25706 trim_cache size 0 max 16384 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:35:16.094 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 msgr2=0x7fb35c0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 0x7fb35c0a53f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb368006010 tx=0x7fb368000bc0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 msgr2=0x7fb37810f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.093+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb36400e9f0 tx=0x7fb36400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 shutdown_connections 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb35c0a2f30 0x7fb35c0a53f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb378109760 0x7fb37810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb378104110 0x7fb37810f000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 --2- 172.21.15.18:0/3755492191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb378103750 0x7fb37810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 >> 172.21.15.18:0/3755492191 conn(0x7fb3780ff220 msgr2=0x7fb3780ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 shutdown_connections 2024-04-21T22:35:16.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.094+0000 7fb37d800640 1 -- 172.21.15.18:0/3755492191 wait complete. 2024-04-21T22:35:16.111 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:35:16.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:35:16.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 -- 172.21.15.18:0/1016669406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101620 msgr2=0x7fe4e8101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 --2- 172.21.15.18:0/1016669406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101620 0x7fe4e8101aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009900 tx=0x7fe4d402bc50 comp rx=0 tx=0).stop 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 -- 172.21.15.18:0/1016669406 shutdown_connections 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 --2- 172.21.15.18:0/1016669406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8101fe0 0x7fe4e810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 --2- 172.21.15.18:0/1016669406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101620 0x7fe4e8101aa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 --2- 172.21.15.18:0/1016669406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8107630 0x7fe4e8107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.283+0000 7fe4eea00640 1 -- 172.21.15.18:0/1016669406 >> 172.21.15.18:0/1016669406 conn(0x7fe4e80fd130 msgr2=0x7fe4e80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.284+0000 7fe4eea00640 1 -- 172.21.15.18:0/1016669406 shutdown_connections 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.284+0000 7fe4eea00640 1 -- 172.21.15.18:0/1016669406 wait complete. 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 Processor -- start 2024-04-21T22:35:16.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 -- start start 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 0x7fe4e819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8107630 0x7fe4e819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8111a50 con 0x7fe4e8101620 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e81118d0 con 0x7fe4e8101fe0 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.285+0000 7fe4eea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8111bd0 con 0x7fe4e8107630 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54172/0 (socket says 172.21.15.18:54172) 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 -- 172.21.15.18:0/3382828779 learned_addr learned my addr 172.21.15.18:0/3382828779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ecc00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 0x7fe4e819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ee000640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8107630 0x7fe4e819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 -- 172.21.15.18:0/3382828779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8107630 msgr2=0x7fe4e819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8107630 0x7fe4e819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 -- 172.21.15.18:0/3382828779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 msgr2=0x7fe4e819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 0x7fe4e819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ed600640 1 -- 172.21.15.18:0/3382828779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e819f0a0 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.286+0000 7fe4ecc00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 0x7fe4e819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4ed600640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00e9f0 tx=0x7fe4dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00cd80 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e819f390 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81a6c20 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc010910 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.287+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc018990 con 0x7fe4e8101620 2024-04-21T22:35:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.289+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c8005290 con 0x7fe4e8101620 2024-04-21T22:35:16.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.293+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fe4dc018b30 con 0x7fe4e8101620 2024-04-21T22:35:16.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.296+0000 7fe4e6000640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 0x7fe4d00a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.296+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe4dc0cfb00 con 0x7fe4e8101620 2024-04-21T22:35:16.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.296+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fe4dc09c4e0 con 0x7fe4e8101620 2024-04-21T22:35:16.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.296+0000 7fe4ecc00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 0x7fe4d00a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.297+0000 7fe4ecc00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 0x7fe4d00a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4036040 tx=0x7fe4d4005fd0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.767+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c8005580 con 0x7fe4e8101620 2024-04-21T22:35:16.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.768+0000 7fe4e6000640 1 -- 172.21.15.18:0/3382828779 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11914 (secure 0 0 0) 0x7fe4dc09bde0 con 0x7fe4e8101620 2024-04-21T22:35:16.768 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:35:16.769 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:34:01.767520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:35:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-04-21T22:35:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.771+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 msgr2=0x7fe4d00a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.771+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 0x7fe4d00a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4036040 tx=0x7fe4d4005fd0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.771+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 msgr2=0x7fe4e819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.771+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00e9f0 tx=0x7fe4dc00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 shutdown_connections 2024-04-21T22:35:16.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4d00a2f20 0x7fe4d00a53e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e8107630 0x7fe4e819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4e8101fe0 0x7fe4e819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 --2- 172.21.15.18:0/3382828779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4e8101620 0x7fe4e819a0b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.772+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 >> 172.21.15.18:0/3382828779 conn(0x7fe4e80fd130 msgr2=0x7fe4e810cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.773+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 shutdown_connections 2024-04-21T22:35:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.773+0000 7fe4eea00640 1 -- 172.21.15.18:0/3382828779 wait complete. 2024-04-21T22:35:16.798 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 -- 172.21.15.18:0/3504707414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c073af0 msgr2=0x7f9f1c073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 --2- 172.21.15.18:0/3504707414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c073af0 0x7f9f1c073ed0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009900 tx=0x7f9f1002bcc0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 -- 172.21.15.18:0/3504707414 shutdown_connections 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 --2- 172.21.15.18:0/3504707414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 0x7f9f1c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 --2- 172.21.15.18:0/3504707414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c074410 0x7f9f1c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 --2- 172.21.15.18:0/3504707414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c073af0 0x7f9f1c073ed0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 -- 172.21.15.18:0/3504707414 >> 172.21.15.18:0/3504707414 conn(0x7f9f1c0fd090 msgr2=0x7f9f1c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 -- 172.21.15.18:0/3504707414 shutdown_connections 2024-04-21T22:35:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.973+0000 7f9f22600640 1 -- 172.21.15.18:0/3504707414 wait complete. 2024-04-21T22:35:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.974+0000 7f9f22600640 1 Processor -- start 2024-04-21T22:35:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.974+0000 7f9f22600640 1 -- start start 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c074410 0x7f9f1c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 0x7f9f1c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c113b70 con 0x7f9f1c10de00 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1139f0 con 0x7f9f1c074410 2024-04-21T22:35:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f22600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c113cf0 con 0x7f9f1c073af0 2024-04-21T22:35:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33090/0 (socket says 172.21.15.18:33090) 2024-04-21T22:35:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 -- 172.21.15.18:0/1441302444 learned_addr learned my addr 172.21.15.18:0/1441302444 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21c00640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 0x7f9f1c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f1be00640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c074410 0x7f9f1c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 -- 172.21.15.18:0/1441302444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c074410 msgr2=0x7f9f1c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c074410 0x7f9f1c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 -- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 msgr2=0x7f9f1c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 0x7f9f1c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.975+0000 7f9f21200640 1 -- 172.21.15.18:0/1441302444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c19f050 con 0x7f9f1c073af0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.976+0000 7f9f21200640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f100043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.976+0000 7f9f19600640 1 -- 172.21.15.18:0/1441302444 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10042020 con 0x7f9f1c073af0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.976+0000 7f9f19600640 1 -- 172.21.15.18:0/1441302444 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f10005000 con 0x7f9f1c073af0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.976+0000 7f9f19600640 1 -- 172.21.15.18:0/1441302444 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10003b00 con 0x7f9f1c073af0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.976+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c19f2e0 con 0x7f9f1c073af0 2024-04-21T22:35:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.977+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c101450 con 0x7f9f1c073af0 2024-04-21T22:35:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.980+0000 7f9f19600640 1 -- 172.21.15.18:0/1441302444 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7f9f10045020 con 0x7f9f1c073af0 2024-04-21T22:35:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.981+0000 7f9f19600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 0x7f9f040a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.981+0000 7f9f269e7740 1 Processor -- start 2024-04-21T22:35:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.981+0000 7f9f19600640 1 -- 172.21.15.18:0/1441302444 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9f100f13f0 con 0x7f9f1c073af0 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 -- start start 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f1be00640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 0x7f9f040a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b210a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2115860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616b206e3a0 con 0x5616b210a890 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5616b2016930 con 0x5616b2109f70 2024-04-21T22:35:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f269e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616b206a360 con 0x5616b2113470 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f21200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b210a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.982+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54214/0 (socket says 172.21.15.18:54214) 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 -- 172.21.15.18:0/3862086961 learned_addr learned my addr 172.21.15.18:0/3862086961 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f21c00640 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 -- 172.21.15.18:0/3862086961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 msgr2=0x5616b2115860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2115860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 -- 172.21.15.18:0/3862086961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 msgr2=0x5616b210a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b210a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f1be00640 1 -- 172.21.15.18:0/3862086961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b1d823f0 con 0x5616b210a890 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.983+0000 7f9f21c00640 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.984+0000 7f9f1be00640 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b750 tx=0x7f9f08027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed883e1764dbf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.984+0000 7f9f1be00640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 0x7f9f040a5370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009af0 tx=0x7f9f08009ef0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.984+0000 7f9f0e000640 1 -- 172.21.15.18:0/3862086961 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0801d050 con 0x5616b210a890 2024-04-21T22:35:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.984+0000 7f9f0e000640 1 -- 172.21.15.18:0/3862086961 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f0802a070 con 0x5616b210a890 2024-04-21T22:35:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.984+0000 7f9f0e000640 1 -- 172.21.15.18:0/3862086961 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08003920 con 0x5616b210a890 2024-04-21T22:35:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 -- 172.21.15.18:0/3862086961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 msgr2=0x5616b2112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b750 tx=0x7f9f08027000 comp rx=0 tx=0).stop 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 -- 172.21.15.18:0/3862086961 shutdown_connections 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2115860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2112f30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 --2- 172.21.15.18:0/3862086961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b210a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.985+0000 7f9f269e7740 1 -- 172.21.15.18:0/3862086961 >> 172.21.15.18:0/3862086961 conn(0x5616b21046a0 msgr2=0x5616b2104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.986+0000 7f9f269e7740 1 -- 172.21.15.18:0/3862086961 shutdown_connections 2024-04-21T22:35:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.986+0000 7f9f269e7740 1 -- 172.21.15.18:0/3862086961 wait complete. 2024-04-21T22:35:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.986+0000 7f9f269e7740 1 -- start start 2024-04-21T22:35:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.986+0000 7f9f269e7740 1 Processor -- start 2024-04-21T22:35:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2110ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2111010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5616b2116200 con 0x5616b210a890 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5616b2029d80 con 0x5616b2109f70 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616b2116380 con 0x5616b2113470 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.987+0000 7f9f269e7740 10 client.0 _ll_register_callbacks cb 0x5616b20662b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2110ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52114/0 (socket says 172.21.15.18:52114) 2024-04-21T22:35:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 -- 172.21.15.18:0/477609973 learned_addr learned my addr 172.21.15.18:0/477609973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21c00640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 -- 172.21.15.18:0/477609973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 msgr2=0x5616b2111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2111010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 -- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 msgr2=0x5616b2110ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2110ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 -- 172.21.15.18:0/477609973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b1e4c7d0 con 0x5616b2109f70 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21c00640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f1be00640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.988+0000 7f9f21200640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f100ba1b0 tx=0x7f9f10005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9debfeb76991f513 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f02a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f100d5070 con 0x5616b2109f70 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9f100051b0 con 0x5616b2109f70 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0802a070 con 0x5616b2109f70 2024-04-21T22:35:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f100bdee0 con 0x5616b2109f70 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f269e7740 10 client.25721 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616b2122590 con 0x5616b2109f70 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.989+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f0802a070 con 0x5616b2109f70 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9f10082ce0 con 0x5616b2109f70 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 10 client.25721 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 10 client.25721 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 20 client.25721 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b2123a40 0x5616b2125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 4 client.25721 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616b207b8e0 con 0x5616b2123a40 2024-04-21T22:35:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.990+0000 7f9f1be00640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b2123a40 0x5616b2125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.991+0000 7f9f1be00640 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b2123a40 0x5616b2125ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7df95114fe90f888 server_cookie=b1976365cda2b0d7 in_seq=0 out_seq=0 2024-04-21T22:35:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.991+0000 7f9f02a00640 10 client.25721 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.992+0000 7f9f02a00640 1 -- 172.21.15.18:0/477609973 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5616b207b8e0 con 0x5616b2123a40 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.992+0000 7f9f02a00640 10 client.25721 handle_command_reply: tid=0 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.992+0000 7f9f269e7740 1 client.25721 shutdown 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 msgr2=0x5616b2110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f100ba1b0 tx=0x7f9f10005e60 comp rx=0 tx=0).stop 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 shutdown_connections 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b2123a40 0x5616b2125ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2113470 0x5616b2111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b210a890 0x5616b2110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 --2- 172.21.15.18:0/477609973 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b2110590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 >> 172.21.15.18:0/477609973 conn(0x5616b21046a0 msgr2=0x5616b21063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:16.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f02a00640 0 client.25721 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:16.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 shutdown_connections 2024-04-21T22:35:16.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 1 -- 172.21.15.18:0/477609973 wait complete. 2024-04-21T22:35:16.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:16.993+0000 7f9f269e7740 20 client.25721 trim_cache size 0 max 16384 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.021+0000 7f9f269e7740 1 Processor -- start 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 -- start start 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 0x5616b211f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b2103510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ab050 con 0x5616b2113470 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1acb90 con 0x5616b210a890 2024-04-21T22:35:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f269e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ab720 con 0x5616b2109f70 2024-04-21T22:35:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.022+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52122/0 (socket says 172.21.15.18:52122) 2024-04-21T22:35:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f1be00640 1 -- 172.21.15.18:0/2096315343 learned_addr learned my addr 172.21.15.18:0/2096315343 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 0x5616b211f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21c00640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b2103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 -- 172.21.15.18:0/2096315343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 msgr2=0x5616b2110e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 -- 172.21.15.18:0/2096315343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 msgr2=0x5616b2103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b2103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 -- 172.21.15.18:0/2096315343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b2106990 con 0x5616b2109f70 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f1be00640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.023+0000 7f9f21200640 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 0x5616b211f0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f100c5f20 tx=0x7f9f100bbcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64054c679fdd332 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.024+0000 7f9f0d600640 1 -- 172.21.15.18:0/2096315343 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f100d5050 con 0x5616b2109f70 2024-04-21T22:35:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.024+0000 7f9f0d600640 1 -- 172.21.15.18:0/2096315343 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f100bd7e0 con 0x5616b2109f70 2024-04-21T22:35:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.024+0000 7f9f0d600640 1 -- 172.21.15.18:0/2096315343 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f100051b0 con 0x5616b2109f70 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 -- 172.21.15.18:0/2096315343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 msgr2=0x5616b211f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 0x5616b211f0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f100c5f20 tx=0x7f9f100bbcf0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 -- 172.21.15.18:0/2096315343 shutdown_connections 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b2103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b210a890 0x5616b2110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 --2- 172.21.15.18:0/2096315343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b2109f70 0x5616b211f0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 -- 172.21.15.18:0/2096315343 >> 172.21.15.18:0/2096315343 conn(0x5616b21046a0 msgr2=0x5616b2102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 -- 172.21.15.18:0/2096315343 shutdown_connections 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.025+0000 7f9f269e7740 1 -- 172.21.15.18:0/2096315343 wait complete. 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.026+0000 7f9f269e7740 1 -- start start 2024-04-21T22:35:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.026+0000 7f9f269e7740 1 Processor -- start 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b211bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b210d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1ac4c0 con 0x5616b2113470 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1abdf0 con 0x5616b2109f70 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1a9030 con 0x5616b210a890 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f269e7740 10 client.0 _ll_register_callbacks cb 0x7f9f100b9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f1be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33142/0 (socket says 172.21.15.18:33142) 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f1be00640 1 -- 172.21.15.18:0/4038706651 learned_addr learned my addr 172.21.15.18:0/4038706651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f21c00640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b210d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.027+0000 7f9f21200640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b211bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 -- 172.21.15.18:0/4038706651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 msgr2=0x5616b210d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 -- 172.21.15.18:0/4038706651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 msgr2=0x5616b211bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b211bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 -- 172.21.15.18:0/4038706651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b2188fe0 con 0x5616b2113470 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f1be00640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f21c00640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b210d760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5616b2105830 tx=0x7f9f14012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8f5d594836dce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.028+0000 7f9f02a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14022060 con 0x5616b2113470 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9f14003d80 con 0x5616b2113470 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f100bd7e0 con 0x5616b2113470 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f14011890 con 0x5616b2113470 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f269e7740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.029+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616b218a140 con 0x5616b2113470 2024-04-21T22:35:17.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f100bd7e0 con 0x5616b2113470 2024-04-21T22:35:17.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9f1401c030 con 0x5616b2113470 2024-04-21T22:35:17.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 10 client.15621 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 20 client.15621 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b218a920 0x5616b218cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 4 client.15621 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.030+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616b2075c30 con 0x5616b218a920 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.031+0000 7f9f21200640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b218a920 0x5616b218cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.032+0000 7f9f21200640 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b218a920 0x5616b218cd40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=714f9768fb7e3bd3 server_cookie=5714dda85976ac21 in_seq=0 out_seq=0 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.032+0000 7f9f02a00640 10 client.15621 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.032+0000 7f9f02a00640 1 -- 172.21.15.18:0/4038706651 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616b2075c30 con 0x5616b218a920 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.032+0000 7f9f02a00640 10 client.15621 handle_command_reply: tid=0 2024-04-21T22:35:17.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.032+0000 7f9f269e7740 1 client.15621 shutdown 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 msgr2=0x5616b210d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b210d760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5616b2105830 tx=0x7f9f14012d20 comp rx=0 tx=0).stop 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 shutdown_connections 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5616b218a920 0x5616b218cd40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f02a00640 0 client.15621 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:17.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5616b2113470 0x5616b210d760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616b210a890 0x5616b210d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 --2- 172.21.15.18:0/4038706651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5616b2109f70 0x5616b211bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 >> 172.21.15.18:0/4038706651 conn(0x5616b21046a0 msgr2=0x5616b2106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 shutdown_connections 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.034+0000 7f9f269e7740 1 -- 172.21.15.18:0/4038706651 wait complete. 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.035+0000 7f9f269e7740 20 client.15621 trim_cache size 0 max 16384 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:17.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.035+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 msgr2=0x7f9f040a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.035+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 0x7f9f040a5370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009af0 tx=0x7f9f08009ef0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.036+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 msgr2=0x7f9f1c19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.036+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f10000c00 tx=0x7f9f100043c0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 shutdown_connections 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9f040a2eb0 0x7f9f040a5370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f1c10de00 0x7f9f1c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f1c074410 0x7f9f1c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 --2- 172.21.15.18:0/1441302444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f1c073af0 0x7f9f1c19a0b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 >> 172.21.15.18:0/1441302444 conn(0x7f9f1c0fd090 msgr2=0x7f9f1c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 shutdown_connections 2024-04-21T22:35:17.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.038+0000 7f9f22600640 1 -- 172.21.15.18:0/1441302444 wait complete. 2024-04-21T22:35:17.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:35:17.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.301+0000 7ff4a7e00640 1 -- 172.21.15.18:0/139713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8103750 msgr2=0x7ff4a8103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.301+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/139713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8103750 0x7ff4a8103bd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff494009930 tx=0x7ff49402bc20 comp rx=0 tx=0).stop 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 -- 172.21.15.18:0/139713 shutdown_connections 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/139713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 0x7ff4a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/139713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8103750 0x7ff4a8103bd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/139713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8109760 0x7ff4a8109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 -- 172.21.15.18:0/139713 >> 172.21.15.18:0/139713 conn(0x7ff4a80ff220 msgr2=0x7ff4a8101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 -- 172.21.15.18:0/139713 shutdown_connections 2024-04-21T22:35:17.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.302+0000 7ff4a7e00640 1 -- 172.21.15.18:0/139713 wait complete. 2024-04-21T22:35:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.304+0000 7ff4a7e00640 1 Processor -- start 2024-04-21T22:35:17.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.304+0000 7ff4a7e00640 1 -- start start 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.304+0000 7ff4a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.304+0000 7ff4a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 0x7ff4a819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 0x7ff4a819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8113bc0 con 0x7ff4a8104110 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8113a40 con 0x7ff4a8103750 2024-04-21T22:35:17.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8113d40 con 0x7ff4a8109760 2024-04-21T22:35:17.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52136/0 (socket says 172.21.15.18:52136) 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a6a00640 1 -- 172.21.15.18:0/805669710 learned_addr learned my addr 172.21.15.18:0/805669710 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a6000640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 0x7ff4a819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a7400640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 0x7ff4a819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.305+0000 7ff4a6a00640 1 -- 172.21.15.18:0/805669710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 msgr2=0x7ff4a819e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 0x7ff4a819e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a6a00640 1 -- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 msgr2=0x7ff4a819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 0x7ff4a819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a6a00640 1 -- 172.21.15.18:0/805669710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a819f080 con 0x7ff4a8103750 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a7400640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 0x7ff4a819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff49800e9f0 tx=0x7ff49800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff49f400640 1 -- 172.21.15.18:0/805669710 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49800cd80 con 0x7ff4a8103750 2024-04-21T22:35:17.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff49f400640 1 -- 172.21.15.18:0/805669710 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff498010910 con 0x7ff4a8103750 2024-04-21T22:35:17.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff49f400640 1 -- 172.21.15.18:0/805669710 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498018990 con 0x7ff4a8103750 2024-04-21T22:35:17.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.306+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a819f370 con 0x7ff4a8103750 2024-04-21T22:35:17.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.307+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a81a6c00 con 0x7ff4a8103750 2024-04-21T22:35:17.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.311+0000 7ff4b057e740 1 Processor -- start 2024-04-21T22:35:17.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.311+0000 7ff4b057e740 1 -- start start 2024-04-21T22:35:17.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068064a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x56068065e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5606805ae3a0 con 0x560680649d80 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560680556930 con 0x56068064a730 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4b057e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5606805aa360 con 0x56068065bc80 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52150/0 (socket says 172.21.15.18:52150) 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3934633884 learned_addr learned my addr 172.21.15.18:0/3934633884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff49f400640 1 -- 172.21.15.18:0/805669710 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7ff498010ac0 con 0x7ff4a8103750 2024-04-21T22:35:17.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.312+0000 7ff4a7400640 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068064a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3934633884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 msgr2=0x56068065e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x56068065e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3934633884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 msgr2=0x56068064a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068064a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 -- 172.21.15.18:0/3934633884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606802c23f0 con 0x56068064a730 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a7400640 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068064a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.313+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4980cce00 tx=0x7ff4980d7670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e48b7330ec44da15 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.314+0000 7ff493e00640 1 -- 172.21.15.18:0/3934633884 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980de070 con 0x56068064a730 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.314+0000 7ff493e00640 1 -- 172.21.15.18:0/3934633884 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4980d5e50 con 0x56068064a730 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.314+0000 7ff493e00640 1 -- 172.21.15.18:0/3934633884 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980d9a00 con 0x56068064a730 2024-04-21T22:35:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.314+0000 7ff49f400640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 0x7ff48c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.314+0000 7ff49f400640 1 -- 172.21.15.18:0/805669710 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff4980cf9b0 con 0x7ff4a8103750 2024-04-21T22:35:17.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4a7400640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 0x7ff48c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 -- 172.21.15.18:0/3934633884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 msgr2=0x56068065b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4980cce00 tx=0x7ff4980d7670 comp rx=0 tx=0).stop 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 -- 172.21.15.18:0/3934633884 shutdown_connections 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x56068065e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065b740 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.315+0000 7ff4b057e740 1 --2- 172.21.15.18:0/3934633884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068064a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.316+0000 7ff4b057e740 1 -- 172.21.15.18:0/3934633884 >> 172.21.15.18:0/3934633884 conn(0x5606806446a0 msgr2=0x560680644a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.316+0000 7ff4a7400640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 0x7ff48c0a53f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0005fd0 tx=0x7ff4a0009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.316+0000 7ff4b057e740 1 -- 172.21.15.18:0/3934633884 shutdown_connections 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.316+0000 7ff4b057e740 1 -- 172.21.15.18:0/3934633884 wait complete. 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.316+0000 7ff4b057e740 1 -- start start 2024-04-21T22:35:17.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 Processor -- start 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 0x560680658d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x560680659260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56068065ea40 con 0x56068065bc80 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560680569d80 con 0x56068064a730 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.317+0000 7ff4b057e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56068065ebc0 con 0x560680649d80 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4b057e740 10 client.0 _ll_register_callbacks cb 0x5606805a62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x560680659260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54290/0 (socket says 172.21.15.18:54290) 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 -- 172.21.15.18:0/226952654 learned_addr learned my addr 172.21.15.18:0/226952654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 0x560680658d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 -- 172.21.15.18:0/226952654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 msgr2=0x560680658d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 0x560680658d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 -- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 msgr2=0x560680659260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x560680659260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a7400640 1 -- 172.21.15.18:0/226952654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56068038c7d0 con 0x56068065bc80 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.318+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 0x560680658d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.319+0000 7ff4a7400640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0010a80 tx=0x7ff4a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb41df615689e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.319+0000 7ff490c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.319+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a001ea50 con 0x56068065bc80 2024-04-21T22:35:17.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.319+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff4a001ebf0 con 0x56068065bc80 2024-04-21T22:35:17.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.319+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4980d5e50 con 0x56068065bc80 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.320+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a001edf0 con 0x56068065bc80 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.320+0000 7ff4b057e740 10 client.15633 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.320+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56068066ade0 con 0x56068065bc80 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.320+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4980d5e50 con 0x56068065bc80 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff4a00286d0 con 0x56068065bc80 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 10 client.15633 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 10 client.15633 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 20 client.15633 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56068066c2f0 0x56068066e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 4 client.15633 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.321+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606805bb8e0 con 0x56068066c2f0 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.322+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56068066c2f0 0x56068066e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.322+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56068066c2f0 0x56068066e700 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a5cbc8b934c4cb4 server_cookie=e54686c45d5cfdf8 in_seq=0 out_seq=0 2024-04-21T22:35:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.322+0000 7ff490c00640 10 client.15633 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.323+0000 7ff490c00640 1 -- 172.21.15.18:0/226952654 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5606805bb8e0 con 0x56068066c2f0 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.323+0000 7ff490c00640 10 client.15633 handle_command_reply: tid=0 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.323+0000 7ff4b057e740 1 client.15633 shutdown 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.323+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 msgr2=0x5606806597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.323+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0010a80 tx=0x7ff4a0004a40 comp rx=0 tx=0).stop 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 shutdown_connections 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56068066c2f0 0x56068066e700 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56068065bc80 0x5606806597a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x560680659260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 --2- 172.21.15.18:0/226952654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560680649d80 0x560680658d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 >> 172.21.15.18:0/226952654 conn(0x5606806446a0 msgr2=0x5606806463f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff490c00640 0 client.15633 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 shutdown_connections 2024-04-21T22:35:17.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 1 -- 172.21.15.18:0/226952654 wait complete. 2024-04-21T22:35:17.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.324+0000 7ff4b057e740 20 client.15633 trim_cache size 0 max 16384 2024-04-21T22:35:17.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:17 smithi018 ceph-mon[26614]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:35:17.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:17 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3382828779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:17.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 Processor -- start 2024-04-21T22:35:17.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 -- start start 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x560680667940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680673fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81ab2b0 con 0x560680649d80 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81acdf0 con 0x56068064a730 2024-04-21T22:35:17.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.352+0000 7ff4b057e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81ab980 con 0x56068065bc80 2024-04-21T22:35:17.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x560680667940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680673fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680673fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33190/0 (socket says 172.21.15.18:33190) 2024-04-21T22:35:17.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a7400640 1 -- 172.21.15.18:0/914438722 learned_addr learned my addr 172.21.15.18:0/914438722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6000640 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 -- 172.21.15.18:0/914438722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 msgr2=0x560680673fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680673fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 -- 172.21.15.18:0/914438722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 msgr2=0x56068065ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 -- 172.21.15.18:0/914438722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560680649060 con 0x560680649d80 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6000640 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.353+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x560680667940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff49800e9c0 tx=0x7ff498018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5baf64cb41760dc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.354+0000 7ff493400640 1 -- 172.21.15.18:0/914438722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980de070 con 0x560680649d80 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.354+0000 7ff493400640 1 -- 172.21.15.18:0/914438722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4980d5e50 con 0x560680649d80 2024-04-21T22:35:17.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.354+0000 7ff493400640 1 -- 172.21.15.18:0/914438722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980a0040 con 0x560680649d80 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 -- 172.21.15.18:0/914438722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 msgr2=0x560680667940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x560680667940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff49800e9c0 tx=0x7ff498018420 comp rx=0 tx=0).stop 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 -- 172.21.15.18:0/914438722 shutdown_connections 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680673fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 --2- 172.21.15.18:0/914438722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x560680667940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 -- 172.21.15.18:0/914438722 >> 172.21.15.18:0/914438722 conn(0x5606806446a0 msgr2=0x56068065a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 -- 172.21.15.18:0/914438722 shutdown_connections 2024-04-21T22:35:17.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.355+0000 7ff4b057e740 1 -- 172.21.15.18:0/914438722 wait complete. 2024-04-21T22:35:17.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.356+0000 7ff4b057e740 1 -- start start 2024-04-21T22:35:17.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.356+0000 7ff4b057e740 1 Processor -- start 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068065f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81ac720 con 0x560680649d80 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81ac050 con 0x56068064a730 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a81a92b0 con 0x56068065bc80 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4b057e740 10 client.0 _ll_register_callbacks cb 0x7ff4a0010940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33206/0 (socket says 172.21.15.18:33206) 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 -- 172.21.15.18:0/1306467210 learned_addr learned my addr 172.21.15.18:0/1306467210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068065f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a6000640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 -- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 msgr2=0x56068065ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 -- 172.21.15.18:0/1306467210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 msgr2=0x56068065f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.357+0000 7ff4a7400640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068065f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff4a7400640 1 -- 172.21.15.18:0/1306467210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606806d19a0 con 0x56068065bc80 2024-04-21T22:35:17.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff4a7400640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0028ce0 tx=0x7ff4a0010fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba590ed3705cb2a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff490c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a001e850 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff4a001e9f0 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.358+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4980d5e50 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4a001ec10 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 10 client.25762 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5606806d2c80 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4980d5e50 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff4a00056e0 con 0x56068065bc80 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 10 client.25762 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 10 client.25762 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:35:17.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 20 client.25762 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5606806d3370 0x5606806d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 4 client.25762 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:17.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.359+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606805b5c30 con 0x5606806d3370 2024-04-21T22:35:17.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5606806d3370 0x5606806d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff4a6a00640 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5606806d3370 0x5606806d5790 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=29fd09889f064953 server_cookie=24e28221121129ac in_seq=0 out_seq=0 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff490c00640 10 client.25762 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff490c00640 1 -- 172.21.15.18:0/1306467210 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606805b5c30 con 0x5606806d3370 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff490c00640 10 client.25762 handle_command_reply: tid=0 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.360+0000 7ff4b057e740 1 client.25762 shutdown 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 msgr2=0x560680660450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0028ce0 tx=0x7ff4a0010fd0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 shutdown_connections 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5606806d3370 0x5606806d5790 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56068065bc80 0x560680660450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56068064a730 0x56068065ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 --2- 172.21.15.18:0/1306467210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560680649d80 0x56068065f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 >> 172.21.15.18:0/1306467210 conn(0x5606806446a0 msgr2=0x560680643690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff490c00640 0 client.25762 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 shutdown_connections 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 1 -- 172.21.15.18:0/1306467210 wait complete. 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.361+0000 7ff4b057e740 20 client.25762 trim_cache size 0 max 16384 2024-04-21T22:35:17.363 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 msgr2=0x7ff48c0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 0x7ff48c0a53f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0005fd0 tx=0x7ff4a0009500 comp rx=0 tx=0).stop 2024-04-21T22:35:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 msgr2=0x7ff4a819a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff49800e9f0 tx=0x7ff49800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 shutdown_connections 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff48c0a2f30 0x7ff48c0a53f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a8109760 0x7ff4a819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a8104110 0x7ff4a819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 --2- 172.21.15.18:0/805669710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4a8103750 0x7ff4a819a0e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 >> 172.21.15.18:0/805669710 conn(0x7ff4a80ff220 msgr2=0x7ff4a80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 shutdown_connections 2024-04-21T22:35:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.362+0000 7ff4a7e00640 1 -- 172.21.15.18:0/805669710 wait complete. 2024-04-21T22:35:17.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 -- 172.21.15.18:0/3850804864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 msgr2=0x7f6f2010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3850804864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2010d8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 -- 172.21.15.18:0/3850804864 shutdown_connections 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3850804864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f201101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3850804864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2010d8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3850804864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f20073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 -- 172.21.15.18:0/3850804864 >> 172.21.15.18:0/3850804864 conn(0x7f6f200fd090 msgr2=0x7f6f200ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 -- 172.21.15.18:0/3850804864 shutdown_connections 2024-04-21T22:35:17.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.551+0000 7f6f1f200640 1 -- 172.21.15.18:0/3850804864 wait complete. 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 Processor -- start 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 -- start start 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f2019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20113b70 con 0x7f6f20073af0 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201139f0 con 0x7f6f20074410 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.552+0000 7f6f1f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20113cf0 con 0x7f6f2010de00 2024-04-21T22:35:17.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54328/0 (socket says 172.21.15.18:54328) 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52208/0 (socket says 172.21.15.18:52208) 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 -- 172.21.15.18:0/3663832898 learned_addr learned my addr 172.21.15.18:0/3663832898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f2019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 -- 172.21.15.18:0/3663832898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 msgr2=0x7f6f2019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f2019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 -- 172.21.15.18:0/3663832898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 msgr2=0x7f6f2019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1de00640 1 -- 172.21.15.18:0/3663832898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2019f050 con 0x7f6f20073af0 2024-04-21T22:35:17.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.553+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f2019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9f0 tx=0x7f6f1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f16a00640 1 -- 172.21.15.18:0/3663832898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000cd80 con 0x7f6f20073af0 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2019f340 con 0x7f6f20073af0 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f16a00640 1 -- 172.21.15.18:0/3663832898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f10010910 con 0x7f6f20073af0 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f16a00640 1 -- 172.21.15.18:0/3663832898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10018990 con 0x7f6f20073af0 2024-04-21T22:35:17.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.554+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201a6bd0 con 0x7f6f20073af0 2024-04-21T22:35:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 Processor -- start 2024-04-21T22:35:17.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 -- start start 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a30a0 0x55d2417ab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2416fe3a0 con 0x55d2417a2780 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d2416a6930 con 0x55d2417a30a0 2024-04-21T22:35:17.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.558+0000 7f6f275ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2416fa360 con 0x55d2417abc80 2024-04-21T22:35:17.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.559+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.559+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54342/0 (socket says 172.21.15.18:54342) 2024-04-21T22:35:17.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.559+0000 7f6f1e800640 1 -- 172.21.15.18:0/3715107047 learned_addr learned my addr 172.21.15.18:0/3715107047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.559+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.559+0000 7f6f16a00640 1 -- 172.21.15.18:0/3663832898 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7f6f10010ac0 con 0x7f6f20073af0 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 -- 172.21.15.18:0/3715107047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a30a0 msgr2=0x55d2417ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a30a0 0x55d2417ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 -- 172.21.15.18:0/3715107047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 msgr2=0x55d2417a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 -- 172.21.15.18:0/3715107047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2414123f0 con 0x55d2417abc80 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417ae070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02c200 tx=0x7f6f0c009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77cb4c4ea8d23ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f0b000640 1 -- 172.21.15.18:0/3715107047 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c043070 con 0x55d2417abc80 2024-04-21T22:35:17.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f0b000640 1 -- 172.21.15.18:0/3715107047 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f0c02c6e0 con 0x55d2417abc80 2024-04-21T22:35:17.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.560+0000 7f6f0b000640 1 -- 172.21.15.18:0/3715107047 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004a40 con 0x55d2417abc80 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 -- 172.21.15.18:0/3715107047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 msgr2=0x55d2417ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417ae070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02c200 tx=0x7f6f0c009560 comp rx=0 tx=0).stop 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 -- 172.21.15.18:0/3715107047 shutdown_connections 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417ae070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a30a0 0x55d2417ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3715107047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a2780 0x55d2417a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 -- 172.21.15.18:0/3715107047 >> 172.21.15.18:0/3715107047 conn(0x55d24179ceb0 msgr2=0x55d24179d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 -- 172.21.15.18:0/3715107047 shutdown_connections 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.561+0000 7f6f275ec740 1 -- 172.21.15.18:0/3715107047 wait complete. 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.562+0000 7f6f275ec740 1 -- start start 2024-04-21T22:35:17.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.562+0000 7f6f16a00640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 0x7f6f040a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.562+0000 7f6f16a00640 1 -- 172.21.15.18:0/3663832898 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6f100cfa50 con 0x7f6f20073af0 2024-04-21T22:35:17.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.562+0000 7f6f275ec740 1 Processor -- start 2024-04-21T22:35:17.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.562+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 0x7f6f040a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d2417aea10 con 0x55d2417a30a0 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d2416b9d80 con 0x55d2417a2780 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d2417aeb90 con 0x55d2417abc80 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f275ec740 10 client.0 _ll_register_callbacks cb 0x55d2416f62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54356/0 (socket says 172.21.15.18:54356) 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.563+0000 7f6f1d400640 1 -- 172.21.15.18:0/2609304663 learned_addr learned my addr 172.21.15.18:0/2609304663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 -- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 msgr2=0x55d2417a9770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a9770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 -- 172.21.15.18:0/2609304663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 msgr2=0x55d2417a8cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417a8cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 -- 172.21.15.18:0/2609304663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2414dc7d0 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1d400640 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02c8b0 tx=0x7f6f0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f4e9a0785c0363 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 0x7f6f040a5380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005bf0 tx=0x7f6f18009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.564+0000 7f6eff400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c04c070 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6f0c0050e0 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c02c6e0 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c043040 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6f275ec740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.565+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2417bacd0 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f0c02c6e0 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6f0c048c90 con 0x55d2417a30a0 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 10 client.15651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 20 client.15651 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d2417bc020 0x55d2417be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 4 client.15651 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.566+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d24170b8e0 con 0x55d2417bc020 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.567+0000 7f6f1de00640 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d2417bc020 0x55d2417be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.567+0000 7f6f1de00640 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d2417bc020 0x55d2417be410 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87875621ee34a264 server_cookie=a353a0638141fbfc in_seq=0 out_seq=0 2024-04-21T22:35:17.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.567+0000 7f6eff400640 10 client.15651 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:17.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6eff400640 1 -- 172.21.15.18:0/2609304663 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d24170b8e0 con 0x55d2417bc020 2024-04-21T22:35:17.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6eff400640 10 client.15651 handle_command_reply: tid=0 2024-04-21T22:35:17.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6f275ec740 1 client.15651 shutdown 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 msgr2=0x55d2417a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02c8b0 tx=0x7f6f0c0047c0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 shutdown_connections 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.568+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d2417bc020 0x55d2417be410 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417a9230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 --2- 172.21.15.18:0/2609304663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 >> 172.21.15.18:0/2609304663 conn(0x55d24179ceb0 msgr2=0x55d24179ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6eff400640 0 client.15651 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 shutdown_connections 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 1 -- 172.21.15.18:0/2609304663 wait complete. 2024-04-21T22:35:17.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.569+0000 7f6f275ec740 20 client.15651 trim_cache size 0 max 16384 2024-04-21T22:35:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.583+0000 7f6f275ec740 1 Processor -- start 2024-04-21T22:35:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 -- start start 2024-04-21T22:35:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417ab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201ab200 con 0x55d2417a30a0 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201acd40 con 0x55d2417a2780 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f275ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201ab8d0 con 0x55d2417abc80 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52232/0 (socket says 172.21.15.18:52232) 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f1de00640 1 -- 172.21.15.18:0/551984404 learned_addr learned my addr 172.21.15.18:0/551984404 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.584+0000 7f6f1e800640 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 -- 172.21.15.18:0/551984404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 msgr2=0x55d2417a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 -- 172.21.15.18:0/551984404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 msgr2=0x55d2417ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 -- 172.21.15.18:0/551984404 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2417a2ed0 con 0x55d2417a30a0 2024-04-21T22:35:17.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.585+0000 7f6f1d400640 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417b78d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84954202b4271a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f0a600640 1 -- 172.21.15.18:0/551984404 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c05e030 con 0x55d2417a30a0 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f0a600640 1 -- 172.21.15.18:0/551984404 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f0c02c6e0 con 0x55d2417a30a0 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f0a600640 1 -- 172.21.15.18:0/551984404 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c04c040 con 0x55d2417a30a0 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 -- 172.21.15.18:0/551984404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 msgr2=0x55d2417b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417b78d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c000bc0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 -- 172.21.15.18:0/551984404 shutdown_connections 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417abc80 0x55d2417a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417b78d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 --2- 172.21.15.18:0/551984404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417a2780 0x55d2417ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.586+0000 7f6f275ec740 1 -- 172.21.15.18:0/551984404 >> 172.21.15.18:0/551984404 conn(0x55d24179ceb0 msgr2=0x55d2417a8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.587+0000 7f6f275ec740 1 -- 172.21.15.18:0/551984404 shutdown_connections 2024-04-21T22:35:17.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.587+0000 7f6f275ec740 1 -- 172.21.15.18:0/551984404 wait complete. 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.587+0000 7f6f275ec740 1 -- start start 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.587+0000 7f6f275ec740 1 Processor -- start 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 0x55d2417af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201ac670 con 0x55d2417a30a0 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201abfa0 con 0x55d2417abc80 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201a9200 con 0x55d2417a2780 2024-04-21T22:35:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.588+0000 7f6f275ec740 10 client.0 _ll_register_callbacks cb 0x7f6f18009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33264/0 (socket says 172.21.15.18:33264) 2024-04-21T22:35:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 -- 172.21.15.18:0/3453549279 learned_addr learned my addr 172.21.15.18:0/3453549279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 0x55d2417af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 -- 172.21.15.18:0/3453549279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 msgr2=0x55d2417af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 0x55d2417af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 -- 172.21.15.18:0/3453549279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 msgr2=0x55d2417af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 -- 172.21.15.18:0/3453549279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2417afe20 con 0x55d2417a2780 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1e800640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 0x55d2417af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6f1de00640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f1009ba30 tx=0x7f6f10009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54fdecca81bc35f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6eff400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.589+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100b8070 con 0x55d2417a2780 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6f10018b30 con 0x55d2417a2780 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c02c6e0 con 0x55d2417a2780 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f100a00e0 con 0x55d2417a2780 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 10 client.25777 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d241821fd0 con 0x55d2417a2780 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f0c02c6e0 con 0x55d2417a2780 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f6f100ac050 con 0x55d2417a2780 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 10 client.25777 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 10 client.25777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 20 client.25777 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d241822720 0x55d241824b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 4 client.25777 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.590+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d241705c30 con 0x55d241822720 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.591+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d241822720 0x55d241824b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.591+0000 7f6f1d400640 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d241822720 0x55d241824b40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0af272533ad08b6 server_cookie=570e1823e06ec64d in_seq=0 out_seq=0 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.591+0000 7f6eff400640 10 client.25777 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6eff400640 1 -- 172.21.15.18:0/3453549279 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d241705c30 con 0x55d241822720 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6eff400640 10 client.25777 handle_command_reply: tid=0 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 client.25777 shutdown 2024-04-21T22:35:17.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 msgr2=0x55d2417b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f1009ba30 tx=0x7f6f10009700 comp rx=0 tx=0).stop 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 shutdown_connections 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d241822720 0x55d241824b40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d2417abc80 0x55d2417af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d2417a30a0 0x55d2417af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 --2- 172.21.15.18:0/3453549279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d2417a2780 0x55d2417b3ef0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 >> 172.21.15.18:0/3453549279 conn(0x55d24179ceb0 msgr2=0x55d241793690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6eff400640 0 client.25777 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 shutdown_connections 2024-04-21T22:35:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.592+0000 7f6f275ec740 1 -- 172.21.15.18:0/3453549279 wait complete. 2024-04-21T22:35:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f275ec740 20 client.25777 trim_cache size 0 max 16384 2024-04-21T22:35:17.596 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 msgr2=0x7f6f040a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 0x7f6f040a5380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005bf0 tx=0x7f6f18009500 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 msgr2=0x7f6f2019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9f0 tx=0x7f6f1000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 shutdown_connections 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.593+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6f040a2ec0 0x7f6f040a5380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f2010de00 0x7f6f2019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f20074410 0x7f6f2019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 --2- 172.21.15.18:0/3663832898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f20073af0 0x7f6f2019a0b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 >> 172.21.15.18:0/3663832898 conn(0x7f6f200fd090 msgr2=0x7f6f200fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 shutdown_connections 2024-04-21T22:35:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.594+0000 7f6f1f200640 1 -- 172.21.15.18:0/3663832898 wait complete. 2024-04-21T22:35:17.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:35:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:17 smithi081 ceph-mon[31692]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:35:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:17 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3382828779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:17.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:17 smithi047 ceph-mon[31561]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:35:17.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:17 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3382828779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 -- 172.21.15.18:0/3642439658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 msgr2=0x7fc4b8073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/3642439658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b8073ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009900 tx=0x7fc4a802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 -- 172.21.15.18:0/3642439658 shutdown_connections 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/3642439658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b810dfc0 0x7fc4b81103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/3642439658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b8074410 0x7fc4b810da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/3642439658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b8073ed0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 -- 172.21.15.18:0/3642439658 >> 172.21.15.18:0/3642439658 conn(0x7fc4b80fd1f0 msgr2=0x7fc4b80ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 -- 172.21.15.18:0/3642439658 shutdown_connections 2024-04-21T22:35:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.816+0000 7fc4bdc00640 1 -- 172.21.15.18:0/3642439658 wait complete. 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 Processor -- start 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 -- start start 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 0x7fc4b819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b810dfc0 0x7fc4b819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8113d00 con 0x7fc4b8074410 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8113b80 con 0x7fc4b8073af0 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.817+0000 7fc4bdc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8113e80 con 0x7fc4b810dfc0 2024-04-21T22:35:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52250/0 (socket says 172.21.15.18:52250) 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 -- 172.21.15.18:0/53637293 learned_addr learned my addr 172.21.15.18:0/53637293 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6000640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 0x7fc4b819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b7400640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b810dfc0 0x7fc4b819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 -- 172.21.15.18:0/53637293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b810dfc0 msgr2=0x7fc4b819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b810dfc0 0x7fc4b819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 -- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 msgr2=0x7fc4b819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 0x7fc4b819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6a00640 1 -- 172.21.15.18:0/53637293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b819f220 con 0x7fc4b8073af0 2024-04-21T22:35:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.818+0000 7fc4b6000640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 0x7fc4b819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000c00 tx=0x7fc4a80043c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4af400640 1 -- 172.21.15.18:0/53637293 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8042020 con 0x7fc4b8073af0 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b819f4b0 con 0x7fc4b8073af0 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4af400640 1 -- 172.21.15.18:0/53637293 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a80054e0 con 0x7fc4b8073af0 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4af400640 1 -- 172.21.15.18:0/53637293 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8003af0 con 0x7fc4b8073af0 2024-04-21T22:35:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.819+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b81a6da0 con 0x7fc4b8073af0 2024-04-21T22:35:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 Processor -- start 2024-04-21T22:35:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 -- start start 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4af400640 1 -- 172.21.15.18:0/53637293 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fc4a8045020 con 0x7fc4b8073af0 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da1192f3a0 con 0x55da119cb6a0 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55da118d7930 con 0x55da119cad80 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.824+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da1192b360 con 0x55da119d4280 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54410/0 (socket says 172.21.15.18:54410) 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b6a00640 1 -- 172.21.15.18:0/1579049226 learned_addr learned my addr 172.21.15.18:0/1579049226 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52254/0 (socket says 172.21.15.18:52254) 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.825+0000 7fc4b6000640 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 -- 172.21.15.18:0/1579049226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 msgr2=0x55da119d6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 -- 172.21.15.18:0/1579049226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 msgr2=0x55da119d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 -- 172.21.15.18:0/1579049226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da116433f0 con 0x55da119cad80 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4b7400640 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009e50 tx=0x7fc4b00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7523c4472a038b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.826+0000 7fc4af400640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 0x7fc49c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.827+0000 7fc4af400640 1 -- 172.21.15.18:0/53637293 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc4a80f14a0 con 0x7fc4b8073af0 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.827+0000 7fc4a3e00640 1 -- 172.21.15.18:0/1579049226 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0003b70 con 0x55da119cad80 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.827+0000 7fc4a3e00640 1 -- 172.21.15.18:0/1579049226 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0015070 con 0x55da119cad80 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.827+0000 7fc4a3e00640 1 -- 172.21.15.18:0/1579049226 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0011800 con 0x55da119cad80 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.827+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 0x7fc49c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 -- 172.21.15.18:0/1579049226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 msgr2=0x55da119cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009e50 tx=0x7fc4b00107a0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 -- 172.21.15.18:0/1579049226 shutdown_connections 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cb6a0 0x55da119d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/1579049226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cad80 0x55da119cb160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4c09b3740 1 -- 172.21.15.18:0/1579049226 >> 172.21.15.18:0/1579049226 conn(0x55da119c54b0 msgr2=0x55da119c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.828+0000 7fc4b6a00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 0x7fc49c0a5370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ba260 tx=0x7fc4a80f4f70 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.829+0000 7fc4c09b3740 1 -- 172.21.15.18:0/1579049226 shutdown_connections 2024-04-21T22:35:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.829+0000 7fc4c09b3740 1 -- 172.21.15.18:0/1579049226 wait complete. 2024-04-21T22:35:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.829+0000 7fc4c09b3740 1 -- start start 2024-04-21T22:35:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 Processor -- start 2024-04-21T22:35:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da119d7070 con 0x55da119cad80 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55da118ead80 con 0x55da119cb6a0 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da119d71f0 con 0x55da119d4280 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.830+0000 7fc4c09b3740 10 client.0 _ll_register_callbacks cb 0x55da119272b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54412/0 (socket says 172.21.15.18:54412) 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 -- 172.21.15.18:0/3950227473 learned_addr learned my addr 172.21.15.18:0/3950227473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b6000640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 -- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 msgr2=0x55da119d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 -- 172.21.15.18:0/3950227473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 msgr2=0x55da119d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b7400640 1 -- 172.21.15.18:0/3950227473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da1170d7d0 con 0x55da119cad80 2024-04-21T22:35:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.831+0000 7fc4b6000640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00114a0 tx=0x7fc4b0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f8196618b7e94a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0020070 con 0x55da119cad80 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc4b0003d80 con 0x55da119cad80 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4b0015070 con 0x55da119cad80 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4b0034050 con 0x55da119cad80 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4c09b3740 10 client.15669 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.832+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da119ebba0 con 0x55da119cad80 2024-04-21T22:35:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0015070 con 0x55da119cad80 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc4b00055c0 con 0x55da119cad80 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 10 client.15669 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 20 client.15669 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da119ecf50 0x55da119ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 4 client.15669 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da1193c8e0 con 0x55da119ecf50 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.833+0000 7fc4b6000640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da119ecf50 0x55da119ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.834+0000 7fc4b6000640 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da119ecf50 0x55da119ef340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77be67b98c1fab31 server_cookie=10b952e92aff8528 in_seq=0 out_seq=0 2024-04-21T22:35:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.834+0000 7fc4a0c00640 10 client.15669 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4a0c00640 1 -- 172.21.15.18:0/3950227473 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55da1193c8e0 con 0x55da119ecf50 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4a0c00640 10 client.15669 handle_command_reply: tid=0 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 client.15669 shutdown 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 msgr2=0x55da119d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00114a0 tx=0x7fc4b0009920 comp rx=0 tx=0).stop 2024-04-21T22:35:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 shutdown_connections 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da119ecf50 0x55da119ef340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3950227473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119d12c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 >> 172.21.15.18:0/3950227473 conn(0x55da119c54b0 msgr2=0x55da119c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4a0c00640 0 client.15669 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 shutdown_connections 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.835+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3950227473 wait complete. 2024-04-21T22:35:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.836+0000 7fc4c09b3740 20 client.15669 trim_cache size 0 max 16384 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 Processor -- start 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 -- start start 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119cad80 0x55da119d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b806f530 con 0x55da119d4280 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8071070 con 0x55da119cb6a0 2024-04-21T22:35:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.850+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b806fc00 con 0x55da119cad80 2024-04-21T22:35:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119cad80 0x55da119d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54428/0 (socket says 172.21.15.18:54428) 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 -- 172.21.15.18:0/3033477541 learned_addr learned my addr 172.21.15.18:0/3033477541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 -- 172.21.15.18:0/3033477541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119cad80 msgr2=0x55da119d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119cad80 0x55da119d39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 -- 172.21.15.18:0/3033477541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 msgr2=0x55da119c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b7400640 1 -- 172.21.15.18:0/3033477541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da119d0270 con 0x55da119d4280 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.851+0000 7fc4b6000640 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.852+0000 7fc4b7400640 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0011590 tx=0x7fc4b0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d864aa60904c0fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.852+0000 7fc4a3400640 1 -- 172.21.15.18:0/3033477541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0020070 con 0x55da119d4280 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.852+0000 7fc4a3400640 1 -- 172.21.15.18:0/3033477541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0015040 con 0x55da119d4280 2024-04-21T22:35:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.852+0000 7fc4a3400640 1 -- 172.21.15.18:0/3033477541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0027070 con 0x55da119d4280 2024-04-21T22:35:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3033477541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 msgr2=0x55da119f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0011590 tx=0x7fc4b0000f40 comp rx=0 tx=0).stop 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3033477541 shutdown_connections 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119d4280 0x55da119f49a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/3033477541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119cad80 0x55da119d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3033477541 >> 172.21.15.18:0/3033477541 conn(0x55da119c54b0 msgr2=0x55da119c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3033477541 shutdown_connections 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- 172.21.15.18:0/3033477541 wait complete. 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.853+0000 7fc4c09b3740 1 -- start start 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 Processor -- start 2024-04-21T22:35:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119e0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80709a0 con 0x55da119cad80 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80702d0 con 0x55da119cb6a0 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b806d510 con 0x55da119d4280 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.854+0000 7fc4c09b3740 10 client.0 _ll_register_callbacks cb 0x7fc4a80f4e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52286/0 (socket says 172.21.15.18:52286) 2024-04-21T22:35:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119e13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33324/0 (socket says 172.21.15.18:33324) 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 -- 172.21.15.18:0/4031306647 learned_addr learned my addr 172.21.15.18:0/4031306647 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b7400640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 -- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 msgr2=0x55da119e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 -- 172.21.15.18:0/4031306647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 msgr2=0x55da119e0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119e0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 -- 172.21.15.18:0/4031306647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da11a52410 con 0x55da119cb6a0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b7400640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119e0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4b6000640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400bba0 tx=0x7fc4a40039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab93ecec4b0d45f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.855+0000 7fc4a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a402e790 con 0x55da119cb6a0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc4a4005020 con 0x55da119cb6a0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4b0015040 con 0x55da119cb6a0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4a402e930 con 0x55da119cb6a0 2024-04-21T22:35:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4c09b3740 10 client.25775 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da11a53780 con 0x55da119cb6a0 2024-04-21T22:35:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.856+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0015040 con 0x55da119cb6a0 2024-04-21T22:35:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc4a401f040 con 0x55da119cb6a0 2024-04-21T22:35:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 10 client.25775 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 10 client.25775 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:35:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 20 client.25775 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da11a53ee0 0x55da11a56300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 4 client.25775 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da11936c30 con 0x55da11a53ee0 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.857+0000 7fc4b7400640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da11a53ee0 0x55da11a56300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4b7400640 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da11a53ee0 0x55da11a56300 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f822a239732b782 server_cookie=9259a7a22eb4bc7d in_seq=0 out_seq=0 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4a0c00640 10 client.25775 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4a0c00640 1 -- 172.21.15.18:0/4031306647 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da11936c30 con 0x55da11a53ee0 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4a0c00640 10 client.25775 handle_command_reply: tid=0 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 client.25775 shutdown 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 msgr2=0x55da119e0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400bba0 tx=0x7fc4a40039c0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 shutdown_connections 2024-04-21T22:35:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55da11a53ee0 0x55da11a56300 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da119d4280 0x55da119e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55da119cb6a0 0x55da119e0e80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 --2- 172.21.15.18:0/4031306647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da119cad80 0x55da119e0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4a0c00640 0 client.25775 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.858+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 >> 172.21.15.18:0/4031306647 conn(0x55da119c54b0 msgr2=0x55da119d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.859+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 shutdown_connections 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.859+0000 7fc4c09b3740 1 -- 172.21.15.18:0/4031306647 wait complete. 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.859+0000 7fc4c09b3740 20 client.25775 trim_cache size 0 max 16384 2024-04-21T22:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.860+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 msgr2=0x7fc49c0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.860+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 0x7fc49c0a5370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ba260 tx=0x7fc4a80f4f70 comp rx=0 tx=0).stop 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.860+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 msgr2=0x7fc4b819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.860+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000c00 tx=0x7fc4a80043c0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 shutdown_connections 2024-04-21T22:35:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc49c0a2eb0 0x7fc49c0a5370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4b810dfc0 0x7fc4b819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b8074410 0x7fc4b819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 --2- 172.21.15.18:0/53637293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4b8073af0 0x7fc4b819a280 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 >> 172.21.15.18:0/53637293 conn(0x7fc4b80fd1f0 msgr2=0x7fc4b80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 shutdown_connections 2024-04-21T22:35:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:17.861+0000 7fc4bdc00640 1 -- 172.21.15.18:0/53637293 wait complete. 2024-04-21T22:35:17.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:35:18.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 -- 172.21.15.18:0/3186887977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c074410 msgr2=0x7fbf7c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 --2- 172.21.15.18:0/3186887977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c074410 0x7fbf7c10d8c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009900 tx=0x7fbf6802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 -- 172.21.15.18:0/3186887977 shutdown_connections 2024-04-21T22:35:18.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 --2- 172.21.15.18:0/3186887977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c10de00 0x7fbf7c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 --2- 172.21.15.18:0/3186887977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c074410 0x7fbf7c10d8c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 --2- 172.21.15.18:0/3186887977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 0x7fbf7c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 -- 172.21.15.18:0/3186887977 >> 172.21.15.18:0/3186887977 conn(0x7fbf7c0fd090 msgr2=0x7fbf7c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 -- 172.21.15.18:0/3186887977 shutdown_connections 2024-04-21T22:35:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.056+0000 7fbf7be00640 1 -- 172.21.15.18:0/3186887977 wait complete. 2024-04-21T22:35:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 Processor -- start 2024-04-21T22:35:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 -- start start 2024-04-21T22:35:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 0x7fbf7c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c10de00 0x7fbf7c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.057+0000 7fbf7be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c113b70 con 0x7fbf7c074410 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1139f0 con 0x7fbf7c10de00 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c113cf0 con 0x7fbf7c073af0 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54462/0 (socket says 172.21.15.18:54462) 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 -- 172.21.15.18:0/2944898847 learned_addr learned my addr 172.21.15.18:0/2944898847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 0x7fbf7c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7b400640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c10de00 0x7fbf7c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 -- 172.21.15.18:0/2944898847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 msgr2=0x7fbf7c19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 0x7fbf7c19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 -- 172.21.15.18:0/2944898847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c10de00 msgr2=0x7fbf7c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c10de00 0x7fbf7c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.058+0000 7fbf7a000640 1 -- 172.21.15.18:0/2944898847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c19f040 con 0x7fbf7c074410 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.059+0000 7fbf7a000640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000c00 tx=0x7fbf68004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.059+0000 7fbf73400640 1 -- 172.21.15.18:0/2944898847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68042020 con 0x7fbf7c074410 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.059+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c19f2d0 con 0x7fbf7c074410 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.059+0000 7fbf73400640 1 -- 172.21.15.18:0/2944898847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf68005000 con 0x7fbf7c074410 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.059+0000 7fbf73400640 1 -- 172.21.15.18:0/2944898847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68003b20 con 0x7fbf7c074410 2024-04-21T22:35:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.060+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1a6bc0 con 0x7fbf7c074410 2024-04-21T22:35:18.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 Processor -- start 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 -- start start 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979223f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979226860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f97917f3a0 con 0x55f97921b890 2024-04-21T22:35:18.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f979127930 con 0x55f979224470 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.065+0000 7fbf8422f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f97917b360 con 0x55f97921af70 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33344/0 (socket says 172.21.15.18:33344) 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 -- 172.21.15.18:0/3524470300 learned_addr learned my addr 172.21.15.18:0/3524470300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979223f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 -- 172.21.15.18:0/3524470300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 msgr2=0x55f979226860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979226860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf73400640 1 -- 172.21.15.18:0/2944898847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fbf68045020 con 0x7fbf7c074410 2024-04-21T22:35:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 -- 172.21.15.18:0/3524470300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 msgr2=0x55f979223f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979223f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.066+0000 7fbf7b400640 1 -- 172.21.15.18:0/3524470300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f978e933f0 con 0x55f97921af70 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.067+0000 7fbf7b400640 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009f40 tx=0x7fbf74010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c32851560b5cd79 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.067+0000 7fbf67400640 1 -- 172.21.15.18:0/3524470300 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74003b70 con 0x55f97921af70 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.067+0000 7fbf67400640 1 -- 172.21.15.18:0/3524470300 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf74003d10 con 0x55f97921af70 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.067+0000 7fbf67400640 1 -- 172.21.15.18:0/3524470300 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74011af0 con 0x55f97921af70 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 -- 172.21.15.18:0/3524470300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 msgr2=0x55f97921b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009f40 tx=0x7fbf74010860 comp rx=0 tx=0).stop 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 -- 172.21.15.18:0/3524470300 shutdown_connections 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979226860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979223f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 --2- 172.21.15.18:0/3524470300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f97921b350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.068+0000 7fbf8422f740 1 -- 172.21.15.18:0/3524470300 >> 172.21.15.18:0/3524470300 conn(0x55f9792156a0 msgr2=0x55f979215a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.069+0000 7fbf73400640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 0x7fbf600a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.069+0000 7fbf8422f740 1 -- 172.21.15.18:0/3524470300 shutdown_connections 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.069+0000 7fbf8422f740 1 -- 172.21.15.18:0/3524470300 wait complete. 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.069+0000 7fbf73400640 1 -- 172.21.15.18:0/2944898847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbf680f0e50 con 0x7fbf7c074410 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.070+0000 7fbf8422f740 1 -- start start 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.069+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 0x7fbf600a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.070+0000 7fbf8422f740 1 Processor -- start 2024-04-21T22:35:18.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f9792214b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979221f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 0x7fbf600a5470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f97921aa40 tx=0x7fbf6c005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf7a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf7a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33356/0 (socket says 172.21.15.18:33356) 2024-04-21T22:35:18.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf7a000640 1 -- 172.21.15.18:0/711911125 learned_addr learned my addr 172.21.15.18:0/711911125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:18.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.071+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f9792214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7b400640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979221f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f979227260 con 0x55f97921af70 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f97913ad80 con 0x55f979224470 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f9792273e0 con 0x55f97921b890 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf8422f740 10 client.0 _ll_register_callbacks cb 0x55f9791772b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 -- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 msgr2=0x55f979221f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979221f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 -- 172.21.15.18:0/711911125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 msgr2=0x55f9792214b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f9792214b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f978f5d7d0 con 0x55f97921b890 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf74003d10 con 0x55f97921b890 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.072+0000 7fbf7a000640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf680b96a0 tx=0x7fbf68005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7759930956241fea server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf5be00640 10 client.25807 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf5be00640 1 -- 172.21.15.18:0/711911125 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680bd940 con 0x55f97921b890 2024-04-21T22:35:18.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf5be00640 1 -- 172.21.15.18:0/711911125 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbf68003cc0 con 0x55f97921b890 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf5be00640 1 -- 172.21.15.18:0/711911125 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf680bd240 con 0x55f97921b890 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf8422f740 10 client.25807 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.073+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f979227260 con 0x55f97921b890 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf5be00640 1 -- 172.21.15.18:0/711911125 <== mon.1 v2:172.21.15.81:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbf680dd0c0 con 0x55f97921b890 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 10 client.25807 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 10 client.25807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 20 client.25807 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f97923cff0 0x55f97923f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 4 client.25807 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f97918c8e0 con 0x55f97923cff0 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.074+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f97923cff0 0x55f97923f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.075+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f97923cff0 0x55f97923f3e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56284f418836cc68 server_cookie=ef384b1cf4b954e6 in_seq=0 out_seq=0 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.075+0000 7fbf5be00640 10 client.25807 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.076+0000 7fbf5be00640 1 -- 172.21.15.18:0/711911125 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f97918c8e0 con 0x55f97923cff0 2024-04-21T22:35:18.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.076+0000 7fbf5be00640 10 client.25807 handle_command_reply: tid=0 2024-04-21T22:35:18.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.079+0000 7fbf8422f740 1 client.25807 shutdown 2024-04-21T22:35:18.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 msgr2=0x55f9792219f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf680b96a0 tx=0x7fbf68005d50 comp rx=0 tx=0).stop 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 shutdown_connections 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f979221f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f97923cff0 0x55f97923f3e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921b890 0x55f9792219f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 --2- 172.21.15.18:0/711911125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f9792214b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 >> 172.21.15.18:0/711911125 conn(0x55f9792156a0 msgr2=0x55f9792173f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf5be00640 0 client.25807 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 shutdown_connections 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 1 -- 172.21.15.18:0/711911125 wait complete. 2024-04-21T22:35:18.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.080+0000 7fbf8422f740 20 client.25807 trim_cache size 0 max 16384 2024-04-21T22:35:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.108+0000 7fbf8422f740 1 Processor -- start 2024-04-21T22:35:18.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.108+0000 7fbf8422f740 1 -- start start 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f97921b890 0x55f979221d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 0x55f979244cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1ab110 con 0x55f97921af70 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1acc50 con 0x55f97921b890 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf8422f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1ab7e0 con 0x55f979224470 2024-04-21T22:35:18.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54492/0 (socket says 172.21.15.18:54492) 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf7aa00640 1 -- 172.21.15.18:0/1006403041 learned_addr learned my addr 172.21.15.18:0/1006403041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.109+0000 7fbf7b400640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 0x55f979244cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7a000640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f97921b890 0x55f979221d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 -- 172.21.15.18:0/1006403041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f97921b890 msgr2=0x55f979221d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f97921b890 0x55f979221d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 -- 172.21.15.18:0/1006403041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 msgr2=0x55f979230150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 -- 172.21.15.18:0/1006403041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97923f750 con 0x55f979224470 2024-04-21T22:35:18.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:18.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.110+0000 7fbf7b400640 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 0x55f979244cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400a010 tx=0x7fbf74003a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce0a1f0e3cd487e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.111+0000 7fbf66a00640 1 -- 172.21.15.18:0/1006403041 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74029070 con 0x55f979224470 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.111+0000 7fbf66a00640 1 -- 172.21.15.18:0/1006403041 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf74009ae0 con 0x55f979224470 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.111+0000 7fbf66a00640 1 -- 172.21.15.18:0/1006403041 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf740055a0 con 0x55f979224470 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 -- 172.21.15.18:0/1006403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 msgr2=0x55f979244cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 0x55f979244cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400a010 tx=0x7fbf74003a20 comp rx=0 tx=0).stop 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 -- 172.21.15.18:0/1006403041 shutdown_connections 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f979224470 0x55f979244cb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f97921b890 0x55f979221d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 --2- 172.21.15.18:0/1006403041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921af70 0x55f979230150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 -- 172.21.15.18:0/1006403041 >> 172.21.15.18:0/1006403041 conn(0x55f9792156a0 msgr2=0x55f979217360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 -- 172.21.15.18:0/1006403041 shutdown_connections 2024-04-21T22:35:18.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.112+0000 7fbf8422f740 1 -- 172.21.15.18:0/1006403041 wait complete. 2024-04-21T22:35:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.113+0000 7fbf8422f740 1 -- start start 2024-04-21T22:35:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.113+0000 7fbf8422f740 1 Processor -- start 2024-04-21T22:35:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.113+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.113+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979229100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf8422f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f97929b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf8422f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1ac580 con 0x55f97921b890 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf8422f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1abeb0 con 0x55f979224470 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf8422f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1a90f0 con 0x55f97921af70 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf8422f740 10 client.0 _ll_register_callbacks cb 0x7fbf680b95b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:18.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33362/0 (socket says 172.21.15.18:33362) 2024-04-21T22:35:18.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 -- 172.21.15.18:0/493914905 learned_addr learned my addr 172.21.15.18:0/493914905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:18.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7b400640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f97929b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7a000640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979229100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 -- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 msgr2=0x55f97929b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f97929b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 -- 172.21.15.18:0/493914905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 msgr2=0x55f979229100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979229100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7aa00640 1 -- 172.21.15.18:0/493914905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97921b6c0 con 0x55f97921af70 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.114+0000 7fbf7a000640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979229100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.115+0000 7fbf7aa00640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c004410 tx=0x7fbf6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3356c80e3f75f7a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.115+0000 7fbf5be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:18.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.115+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003ab0 con 0x55f97921af70 2024-04-21T22:35:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.115+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf74009ae0 con 0x55f97921af70 2024-04-21T22:35:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.115+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbf6c003c50 con 0x55f97921af70 2024-04-21T22:35:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.116+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf6c003e50 con 0x55f97921af70 2024-04-21T22:35:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.116+0000 7fbf8422f740 10 client.25813 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:18.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.116+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9792a3f70 con 0x55f97921af70 2024-04-21T22:35:18.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.116+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf74009ae0 con 0x55f97921af70 2024-04-21T22:35:18.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbf6c02b380 con 0x55f97921af70 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 10 client.25813 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 10 client.25813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 20 client.25813 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f9792a45f0 0x55f9792a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 4 client.25813 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.117+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f979186c30 con 0x55f9792a45f0 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.118+0000 7fbf7a000640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f9792a45f0 0x55f9792a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.118+0000 7fbf7a000640 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f9792a45f0 0x55f9792a69e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917c26ac15af927e server_cookie=339ddc1cb3452fa1 in_seq=0 out_seq=0 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.118+0000 7fbf5be00640 10 client.25813 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf5be00640 1 -- 172.21.15.18:0/493914905 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f979186c30 con 0x55f9792a45f0 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf5be00640 10 client.25813 handle_command_reply: tid=0 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 client.25813 shutdown 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 msgr2=0x55f979228bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c004410 tx=0x7fbf6c0046c0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 shutdown_connections 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f979224470 0x55f97929b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f97921b890 0x55f979229100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f9792a45f0 0x55f9792a69e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 --2- 172.21.15.18:0/493914905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f97921af70 0x55f979228bc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 >> 172.21.15.18:0/493914905 conn(0x55f9792156a0 msgr2=0x55f979213e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf5be00640 0 client.25813 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 shutdown_connections 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.119+0000 7fbf8422f740 1 -- 172.21.15.18:0/493914905 wait complete. 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.120+0000 7fbf8422f740 20 client.25813 trim_cache size 0 max 16384 2024-04-21T22:35:18.121 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.120+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 msgr2=0x7fbf600a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.120+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 0x7fbf600a5470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55f97921aa40 tx=0x7fbf6c005f90 comp rx=0 tx=0).stop 2024-04-21T22:35:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.120+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 msgr2=0x7fbf7c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.120+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000c00 tx=0x7fbf68004360 comp rx=0 tx=0).stop 2024-04-21T22:35:18.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 shutdown_connections 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbf600a2fb0 0x7fbf600a5470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf7c10de00 0x7fbf7c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf7c074410 0x7fbf7c19a590 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 --2- 172.21.15.18:0/2944898847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf7c073af0 0x7fbf7c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 >> 172.21.15.18:0/2944898847 conn(0x7fbf7c0fd090 msgr2=0x7fbf7c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 shutdown_connections 2024-04-21T22:35:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:18.121+0000 7fbf7be00640 1 -- 172.21.15.18:0/2944898847 wait complete. 2024-04-21T22:35:19.146 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:35:19.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:35:19.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:35:19.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 -- 172.21.15.18:0/3537193719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf81125b0 msgr2=0x7fadf81149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 --2- 172.21.15.18:0/3537193719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf81125b0 0x7fadf81149a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009cd0 tx=0x7fadf002c0f0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 -- 172.21.15.18:0/3537193719 shutdown_connections 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 --2- 172.21.15.18:0/3537193719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf81125b0 0x7fadf81149a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 --2- 172.21.15.18:0/3537193719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf8076590 0x7fadf8112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 --2- 172.21.15.18:0/3537193719 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8075c70 0x7fadf8076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 -- 172.21.15.18:0/3537193719 >> 172.21.15.18:0/3537193719 conn(0x7fadf80ff3c0 msgr2=0x7fadf81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 -- 172.21.15.18:0/3537193719 shutdown_connections 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.331+0000 7fadffa00640 1 -- 172.21.15.18:0/3537193719 wait complete. 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 Processor -- start 2024-04-21T22:35:19.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 -- start start 2024-04-21T22:35:19.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8076590 0x7fadf819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf81125b0 0x7fadf81a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81180d0 con 0x7fadf81125b0 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8117f50 con 0x7fadf8076590 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.333+0000 7fadffa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8118250 con 0x7fadf8075c70 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf81125b0 0x7fadf81a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8076590 0x7fadf819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33374/0 (socket says 172.21.15.18:33374) 2024-04-21T22:35:19.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 -- 172.21.15.18:0/3860686636 learned_addr learned my addr 172.21.15.18:0/3860686636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 -- 172.21.15.18:0/3860686636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8076590 msgr2=0x7fadf819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8076590 0x7fadf819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 -- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf81125b0 msgr2=0x7fadf81a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf81125b0 0x7fadf81a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.334+0000 7fadfd000640 1 -- 172.21.15.18:0/3860686636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf81a3600 con 0x7fadf8075c70 2024-04-21T22:35:19.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadfd000640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d950 tx=0x7fadec00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadf5600640 1 -- 172.21.15.18:0/3860686636 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec017030 con 0x7fadf8075c70 2024-04-21T22:35:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadf5600640 1 -- 172.21.15.18:0/3860686636 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadec004020 con 0x7fadf8075c70 2024-04-21T22:35:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadf5600640 1 -- 172.21.15.18:0/3860686636 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec003d60 con 0x7fadf8075c70 2024-04-21T22:35:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81a38f0 con 0x7fadf8075c70 2024-04-21T22:35:19.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.335+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81ab180 con 0x7fadf8075c70 2024-04-21T22:35:19.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.339+0000 7fadf5600640 1 -- 172.21.15.18:0/3860686636 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fadec01a070 con 0x7fadf8075c70 2024-04-21T22:35:19.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 Processor -- start 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 -- start start 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209315b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209321010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x565209273df0 con 0x56520931ec20 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565209279040 con 0x565209315720 2024-04-21T22:35:19.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.340+0000 7fae0267e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5652092218c0 con 0x565209316040 2024-04-21T22:35:19.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209321010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33380/0 (socket says 172.21.15.18:33380) 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 -- 172.21.15.18:0/3194453971 learned_addr learned my addr 172.21.15.18:0/3194453971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 -- 172.21.15.18:0/3194453971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 msgr2=0x565209315b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209315b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 -- 172.21.15.18:0/3194453971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 msgr2=0x565209321010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209321010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadfd000640 1 -- 172.21.15.18:0/3194453971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652090557e0 con 0x565209316040 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.341+0000 7fadf5600640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 0x7fade00a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.342+0000 7fadfd000640 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fadec0cc610 tx=0x7fadec0d7910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74dd509688380f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.342+0000 7fadfda00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 0x7fade00a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.342+0000 7fadea000640 1 -- 172.21.15.18:0/3194453971 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0e2070 con 0x565209316040 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.342+0000 7fadea000640 1 -- 172.21.15.18:0/3194453971 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadec0bcd90 con 0x565209316040 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.342+0000 7fadea000640 1 -- 172.21.15.18:0/3194453971 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0bb4e0 con 0x565209316040 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fadf5600640 1 -- 172.21.15.18:0/3860686636 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fadec0cf190 con 0x7fadf8075c70 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 -- 172.21.15.18:0/3194453971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 msgr2=0x56520931e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fadec0cc610 tx=0x7fadec0d7910 comp rx=0 tx=0).stop 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 -- 172.21.15.18:0/3194453971 shutdown_connections 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209321010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931e6e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 --2- 172.21.15.18:0/3194453971 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209315b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 -- 172.21.15.18:0/3194453971 >> 172.21.15.18:0/3194453971 conn(0x56520930fe50 msgr2=0x565209310230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fadfda00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 0x7fade00a53f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009bf0 tx=0x7fadf0005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 -- 172.21.15.18:0/3194453971 shutdown_connections 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.343+0000 7fae0267e740 1 -- 172.21.15.18:0/3194453971 wait complete. 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.344+0000 7fae0267e740 1 -- start start 2024-04-21T22:35:19.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.344+0000 7fae0267e740 1 Processor -- start 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520931c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x565209234d20 con 0x565209315720 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x565209275000 con 0x56520931ec20 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x565209321890 con 0x565209316040 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fae0267e740 10 client.0 _ll_register_callbacks cb 0x5652092700a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33382/0 (socket says 172.21.15.18:33382) 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fadf7e00640 1 -- 172.21.15.18:0/1514880231 learned_addr learned my addr 172.21.15.18:0/1514880231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fadfd000640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.345+0000 7fadfda00640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520931c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 -- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 msgr2=0x56520931c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520931c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 -- 172.21.15.18:0/1514880231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 msgr2=0x56520931bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 -- 172.21.15.18:0/1514880231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652090b5f70 con 0x565209316040 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadfd000640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fade400bf30 tx=0x7fade40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343bf2524654fc3a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7faddea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.346+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4004020 con 0x565209316040 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadec0bcd90 con 0x565209316040 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fade40041c0 con 0x565209316040 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fade40043c0 con 0x565209316040 2024-04-21T22:35:19.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7fae0267e740 10 client.25825 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565208f4d170 con 0x565209316040 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadec0bcd90 con 0x565209316040 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.347+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fade4003ab0 con 0x565209316040 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 10 client.25825 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 20 client.25825 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56520932ed30 0x5652093311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 4 client.25825 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565209286580 con 0x56520932ed30 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fadfd000640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56520932ed30 0x5652093311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7fadfd000640 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56520932ed30 0x5652093311a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb5ed432502eec6 server_cookie=112633e8819b4df3 in_seq=0 out_seq=0 2024-04-21T22:35:19.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.348+0000 7faddea00640 10 client.25825 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.349+0000 7faddea00640 1 -- 172.21.15.18:0/1514880231 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x565209286580 con 0x56520932ed30 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.349+0000 7faddea00640 10 client.25825 handle_command_reply: tid=0 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.349+0000 7fae0267e740 1 client.25825 shutdown 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.349+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 msgr2=0x56520931c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.349+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fade400bf30 tx=0x7fade40118d0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 shutdown_connections 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520931c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56520932ed30 0x5652093311a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520931c1d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 --2- 172.21.15.18:0/1514880231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 >> 172.21.15.18:0/1514880231 conn(0x56520930fe50 msgr2=0x565209311ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7faddea00640 0 client.25825 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 shutdown_connections 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 1 -- 172.21.15.18:0/1514880231 wait complete. 2024-04-21T22:35:19.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.350+0000 7fae0267e740 20 client.25825 trim_cache size 0 max 16384 2024-04-21T22:35:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.369+0000 7fae0267e740 1 Processor -- start 2024-04-21T22:35:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.369+0000 7fae0267e740 1 -- start start 2024-04-21T22:35:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.369+0000 7fae0267e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fae0267e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fae0267e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520930ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fae0267e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b3c70 con 0x565209315720 2024-04-21T22:35:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fae0267e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b57b0 con 0x56520931ec20 2024-04-21T22:35:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fae0267e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b4340 con 0x565209316040 2024-04-21T22:35:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadfd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33384/0 (socket says 172.21.15.18:33384) 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadf7e00640 1 -- 172.21.15.18:0/1546151331 learned_addr learned my addr 172.21.15.18:0/1546151331 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadfda00640 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520930ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadf7e00640 1 -- 172.21.15.18:0/1546151331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 msgr2=0x56520930ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.370+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520930ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fadf7e00640 1 -- 172.21.15.18:0/1546151331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 msgr2=0x56520931e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fadf7e00640 1 -- 172.21.15.18:0/1546151331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520931a1e0 con 0x565209316040 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fadfd000640 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fadf7e00640 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fade4003f20 tx=0x7fade4005b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36955553b1d56192 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fade9600640 1 -- 172.21.15.18:0/1546151331 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4003ff0 con 0x565209316040 2024-04-21T22:35:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fade9600640 1 -- 172.21.15.18:0/1546151331 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade4004190 con 0x565209316040 2024-04-21T22:35:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.371+0000 7fade9600640 1 -- 172.21.15.18:0/1546151331 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4003aa0 con 0x565209316040 2024-04-21T22:35:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 -- 172.21.15.18:0/1546151331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 msgr2=0x56520932a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fade4003f20 tx=0x7fade4005b90 comp rx=0 tx=0).stop 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 -- 172.21.15.18:0/1546151331 shutdown_connections 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56520931ec20 0x56520930ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x56520932a620 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 --2- 172.21.15.18:0/1546151331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565209315720 0x56520931e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 -- 172.21.15.18:0/1546151331 >> 172.21.15.18:0/1546151331 conn(0x56520930fe50 msgr2=0x56520930e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 -- 172.21.15.18:0/1546151331 shutdown_connections 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.372+0000 7fae0267e740 1 -- 172.21.15.18:0/1546151331 wait complete. 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 -- start start 2024-04-21T22:35:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 Processor -- start 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x5652093231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209323730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b50e0 con 0x56520931ec20 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b4a10 con 0x565209315720 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.373+0000 7fae0267e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b1c50 con 0x565209316040 2024-04-21T22:35:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fae0267e740 10 client.0 _ll_register_callbacks cb 0x7fade400bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52376/0 (socket says 172.21.15.18:52376) 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 -- 172.21.15.18:0/763899663 learned_addr learned my addr 172.21.15.18:0/763899663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadf7e00640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x5652093231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfda00640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209323730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 -- 172.21.15.18:0/763899663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 msgr2=0x5652093231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x5652093231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 -- 172.21.15.18:0/763899663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 msgr2=0x565209323730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209323730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.374+0000 7fadfd000640 1 -- 172.21.15.18:0/763899663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565209323ee0 con 0x565209315720 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7fadfd000640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fadec097150 tx=0x7fadec0035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3c7caae94aea5d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7faddea00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec09b240 con 0x565209315720 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fadec0041d0 con 0x565209315720 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade4004190 con 0x565209315720 2024-04-21T22:35:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadec09afb0 con 0x565209315720 2024-04-21T22:35:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7fae0267e740 10 client.25805 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.375+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652093962f0 con 0x565209315720 2024-04-21T22:35:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade4004190 con 0x565209315720 2024-04-21T22:35:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fadec024060 con 0x565209315720 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 10 client.25805 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 20 client.25805 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5652093965d0 0x5652093989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 4 client.25805 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5652092808d0 con 0x5652093965d0 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.376+0000 7fadf7e00640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5652093965d0 0x5652093989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.377+0000 7fadf7e00640 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5652093965d0 0x5652093989c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ebc43d3d94a4f0 server_cookie=3cc6cf34cd80c5f6 in_seq=0 out_seq=0 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.377+0000 7faddea00640 10 client.25805 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.378+0000 7faddea00640 1 -- 172.21.15.18:0/763899663 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5652092808d0 con 0x5652093965d0 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.378+0000 7faddea00640 10 client.25805 handle_command_reply: tid=0 2024-04-21T22:35:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.378+0000 7fae0267e740 1 client.25805 shutdown 2024-04-21T22:35:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.378+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 msgr2=0x565209326e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.378+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fadec097150 tx=0x7fadec0035f0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 shutdown_connections 2024-04-21T22:35:19.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56520931ec20 0x565209323730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5652093965d0 0x5652093989c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565209316040 0x5652093231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 --2- 172.21.15.18:0/763899663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x565209315720 0x565209326e70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7faddea00640 0 client.25805 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 >> 172.21.15.18:0/763899663 conn(0x56520930fe50 msgr2=0x56520930eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 shutdown_connections 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 1 -- 172.21.15.18:0/763899663 wait complete. 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.379+0000 7fae0267e740 20 client.25805 trim_cache size 0 max 16384 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:35:19.380 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "e8d40e78-18ae-4df8-93e2-7937c8d2f357", 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 msgr2=0x7fade00a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 0x7fade00a53f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009bf0 tx=0x7fadf0005d80 comp rx=0 tx=0).stop 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 msgr2=0x7fadf819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d950 tx=0x7fadec00de10 comp rx=0 tx=0).stop 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 shutdown_connections 2024-04-21T22:35:19.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fade00a2f30 0x7fade00a53f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadf81125b0 0x7fadf81a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadf8076590 0x7fadf819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 --2- 172.21.15.18:0/3860686636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf8075c70 0x7fadf819e610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 >> 172.21.15.18:0/3860686636 conn(0x7fadf80ff3c0 msgr2=0x7fadf8113ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 shutdown_connections 2024-04-21T22:35:19.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.380+0000 7fadffa00640 1 -- 172.21.15.18:0/3860686636 wait complete. 2024-04-21T22:35:19.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:35:19.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:35:19.466 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:19 smithi018 ceph-mon[26614]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:35:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:19 smithi081 ceph-mon[31692]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:35:19.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 -- 172.21.15.18:0/2330516255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 msgr2=0x7fb808109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 --2- 172.21.15.18:0/2330516255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb808109b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009900 tx=0x7fb7f802bc30 comp rx=0 tx=0).stop 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 -- 172.21.15.18:0/2330516255 shutdown_connections 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 --2- 172.21.15.18:0/2330516255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 0x7fb808110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 --2- 172.21.15.18:0/2330516255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb808103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 --2- 172.21.15.18:0/2330516255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb808109b40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.650+0000 7fb80ca00640 1 -- 172.21.15.18:0/2330516255 >> 172.21.15.18:0/2330516255 conn(0x7fb8080ff220 msgr2=0x7fb808101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.651+0000 7fb80ca00640 1 -- 172.21.15.18:0/2330516255 shutdown_connections 2024-04-21T22:35:19.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.651+0000 7fb80ca00640 1 -- 172.21.15.18:0/2330516255 wait complete. 2024-04-21T22:35:19.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.652+0000 7fb80ca00640 1 Processor -- start 2024-04-21T22:35:19.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.652+0000 7fb80ca00640 1 -- start start 2024-04-21T22:35:19.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 0x7fb80819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb80819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb808113b30 con 0x7fb808104110 2024-04-21T22:35:19.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8081139b0 con 0x7fb808109760 2024-04-21T22:35:19.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb80ca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb808113cb0 con 0x7fb808103750 2024-04-21T22:35:19.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb806800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb806800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33408/0 (socket says 172.21.15.18:33408) 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb806800640 1 -- 172.21.15.18:0/968085559 learned_addr learned my addr 172.21.15.18:0/968085559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb807200640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb80819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.653+0000 7fb805e00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 0x7fb80819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 -- 172.21.15.18:0/968085559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 msgr2=0x7fb80819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb80819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 -- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 msgr2=0x7fb80819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 0x7fb80819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 -- 172.21.15.18:0/968085559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80819f000 con 0x7fb808103750 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb807200640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb80819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb806800640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8005940 tx=0x7fb7f8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb7ff400640 1 -- 172.21.15.18:0/968085559 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8041070 con 0x7fb808103750 2024-04-21T22:35:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.654+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80819f290 con 0x7fb808103750 2024-04-21T22:35:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.655+0000 7fb7ff400640 1 -- 172.21.15.18:0/968085559 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f80054e0 con 0x7fb808103750 2024-04-21T22:35:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.655+0000 7fb7ff400640 1 -- 172.21.15.18:0/968085559 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8003d00 con 0x7fb808103750 2024-04-21T22:35:19.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.655+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8081a6b80 con 0x7fb808103750 2024-04-21T22:35:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.660+0000 7fb7ff400640 1 -- 172.21.15.18:0/968085559 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 138117+0+0 (secure 0 0 0) 0x7fb7f8044070 con 0x7fb808103750 2024-04-21T22:35:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.660+0000 7fb810051740 1 Processor -- start 2024-04-21T22:35:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.660+0000 7fb810051740 1 -- start start 2024-04-21T22:35:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.660+0000 7fb810051740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d0463cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb810051740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04656a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb806800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04656a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb807200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d0463cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb806800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04656a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52402/0 (socket says 172.21.15.18:52402) 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb806800640 1 -- 172.21.15.18:0/4269750631 learned_addr learned my addr 172.21.15.18:0/4269750631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb810051740 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.661+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d045a0410 con 0x562d0463c7a0 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d045487e0 con 0x562d0463d0c0 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d0459c3d0 con 0x562d04656fc0 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb7ff400640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 0x7fb7ec0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 -- 172.21.15.18:0/4269750631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 msgr2=0x562d04656a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04656a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 -- 172.21.15.18:0/4269750631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 msgr2=0x562d0463cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d0463cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb805e00640 1 -- 172.21.15.18:0/4269750631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0437e7d0 con 0x562d04656fc0 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb807200640 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d0463cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:19.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.662+0000 7fb7ff400640 1 -- 172.21.15.18:0/968085559 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7f80f0c70 con 0x7fb808103750 2024-04-21T22:35:19.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.663+0000 7fb805e00640 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046593b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009b40 tx=0x7fb7f40113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4080929af030b8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.663+0000 7fb807200640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 0x7fb7ec0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.663+0000 7fb7f3400640 1 -- 172.21.15.18:0/4269750631 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011e10 con 0x562d04656fc0 2024-04-21T22:35:19.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.663+0000 7fb7f3400640 1 -- 172.21.15.18:0/4269750631 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4012930 con 0x562d04656fc0 2024-04-21T22:35:19.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.663+0000 7fb7f3400640 1 -- 172.21.15.18:0/4269750631 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400fa50 con 0x562d04656fc0 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 msgr2=0x562d046593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb807200640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 0x7fb7ec0a53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb800005fd0 tx=0x7fb800004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046593b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009b40 tx=0x7fb7f40113e0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 shutdown_connections 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046593b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04656a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 --2- 172.21.15.18:0/4269750631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d0463cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.664+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 >> 172.21.15.18:0/4269750631 conn(0x562d046371e0 msgr2=0x562d046375c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.665+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 shutdown_connections 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.665+0000 7fb810051740 1 -- 172.21.15.18:0/4269750631 wait complete. 2024-04-21T22:35:19.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.665+0000 7fb810051740 1 -- start start 2024-04-21T22:35:19.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 Processor -- start 2024-04-21T22:35:19.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 0x562d04654450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04654990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d04659db0 con 0x562d0463d0c0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d0455bc40 con 0x562d04656fc0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d04659f30 con 0x562d0463c7a0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.666+0000 7fb810051740 10 client.0 _ll_register_callbacks cb 0x562d0455b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33432/0 (socket says 172.21.15.18:33432) 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 -- 172.21.15.18:0/299608917 learned_addr learned my addr 172.21.15.18:0/299608917 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb805e00640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 0x562d04654450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 -- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 msgr2=0x562d04654990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb807200640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04654990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04654990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 -- 172.21.15.18:0/299608917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 msgr2=0x562d04654450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 0x562d04654450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb806800640 1 -- 172.21.15.18:0/299608917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d042b43f0 con 0x562d0463c7a0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb805e00640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 0x562d04654450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.667+0000 7fb807200640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04654990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb806800640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80b94c0 tx=0x7fb7f80035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53615f82ee0700fe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb7e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f804b040 con 0x562d0463c7a0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7f8005210 con 0x562d0463c7a0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7f4012930 con 0x562d0463c7a0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7f80bcba0 con 0x562d0463c7a0 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb810051740 10 client.25843 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:19.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d042740f0 con 0x562d0463c7a0 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.668+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f4012930 con 0x562d0463c7a0 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb7f80b96d0 con 0x562d0463c7a0 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 10 client.25843 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 10 client.25843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 20 client.25843 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d0466fad0 0x562d04671f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 4 client.25843 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d045b3c40 con 0x562d0466fad0 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.669+0000 7fb805e00640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d0466fad0 0x562d04671f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.670+0000 7fb805e00640 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d0466fad0 0x562d04671f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6a2e8ac0840d09 server_cookie=a5443e7831b42d66 in_seq=0 out_seq=0 2024-04-21T22:35:19.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.670+0000 7fb7e7e00640 10 client.25843 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb7e7e00640 1 -- 172.21.15.18:0/299608917 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d045b3c40 con 0x562d0466fad0 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb7e7e00640 10 client.25843 handle_command_reply: tid=0 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 client.25843 shutdown 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 msgr2=0x562d04653f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80b94c0 tx=0x7fb7f80035f0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 shutdown_connections 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04654990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463d0c0 0x562d04654450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d0466fad0 0x562d04671f40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 --2- 172.21.15.18:0/299608917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463c7a0 0x562d04653f10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb7e7e00640 0 client.25843 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.671+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 >> 172.21.15.18:0/299608917 conn(0x562d046371e0 msgr2=0x562d04638f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.672+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 shutdown_connections 2024-04-21T22:35:19.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.672+0000 7fb810051740 1 -- 172.21.15.18:0/299608917 wait complete. 2024-04-21T22:35:19.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.672+0000 7fb810051740 20 client.25843 trim_cache size 0 max 16384 2024-04-21T22:35:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:19 smithi047 ceph-mon[31561]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:35:19.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.709+0000 7fb810051740 1 Processor -- start 2024-04-21T22:35:19.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.709+0000 7fb810051740 1 -- start start 2024-04-21T22:35:19.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04671ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb80806f490 con 0x562d0463c7a0 2024-04-21T22:35:19.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb808070fd0 con 0x562d0463d0c0 2024-04-21T22:35:19.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb810051740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb80806fb60 con 0x562d04656fc0 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb806800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb806800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54576/0 (socket says 172.21.15.18:54576) 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb806800640 1 -- 172.21.15.18:0/1039947650 learned_addr learned my addr 172.21.15.18:0/1039947650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb805e00640 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04671ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.710+0000 7fb807200640 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 -- 172.21.15.18:0/1039947650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 msgr2=0x562d046362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046362c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 -- 172.21.15.18:0/1039947650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 msgr2=0x562d04671ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04671ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 -- 172.21.15.18:0/1039947650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0463cef0 con 0x562d0463c7a0 2024-04-21T22:35:19.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.711+0000 7fb806800640 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ee380 tx=0x7fb7f802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8c11d50ba039e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.712+0000 7fb7f2a00640 1 -- 172.21.15.18:0/1039947650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f804b070 con 0x562d0463c7a0 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.712+0000 7fb7f2a00640 1 -- 172.21.15.18:0/1039947650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7f8005690 con 0x562d0463c7a0 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.712+0000 7fb7f2a00640 1 -- 172.21.15.18:0/1039947650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80bc9c0 con 0x562d0463c7a0 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 -- 172.21.15.18:0/1039947650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 msgr2=0x562d04656640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ee380 tx=0x7fb7f802bc30 comp rx=0 tx=0).stop 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 -- 172.21.15.18:0/1039947650 shutdown_connections 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d04656fc0 0x562d046362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d0463d0c0 0x562d04671ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 --2- 172.21.15.18:0/1039947650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d04656640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 -- 172.21.15.18:0/1039947650 >> 172.21.15.18:0/1039947650 conn(0x562d046371e0 msgr2=0x562d04635bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 -- 172.21.15.18:0/1039947650 shutdown_connections 2024-04-21T22:35:19.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.713+0000 7fb810051740 1 -- 172.21.15.18:0/1039947650 wait complete. 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.714+0000 7fb810051740 1 -- start start 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.714+0000 7fb810051740 1 Processor -- start 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.714+0000 7fb810051740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.714+0000 7fb810051740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 0x562d04667ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb810051740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04662e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb810051740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb808070900 con 0x562d0463c7a0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb810051740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb808070230 con 0x562d04656fc0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb810051740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb80806d490 con 0x562d0463d0c0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb810051740 10 client.0 _ll_register_callbacks cb 0x7fb7f80f4410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb806800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb806800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54578/0 (socket says 172.21.15.18:54578) 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb807200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04662e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb806800640 1 -- 172.21.15.18:0/1263073498 learned_addr learned my addr 172.21.15.18:0/1263073498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:19.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.715+0000 7fb805e00640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 0x562d04667ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 -- 172.21.15.18:0/1263073498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 msgr2=0x562d04667ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 0x562d04667ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 -- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 msgr2=0x562d04662e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04662e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 -- 172.21.15.18:0/1263073498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d046636c0 con 0x562d0463c7a0 2024-04-21T22:35:19.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb805e00640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 0x562d04667ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb806800640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009320 tx=0x7fb7f8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432b6d7aa3966c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.716+0000 7fb7e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f804b050 con 0x562d0463c7a0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7f8005210 con 0x562d0463c7a0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d045ad950 con 0x562d0463c7a0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb7f80bc9c0 con 0x562d0463c7a0 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb810051740 10 client.15726 fetch_fsmap learned FSMap version 28 2024-04-21T22:35:19.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.717+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d046636c0 con 0x562d0463c7a0 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562d045ad950 con 0x562d0463c7a0 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb7f80b7c60 con 0x562d0463c7a0 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 10 client.15726 fetch_fsmap finished waiting for FSMap version 28 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 20 client.15726 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d046d5ee0 0x562d046d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 4 client.15726 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:35:19.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.718+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d045a7ca0 con 0x562d046d5ee0 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.719+0000 7fb805e00640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d046d5ee0 0x562d046d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.719+0000 7fb805e00640 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d046d5ee0 0x562d046d82d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a139407ee6a34e5 server_cookie=98589cb261cf0ae9 in_seq=0 out_seq=0 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.719+0000 7fb7e7e00640 10 client.15726 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb7e7e00640 1 -- 172.21.15.18:0/1263073498 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562d045a7ca0 con 0x562d046d5ee0 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb7e7e00640 10 client.15726 handle_command_reply: tid=0 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 client.15726 shutdown 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 msgr2=0x562d046679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009320 tx=0x7fb7f8003f90 comp rx=0 tx=0).stop 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 shutdown_connections 2024-04-21T22:35:19.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d04656fc0 0x562d04662e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562d046d5ee0 0x562d046d82d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.720+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d0463d0c0 0x562d04667ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb7e7e00640 0 client.15726 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb810051740 1 --2- 172.21.15.18:0/1263073498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d0463c7a0 0x562d046679a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 >> 172.21.15.18:0/1263073498 conn(0x562d046371e0 msgr2=0x562d04636440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 shutdown_connections 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb810051740 1 -- 172.21.15.18:0/1263073498 wait complete. 2024-04-21T22:35:19.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.721+0000 7fb810051740 20 client.15726 trim_cache size 0 max 16384 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "e8d40e78-18ae-4df8-93e2-7937c8d2f357": { 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "e8d40e78-18ae-4df8-93e2-7937c8d2f357", 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:35:19.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:35:19.725 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:19.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.722+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 msgr2=0x7fb7ec0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.722+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 0x7fb7ec0a53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb800005fd0 tx=0x7fb800004a40 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.722+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 msgr2=0x7fb80819a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.722+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8005940 tx=0x7fb7f8004270 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 shutdown_connections 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7ec0a2f30 0x7fb7ec0a53f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808109760 0x7fb80819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808104110 0x7fb80819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 --2- 172.21.15.18:0/968085559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb808103750 0x7fb80819a010 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 >> 172.21.15.18:0/968085559 conn(0x7fb8080ff220 msgr2=0x7fb8080ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 shutdown_connections 2024-04-21T22:35:19.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:19.723+0000 7fb80ca00640 1 -- 172.21.15.18:0/968085559 wait complete. 2024-04-21T22:35:19.747 INFO:tasks.cephfs.filesystem:scrub status for tag:e8d40e78-18ae-4df8-93e2-7937c8d2f357 - {'path': '/', 'tag': 'e8d40e78-18ae-4df8-93e2-7937c8d2f357', 'options': 'recursive,force'} 2024-04-21T22:35:20.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:20 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:35:20.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:20 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:20.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:20 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:35:20.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:20 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:20 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:35:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:20 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:20 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:35:20.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:20 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:20 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:35:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:20 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:20.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:20 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:35:20.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:20 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:21.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:21 smithi018 ceph-mon[26614]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-21T22:35:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:21 smithi081 ceph-mon[31692]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-21T22:35:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:21 smithi047 ceph-mon[31561]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-04-21T22:35:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:23 smithi018 ceph-mon[26614]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:35:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:35:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:23 smithi081 ceph-mon[31692]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:35:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:35:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:23 smithi047 ceph-mon[31561]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:35:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:35:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:25 smithi018 ceph-mon[26614]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:35:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:25 smithi081 ceph-mon[31692]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:35:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:25 smithi047 ceph-mon[31561]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:35:27.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:27 smithi018 ceph-mon[26614]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:27.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:27 smithi081 ceph-mon[31692]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:27 smithi047 ceph-mon[31561]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:29.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:29 smithi018 ceph-mon[26614]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:35:29.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:29 smithi081 ceph-mon[31692]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:35:29.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:29 smithi047 ceph-mon[31561]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:35:31.024 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 60% (7539/12485) Updating files: 61% (7616/12485) Updating files: 62% (7741/12485) Updating files: 63% (7866/12485) Updating files: 64% (7991/12485) Updating files: 65% (8116/12485) Updating files: 66% (8241/12485) Updating files: 67% (8365/12485) Updating files: 68% (8490/12485) Updating files: 69% (8615/12485) Updating files: 70% (8740/12485) Updating files: 71% (8865/12485) Updating files: 72% (8990/12485) Updating files: 73% (9115/12485) Updating files: 74% (9239/12485) Updating files: 75% (9364/12485) Updating files: 76% (9489/12485) Updating files: 77% (9614/12485) Updating files: 78% (9739/12485) Updating files: 79% (9864/12485) Updating files: 80% (9988/12485) Updating files: 81% (10113/12485) Updating files: 82% (10238/12485) Updating files: 83% (10363/12485) Updating files: 84% (10488/12485) Updating files: 85% (10613/12485) Updating files: 86% (10738/12485) Updating files: 87% (10862/12485) Updating files: 88% (10987/12485) Updating files: 89% (11112/12485) Updating files: 90% (11237/12485) Updating files: 91% (11362/12485) Updating files: 92% (11487/12485) Updating files: 93% (11612/12485) Updating files: 94% (11736/12485) Updating files: 95% (11861/12485) Updating files: 96% (11986/12485) Updating files: 96% (12036/12485) Updating files: 97% (12111/12485) Updating files: 98% (12236/12485) Updating files: 99% (12361/12485) Updating files: 100% (12485/12485) Updating files: 100% (12485/12485), done. 2024-04-21T22:35:31.400 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '430e09df97c8fc7dc2b2ae424f68ed11366c540f'. 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-04-21T22:35:31.401 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.402 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-04-21T22:35:31.402 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.402 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-21T22:35:31.402 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:35:31.402 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 430e09df97c Merge pull request #57017 from zdover23/wip-doc-2024-04-21-backport-56904-to-squid 2024-04-21T22:35:31.411 DEBUG:teuthology.orchestra.run.smithi018:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-21T22:35:31.472 INFO:tasks.workunit.client.0.smithi018.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-21T22:35:31.479 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T22:35:31.479 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-21T22:35:31.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:31 smithi018 ceph-mon[26614]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:31 smithi081 ceph-mon[31692]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:31.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:31 smithi047 ceph-mon[31561]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:32.417 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-21T22:35:32.531 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-21T22:35:32.619 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T22:35:32.625 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T22:35:32.625 INFO:tasks.workunit.client.0.smithi018.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-21T22:35:32.716 INFO:tasks.workunit.client.0.smithi018.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T22:35:32.726 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:35:32.726 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-21T22:35:32.781 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-04-21T22:35:32.783 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-04-21T22:35:32.783 DEBUG:teuthology.orchestra.run.smithi018:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=430e09df97c8fc7dc2b2ae424f68ed11366c540f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-04-21T22:35:32.857 INFO:tasks.workunit.client.0.smithi018.stderr:+ set -e 2024-04-21T22:35:32.857 INFO:tasks.workunit.client.0.smithi018.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-04-21T22:35:32.864 INFO:tasks.workunit.client.0.smithi018.stderr:Cloning into 'xfstests-dev'... 2024-04-21T22:35:33.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:33 smithi018 ceph-mon[26614]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:33 smithi081 ceph-mon[31692]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:33 smithi047 ceph-mon[31561]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:35:34.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:34 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:34.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:34 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:34.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:34 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:35.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:35 smithi018 ceph-mon[26614]: pgmap v49: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-04-21T22:35:35.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:35 smithi018 ceph-mon[26614]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-04-21T22:35:35.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:35 smithi047 ceph-mon[31561]: pgmap v49: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-04-21T22:35:35.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:35 smithi047 ceph-mon[31561]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-04-21T22:35:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:35 smithi081 ceph-mon[31692]: pgmap v49: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-04-21T22:35:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:35 smithi081 ceph-mon[31692]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-04-21T22:35:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:37 smithi018 ceph-mon[26614]: pgmap v50: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-21T22:35:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:37 smithi081 ceph-mon[31692]: pgmap v50: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-21T22:35:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:37 smithi047 ceph-mon[31561]: pgmap v50: 97 pgs: 97 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-21T22:35:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:39 smithi018 ceph-mon[26614]: pgmap v51: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-04-21T22:35:39.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:39 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:39 smithi081 ceph-mon[31692]: pgmap v51: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-04-21T22:35:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:39 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:39 smithi047 ceph-mon[31561]: pgmap v51: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.2 MiB/s wr, 20 op/s 2024-04-21T22:35:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:39 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:41 smithi081 ceph-mon[31692]: pgmap v52: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:41 smithi047 ceph-mon[31561]: pgmap v52: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:41 smithi018 ceph-mon[26614]: pgmap v52: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:43 smithi081 ceph-mon[31692]: pgmap v53: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:43 smithi047 ceph-mon[31561]: pgmap v53: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:43 smithi018 ceph-mon[26614]: pgmap v53: 97 pgs: 97 active+clean; 15 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2024-04-21T22:35:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:45 smithi081 ceph-mon[31692]: pgmap v54: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-04-21T22:35:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:45 smithi047 ceph-mon[31561]: pgmap v54: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-04-21T22:35:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:45 smithi018 ceph-mon[26614]: pgmap v54: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 1.2 MiB/s wr, 25 op/s 2024-04-21T22:35:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:47 smithi081 ceph-mon[31692]: pgmap v55: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.2 MiB/s wr, 19 op/s 2024-04-21T22:35:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:47 smithi047 ceph-mon[31561]: pgmap v55: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.2 MiB/s wr, 19 op/s 2024-04-21T22:35:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:47 smithi018 ceph-mon[26614]: pgmap v55: 97 pgs: 97 active+clean; 16 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 1.2 MiB/s wr, 19 op/s 2024-04-21T22:35:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:49 smithi081 ceph-mon[31692]: pgmap v56: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.7 MiB/s wr, 42 op/s 2024-04-21T22:35:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:49 smithi047 ceph-mon[31561]: pgmap v56: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.7 MiB/s wr, 42 op/s 2024-04-21T22:35:49.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:35:49.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:35:49.833 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:49 smithi018 ceph-mon[26614]: pgmap v56: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.7 MiB/s wr, 42 op/s 2024-04-21T22:35:49.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 -- 172.21.15.18:0/433822064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6734103720 msgr2=0x7f6734103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:49.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 --2- 172.21.15.18:0/433822064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6734103720 0x7f6734103ba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6720009930 tx=0x7f672002bc30 comp rx=0 tx=0).stop 2024-04-21T22:35:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 -- 172.21.15.18:0/433822064 shutdown_connections 2024-04-21T22:35:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 --2- 172.21.15.18:0/433822064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67341040e0 0x7f67341105f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 --2- 172.21.15.18:0/433822064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6734103720 0x7f6734103ba0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 --2- 172.21.15.18:0/433822064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734109730 0x7f6734109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 -- 172.21.15.18:0/433822064 >> 172.21.15.18:0/433822064 conn(0x7f67340ff210 msgr2=0x7f6734101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:49.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 -- 172.21.15.18:0/433822064 shutdown_connections 2024-04-21T22:35:49.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.979+0000 7f6739200640 1 -- 172.21.15.18:0/433822064 wait complete. 2024-04-21T22:35:49.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.980+0000 7f6739200640 1 Processor -- start 2024-04-21T22:35:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.980+0000 7f6739200640 1 -- start start 2024-04-21T22:35:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 0x7f673419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67341040e0 0x7f673419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6734113b90 con 0x7f67341040e0 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6734113a10 con 0x7f6734109730 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6739200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6734113d10 con 0x7f6734103720 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67341040e0 0x7f673419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6733e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6733400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 0x7f673419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6733e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59076/0 (socket says 172.21.15.18:59076) 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.981+0000 7f6733e00640 1 -- 172.21.15.18:0/4150707254 learned_addr learned my addr 172.21.15.18:0/4150707254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 -- 172.21.15.18:0/4150707254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 msgr2=0x7f673419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 0x7f673419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 -- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67341040e0 msgr2=0x7f673419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67341040e0 0x7f673419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 -- 172.21.15.18:0/4150707254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673419f0a0 con 0x7f6734109730 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733400640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 0x7f673419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6733e00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e970 tx=0x7f672c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f672be00640 1 -- 172.21.15.18:0/4150707254 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c00ccc0 con 0x7f6734109730 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673419f390 con 0x7f6734109730 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f672be00640 1 -- 172.21.15.18:0/4150707254 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f672c00ce60 con 0x7f6734109730 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.982+0000 7f672be00640 1 -- 172.21.15.18:0/4150707254 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c010490 con 0x7f6734109730 2024-04-21T22:35:49.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.983+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67341a6c20 con 0x7f6734109730 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.986+0000 7f672be00640 1 -- 172.21.15.18:0/4150707254 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f672c005020 con 0x7f6734109730 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.986+0000 7f673d604740 1 Processor -- start 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.986+0000 7f673d604740 1 -- start start 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a95e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874a9ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874aa13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5578749f9410 con 0x557874a95ab0 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5578749a17e0 con 0x557874a963d0 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f673d604740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578749f53d0 con 0x557874a9efb0 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a95e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f6733400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874a9ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a95e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49644/0 (socket says 172.21.15.18:49644) 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f6732a00640 1 -- 172.21.15.18:0/3874390820 learned_addr learned my addr 172.21.15.18:0/3874390820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.987+0000 7f6732a00640 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874aa13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f672be00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 0x7f67180a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 -- 172.21.15.18:0/3874390820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 msgr2=0x557874aa13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874aa13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 -- 172.21.15.18:0/3874390820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 msgr2=0x557874a95e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a95e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 -- 172.21.15.18:0/3874390820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578747d77d0 con 0x557874a963d0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733e00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 0x7f67180a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f672be00640 1 -- 172.21.15.18:0/4150707254 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f672c0cf920 con 0x7f6734109730 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6733400640 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874a9ea70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6724005fd0 tx=0x7f6724011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd398328e0c15843 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6728c00640 1 -- 172.21.15.18:0/3874390820 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724011e60 con 0x557874a963d0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6728c00640 1 -- 172.21.15.18:0/3874390820 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6724004d20 con 0x557874a963d0 2024-04-21T22:35:49.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.988+0000 7f6728c00640 1 -- 172.21.15.18:0/3874390820 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240043d0 con 0x557874a963d0 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 -- 172.21.15.18:0/3874390820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 msgr2=0x557874a9ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f6733e00640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 0x7f67180a51c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f672c004730 tx=0x7f672c0046c0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874a9ea70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6724005fd0 tx=0x7f6724011c70 comp rx=0 tx=0).stop 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 -- 172.21.15.18:0/3874390820 shutdown_connections 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874aa13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874a9ea70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 --2- 172.21.15.18:0/3874390820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a95e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 -- 172.21.15.18:0/3874390820 >> 172.21.15.18:0/3874390820 conn(0x557874a901e0 msgr2=0x557874a905c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 -- 172.21.15.18:0/3874390820 shutdown_connections 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.989+0000 7f673d604740 1 -- 172.21.15.18:0/3874390820 wait complete. 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.990+0000 7f673d604740 1 -- start start 2024-04-21T22:35:49.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.990+0000 7f673d604740 1 Processor -- start 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a95ab0 0x557874a9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a963d0 0x557874a9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557874aa1da0 con 0x557874a963d0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5578749b4c40 con 0x557874a9efb0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557874aa1f20 con 0x557874a95ab0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f673d604740 10 client.0 _ll_register_callbacks cb 0x5578749b4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59090/0 (socket says 172.21.15.18:59090) 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 -- 172.21.15.18:0/1168060267 learned_addr learned my addr 172.21.15.18:0/1168060267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6733400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a963d0 0x557874a9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a95ab0 0x557874a9c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 -- 172.21.15.18:0/1168060267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a95ab0 msgr2=0x557874a9c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a95ab0 0x557874a9c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 -- 172.21.15.18:0/1168060267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a963d0 msgr2=0x557874a9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a963d0 0x557874a9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.991+0000 7f6732a00640 1 -- 172.21.15.18:0/1168060267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55787470d3f0 con 0x557874a9efb0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f6732a00640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6720036040 tx=0x7f672002df90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84209a65e070e4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f671d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67200046c0 con 0x557874a9efb0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6724004d20 con 0x557874a9efb0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6720004860 con 0x557874a9efb0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6720058050 con 0x557874a9efb0 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f673d604740 10 client.25832 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:49.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.992+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5578746cd0f0 con 0x557874a9efb0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6724004d20 con 0x557874a9efb0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f672004f070 con 0x557874a9efb0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 10 client.25832 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 10 client.25832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 20 client.25832 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874aaf3b0 0x557874ab17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 4 client.25832 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.993+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557874a0cc40 con 0x557874aaf3b0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.994+0000 7f6733400640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874aaf3b0 0x557874ab17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.994+0000 7f6733400640 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874aaf3b0 0x557874ab17e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a981dea274812a1 server_cookie=e59e3031d2670079 in_seq=0 out_seq=0 2024-04-21T22:35:49.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.994+0000 7f671d600640 10 client.25832 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.995+0000 7f671d600640 1 -- 172.21.15.18:0/1168060267 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557874a0cc40 con 0x557874aaf3b0 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.995+0000 7f671d600640 10 client.25832 handle_command_reply: tid=0 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 client.25832 shutdown 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 msgr2=0x557874a9cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6720036040 tx=0x7f672002df90 comp rx=0 tx=0).stop 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 shutdown_connections 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a9cac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a963d0 0x557874a9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874aaf3b0 0x557874ab17e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 --2- 172.21.15.18:0/1168060267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a95ab0 0x557874a9c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 >> 172.21.15.18:0/1168060267 conn(0x557874a901e0 msgr2=0x557874a91f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f671d600640 0 client.25832 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 shutdown_connections 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 1 -- 172.21.15.18:0/1168060267 wait complete. 2024-04-21T22:35:49.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:49.996+0000 7f673d604740 20 client.25832 trim_cache size 0 max 16384 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.015+0000 7f673d604740 1 Processor -- start 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.015+0000 7f673d604740 1 -- start start 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 0x557874a9c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67341af500 con 0x557874a95ab0 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67341b1160 con 0x557874a9efb0 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f673d604740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67341afc30 con 0x557874a963d0 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49664/0 (socket says 172.21.15.18:49664) 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6732a00640 1 -- 172.21.15.18:0/119554078 learned_addr learned my addr 172.21.15.18:0/119554078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6733400640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 0x557874a9c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6732a00640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6733400640 1 -- 172.21.15.18:0/119554078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 msgr2=0x557874a91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.016+0000 7f6733400640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a91d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f6733400640 1 -- 172.21.15.18:0/119554078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 msgr2=0x557874a9e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f6733400640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f6733400640 1 -- 172.21.15.18:0/119554078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557874a8a660 con 0x557874a963d0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f6732a00640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f6733400640 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 0x557874a9c8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f672400f790 tx=0x7f672400ff20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81270c0e5076f611 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f671fe00640 1 -- 172.21.15.18:0/119554078 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672401e040 con 0x557874a963d0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f671fe00640 1 -- 172.21.15.18:0/119554078 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6724009480 con 0x557874a963d0 2024-04-21T22:35:50.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.017+0000 7f671fe00640 1 -- 172.21.15.18:0/119554078 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672402a5f0 con 0x557874a963d0 2024-04-21T22:35:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- 172.21.15.18:0/119554078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 msgr2=0x557874a9c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 0x557874a9c8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f672400f790 tx=0x7f672400ff20 comp rx=0 tx=0).stop 2024-04-21T22:35:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- 172.21.15.18:0/119554078 shutdown_connections 2024-04-21T22:35:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a9efb0 0x557874a91d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a963d0 0x557874a9c8e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 --2- 172.21.15.18:0/119554078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874a9e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- 172.21.15.18:0/119554078 >> 172.21.15.18:0/119554078 conn(0x557874a901e0 msgr2=0x557874a91610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- 172.21.15.18:0/119554078 shutdown_connections 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- 172.21.15.18:0/119554078 wait complete. 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 -- start start 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.018+0000 7f673d604740 1 Processor -- start 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874ab4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874ab4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67341b09d0 con 0x557874a95ab0 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67341b0300 con 0x557874a963d0 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67341ad4e0 con 0x557874a9efb0 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f673d604740 10 client.0 _ll_register_callbacks cb 0x7f67200044f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:50.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f6732a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49670/0 (socket says 172.21.15.18:49670) 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f6732a00640 1 -- 172.21.15.18:0/773317823 learned_addr learned my addr 172.21.15.18:0/773317823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.019+0000 7f6733400640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874ab4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874ab4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 -- 172.21.15.18:0/773317823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 msgr2=0x557874ab4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874ab4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 -- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 msgr2=0x557874ab4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874ab4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 -- 172.21.15.18:0/773317823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557874ab5050 con 0x557874a95ab0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f6732a00640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f672002c240 tx=0x7f6720005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d49483657241921 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f671d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672002c5d0 con 0x557874a95ab0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6720004ee0 con 0x557874a95ab0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.020+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6724009480 con 0x557874a95ab0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f67200050e0 con 0x557874a95ab0 2024-04-21T22:35:50.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 10 client.15744 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557874b15620 con 0x557874a95ab0 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6724009480 con 0x557874a95ab0 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f672004f040 con 0x557874a95ab0 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 10 client.15744 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 20 client.15744 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874b15c60 0x557874b18080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 4 client.15744 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.021+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557874a06950 con 0x557874b15c60 2024-04-21T22:35:50.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f6733400640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874b15c60 0x557874b18080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f6733400640 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874b15c60 0x557874b18080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487f6ce7a9914261 server_cookie=b04cf4fed7a010be in_seq=0 out_seq=0 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f671d600640 10 client.15744 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f671d600640 1 -- 172.21.15.18:0/773317823 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557874a06950 con 0x557874b15c60 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f671d600640 10 client.15744 handle_command_reply: tid=0 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.022+0000 7f673d604740 1 client.15744 shutdown 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 msgr2=0x557874ab7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f672002c240 tx=0x7f6720005fd0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 shutdown_connections 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x557874b15c60 0x557874b18080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557874a9efb0 0x557874ab4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557874a963d0 0x557874ab4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 --2- 172.21.15.18:0/773317823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557874a95ab0 0x557874ab7140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 >> 172.21.15.18:0/773317823 conn(0x557874a901e0 msgr2=0x557874a91610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f671d600640 0 client.15744 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:50.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 shutdown_connections 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 1 -- 172.21.15.18:0/773317823 wait complete. 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.023+0000 7f673d604740 20 client.15744 trim_cache size 0 max 16384 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:35:50.027 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 msgr2=0x7f67180a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 0x7f67180a51c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f672c004730 tx=0x7f672c0046c0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 msgr2=0x7f673419e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e970 tx=0x7f672c00ed70 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 shutdown_connections 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f67180a2d00 0x7f67180a51c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6734109730 0x7f673419e970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67341040e0 0x7f673419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 --2- 172.21.15.18:0/4150707254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6734103720 0x7f673419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 >> 172.21.15.18:0/4150707254 conn(0x7f67340ff210 msgr2=0x7f67340ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 shutdown_connections 2024-04-21T22:35:50.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.024+0000 7f6739200640 1 -- 172.21.15.18:0/4150707254 wait complete. 2024-04-21T22:35:50.041 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:35:50.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 -- 172.21.15.18:0/3519110645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c81041d0 msgr2=0x7f11c81106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 --2- 172.21.15.18:0/3519110645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c81041d0 0x7f11c81106e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009ca0 tx=0x7f11c002c100 comp rx=0 tx=0).stop 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 -- 172.21.15.18:0/3519110645 shutdown_connections 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 --2- 172.21.15.18:0/3519110645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c81041d0 0x7f11c81106e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 --2- 172.21.15.18:0/3519110645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c8103810 0x7f11c8103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 --2- 172.21.15.18:0/3519110645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8109820 0x7f11c8109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 -- 172.21.15.18:0/3519110645 >> 172.21.15.18:0/3519110645 conn(0x7f11c80ff2c0 msgr2=0x7f11c81016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 -- 172.21.15.18:0/3519110645 shutdown_connections 2024-04-21T22:35:50.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.239+0000 7f11ce600640 1 -- 172.21.15.18:0/3519110645 wait complete. 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.240+0000 7f11ce600640 1 Processor -- start 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.240+0000 7f11ce600640 1 -- start start 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.240+0000 7f11ce600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11ce600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 0x7f11c819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11ce600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c8109820 0x7f11c819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11ce600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8113c30 con 0x7f11c8103810 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11ce600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8113ab0 con 0x7f11c8109820 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11ce600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8113db0 con 0x7f11c81041d0 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49686/0 (socket says 172.21.15.18:49686) 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 -- 172.21.15.18:0/2575139935 learned_addr learned my addr 172.21.15.18:0/2575139935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11c7e00640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 0x7f11c819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cdc00640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c8109820 0x7f11c819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 -- 172.21.15.18:0/2575139935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 msgr2=0x7f11c819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 0x7f11c819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 -- 172.21.15.18:0/2575139935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c8109820 msgr2=0x7f11c819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c8109820 0x7f11c819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11cd200640 1 -- 172.21.15.18:0/2575139935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c819f0a0 con 0x7f11c8103810 2024-04-21T22:35:50.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.241+0000 7f11c7e00640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 0x7f11c819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11cd200640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00e9f0 tx=0x7f11bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00cd80 con 0x7f11c8103810 2024-04-21T22:35:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11bc010910 con 0x7f11c8103810 2024-04-21T22:35:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc018990 con 0x7f11c8103810 2024-04-21T22:35:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c819f390 con 0x7f11c8103810 2024-04-21T22:35:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.242+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c81a6c20 con 0x7f11c8103810 2024-04-21T22:35:50.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.244+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c804f570 con 0x7f11c8103810 2024-04-21T22:35:50.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.246+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f11bc010ac0 con 0x7f11c8103810 2024-04-21T22:35:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.248+0000 7f11c5600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 0x7f11b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.248+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f11bc0cf740 con 0x7f11c8103810 2024-04-21T22:35:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.248+0000 7f11c7e00640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 0x7f11b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.249+0000 7f11c7e00640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 0x7f11b00a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11c8108bf0 tx=0x7f11b4005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.252+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f11bc09bcb0 con 0x7f11c8103810 2024-04-21T22:35:50.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.500+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c81a6e40 con 0x7f11c8103810 2024-04-21T22:35:50.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.502+0000 7f11c5600640 1 -- 172.21.15.18:0/2575139935 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11924 (secure 0 0 0) 0x7f11bc09ffb0 con 0x7f11c8103810 2024-04-21T22:35:50.502 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:35:50.502 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:35:38.100346+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:35:50.502 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 30 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 msgr2=0x7f11b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 0x7f11b00a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11c8108bf0 tx=0x7f11b4005f90 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 msgr2=0x7f11c819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00e9f0 tx=0x7f11bc00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 shutdown_connections 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11b00a2cf0 0x7f11b00a51b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11c8109820 0x7f11c819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c81041d0 0x7f11c819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 --2- 172.21.15.18:0/2575139935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c8103810 0x7f11c819a0b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 >> 172.21.15.18:0/2575139935 conn(0x7f11c80ff2c0 msgr2=0x7f11c80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 shutdown_connections 2024-04-21T22:35:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.505+0000 7f11ce600640 1 -- 172.21.15.18:0/2575139935 wait complete. 2024-04-21T22:35:50.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 -- 172.21.15.18:0/3675950392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105910 msgr2=0x7f3564105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 --2- 172.21.15.18:0/3675950392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105910 0x7f3564105d70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f355c009890 tx=0x7f355c02bc00 comp rx=0 tx=0).stop 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 -- 172.21.15.18:0/3675950392 shutdown_connections 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 --2- 172.21.15.18:0/3675950392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105910 0x7f3564105d70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 --2- 172.21.15.18:0/3675950392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100e30 0x7f35641052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 --2- 172.21.15.18:0/3675950392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564100510 0x7f35641008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 -- 172.21.15.18:0/3675950392 >> 172.21.15.18:0/3675950392 conn(0x7f35640771f0 msgr2=0x7f35640fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 -- 172.21.15.18:0/3675950392 shutdown_connections 2024-04-21T22:35:50.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.746+0000 7f3563200640 1 -- 172.21.15.18:0/3675950392 wait complete. 2024-04-21T22:35:50.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.747+0000 7f3563200640 1 Processor -- start 2024-04-21T22:35:50.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 -- start start 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 0x7f356419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 0x7f35641a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3564117f20 con 0x7f3564100510 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3564117da0 con 0x7f3564105910 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3563200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35641180a0 con 0x7f3564100e30 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3561e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3561e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49712/0 (socket says 172.21.15.18:49712) 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3561e00640 1 -- 172.21.15.18:0/2165651682 learned_addr learned my addr 172.21.15.18:0/2165651682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3561400640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 0x7f356419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.748+0000 7f3562800640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 0x7f35641a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 -- 172.21.15.18:0/2165651682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 msgr2=0x7f356419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 0x7f356419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 -- 172.21.15.18:0/2165651682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 msgr2=0x7f35641a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 0x7f35641a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 -- 172.21.15.18:0/2165651682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35641a3430 con 0x7f3564100510 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561400640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 0x7f356419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3562800640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 0x7f35641a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f3561e00640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f354c00ea60 tx=0x7f354c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.749+0000 7f355aa00640 1 -- 172.21.15.18:0/2165651682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00cde0 con 0x7f3564100510 2024-04-21T22:35:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.750+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35641a3720 con 0x7f3564100510 2024-04-21T22:35:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.750+0000 7f355aa00640 1 -- 172.21.15.18:0/2165651682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354c0035f0 con 0x7f3564100510 2024-04-21T22:35:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.750+0000 7f355aa00640 1 -- 172.21.15.18:0/2165651682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c005220 con 0x7f3564100510 2024-04-21T22:35:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.750+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35641aafb0 con 0x7f3564100510 2024-04-21T22:35:50.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.753+0000 7f355aa00640 1 -- 172.21.15.18:0/2165651682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f354c0037a0 con 0x7f3564100510 2024-04-21T22:35:50.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.753+0000 7f356bc0e740 1 Processor -- start 2024-04-21T22:35:50.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.753+0000 7f356bc0e740 1 -- start start 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 0x55c752b31350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b39f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 0x55c752b3c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c752a953a0 con 0x55c752b30f70 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c752a3d930 con 0x55c752b31890 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f356bc0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c752a91360 con 0x55c752b3a470 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b39f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3562800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 0x55c752b31350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 0x55c752b3c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3562800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 0x55c752b31350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49728/0 (socket says 172.21.15.18:49728) 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3562800640 1 -- 172.21.15.18:0/596068390 learned_addr learned my addr 172.21.15.18:0/596068390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 -- 172.21.15.18:0/596068390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 msgr2=0x55c752b39f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b39f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 -- 172.21.15.18:0/596068390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 msgr2=0x55c752b31350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 0x55c752b31350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.754+0000 7f3561400640 1 -- 172.21.15.18:0/596068390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7527a93f0 con 0x55c752b3a470 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f355aa00640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 0x7f35480a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f3561400640 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 0x55c752b3c860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3554005fd0 tx=0x7f355400eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f687d0ff4338f75f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f355aa00640 1 -- 172.21.15.18:0/2165651682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f354c0cf640 con 0x7f3564100510 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f3553400640 1 -- 172.21.15.18:0/596068390 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355400cd60 con 0x55c752b3a470 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f3562800640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 0x7f35480a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f3553400640 1 -- 172.21.15.18:0/596068390 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355401d070 con 0x55c752b3a470 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.755+0000 7f3553400640 1 -- 172.21.15.18:0/596068390 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355400b5c0 con 0x55c752b3a470 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 -- 172.21.15.18:0/596068390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 msgr2=0x55c752b3c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 0x55c752b3c860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3554005fd0 tx=0x7f355400eb70 comp rx=0 tx=0).stop 2024-04-21T22:35:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f3562800640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 0x7f35480a51c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f355c0095f0 tx=0x7f355c02e040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 -- 172.21.15.18:0/596068390 shutdown_connections 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b3a470 0x55c752b3c860 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b39f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 --2- 172.21.15.18:0/596068390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b30f70 0x55c752b31350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 -- 172.21.15.18:0/596068390 >> 172.21.15.18:0/596068390 conn(0x55c752b2b6a0 msgr2=0x55c752b2ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 -- 172.21.15.18:0/596068390 shutdown_connections 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.756+0000 7f356bc0e740 1 -- 172.21.15.18:0/596068390 wait complete. 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 -- start start 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 Processor -- start 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b37f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.757+0000 7f356bc0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c752b3d260 con 0x55c752b31890 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f356bc0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c752a50d80 con 0x55c752b3a470 2024-04-21T22:35:50.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f356bc0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c752b3d3e0 con 0x55c752b30f70 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f356bc0e740 10 client.0 _ll_register_callbacks cb 0x55c752a8d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40630/0 (socket says 172.21.15.18:40630) 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 -- 172.21.15.18:0/783861772 learned_addr learned my addr 172.21.15.18:0/783861772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3562800640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b37f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 -- 172.21.15.18:0/783861772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 msgr2=0x55c752b37f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b37f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 -- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 msgr2=0x55c752b379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 -- 172.21.15.18:0/783861772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7528737d0 con 0x55c752b30f70 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3561e00640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f354c000c00 tx=0x7f354c097e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eeee0222dc1e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.758+0000 7f3547e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c09b4c0 con 0x55c752b30f70 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f355401d070 con 0x55c752b30f70 2024-04-21T22:35:50.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f354c0981d0 con 0x55c752b30f70 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f354c0b3050 con 0x55c752b30f70 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f356bc0e740 10 client.25885 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c752b495e0 con 0x55c752b30f70 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355401d070 con 0x55c752b30f70 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f354c0053c0 con 0x55c752b30f70 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f356bc0e740 10 client.25885 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.759+0000 7f356bc0e740 10 client.25885 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f356bc0e740 20 client.25885 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752b4aa40 0x55c752b4ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f356bc0e740 4 client.25885 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c752aa28e0 con 0x55c752b4aa40 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f3561400640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752b4aa40 0x55c752b4ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f3561400640 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752b4aa40 0x55c752b4ceb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa32775a85ac8b6e server_cookie=ae2144b55bc97cc5 in_seq=0 out_seq=0 2024-04-21T22:35:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.760+0000 7f3547e00640 10 client.25885 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.761+0000 7f3547e00640 1 -- 172.21.15.18:0/783861772 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c752aa28e0 con 0x55c752b4aa40 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.761+0000 7f3547e00640 10 client.25885 handle_command_reply: tid=0 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.761+0000 7f356bc0e740 1 client.25885 shutdown 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.761+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 msgr2=0x55c752b374a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.761+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f354c000c00 tx=0x7f354c097e00 comp rx=0 tx=0).stop 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 shutdown_connections 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752b4aa40 0x55c752b4ceb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b37f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 --2- 172.21.15.18:0/783861772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b374a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f3547e00640 0 client.25885 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 >> 172.21.15.18:0/783861772 conn(0x55c752b2b6a0 msgr2=0x55c752b2d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 shutdown_connections 2024-04-21T22:35:50.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 1 -- 172.21.15.18:0/783861772 wait complete. 2024-04-21T22:35:50.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.762+0000 7f356bc0e740 20 client.25885 trim_cache size 0 max 16384 2024-04-21T22:35:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.777+0000 7f356bc0e740 1 Processor -- start 2024-04-21T22:35:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.777+0000 7f356bc0e740 1 -- start start 2024-04-21T22:35:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.777+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b52c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f356bc0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b3990 con 0x55c752b31890 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f356bc0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b55f0 con 0x55c752b3a470 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f356bc0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b40c0 con 0x55c752b30f70 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40632/0 (socket says 172.21.15.18:40632) 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49744/0 (socket says 172.21.15.18:49744) 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 -- 172.21.15.18:0/2646508295 learned_addr learned my addr 172.21.15.18:0/2646508295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3562800640 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b52c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 -- 172.21.15.18:0/2646508295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 msgr2=0x55c752b52c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b52c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 -- 172.21.15.18:0/2646508295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 msgr2=0x55c752b52750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561e00640 1 -- 172.21.15.18:0/2646508295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c752b30290 con 0x55c752b30f70 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.778+0000 7f3561400640 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f3561e00640 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f354c09baf0 tx=0x7f354c003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5593df2f67f5309c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f3552a00640 1 -- 172.21.15.18:0/2646508295 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0b8030 con 0x55c752b30f70 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f3552a00640 1 -- 172.21.15.18:0/2646508295 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354c09c260 con 0x55c752b30f70 2024-04-21T22:35:50.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f3552a00640 1 -- 172.21.15.18:0/2646508295 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0cd010 con 0x55c752b30f70 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f356bc0e740 1 -- 172.21.15.18:0/2646508295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 msgr2=0x55c752b46150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.779+0000 7f356bc0e740 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f354c09baf0 tx=0x7f354c003f30 comp rx=0 tx=0).stop 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 -- 172.21.15.18:0/2646508295 shutdown_connections 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b3a470 0x55c752b52c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b31890 0x55c752b52750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 --2- 172.21.15.18:0/2646508295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b46150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 -- 172.21.15.18:0/2646508295 >> 172.21.15.18:0/2646508295 conn(0x55c752b2b6a0 msgr2=0x55c752b2d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 -- 172.21.15.18:0/2646508295 shutdown_connections 2024-04-21T22:35:50.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 -- 172.21.15.18:0/2646508295 wait complete. 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 -- start start 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.780+0000 7f356bc0e740 1 Processor -- start 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b3fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 0x55c752b40130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b4e60 con 0x55c752b3a470 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b4790 con 0x55c752b31890 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35641b1970 con 0x55c752b30f70 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f356bc0e740 10 client.0 _ll_register_callbacks cb 0x7f354c00ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40638/0 (socket says 172.21.15.18:40638) 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 -- 172.21.15.18:0/1291117023 learned_addr learned my addr 172.21.15.18:0/1291117023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3562800640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 0x55c752b40130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561400640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b3fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 -- 172.21.15.18:0/1291117023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 msgr2=0x55c752b3fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b3fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 -- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 msgr2=0x55c752b40130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 0x55c752b40130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3561e00640 1 -- 172.21.15.18:0/1291117023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c752b40770 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.781+0000 7f3562800640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 0x55c752b40130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3561e00640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f354c09b860 tx=0x7f354c0cce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df02bcd0dd73244 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0b8030 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f354c0981d0 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f354c09c260 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f354c09bb60 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 10 client.25891 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c752bb0e00 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354c09c260 con 0x55c752b30f70 2024-04-21T22:35:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f354c0978b0 con 0x55c752b30f70 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 10 client.25891 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 10 client.25891 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 20 client.25891 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.782+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752bb1280 0x55c752bb3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.783+0000 7f356bc0e740 4 client.25891 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.783+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c752a9cc30 con 0x55c752bb1280 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.783+0000 7f3561400640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752bb1280 0x55c752bb3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.783+0000 7f3561400640 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752bb1280 0x55c752bb3670 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90705a113e935d43 server_cookie=688d357a7b30d866 in_seq=0 out_seq=0 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.783+0000 7f3547e00640 10 client.25891 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f3547e00640 1 -- 172.21.15.18:0/1291117023 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c752a9cc30 con 0x55c752bb1280 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f3547e00640 10 client.25891 handle_command_reply: tid=0 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 client.25891 shutdown 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 msgr2=0x55c752b42860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f354c09b860 tx=0x7f354c0cce40 comp rx=0 tx=0).stop 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 shutdown_connections 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55c752bb1280 0x55c752bb3670 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c752b3a470 0x55c752b40130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c752b31890 0x55c752b3fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 --2- 172.21.15.18:0/1291117023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c752b30f70 0x55c752b42860 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f3547e00640 0 client.25891 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 >> 172.21.15.18:0/1291117023 conn(0x55c752b2b6a0 msgr2=0x55c752b29e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 shutdown_connections 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 1 -- 172.21.15.18:0/1291117023 wait complete. 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.784+0000 7f356bc0e740 20 client.25891 trim_cache size 0 max 16384 2024-04-21T22:35:50.788 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 msgr2=0x7f35480a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 0x7f35480a51c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f355c0095f0 tx=0x7f355c02e040 comp rx=0 tx=0).stop 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 msgr2=0x7f356419e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f354c00ea60 tx=0x7f354c00ef20 comp rx=0 tx=0).stop 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 shutdown_connections 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35480a2d00 0x7f35480a51c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3564105910 0x7f35641a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564100e30 0x7f356419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 --2- 172.21.15.18:0/2165651682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3564100510 0x7f356419e440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 >> 172.21.15.18:0/2165651682 conn(0x7f35640771f0 msgr2=0x7f35641032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 shutdown_connections 2024-04-21T22:35:50.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:50.785+0000 7f3563200640 1 -- 172.21.15.18:0/2165651682 wait complete. 2024-04-21T22:35:50.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:35:51.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 -- 172.21.15.18:0/73395127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f0410dc00 msgr2=0x7f3f0410dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/73395127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f0410dc00 0x7f3f0410dfe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009930 tx=0x7f3ef802bc30 comp rx=0 tx=0).stop 2024-04-21T22:35:51.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 -- 172.21.15.18:0/73395127 shutdown_connections 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/73395127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 0x7f3f041149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/73395127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f04107c80 0x7f3f04108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/73395127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f0410dc00 0x7f3f0410dfe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 -- 172.21.15.18:0/73395127 >> 172.21.15.18:0/73395127 conn(0x7f3f04077550 msgr2=0x7f3f04106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 -- 172.21.15.18:0/73395127 shutdown_connections 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.012+0000 7f3f0ae00640 1 -- 172.21.15.18:0/73395127 wait complete. 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 Processor -- start 2024-04-21T22:35:51.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 -- start start 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 0x7f3f0419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f0410dc00 0x7f3f041a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04117f90 con 0x7f3f0410dc00 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04117e10 con 0x7f3f04108640 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.014+0000 7f3f0ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04118110 con 0x7f3f04107c80 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f0410dc00 0x7f3f041a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40654/0 (socket says 172.21.15.18:40654) 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 -- 172.21.15.18:0/3295708483 learned_addr learned my addr 172.21.15.18:0/3295708483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09000640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 0x7f3f0419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 -- 172.21.15.18:0/3295708483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 msgr2=0x7f3f0419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 0x7f3f0419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 -- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f0410dc00 msgr2=0x7f3f041a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f0410dc00 0x7f3f041a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.015+0000 7f3f09a00640 1 -- 172.21.15.18:0/3295708483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f041a33a0 con 0x7f3f04107c80 2024-04-21T22:35:51.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009900 tx=0x7f3ef8004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f02000640 1 -- 172.21.15.18:0/3295708483 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8043020 con 0x7f3f04107c80 2024-04-21T22:35:51.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f02000640 1 -- 172.21.15.18:0/3295708483 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef80054e0 con 0x7f3f04107c80 2024-04-21T22:35:51.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f02000640 1 -- 172.21.15.18:0/3295708483 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8003b80 con 0x7f3f04107c80 2024-04-21T22:35:51.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f041a3630 con 0x7f3f04107c80 2024-04-21T22:35:51.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.016+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f041aaf20 con 0x7f3f04107c80 2024-04-21T22:35:51.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.019+0000 7f3f0f033740 1 Processor -- start 2024-04-21T22:35:51.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.019+0000 7f3f02000640 1 -- 172.21.15.18:0/3295708483 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3ef8046020 con 0x7f3f04107c80 2024-04-21T22:35:51.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 -- start start 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2544f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec2547860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ec24a03a0 con 0x555ec253bf70 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555ec2448930 con 0x555ec253c890 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0f033740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555ec249c360 con 0x555ec2545470 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.020+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49792/0 (socket says 172.21.15.18:49792) 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec2547860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f0a400640 1 -- 172.21.15.18:0/2424146596 learned_addr learned my addr 172.21.15.18:0/2424146596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09a00640 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2544f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 -- 172.21.15.18:0/2424146596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 msgr2=0x555ec2544f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2544f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 -- 172.21.15.18:0/2424146596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 msgr2=0x555ec253c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 -- 172.21.15.18:0/2424146596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ec21b43f0 con 0x555ec2545470 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f0a400640 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f09000640 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec2547860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbc0 tx=0x7f3ef00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=289c4d1bb8a5d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.021+0000 7f3f02000640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 0x7f3eec0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.022+0000 7f3ef6a00640 1 -- 172.21.15.18:0/2424146596 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0004030 con 0x555ec2545470 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.022+0000 7f3f02000640 1 -- 172.21.15.18:0/3295708483 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3ef80f13b0 con 0x7f3f04107c80 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.022+0000 7f3f0a400640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 0x7f3eec0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.022+0000 7f3ef6a00640 1 -- 172.21.15.18:0/2424146596 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef00041d0 con 0x555ec2545470 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.022+0000 7f3ef6a00640 1 -- 172.21.15.18:0/2424146596 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00116a0 con 0x555ec2545470 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- 172.21.15.18:0/2424146596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 msgr2=0x555ec2547860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec2547860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbc0 tx=0x7f3ef00107a0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0a400640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 0x7f3eec0a5240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3efc011890 tx=0x7f3efc009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- 172.21.15.18:0/2424146596 shutdown_connections 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec2547860 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2544f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2424146596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- 172.21.15.18:0/2424146596 >> 172.21.15.18:0/2424146596 conn(0x555ec25366a0 msgr2=0x555ec2536a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- 172.21.15.18:0/2424146596 shutdown_connections 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- 172.21.15.18:0/2424146596 wait complete. 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 -- start start 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.023+0000 7f3f0f033740 1 Processor -- start 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 0x555ec2542500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2542a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 0x555ec2542f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555ec2548260 con 0x555ec2545470 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555ec245bd80 con 0x555ec253c890 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555ec25483e0 con 0x555ec253bf70 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0f033740 10 client.0 _ll_register_callbacks cb 0x555ec24982b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 0x555ec2542f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 0x555ec2542500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 0x555ec2542500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40658/0 (socket says 172.21.15.18:40658) 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f09a00640 1 -- 172.21.15.18:0/2973176549 learned_addr learned my addr 172.21.15.18:0/2973176549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.024+0000 7f3f09000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2542a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 -- 172.21.15.18:0/2973176549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 msgr2=0x555ec2542500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 0x555ec2542500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 -- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 msgr2=0x555ec2542a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2542a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 -- 172.21.15.18:0/2973176549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ec227e7d0 con 0x555ec2545470 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3f0a400640 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 0x555ec2542f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009fd0 tx=0x7f3efc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e095e88da17cbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3eeb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:51.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.025+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc004b20 con 0x555ec2545470 2024-04-21T22:35:51.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3efc017030 con 0x555ec2545470 2024-04-21T22:35:51.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef00041d0 con 0x555ec2545470 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3efc004cc0 con 0x555ec2545470 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 10 client.15780 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555ec25545c0 con 0x555ec2545470 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef00041d0 con 0x555ec2545470 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f3efc01dc10 con 0x555ec2545470 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 10 client.15780 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 10 client.15780 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 20 client.15780 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.026+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec2555ad0 0x555ec2557f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.027+0000 7f3f0f033740 4 client.15780 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.027+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ec24ad8e0 con 0x555ec2555ad0 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.027+0000 7f3f09a00640 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec2555ad0 0x555ec2557f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.027+0000 7f3f09a00640 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec2555ad0 0x555ec2557f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=761d0ab100df6b90 server_cookie=ea350bf5d878197c in_seq=0 out_seq=0 2024-04-21T22:35:51.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.027+0000 7f3eeb400640 10 client.15780 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.028+0000 7f3eeb400640 1 -- 172.21.15.18:0/2973176549 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555ec24ad8e0 con 0x555ec2555ad0 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.028+0000 7f3eeb400640 10 client.15780 handle_command_reply: tid=0 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.028+0000 7f3f0f033740 1 client.15780 shutdown 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 msgr2=0x555ec2542f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 0x555ec2542f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009fd0 tx=0x7f3efc004ab0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 shutdown_connections 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec2555ad0 0x555ec2557f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec2545470 0x555ec2542f80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec2542a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3eeb400640 0 client.15780 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 --2- 172.21.15.18:0/2973176549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253bf70 0x555ec2542500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 >> 172.21.15.18:0/2973176549 conn(0x555ec25366a0 msgr2=0x555ec25383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 shutdown_connections 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 1 -- 172.21.15.18:0/2973176549 wait complete. 2024-04-21T22:35:51.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.029+0000 7f3f0f033740 20 client.15780 trim_cache size 0 max 16384 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 Processor -- start 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 -- start start 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec2544c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec2545470 0x555ec25381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b38a0 con 0x555ec253bf70 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b5500 con 0x555ec2545470 2024-04-21T22:35:51.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.044+0000 7f3f0f033740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b3fd0 con 0x555ec253c890 2024-04-21T22:35:51.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec2544c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40670/0 (socket says 172.21.15.18:40670) 2024-04-21T22:35:51.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 -- 172.21.15.18:0/1966627232 learned_addr learned my addr 172.21.15.18:0/1966627232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f0a400640 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec2545470 0x555ec25381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 -- 172.21.15.18:0/1966627232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec2545470 msgr2=0x555ec25381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec2545470 0x555ec25381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 -- 172.21.15.18:0/1966627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 msgr2=0x555ec2544c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec2544c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.045+0000 7f3f09000640 1 -- 172.21.15.18:0/1966627232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ec2535ec0 con 0x555ec253c890 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3f09000640 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbc0 tx=0x7f3ef0003e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abaebcb78b1730d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3ef6000640 1 -- 172.21.15.18:0/1966627232 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef002b070 con 0x555ec253c890 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3ef6000640 1 -- 172.21.15.18:0/1966627232 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef0005520 con 0x555ec253c890 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3ef6000640 1 -- 172.21.15.18:0/1966627232 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0011440 con 0x555ec253c890 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3f0f033740 1 -- 172.21.15.18:0/1966627232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 msgr2=0x555ec2551120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.046+0000 7f3f0f033740 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbc0 tx=0x7f3ef0003e70 comp rx=0 tx=0).stop 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 -- 172.21.15.18:0/1966627232 shutdown_connections 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec2545470 0x555ec25381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec253c890 0x555ec2551120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 --2- 172.21.15.18:0/1966627232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec2544c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 -- 172.21.15.18:0/1966627232 >> 172.21.15.18:0/1966627232 conn(0x555ec25366a0 msgr2=0x555ec2537ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 -- 172.21.15.18:0/1966627232 shutdown_connections 2024-04-21T22:35:51.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 -- 172.21.15.18:0/1966627232 wait complete. 2024-04-21T22:35:51.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 -- start start 2024-04-21T22:35:51.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.047+0000 7f3f0f033740 1 Processor -- start 2024-04-21T22:35:51.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b4d70 con 0x555ec253bf70 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b46a0 con 0x555ec253c890 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041b1880 con 0x555ec2545470 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0f033740 10 client.0 _ll_register_callbacks cb 0x7f3efc011e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59250/0 (socket says 172.21.15.18:59250) 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49828/0 (socket says 172.21.15.18:49828) 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40672/0 (socket says 172.21.15.18:40672) 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09000640 1 -- 172.21.15.18:0/3882340264 learned_addr learned my addr 172.21.15.18:0/3882340264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 -- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 msgr2=0x555ec253fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 -- 172.21.15.18:0/3882340264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 msgr2=0x555ec253f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f0a400640 1 -- 172.21.15.18:0/3882340264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ec25bb5d0 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09000640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.048+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3f0a400640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3efc004130 tx=0x7f3efc003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1a03687b463161 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3eeb400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc03d060 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3efc004320 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef0005520 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3efc004b20 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3f0f033740 10 client.25909 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.049+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555ec25bc7d0 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ef0005520 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f3efc01db50 con 0x555ec2545470 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 10 client.25909 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 10 client.25909 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 20 client.25909 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec25bcf20 0x555ec25bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 4 client.25909 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ec24a7c30 con 0x555ec25bcf20 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.050+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec25bcf20 0x555ec25bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f09a00640 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec25bcf20 0x555ec25bf340 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2f6f800c44c21d12 server_cookie=bcc47f431def22d5 in_seq=0 out_seq=0 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3eeb400640 10 client.25909 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3eeb400640 1 -- 172.21.15.18:0/3882340264 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ec24a7c30 con 0x555ec25bcf20 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3eeb400640 10 client.25909 handle_command_reply: tid=0 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 client.25909 shutdown 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 msgr2=0x555ec25bb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3efc004130 tx=0x7f3efc003c20 comp rx=0 tx=0).stop 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 shutdown_connections 2024-04-21T22:35:51.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x555ec25bcf20 0x555ec25bf340 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555ec2545470 0x555ec25bb090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555ec253c890 0x555ec253fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 --2- 172.21.15.18:0/3882340264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555ec253bf70 0x555ec253f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3eeb400640 0 client.25909 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 >> 172.21.15.18:0/3882340264 conn(0x555ec25366a0 msgr2=0x555ec2535690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 shutdown_connections 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.051+0000 7f3f0f033740 1 -- 172.21.15.18:0/3882340264 wait complete. 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0f033740 20 client.25909 trim_cache size 0 max 16384 2024-04-21T22:35:51.055 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 msgr2=0x7f3eec0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 0x7f3eec0a5240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3efc011890 tx=0x7f3efc009500 comp rx=0 tx=0).stop 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 msgr2=0x7f3f0419e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009900 tx=0x7f3ef8004360 comp rx=0 tx=0).stop 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 shutdown_connections 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3eec0a2d80 0x7f3eec0a5240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f0410dc00 0x7f3f041a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f04108640 0x7f3f0419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 --2- 172.21.15.18:0/3295708483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f04107c80 0x7f3f0419e3b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 >> 172.21.15.18:0/3295708483 conn(0x7f3f04077550 msgr2=0x7f3f04078530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.052+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 shutdown_connections 2024-04-21T22:35:51.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.053+0000 7f3f0ae00640 1 -- 172.21.15.18:0/3295708483 wait complete. 2024-04-21T22:35:51.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:35:51.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 -- 172.21.15.18:0/503781296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380102720 msgr2=0x7fa380102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 --2- 172.21.15.18:0/503781296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380102720 0x7fa380102b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa370009900 tx=0x7fa37002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 -- 172.21.15.18:0/503781296 shutdown_connections 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 --2- 172.21.15.18:0/503781296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 0x7fa38010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 --2- 172.21.15.18:0/503781296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380103040 0x7fa38010b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.289+0000 7fa385800640 1 --2- 172.21.15.18:0/503781296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380102720 0x7fa380102b00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.290+0000 7fa385800640 1 -- 172.21.15.18:0/503781296 >> 172.21.15.18:0/503781296 conn(0x7fa3800771f0 msgr2=0x7fa3800fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.290+0000 7fa385800640 1 -- 172.21.15.18:0/503781296 shutdown_connections 2024-04-21T22:35:51.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.290+0000 7fa385800640 1 -- 172.21.15.18:0/503781296 wait complete. 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 Processor -- start 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 -- start start 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 0x7fa38019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801118f0 con 0x7fa380103040 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa380111770 con 0x7fa380102720 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.291+0000 7fa385800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa380111a70 con 0x7fa38010bb40 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49844/0 (socket says 172.21.15.18:49844) 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59274/0 (socket says 172.21.15.18:59274) 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37f400640 1 -- 172.21.15.18:0/3558471067 learned_addr learned my addr 172.21.15.18:0/3558471067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa384e00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 0x7fa38019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 -- 172.21.15.18:0/3558471067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 msgr2=0x7fa38019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 0x7fa38019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 -- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 msgr2=0x7fa3801983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 -- 172.21.15.18:0/3558471067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38019ce30 con 0x7fa380102720 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37f400640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.292+0000 7fa37fe00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa370000c00 tx=0x7fa37002cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.293+0000 7fa37cc00640 1 -- 172.21.15.18:0/3558471067 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370041070 con 0x7fa380102720 2024-04-21T22:35:51.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.293+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38019d0c0 con 0x7fa380102720 2024-04-21T22:35:51.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.293+0000 7fa37cc00640 1 -- 172.21.15.18:0/3558471067 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3700054e0 con 0x7fa380102720 2024-04-21T22:35:51.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.293+0000 7fa37cc00640 1 -- 172.21.15.18:0/3558471067 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370003d00 con 0x7fa380102720 2024-04-21T22:35:51.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.293+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3801a49b0 con 0x7fa380102720 2024-04-21T22:35:51.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 Processor -- start 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 -- start start 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa37cc00640 1 -- 172.21.15.18:0/3558471067 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa370044070 con 0x7fa380102720 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416b890 0x55d864173f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d864176860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d8640cf3a0 con 0x55d86416b890 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d864077930 con 0x55d864174470 2024-04-21T22:35:51.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.298+0000 7fa3897fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8640cb360 con 0x55d86416af70 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa37fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416b890 0x55d864173f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40698/0 (socket says 172.21.15.18:40698) 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 -- 172.21.15.18:0/1186820750 learned_addr learned my addr 172.21.15.18:0/1186820750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa37f400640 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d864176860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 -- 172.21.15.18:0/1186820750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 msgr2=0x55d864176860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d864176860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 -- 172.21.15.18:0/1186820750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416b890 msgr2=0x55d864173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416b890 0x55d864173f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 -- 172.21.15.18:0/1186820750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d863de33f0 con 0x55d86416af70 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.299+0000 7fa384e00640 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa378009f50 tx=0x7fa3780118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6baacec2872f0268 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa37cc00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 0x7fa3640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa375600640 1 -- 172.21.15.18:0/1186820750 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378004d20 con 0x55d86416af70 2024-04-21T22:35:51.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa375600640 1 -- 172.21.15.18:0/1186820750 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa378004050 con 0x55d86416af70 2024-04-21T22:35:51.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa375600640 1 -- 172.21.15.18:0/1186820750 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378005260 con 0x55d86416af70 2024-04-21T22:35:51.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa37cc00640 1 -- 172.21.15.18:0/3558471067 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa3700f0ba0 con 0x7fa380102720 2024-04-21T22:35:51.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.300+0000 7fa37fe00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 0x7fa3640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- 172.21.15.18:0/1186820750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 msgr2=0x55d86416b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa378009f50 tx=0x7fa3780118d0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa37fe00640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 0x7fa3640a51c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3700ee4b0 tx=0x7fa3700f46f0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- 172.21.15.18:0/1186820750 shutdown_connections 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d864176860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416b890 0x55d864173f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1186820750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d86416b350 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- 172.21.15.18:0/1186820750 >> 172.21.15.18:0/1186820750 conn(0x55d8641656a0 msgr2=0x55d864165a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- 172.21.15.18:0/1186820750 shutdown_connections 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- 172.21.15.18:0/1186820750 wait complete. 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.301+0000 7fa3897fd740 1 -- start start 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 Processor -- start 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864171440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d864171980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864171ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d864177260 con 0x55d864174470 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d86408ad80 con 0x55d86416b890 2024-04-21T22:35:51.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d8641773e0 con 0x55d86416af70 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa3897fd740 10 client.0 _ll_register_callbacks cb 0x55d8640c72b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa384e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864171440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa37f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d864171980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.302+0000 7fa384e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864171440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40706/0 (socket says 172.21.15.18:40706) 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa384e00640 1 -- 172.21.15.18:0/1412763028 learned_addr learned my addr 172.21.15.18:0/1412763028 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa384e00640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864171ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 -- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 msgr2=0x55d864171440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864171440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 -- 172.21.15.18:0/1412763028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 msgr2=0x55d864171ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864171ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 -- 172.21.15.18:0/1412763028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d863ead7d0 con 0x55d86416b890 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa37f400640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d864171980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3800fef60 tx=0x7fa36800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74caff2b23428379 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.303+0000 7fa36e000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:51.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368012110 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa368004050 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa378004050 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa3680122b0 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa3897fd740 10 client.25892 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d864187910 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa378004050 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa3680104c0 con 0x55d86416b890 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.304+0000 7fa3897fd740 10 client.25892 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa3897fd740 10 client.25892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa3897fd740 20 client.25892 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d864188ea0 0x55d86418b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa3897fd740 4 client.25892 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8640dc8e0 con 0x55d864188ea0 2024-04-21T22:35:51.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa384e00640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d864188ea0 0x55d86418b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa384e00640 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d864188ea0 0x55d86418b2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cc99815fb1a9e3 server_cookie=3edeeadb3e9ef9bd in_seq=0 out_seq=0 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.305+0000 7fa36e000640 10 client.25892 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.306+0000 7fa36e000640 1 -- 172.21.15.18:0/1412763028 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8640dc8e0 con 0x55d864188ea0 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.306+0000 7fa36e000640 10 client.25892 handle_command_reply: tid=0 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.306+0000 7fa3897fd740 1 client.25892 shutdown 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 msgr2=0x55d864171980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d864171980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3800fef60 tx=0x7fa36800f790 comp rx=0 tx=0).stop 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 shutdown_connections 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d864188ea0 0x55d86418b2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864171ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d864171980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa36e000640 0 client.25892 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 --2- 172.21.15.18:0/1412763028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864171440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 >> 172.21.15.18:0/1412763028 conn(0x55d8641656a0 msgr2=0x55d8641673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 shutdown_connections 2024-04-21T22:35:51.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 1 -- 172.21.15.18:0/1412763028 wait complete. 2024-04-21T22:35:51.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.307+0000 7fa3897fd740 20 client.25892 trim_cache size 0 max 16384 2024-04-21T22:35:51.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 Processor -- start 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 -- start start 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864173b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864190b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801ab0c0 con 0x55d864174470 2024-04-21T22:35:51.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801acd20 con 0x55d86416b890 2024-04-21T22:35:51.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.324+0000 7fa3897fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801ab7f0 con 0x55d86416af70 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa384e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864173b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59302/0 (socket says 172.21.15.18:59302) 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 -- 172.21.15.18:0/749488218 learned_addr learned my addr 172.21.15.18:0/749488218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa384e00640 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864190b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 -- 172.21.15.18:0/749488218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 msgr2=0x55d864173b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864173b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 -- 172.21.15.18:0/749488218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 msgr2=0x55d864190b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864190b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa37f400640 1 -- 172.21.15.18:0/749488218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d86418b920 con 0x55d86416b890 2024-04-21T22:35:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.325+0000 7fa384e00640 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864190b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.326+0000 7fa37f400640 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa368009620 tx=0x7fa36800fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a87c37f444a353a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.326+0000 7fa374c00640 1 -- 172.21.15.18:0/749488218 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368029070 con 0x55d86416b890 2024-04-21T22:35:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.326+0000 7fa374c00640 1 -- 172.21.15.18:0/749488218 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3680055c0 con 0x55d86416b890 2024-04-21T22:35:51.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.326+0000 7fa374c00640 1 -- 172.21.15.18:0/749488218 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680038e0 con 0x55d86416b890 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 -- 172.21.15.18:0/749488218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 msgr2=0x55d8641845b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa368009620 tx=0x7fa36800fc90 comp rx=0 tx=0).stop 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 -- 172.21.15.18:0/749488218 shutdown_connections 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d864174470 0x55d864190b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d86416b890 0x55d8641845b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 --2- 172.21.15.18:0/749488218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416af70 0x55d864173b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 -- 172.21.15.18:0/749488218 >> 172.21.15.18:0/749488218 conn(0x55d8641656a0 msgr2=0x55d864164690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 -- 172.21.15.18:0/749488218 shutdown_connections 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.327+0000 7fa3897fd740 1 -- 172.21.15.18:0/749488218 wait complete. 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.328+0000 7fa3897fd740 1 -- start start 2024-04-21T22:35:51.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.328+0000 7fa3897fd740 1 Processor -- start 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.328+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 0x55d86417d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d8641ee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801ac590 con 0x55d86416af70 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801abec0 con 0x55d864174470 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801a90a0 con 0x55d86416b890 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa3897fd740 10 client.0 _ll_register_callbacks cb 0x7fa368009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa384e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 0x55d86417d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa384e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49866/0 (socket says 172.21.15.18:49866) 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa384e00640 1 -- 172.21.15.18:0/4149068675 learned_addr learned my addr 172.21.15.18:0/4149068675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa384e00640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d8641ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 -- 172.21.15.18:0/4149068675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 msgr2=0x55d8641ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d8641ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 -- 172.21.15.18:0/4149068675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 msgr2=0x55d86417cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa37f400640 1 -- 172.21.15.18:0/4149068675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8641ee940 con 0x55d86416b890 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.329+0000 7fa384e00640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa37f400640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 0x55d86417d090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55d864177280 tx=0x7fa36802e670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece96b5bed6ce1be server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa36e000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368029070 con 0x55d86416b890 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa3680050d0 con 0x55d86416b890 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3680055c0 con 0x55d86416b890 2024-04-21T22:35:51.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa368010430 con 0x55d86416b890 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa3897fd740 10 client.25927 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d8641efba0 con 0x55d86416b890 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.330+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3680055c0 con 0x55d86416b890 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fa368025790 con 0x55d86416b890 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 10 client.25927 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 10 client.25927 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 20 client.25927 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d8641f0250 0x55d8641f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 4 client.25927 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8640d6c30 con 0x55d8641f0250 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa384e00640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d8641f0250 0x55d8641f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa384e00640 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d8641f0250 0x55d8641f2670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b68c346a835c6eb9 server_cookie=53e222a5771a10fb in_seq=0 out_seq=0 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.331+0000 7fa36e000640 10 client.25927 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa36e000640 1 -- 172.21.15.18:0/4149068675 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8640d6c30 con 0x55d8641f0250 2024-04-21T22:35:51.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa36e000640 10 client.25927 handle_command_reply: tid=0 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 client.25927 shutdown 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 msgr2=0x55d86417d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 0x55d86417d090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55d864177280 tx=0x7fa36802e670 comp rx=0 tx=0).stop 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 shutdown_connections 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55d8641f0250 0x55d8641f2670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d864174470 0x55d8641ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d86416b890 0x55d86417d090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 --2- 172.21.15.18:0/4149068675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d86416af70 0x55d86417cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa36e000640 0 client.25927 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 >> 172.21.15.18:0/4149068675 conn(0x55d8641656a0 msgr2=0x55d864171400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 shutdown_connections 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 1 -- 172.21.15.18:0/4149068675 wait complete. 2024-04-21T22:35:51.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.332+0000 7fa3897fd740 20 client.25927 trim_cache size 0 max 16384 2024-04-21T22:35:51.336 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 msgr2=0x7fa3640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 0x7fa3640a51c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3700ee4b0 tx=0x7fa3700f46f0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 msgr2=0x7fa380197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa370000c00 tx=0x7fa37002cb50 comp rx=0 tx=0).stop 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 shutdown_connections 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa3640a2d00 0x7fa3640a51c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa38010bb40 0x7fa38019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa380103040 0x7fa3801983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 --2- 172.21.15.18:0/3558471067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa380102720 0x7fa380197e90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 >> 172.21.15.18:0/3558471067 conn(0x7fa3800771f0 msgr2=0x7fa3800fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 shutdown_connections 2024-04-21T22:35:51.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.333+0000 7fa385800640 1 -- 172.21.15.18:0/3558471067 wait complete. 2024-04-21T22:35:51.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 -- 172.21.15.18:0/3163534989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 msgr2=0x7f6d04107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 --2- 172.21.15.18:0/3163534989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d04107990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009890 tx=0x7f6cf802bb70 comp rx=0 tx=0).stop 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 -- 172.21.15.18:0/3163534989 shutdown_connections 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 --2- 172.21.15.18:0/3163534989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d041003f0 0x7f6d0410e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 --2- 172.21.15.18:0/3163534989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d040ffa30 0x7f6d040ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 --2- 172.21.15.18:0/3163534989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d04107990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 -- 172.21.15.18:0/3163534989 >> 172.21.15.18:0/3163534989 conn(0x7f6d04076980 msgr2=0x7f6d040fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 -- 172.21.15.18:0/3163534989 shutdown_connections 2024-04-21T22:35:51.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.572+0000 7f6d0a000640 1 -- 172.21.15.18:0/3163534989 wait complete. 2024-04-21T22:35:51.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 Processor -- start 2024-04-21T22:35:51.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 -- start start 2024-04-21T22:35:51.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 0x7f6d0419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 0x7f6d0419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d0419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041118c0 con 0x7f6d041003f0 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d04111740 con 0x7f6d040ffa30 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.574+0000 7f6d0a000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d04111a40 con 0x7f6d041075b0 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 0x7f6d0419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 0x7f6d0419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 0x7f6d0419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49886/0 (socket says 172.21.15.18:49886) 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d03e00640 1 -- 172.21.15.18:0/702114102 learned_addr learned my addr 172.21.15.18:0/702114102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d09600640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d0419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 -- 172.21.15.18:0/702114102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 msgr2=0x7f6d0419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d0419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 -- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 msgr2=0x7f6d0419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 0x7f6d0419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 -- 172.21.15.18:0/702114102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0419f030 con 0x7f6d040ffa30 2024-04-21T22:35:51.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.575+0000 7f6d08c00640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 0x7f6d0419a040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8037040 tx=0x7f6cf8004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.576+0000 7f6d01600640 1 -- 172.21.15.18:0/702114102 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8041020 con 0x7f6d040ffa30 2024-04-21T22:35:51.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.576+0000 7f6d01600640 1 -- 172.21.15.18:0/702114102 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf802c9f0 con 0x7f6d040ffa30 2024-04-21T22:35:51.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.576+0000 7f6d01600640 1 -- 172.21.15.18:0/702114102 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8039040 con 0x7f6d040ffa30 2024-04-21T22:35:51.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.576+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0419f2c0 con 0x7f6d040ffa30 2024-04-21T22:35:51.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.576+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041a6bb0 con 0x7f6d040ffa30 2024-04-21T22:35:51.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.579+0000 7f6d01600640 1 -- 172.21.15.18:0/702114102 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6cf8044020 con 0x7f6d040ffa30 2024-04-21T22:35:51.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.579+0000 7f6d0e380740 1 Processor -- start 2024-04-21T22:35:51.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 -- start start 2024-04-21T22:35:51.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eed1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eed4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56456ee2d3a0 con 0x56456eec9890 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56456edd5930 con 0x56456eec8f70 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d0e380740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56456ee29360 con 0x56456eed2470 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d09600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d08c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eed1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d09600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59350/0 (socket says 172.21.15.18:59350) 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.580+0000 7f6d09600640 1 -- 172.21.15.18:0/2248635657 learned_addr learned my addr 172.21.15.18:0/2248635657 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d03e00640 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eed4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 -- 172.21.15.18:0/2248635657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 msgr2=0x56456eed4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eed4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 -- 172.21.15.18:0/2248635657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 msgr2=0x56456eed1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eed1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 -- 172.21.15.18:0/2248635657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456eb413f0 con 0x56456eec8f70 2024-04-21T22:35:51.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d03e00640 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eed4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6d09600640 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc010370 tx=0x7f6cfc010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900a78f17eece99a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6cf5c00640 1 -- 172.21.15.18:0/2248635657 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc016070 con 0x56456eec8f70 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6cf5c00640 1 -- 172.21.15.18:0/2248635657 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc004d20 con 0x56456eec8f70 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.581+0000 7f6cf5c00640 1 -- 172.21.15.18:0/2248635657 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc005480 con 0x56456eec8f70 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d01600640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 0x7f6cec0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d08c00640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 0x7f6cec0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d01600640 1 -- 172.21.15.18:0/702114102 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6cf80f0b80 con 0x7f6d040ffa30 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 -- 172.21.15.18:0/2248635657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 msgr2=0x56456eec9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc010370 tx=0x7f6cfc010830 comp rx=0 tx=0).stop 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 -- 172.21.15.18:0/2248635657 shutdown_connections 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eed4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eed1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2248635657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec8f70 0x56456eec9350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.582+0000 7f6d0e380740 1 -- 172.21.15.18:0/2248635657 >> 172.21.15.18:0/2248635657 conn(0x56456eec36a0 msgr2=0x56456eec3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.583+0000 7f6d0e380740 1 -- 172.21.15.18:0/2248635657 shutdown_connections 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.583+0000 7f6d0e380740 1 -- 172.21.15.18:0/2248635657 wait complete. 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.583+0000 7f6d08c00640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 0x7f6cec0a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56456eec8a40 tx=0x7f6cf80f4630 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.583+0000 7f6d0e380740 1 -- start start 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.583+0000 7f6d0e380740 1 Processor -- start 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eecf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eecffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56456eed5260 con 0x56456eec8f70 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56456ede8d80 con 0x56456eec9890 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56456eed53e0 con 0x56456eed2470 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d0e380740 10 client.0 _ll_register_callbacks cb 0x56456ee252b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d09600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eecf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d09600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eecf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49896/0 (socket says 172.21.15.18:49896) 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d09600640 1 -- 172.21.15.18:0/1182559122 learned_addr learned my addr 172.21.15.18:0/1182559122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.584+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59364/0 (socket says 172.21.15.18:59364) 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d09600640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eecffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 -- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 msgr2=0x56456eecffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eecffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 -- 172.21.15.18:0/1182559122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 msgr2=0x56456eecf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eecf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 -- 172.21.15.18:0/1182559122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456ec0b7d0 con 0x56456eec9890 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d09600640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eecffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d03e00640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d0410e140 tx=0x7f6cf0011b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a519cb91ee5a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6cea000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:51.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf001f060 con 0x56456eec9890 2024-04-21T22:35:51.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc004d20 con 0x56456eec9890 2024-04-21T22:35:51.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6cf0004320 con 0x56456eec9890 2024-04-21T22:35:51.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.585+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6cf000f970 con 0x56456eec9890 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 10 client.25910 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56456eee16d0 con 0x56456eec9890 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc004d20 con 0x56456eec9890 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6cf00223b0 con 0x56456eec9890 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 10 client.25910 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 10 client.25910 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 20 client.25910 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.586+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456eee2ae0 0x56456eee4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.587+0000 7f6d0e380740 4 client.25910 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.587+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56456ee3a8e0 con 0x56456eee2ae0 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.587+0000 7f6d09600640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456eee2ae0 0x56456eee4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.587+0000 7f6d09600640 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456eee2ae0 0x56456eee4ed0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3a08462f0276100 server_cookie=447040f139af6576 in_seq=0 out_seq=0 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.587+0000 7f6cea000640 10 client.25910 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:51.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6cea000640 1 -- 172.21.15.18:0/1182559122 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56456ee3a8e0 con 0x56456eee2ae0 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6cea000640 10 client.25910 handle_command_reply: tid=0 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 client.25910 shutdown 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 msgr2=0x56456eecfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d0410e140 tx=0x7f6cf0011b50 comp rx=0 tx=0).stop 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 shutdown_connections 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456eee2ae0 0x56456eee4ed0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eed2470 0x56456eecffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eec9890 0x56456eecfa90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 --2- 172.21.15.18:0/1182559122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eecf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 >> 172.21.15.18:0/1182559122 conn(0x56456eec36a0 msgr2=0x56456eec53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.588+0000 7f6cea000640 0 client.25910 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.589+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 shutdown_connections 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.589+0000 7f6d0e380740 1 -- 172.21.15.18:0/1182559122 wait complete. 2024-04-21T22:35:51.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.589+0000 7f6d0e380740 20 client.25910 trim_cache size 0 max 16384 2024-04-21T22:35:51.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 Processor -- start 2024-04-21T22:35:51.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 -- start start 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 0x56456eede180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eeea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041af540 con 0x56456eec8f70 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041b11a0 con 0x56456eed2470 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d0e380740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041afc70 con 0x56456eec9890 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d09600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d09600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49908/0 (socket says 172.21.15.18:49908) 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d09600640 1 -- 172.21.15.18:0/3469171790 learned_addr learned my addr 172.21.15.18:0/3469171790 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d03e00640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 0x56456eede180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.604+0000 7f6d09600640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eeea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 -- 172.21.15.18:0/3469171790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 msgr2=0x56456eede180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 0x56456eede180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 -- 172.21.15.18:0/3469171790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 msgr2=0x56456eeea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eeea7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 -- 172.21.15.18:0/3469171790 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456eebdae0 con 0x56456eec8f70 2024-04-21T22:35:51.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d03e00640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 0x56456eede180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6d09600640 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc015040 tx=0x7f6cfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb01b16fec6f47a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6cf5200640 1 -- 172.21.15.18:0/3469171790 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc016040 con 0x56456eec8f70 2024-04-21T22:35:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6cf5200640 1 -- 172.21.15.18:0/3469171790 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc032070 con 0x56456eec8f70 2024-04-21T22:35:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.605+0000 7f6cf5200640 1 -- 172.21.15.18:0/3469171790 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc005150 con 0x56456eec8f70 2024-04-21T22:35:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- 172.21.15.18:0/3469171790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 msgr2=0x56456eed1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc015040 tx=0x7f6cfc009bb0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- 172.21.15.18:0/3469171790 shutdown_connections 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eeea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec9890 0x56456eede180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 --2- 172.21.15.18:0/3469171790 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec8f70 0x56456eed1c80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- 172.21.15.18:0/3469171790 >> 172.21.15.18:0/3469171790 conn(0x56456eec36a0 msgr2=0x56456eeca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- 172.21.15.18:0/3469171790 shutdown_connections 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- 172.21.15.18:0/3469171790 wait complete. 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.606+0000 7f6d0e380740 1 -- start start 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 Processor -- start 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 0x56456eeda880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eecc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041b0a10 con 0x56456eec9890 2024-04-21T22:35:51.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041b0340 con 0x56456eed2470 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d041ad520 con 0x56456eec8f70 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d0e380740 10 client.0 _ll_register_callbacks cb 0x7f6cf0009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49922/0 (socket says 172.21.15.18:49922) 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.607+0000 7f6d03e00640 1 -- 172.21.15.18:0/2452972355 learned_addr learned my addr 172.21.15.18:0/2452972355 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d09600640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 0x56456eeda880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d09600640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eecc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 -- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 msgr2=0x56456eeda880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 0x56456eeda880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 -- 172.21.15.18:0/2452972355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 msgr2=0x56456eecc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eecc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 -- 172.21.15.18:0/2452972355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456eecc8a0 con 0x56456eec9890 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d09600640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 0x56456eeda880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6d03e00640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009740 tx=0x7f6cf0022d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c2cfd806ae519b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6cea000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.608+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00225c0 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc032070 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6cf0005390 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0039050 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 10 client.15822 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56456ef48d80 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc032070 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6cf0034030 con 0x56456eec9890 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 10 client.15822 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 10 client.15822 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 20 client.15822 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456ef49580 0x56456ef4b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 4 client.15822 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.609+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56456ee34c30 con 0x56456ef49580 2024-04-21T22:35:51.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.610+0000 7f6d09600640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456ef49580 0x56456ef4b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.610+0000 7f6d09600640 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456ef49580 0x56456ef4b9a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33face31de03e912 server_cookie=b035b793ec7a8eb8 in_seq=0 out_seq=0 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.610+0000 7f6cea000640 10 client.15822 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6cea000640 1 -- 172.21.15.18:0/2452972355 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56456ee34c30 con 0x56456ef49580 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6cea000640 10 client.15822 handle_command_reply: tid=0 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 client.15822 shutdown 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 msgr2=0x56456eecbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009740 tx=0x7f6cf0022d50 comp rx=0 tx=0).stop 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 shutdown_connections 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x56456ef49580 0x56456ef4b9a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56456eed2470 0x56456eecc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56456eec9890 0x56456eecbe20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6cea000640 0 client.15822 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:35:51.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 --2- 172.21.15.18:0/2452972355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56456eec8f70 0x56456eeda880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 >> 172.21.15.18:0/2452972355 conn(0x56456eec36a0 msgr2=0x56456eecf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 shutdown_connections 2024-04-21T22:35:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 1 -- 172.21.15.18:0/2452972355 wait complete. 2024-04-21T22:35:51.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.611+0000 7f6d0e380740 20 client.15822 trim_cache size 0 max 16384 2024-04-21T22:35:51.615 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 msgr2=0x7f6cec0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 0x7f6cec0a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56456eec8a40 tx=0x7f6cf80f4630 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 msgr2=0x7f6d0419a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 0x7f6d0419a040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8037040 tx=0x7f6cf8004430 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 shutdown_connections 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6cec0a2d80 0x7f6cec0a5240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d041075b0 0x7f6d0419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d041003f0 0x7f6d0419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 --2- 172.21.15.18:0/702114102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d040ffa30 0x7f6d0419a040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 >> 172.21.15.18:0/702114102 conn(0x7f6d04076980 msgr2=0x7f6d040fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 shutdown_connections 2024-04-21T22:35:51.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.612+0000 7f6d0a000640 1 -- 172.21.15.18:0/702114102 wait complete. 2024-04-21T22:35:51.627 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:51 smithi018 ceph-mon[26614]: pgmap v57: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:51.628 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:51 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2575139935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:51.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:35:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:51 smithi081 ceph-mon[31692]: pgmap v57: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:51 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2575139935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:51 smithi047 ceph-mon[31561]: pgmap v57: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:51 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2575139935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:35:51.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 -- 172.21.15.18:0/958667884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0109770 msgr2=0x7fcbe0109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/958667884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0109770 0x7fcbe0109b50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009900 tx=0x7fcbd002bc30 comp rx=0 tx=0).stop 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 -- 172.21.15.18:0/958667884 shutdown_connections 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/958667884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0104120 0x7fcbe0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/958667884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0103760 0x7fcbe0103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/958667884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0109770 0x7fcbe0109b50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.848+0000 7fcbdfe00640 1 -- 172.21.15.18:0/958667884 >> 172.21.15.18:0/958667884 conn(0x7fcbe00ff230 msgr2=0x7fcbe0101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.849+0000 7fcbdfe00640 1 -- 172.21.15.18:0/958667884 shutdown_connections 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.849+0000 7fcbdfe00640 1 -- 172.21.15.18:0/958667884 wait complete. 2024-04-21T22:35:51.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.850+0000 7fcbdfe00640 1 Processor -- start 2024-04-21T22:35:51.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.850+0000 7fcbdfe00640 1 -- start start 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0104120 0x7fcbe019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 0x7fcbe019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113b90 con 0x7fcbe0104120 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113a10 con 0x7fcbe0103760 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdfe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113d10 con 0x7fcbe0109770 2024-04-21T22:35:51.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbde000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0104120 0x7fcbe019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59402/0 (socket says 172.21.15.18:59402) 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdea00640 1 -- 172.21.15.18:0/168821172 learned_addr learned my addr 172.21.15.18:0/168821172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdf400640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 0x7fcbe019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.851+0000 7fcbdea00640 1 -- 172.21.15.18:0/168821172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 msgr2=0x7fcbe019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdea00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 0x7fcbe019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdea00640 1 -- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0104120 msgr2=0x7fcbe019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdea00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0104120 0x7fcbe019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdea00640 1 -- 172.21.15.18:0/168821172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe019f0e0 con 0x7fcbe0103760 2024-04-21T22:35:51.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdf400640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 0x7fcbe019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdea00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcbd002efd0 tx=0x7fcbd00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbd7400640 1 -- 172.21.15.18:0/168821172 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0041070 con 0x7fcbe0103760 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe019f370 con 0x7fcbe0103760 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbd7400640 1 -- 172.21.15.18:0/168821172 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd002ccc0 con 0x7fcbe0103760 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.852+0000 7fcbd7400640 1 -- 172.21.15.18:0/168821172 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0003c60 con 0x7fcbe0103760 2024-04-21T22:35:51.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.853+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01a6c60 con 0x7fcbe0103760 2024-04-21T22:35:51.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.856+0000 7fcbd7400640 1 -- 172.21.15.18:0/168821172 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fcbd0044070 con 0x7fcbe0103760 2024-04-21T22:35:51.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.856+0000 7fcbe89c2740 1 Processor -- start 2024-04-21T22:35:51.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.856+0000 7fcbe89c2740 1 -- start start 2024-04-21T22:35:51.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a080350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a088f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d89fe43a0 con 0x564d8a07ff70 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564d89f8c930 con 0x564d8a080890 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d89fe0360 con 0x564d8a089470 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbdf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a080350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbde000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a088f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbde000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40830/0 (socket says 172.21.15.18:40830) 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbde000640 1 -- 172.21.15.18:0/3316945422 learned_addr learned my addr 172.21.15.18:0/3316945422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.857+0000 7fcbd7400640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 0x7fcbc40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 -- 172.21.15.18:0/3316945422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 msgr2=0x564d8a088f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a088f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 -- 172.21.15.18:0/3316945422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 msgr2=0x564d8a080350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a080350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 -- 172.21.15.18:0/3316945422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d89cf83f0 con 0x564d8a089470 2024-04-21T22:35:51.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbd7400640 1 -- 172.21.15.18:0/168821172 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcbd00f0d60 con 0x7fcbe0103760 2024-04-21T22:35:51.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbdea00640 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a088f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbdf400640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 0x7fcbc40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbde000640 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009c90 tx=0x7fcbcc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61da4b71fdb6d192 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbcbe00640 1 -- 172.21.15.18:0/3316945422 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc01e070 con 0x564d8a089470 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbcbe00640 1 -- 172.21.15.18:0/3316945422 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbcc019b10 con 0x564d8a089470 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.858+0000 7fcbcbe00640 1 -- 172.21.15.18:0/3316945422 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00ea80 con 0x564d8a089470 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3316945422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 msgr2=0x564d8a08b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbdf400640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 0x7fcbc40a51c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009b80 tx=0x7fcbd8004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009c90 tx=0x7fcbcc011810 comp rx=0 tx=0).stop 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3316945422 shutdown_connections 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a08b860 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a088f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3316945422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a080350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3316945422 >> 172.21.15.18:0/3316945422 conn(0x564d8a07a6a0 msgr2=0x564d8a07aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3316945422 shutdown_connections 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.859+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3316945422 wait complete. 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 -- start start 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 Processor -- start 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a086960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a086ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564d8a08c260 con 0x564d8a07ff70 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564d89f9fd80 con 0x564d8a080890 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.860+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564d8a08c3e0 con 0x564d8a089470 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbe89c2740 10 client.0 _ll_register_callbacks cb 0x564d89fdc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49950/0 (socket says 172.21.15.18:49950) 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 -- 172.21.15.18:0/3499695833 learned_addr learned my addr 172.21.15.18:0/3499695833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdf400640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a086ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbde000640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a086960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 -- 172.21.15.18:0/3499695833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 msgr2=0x564d8a086ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a086ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 -- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 msgr2=0x564d8a086960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a086960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 -- 172.21.15.18:0/3499695833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d89dc27d0 con 0x564d8a07ff70 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbde000640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a086960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.861+0000 7fcbdea00640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005ec0 tx=0x7fcbd00036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5dc1cd5947f3aa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd004b070 con 0x564d8a07ff70 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcbd0005570 con 0x564d8a07ff70 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbcc019b10 con 0x564d8a07ff70 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbd00bd100 con 0x564d8a07ff70 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbe89c2740 10 client.15834 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564d8a0984e0 con 0x564d8a07ff70 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.862+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbcc019b10 con 0x564d8a07ff70 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcbd00ee6d0 con 0x564d8a07ff70 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 10 client.15834 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 20 client.15834 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a0999f0 0x564d8a09beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 4 client.15834 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d89ff18e0 con 0x564d8a0999f0 2024-04-21T22:35:51.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.863+0000 7fcbde000640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a0999f0 0x564d8a09beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.864+0000 7fcbde000640 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a0999f0 0x564d8a09beb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deeb4488d4175fc0 server_cookie=19b9ece693f8ca2b in_seq=0 out_seq=0 2024-04-21T22:35:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.864+0000 7fcbc8c00640 10 client.15834 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.864+0000 7fcbc8c00640 1 -- 172.21.15.18:0/3499695833 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d89ff18e0 con 0x564d8a0999f0 2024-04-21T22:35:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbc8c00640 10 client.15834 handle_command_reply: tid=0 2024-04-21T22:35:51.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 client.15834 shutdown 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 msgr2=0x564d8a086420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005ec0 tx=0x7fcbd00036b0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 shutdown_connections 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a0999f0 0x564d8a09beb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a089470 0x564d8a086ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a080890 0x564d8a086960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/3499695833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a07ff70 0x564d8a086420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbc8c00640 0 client.15834 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 >> 172.21.15.18:0/3499695833 conn(0x564d8a07a6a0 msgr2=0x564d8a07c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 shutdown_connections 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 1 -- 172.21.15.18:0/3499695833 wait complete. 2024-04-21T22:35:51.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.865+0000 7fcbe89c2740 20 client.15834 trim_cache size 0 max 16384 2024-04-21T22:35:51.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.880+0000 7fcbe89c2740 1 Processor -- start 2024-04-21T22:35:51.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 -- start start 2024-04-21T22:35:51.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a086cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a0a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01af510 con 0x564d8a089470 2024-04-21T22:35:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01b1170 con 0x564d8a07ff70 2024-04-21T22:35:51.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01afc40 con 0x564d8a080890 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59414/0 (socket says 172.21.15.18:59414) 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbdf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a0a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbdea00640 1 -- 172.21.15.18:0/407565525 learned_addr learned my addr 172.21.15.18:0/407565525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbde000640 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a086cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.881+0000 7fcbdea00640 1 -- 172.21.15.18:0/407565525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 msgr2=0x564d8a086cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbdea00640 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a086cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbdea00640 1 -- 172.21.15.18:0/407565525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 msgr2=0x564d8a0a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbdea00640 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a0a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbdea00640 1 -- 172.21.15.18:0/407565525 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8a07f170 con 0x564d8a07ff70 2024-04-21T22:35:51.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbdea00640 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005ab0 tx=0x7fcbd00bb840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f59a710706cfd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbcb400640 1 -- 172.21.15.18:0/407565525 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd004b040 con 0x564d8a07ff70 2024-04-21T22:35:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbcb400640 1 -- 172.21.15.18:0/407565525 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd00bda30 con 0x564d8a07ff70 2024-04-21T22:35:51.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.882+0000 7fcbcb400640 1 -- 172.21.15.18:0/407565525 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00bcc90 con 0x564d8a07ff70 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- 172.21.15.18:0/407565525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 msgr2=0x564d8a095180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0005ab0 tx=0x7fcbd00bb840 comp rx=0 tx=0).stop 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- 172.21.15.18:0/407565525 shutdown_connections 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a0a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a086cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/407565525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a07ff70 0x564d8a095180 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- 172.21.15.18:0/407565525 >> 172.21.15.18:0/407565525 conn(0x564d8a07a6a0 msgr2=0x564d8a079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- 172.21.15.18:0/407565525 shutdown_connections 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- 172.21.15.18:0/407565525 wait complete. 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.883+0000 7fcbe89c2740 1 -- start start 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 Processor -- start 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a083710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a083c50 0x564d8a0feff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01b09e0 con 0x564d8a089470 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01b0310 con 0x564d8a083c50 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01ad4f0 con 0x564d8a080890 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbe89c2740 10 client.0 _ll_register_callbacks cb 0x7fcbd0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbde000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a083710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40852/0 (socket says 172.21.15.18:40852) 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbdea00640 1 -- 172.21.15.18:0/2694530118 learned_addr learned my addr 172.21.15.18:0/2694530118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.884+0000 7fcbdf400640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a083c50 0x564d8a0feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 -- 172.21.15.18:0/2694530118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 msgr2=0x564d8a0831d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 -- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a083c50 msgr2=0x564d8a0feff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a083c50 0x564d8a0feff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 -- 172.21.15.18:0/2694530118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8a0ff580 con 0x564d8a089470 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbdea00640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbde000640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a083710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc011d10 tx=0x7fcbcc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04e65a4f4b04744 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.885+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc029e60 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcbcc0050b0 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd00bda30 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbcc037050 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 10 client.15840 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564d8a100840 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd00bda30 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcbcc00e750 con 0x564d8a089470 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 10 client.15840 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 20 client.15840 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a100f00 0x564d8a103320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 4 client.15840 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.886+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d89febc30 con 0x564d8a100f00 2024-04-21T22:35:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.887+0000 7fcbdea00640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a100f00 0x564d8a103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.887+0000 7fcbdea00640 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a100f00 0x564d8a103320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38d08f8325ed8c3 server_cookie=46566008081d290f in_seq=0 out_seq=0 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.887+0000 7fcbc8c00640 10 client.15840 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbc8c00640 1 -- 172.21.15.18:0/2694530118 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d89febc30 con 0x564d8a100f00 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbc8c00640 10 client.15840 handle_command_reply: tid=0 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 client.15840 shutdown 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 msgr2=0x564d8a083710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a083710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc011d10 tx=0x7fcbcc009850 comp rx=0 tx=0).stop 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 shutdown_connections 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564d8a083c50 0x564d8a0feff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564d8a089470 0x564d8a083710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x564d8a100f00 0x564d8a103320 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 --2- 172.21.15.18:0/2694530118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d8a080890 0x564d8a0831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 >> 172.21.15.18:0/2694530118 conn(0x564d8a07a6a0 msgr2=0x564d8a07b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbc8c00640 0 client.15840 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 shutdown_connections 2024-04-21T22:35:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 1 -- 172.21.15.18:0/2694530118 wait complete. 2024-04-21T22:35:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.888+0000 7fcbe89c2740 20 client.15840 trim_cache size 0 max 16384 2024-04-21T22:35:51.891 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:35:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 msgr2=0x7fcbc40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 0x7fcbc40a51c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009b80 tx=0x7fcbd8004a40 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 msgr2=0x7fcbe019a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcbd002efd0 tx=0x7fcbd00042f0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 shutdown_connections 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcbc40a2d00 0x7fcbc40a51c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe0109770 0x7fcbe019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbe0104120 0x7fcbe019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 --2- 172.21.15.18:0/168821172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbe0103760 0x7fcbe019a0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 >> 172.21.15.18:0/168821172 conn(0x7fcbe00ff230 msgr2=0x7fcbe00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 shutdown_connections 2024-04-21T22:35:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:51.889+0000 7fcbdfe00640 1 -- 172.21.15.18:0/168821172 wait complete. 2024-04-21T22:35:52.907 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:35:52.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:35:52.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:35:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 -- 172.21.15.18:0/2272481450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100df0 msgr2=0x7f657c10d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 --2- 172.21.15.18:0/2272481450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100df0 0x7f657c10d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6574009cd0 tx=0x7f657402c0e0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 -- 172.21.15.18:0/2272481450 shutdown_connections 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 --2- 172.21.15.18:0/2272481450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100df0 0x7f657c10d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 --2- 172.21.15.18:0/2272481450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100430 0x7f657c1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 --2- 172.21.15.18:0/2272481450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c1068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 -- 172.21.15.18:0/2272481450 >> 172.21.15.18:0/2272481450 conn(0x7f657c0771f0 msgr2=0x7f657c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.140+0000 7f6582e00640 1 -- 172.21.15.18:0/2272481450 shutdown_connections 2024-04-21T22:35:53.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.141+0000 7f6582e00640 1 -- 172.21.15.18:0/2272481450 wait complete. 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.141+0000 7f6582e00640 1 Processor -- start 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 -- start start 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100df0 0x7f657c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1107e0 con 0x7f657c1064d0 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f657c110660 con 0x7f657c100df0 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f657c110960 con 0x7f657c100430 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6581a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6581a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40868/0 (socket says 172.21.15.18:40868) 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6581a00640 1 -- 172.21.15.18:0/1451386192 learned_addr learned my addr 172.21.15.18:0/1451386192 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6581000640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100df0 0x7f657c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.142+0000 7f6582400640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 -- 172.21.15.18:0/1451386192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100df0 msgr2=0x7f657c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100df0 0x7f657c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 -- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 msgr2=0x7f657c19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 -- 172.21.15.18:0/1451386192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c19ce20 con 0x7f657c100430 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6582400640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:53.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6581a00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f657a000640 1 -- 172.21.15.18:0/1451386192 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000cd80 con 0x7f657c100430 2024-04-21T22:35:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f657a000640 1 -- 172.21.15.18:0/1451386192 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570010910 con 0x7f657c100430 2024-04-21T22:35:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f657a000640 1 -- 172.21.15.18:0/1451386192 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570018990 con 0x7f657c100430 2024-04-21T22:35:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.143+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c19d110 con 0x7f657c100430 2024-04-21T22:35:53.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.144+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c1a49a0 con 0x7f657c100430 2024-04-21T22:35:53.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.148+0000 7f6587031740 1 Processor -- start 2024-04-21T22:35:53.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.148+0000 7f6587031740 1 -- start start 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.148+0000 7f657a000640 1 -- 172.21.15.18:0/1451386192 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6570010ac0 con 0x7f657c100430 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f6d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f7acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561d67ecbdf0 con 0x561d67f6d2c0 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d67ed1040 con 0x561d67f6dc70 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6587031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561d67e798c0 con 0x561d67f7b1f0 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6582400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f6d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40880/0 (socket says 172.21.15.18:40880) 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 -- 172.21.15.18:0/3631058677 learned_addr learned my addr 172.21.15.18:0/3631058677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581a00640 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f7acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 -- 172.21.15.18:0/3631058677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 msgr2=0x561d67f7acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f7acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 -- 172.21.15.18:0/3631058677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 msgr2=0x561d67f6d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f6d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.149+0000 7f6581000640 1 -- 172.21.15.18:0/3631058677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d67cad7e0 con 0x561d67f7b1f0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.150+0000 7f6581000640 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6568009c90 tx=0x7f6568011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f951aa9adea095 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.150+0000 7f656ea00640 1 -- 172.21.15.18:0/3631058677 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656801e070 con 0x561d67f7b1f0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.150+0000 7f656ea00640 1 -- 172.21.15.18:0/3631058677 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568019b10 con 0x561d67f7b1f0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.150+0000 7f656ea00640 1 -- 172.21.15.18:0/3631058677 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656800eaf0 con 0x561d67f7b1f0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.150+0000 7f657a000640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 0x7f65640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f657a000640 1 -- 172.21.15.18:0/1451386192 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f65700cf6d0 con 0x7f657c100430 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6582400640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 0x7f65640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 -- 172.21.15.18:0/3631058677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 msgr2=0x561d67f7d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6568009c90 tx=0x7f6568011810 comp rx=0 tx=0).stop 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 -- 172.21.15.18:0/3631058677 shutdown_connections 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f7b1f0 0x561d67f7d5e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f7acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 --2- 172.21.15.18:0/3631058677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f6d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 -- 172.21.15.18:0/3631058677 >> 172.21.15.18:0/3631058677 conn(0x561d67f68010 msgr2=0x561d67f683f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 -- 172.21.15.18:0/3631058677 shutdown_connections 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6587031740 1 -- 172.21.15.18:0/3631058677 wait complete. 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.151+0000 7f6582400640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 0x7f65640a5240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f657402c620 tx=0x7f6574004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 -- start start 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 Processor -- start 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 0x561d67f781f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f78c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561d67e8cd20 con 0x561d67f7b1f0 2024-04-21T22:35:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561d67ecd000 con 0x561d67f6d2c0 2024-04-21T22:35:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.152+0000 7f6587031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561d67f7dfb0 con 0x561d67f6dc70 2024-04-21T22:35:53.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6587031740 10 client.0 _ll_register_callbacks cb 0x561d67ec80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:53.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6582400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f78c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40890/0 (socket says 172.21.15.18:40890) 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 -- 172.21.15.18:0/2645694577 learned_addr learned my addr 172.21.15.18:0/2645694577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581a00640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 0x561d67f781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 -- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 msgr2=0x561d67f781f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 0x561d67f781f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 -- 172.21.15.18:0/2645694577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 msgr2=0x561d67f78c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f78c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 -- 172.21.15.18:0/2645694577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d67d0df70 con 0x561d67f6dc70 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581a00640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 0x561d67f781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.153+0000 7f6581000640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6568009890 tx=0x7f6568019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf843a980637cb39 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6563400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:53.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656801e040 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6568019b10 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6568004030 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6568033050 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6587031740 10 client.25972 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d67ba5170 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.154+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568019b10 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f656800e7f0 con 0x561d67f6dc70 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 10 client.25972 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 10 client.25972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 20 client.25972 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67f8b390 0x561d67f8d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 4 client.25972 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d67ede580 con 0x561d67f8b390 2024-04-21T22:35:53.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.155+0000 7f6581a00640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67f8b390 0x561d67f8d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.156+0000 7f6581a00640 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67f8b390 0x561d67f8d780 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4297b8a8e603be server_cookie=a5e71ffc3a2fea35 in_seq=0 out_seq=0 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.156+0000 7f6563400640 10 client.25972 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.156+0000 7f6563400640 1 -- 172.21.15.18:0/2645694577 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561d67ede580 con 0x561d67f8b390 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.156+0000 7f6563400640 10 client.25972 handle_command_reply: tid=0 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 client.25972 shutdown 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 msgr2=0x561d67f78730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6568009890 tx=0x7f6568019660 comp rx=0 tx=0).stop 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 shutdown_connections 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f78c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67f8b390 0x561d67f8d780 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f78730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 --2- 172.21.15.18:0/2645694577 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6d2c0 0x561d67f781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6563400640 0 client.25972 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 >> 172.21.15.18:0/2645694577 conn(0x561d67f68010 msgr2=0x561d67f69d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 shutdown_connections 2024-04-21T22:35:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 1 -- 172.21.15.18:0/2645694577 wait complete. 2024-04-21T22:35:53.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.157+0000 7f6587031740 20 client.25972 trim_cache size 0 max 16384 2024-04-21T22:35:53.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 Processor -- start 2024-04-21T22:35:53.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 -- start start 2024-04-21T22:35:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1ab190 con 0x561d67f7b1f0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1acdf0 con 0x561d67f6dc70 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.180+0000 7f6587031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1ab8c0 con 0x561d67f6d2c0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40892/0 (socket says 172.21.15.18:40892) 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 -- 172.21.15.18:0/36337957 learned_addr learned my addr 172.21.15.18:0/36337957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6582400640 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581000640 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 -- 172.21.15.18:0/36337957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 msgr2=0x561d67f788c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f788c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 -- 172.21.15.18:0/36337957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 msgr2=0x561d67f93000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f93000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.181+0000 7f6581a00640 1 -- 172.21.15.18:0/36337957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d67f6c9d0 con 0x561d67f6d2c0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f6581a00640 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9c0 tx=0x7f6570000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6397e8b585ffd35e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f656e000640 1 -- 172.21.15.18:0/36337957 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65700a4860 con 0x561d67f6d2c0 2024-04-21T22:35:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f656e000640 1 -- 172.21.15.18:0/36337957 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570099ef0 con 0x561d67f6d2c0 2024-04-21T22:35:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f656e000640 1 -- 172.21.15.18:0/36337957 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657009b040 con 0x561d67f6d2c0 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f6587031740 1 -- 172.21.15.18:0/36337957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 msgr2=0x561d67f86d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.182+0000 7f6587031740 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9c0 tx=0x7f6570000bc0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 -- 172.21.15.18:0/36337957 shutdown_connections 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f7b1f0 0x561d67f93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f6dc70 0x561d67f788c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 --2- 172.21.15.18:0/36337957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6d2c0 0x561d67f86d60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 -- 172.21.15.18:0/36337957 >> 172.21.15.18:0/36337957 conn(0x561d67f68010 msgr2=0x561d67f781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 -- 172.21.15.18:0/36337957 shutdown_connections 2024-04-21T22:35:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 -- 172.21.15.18:0/36337957 wait complete. 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 -- start start 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.183+0000 7f6587031740 1 Processor -- start 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f83270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f7b1f0 0x561d67f6ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1ac660 con 0x561d67f6d2c0 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1abf90 con 0x561d67f7b1f0 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f657c1a9170 con 0x561d67f6dc70 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6587031740 10 client.0 _ll_register_callbacks cb 0x7f656801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f83270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40898/0 (socket says 172.21.15.18:40898) 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 -- 172.21.15.18:0/420227385 learned_addr learned my addr 172.21.15.18:0/420227385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6582400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f7b1f0 0x561d67f6ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 -- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f7b1f0 msgr2=0x561d67f6ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f7b1f0 0x561d67f6ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 -- 172.21.15.18:0/420227385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 msgr2=0x561d67f83270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f83270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.184+0000 7f6581000640 1 -- 172.21.15.18:0/420227385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d67f70730 con 0x561d67f6dc70 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6581000640 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656800ec10 tx=0x7f65680098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0b52660e703cf8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6563400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656800e8e0 con 0x561d67f6dc70 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6570099ef0 con 0x561d67f6dc70 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6568004040 con 0x561d67f6dc70 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6568005040 con 0x561d67f6dc70 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6587031740 10 client.25978 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.185+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d67ff6bc0 con 0x561d67f6dc70 2024-04-21T22:35:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570099ef0 con 0x561d67f6dc70 2024-04-21T22:35:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f6568019ce0 con 0x561d67f6dc70 2024-04-21T22:35:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 10 client.25978 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 20 client.25978 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67ff7390 0x561d67ff97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 4 client.25978 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561d67ed88d0 con 0x561d67ff7390 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.186+0000 7f6581a00640 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67ff7390 0x561d67ff97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.187+0000 7f6581a00640 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67ff7390 0x561d67ff97b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f91001032f7a74 server_cookie=87c5887453ef2457 in_seq=0 out_seq=0 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.187+0000 7f6563400640 10 client.25978 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.188+0000 7f6563400640 1 -- 172.21.15.18:0/420227385 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561d67ed88d0 con 0x561d67ff7390 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.188+0000 7f6563400640 10 client.25978 handle_command_reply: tid=0 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.188+0000 7f6587031740 1 client.25978 shutdown 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.188+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 msgr2=0x561d67f837b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.188+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f656800ec10 tx=0x7f65680098c0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 shutdown_connections 2024-04-21T22:35:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561d67f7b1f0 0x561d67f6ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561d67ff7390 0x561d67ff97b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d67f6dc70 0x561d67f837b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 --2- 172.21.15.18:0/420227385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d67f6d2c0 0x561d67f83270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 >> 172.21.15.18:0/420227385 conn(0x561d67f68010 msgr2=0x561d67f78870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6563400640 0 client.25978 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 shutdown_connections 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 1 -- 172.21.15.18:0/420227385 wait complete. 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.189+0000 7f6587031740 20 client.25978 trim_cache size 0 max 16384 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:53.191 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "c595848f-8f04-4d8d-95bb-e3e07698f1bc", 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 msgr2=0x7f65640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 0x7f65640a5240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f657402c620 tx=0x7f6574004a40 comp rx=0 tx=0).stop 2024-04-21T22:35:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 msgr2=0x7f657c197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 shutdown_connections 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f65640a2d80 0x7f65640a5240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f657c1064d0 0x7f657c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f657c100df0 0x7f657c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 --2- 172.21.15.18:0/1451386192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657c100430 0x7f657c197e30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 >> 172.21.15.18:0/1451386192 conn(0x7f657c0771f0 msgr2=0x7f657c068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 shutdown_connections 2024-04-21T22:35:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.190+0000 7f6582e00640 1 -- 172.21.15.18:0/1451386192 wait complete. 2024-04-21T22:35:53.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:35:53.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:35:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 -- 172.21.15.18:0/2279694627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 msgr2=0x7f77fc102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 --2- 172.21.15.18:0/2279694627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc102b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 -- 172.21.15.18:0/2279694627 shutdown_connections 2024-04-21T22:35:53.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 --2- 172.21.15.18:0/2279694627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc10bb40 0x7f77fc10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 --2- 172.21.15.18:0/2279694627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc103040 0x7f77fc10b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 --2- 172.21.15.18:0/2279694627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc102b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 -- 172.21.15.18:0/2279694627 >> 172.21.15.18:0/2279694627 conn(0x7f77fc0771f0 msgr2=0x7f77fc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 -- 172.21.15.18:0/2279694627 shutdown_connections 2024-04-21T22:35:53.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.439+0000 7f77fbe00640 1 -- 172.21.15.18:0/2279694627 wait complete. 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.440+0000 7f77fbe00640 1 Processor -- start 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 -- start start 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc10bb40 0x7f77fc19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc111940 con 0x7f77fc10bb40 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1117c0 con 0x7f77fc102720 2024-04-21T22:35:53.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc111ac0 con 0x7f77fc103040 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40914/0 (socket says 172.21.15.18:40914) 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77fa000640 1 -- 172.21.15.18:0/3879517823 learned_addr learned my addr 172.21.15.18:0/3879517823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.441+0000 7f77faa00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fb400640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc10bb40 0x7f77fc19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 -- 172.21.15.18:0/3879517823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 msgr2=0x7f77fc197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 -- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc10bb40 msgr2=0x7f77fc19c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc10bb40 0x7f77fc19c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 -- 172.21.15.18:0/3879517823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc19ce90 con 0x7f77fc103040 2024-04-21T22:35:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77faa00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.442+0000 7f77fa000640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77e800e9f0 tx=0x7f77e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.443+0000 7f7800a00640 1 -- 172.21.15.18:0/3879517823 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e800cd80 con 0x7f77fc103040 2024-04-21T22:35:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.443+0000 7f7800a00640 1 -- 172.21.15.18:0/3879517823 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8010910 con 0x7f77fc103040 2024-04-21T22:35:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.443+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc19d180 con 0x7f77fc103040 2024-04-21T22:35:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.443+0000 7f7800a00640 1 -- 172.21.15.18:0/3879517823 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8018990 con 0x7f77fc103040 2024-04-21T22:35:53.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.443+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc1a4a10 con 0x7f77fc103040 2024-04-21T22:35:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.447+0000 7f7800a00640 1 -- 172.21.15.18:0/3879517823 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f77e8010ac0 con 0x7f77fc103040 2024-04-21T22:35:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.447+0000 7f7804b8f740 1 Processor -- start 2024-04-21T22:35:53.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.447+0000 7f7804b8f740 1 -- start start 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471dab0 0x55aaa471de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa47293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aaa4681410 con 0x55aaa471dab0 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aaa46297e0 con 0x55aaa4726fb0 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f7804b8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aaa467d3d0 con 0x55aaa471e3d0 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40920/0 (socket says 172.21.15.18:40920) 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 -- 172.21.15.18:0/4097394789 learned_addr learned my addr 172.21.15.18:0/4097394789 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77fa000640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa47293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77fb400640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471dab0 0x55aaa471de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 -- 172.21.15.18:0/4097394789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 msgr2=0x55aaa47293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa47293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 -- 172.21.15.18:0/4097394789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471dab0 msgr2=0x55aaa471de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471dab0 0x55aaa471de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.448+0000 7f77faa00640 1 -- 172.21.15.18:0/4097394789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa445f7d0 con 0x55aaa471e3d0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77fa000640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa47293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77faa00640 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009230 tx=0x7f77ec009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b04a2626eaad15 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f7800a00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 0x7f77e00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f7800a00640 1 -- 172.21.15.18:0/3879517823 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77e80cf720 con 0x7f77fc103040 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77e7e00640 1 -- 172.21.15.18:0/4097394789 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec043070 con 0x55aaa471e3d0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77e7e00640 1 -- 172.21.15.18:0/4097394789 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec02c6e0 con 0x55aaa471e3d0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77e7e00640 1 -- 172.21.15.18:0/4097394789 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec004ee0 con 0x55aaa471e3d0 2024-04-21T22:35:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.449+0000 7f77fb400640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 0x7f77e00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 -- 172.21.15.18:0/4097394789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 msgr2=0x55aaa4726a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f77fb400640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 0x7f77e00a5240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005fd0 tx=0x7f77f4009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009230 tx=0x7f77ec009560 comp rx=0 tx=0).stop 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 -- 172.21.15.18:0/4097394789 shutdown_connections 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa47293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4726a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 --2- 172.21.15.18:0/4097394789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471dab0 0x55aaa471de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.450+0000 7f7804b8f740 1 -- 172.21.15.18:0/4097394789 >> 172.21.15.18:0/4097394789 conn(0x55aaa47181e0 msgr2=0x55aaa47185c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.451+0000 7f7804b8f740 1 -- 172.21.15.18:0/4097394789 shutdown_connections 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.451+0000 7f7804b8f740 1 -- 172.21.15.18:0/4097394789 wait complete. 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.451+0000 7f7804b8f740 1 -- start start 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.451+0000 7f7804b8f740 1 Processor -- start 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa4724070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471e3d0 0x55aaa47245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aaa4729d40 con 0x55aaa471e3d0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aaa463cc40 con 0x55aaa4726fb0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aaa4729ec0 con 0x55aaa471dab0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f7804b8f740 10 client.0 _ll_register_callbacks cb 0x55aaa463c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f77fb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f77faa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa4724070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f77fb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59516/0 (socket says 172.21.15.18:59516) 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f77fb400640 1 -- 172.21.15.18:0/1234860007 learned_addr learned my addr 172.21.15.18:0/1234860007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.452+0000 7f77fa000640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471e3d0 0x55aaa47245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 -- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 msgr2=0x55aaa4724af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 -- 172.21.15.18:0/1234860007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471e3d0 msgr2=0x55aaa47245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471e3d0 0x55aaa47245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 -- 172.21.15.18:0/1234860007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa43953f0 con 0x55aaa471dab0 2024-04-21T22:35:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77fb400640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77faa00640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa4724070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77ec02c2d0 tx=0x7f77ec009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=354399fcfd57b411 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.453+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec04f070 con 0x55aaa471dab0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77ec02c6e0 con 0x55aaa471dab0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77ec048450 con 0x55aaa471dab0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77ec058050 con 0x55aaa471dab0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 10 client.25990 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aaa43550f0 con 0x55aaa471dab0 2024-04-21T22:35:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec02c6e0 con 0x55aaa471dab0 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f77ec052020 con 0x55aaa471dab0 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 10 client.25990 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 10 client.25990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.454+0000 7f7804b8f740 20 client.25990 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa473fa00 0x55aaa4741df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f7804b8f740 4 client.25990 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaa4694c40 con 0x55aaa473fa00 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f77fa000640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa473fa00 0x55aaa4741df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f77fa000640 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa473fa00 0x55aaa4741df0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15f5386cd4fa147 server_cookie=d224715fe4904dcb in_seq=0 out_seq=0 2024-04-21T22:35:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.455+0000 7f77e4c00640 10 client.25990 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.456+0000 7f77e4c00640 1 -- 172.21.15.18:0/1234860007 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aaa4694c40 con 0x55aaa473fa00 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.456+0000 7f77e4c00640 10 client.25990 handle_command_reply: tid=0 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.456+0000 7f7804b8f740 1 client.25990 shutdown 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.456+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 msgr2=0x55aaa4724070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.456+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa4724070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77ec02c2d0 tx=0x7f77ec009260 comp rx=0 tx=0).stop 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 shutdown_connections 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa4726fb0 0x55aaa4724af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa471e3d0 0x55aaa47245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa473fa00 0x55aaa4741df0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 --2- 172.21.15.18:0/1234860007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa4724070 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 >> 172.21.15.18:0/1234860007 conn(0x55aaa47181e0 msgr2=0x55aaa4719f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f77e4c00640 0 client.25990 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 shutdown_connections 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 1 -- 172.21.15.18:0/1234860007 wait complete. 2024-04-21T22:35:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.457+0000 7f7804b8f740 20 client.25990 trim_cache size 0 max 16384 2024-04-21T22:35:53.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 Processor -- start 2024-04-21T22:35:53.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 -- start start 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa47267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa47479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1ab070 con 0x55aaa4726fb0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1accd0 con 0x55aaa471e3d0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.479+0000 7f7804b8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1ab7a0 con 0x55aaa471dab0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59520/0 (socket says 172.21.15.18:59520) 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 -- 172.21.15.18:0/920378279 learned_addr learned my addr 172.21.15.18:0/920378279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77faa00640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa47267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fb400640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa47479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 -- 172.21.15.18:0/920378279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 msgr2=0x55aaa47267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa47267a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 -- 172.21.15.18:0/920378279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 msgr2=0x55aaa47479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa47479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 -- 172.21.15.18:0/920378279 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa4729710 con 0x55aaa471e3d0 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fb400640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa47479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:35:53.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.480+0000 7f77fa000640 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f77e80cce70 tx=0x7f77e80d1b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72be8df92dbd32eb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.481+0000 7f77e7400640 1 -- 172.21.15.18:0/920378279 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8099d30 con 0x55aaa471e3d0 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.481+0000 7f77e7400640 1 -- 172.21.15.18:0/920378279 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8099f90 con 0x55aaa471e3d0 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.481+0000 7f77e7400640 1 -- 172.21.15.18:0/920378279 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8018db0 con 0x55aaa471e3d0 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.481+0000 7f7804b8f740 1 -- 172.21.15.18:0/920378279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 msgr2=0x55aaa47474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.481+0000 7f7804b8f740 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f77e80cce70 tx=0x7f77e80d1b70 comp rx=0 tx=0).stop 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 -- 172.21.15.18:0/920378279 shutdown_connections 2024-04-21T22:35:53.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa47479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471e3d0 0x55aaa47474a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 --2- 172.21.15.18:0/920378279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471dab0 0x55aaa47267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 -- 172.21.15.18:0/920378279 >> 172.21.15.18:0/920378279 conn(0x55aaa47181e0 msgr2=0x55aaa47229a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 -- 172.21.15.18:0/920378279 shutdown_connections 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 -- 172.21.15.18:0/920378279 wait complete. 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 -- start start 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.482+0000 7f7804b8f740 1 Processor -- start 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4737ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa4720480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1ac540 con 0x55aaa4726fb0 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1abe70 con 0x55aaa471dab0 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1a9050 con 0x55aaa471e3d0 2024-04-21T22:35:53.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f7804b8f740 10 client.0 _ll_register_callbacks cb 0x7f77ec02c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:59528/0 (socket says 172.21.15.18:59528) 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77faa00640 1 -- 172.21.15.18:0/621696220 learned_addr learned my addr 172.21.15.18:0/621696220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77fa000640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4737ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77fb400640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa4720480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77faa00640 1 -- 172.21.15.18:0/621696220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 msgr2=0x55aaa4737ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.483+0000 7f77faa00640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4737ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77faa00640 1 -- 172.21.15.18:0/621696220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 msgr2=0x55aaa4720480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77faa00640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa4720480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77faa00640 1 -- 172.21.15.18:0/621696220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa4720b70 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77faa00640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec03f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3f8cea837e9237 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec061060 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77ec03f440 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.484+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77e8099f90 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77ec04c040 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 10 client.25970 fetch_fsmap learned FSMap version 30 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55aaa47a5700 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8099f90 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f77ec052070 con 0x55aaa471dab0 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 10 client.25970 fetch_fsmap finished waiting for FSMap version 30 2024-04-21T22:35:53.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 20 client.25970 populate_metadata read hostname 'smithi018' 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa47a5eb0 0x55aaa47a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 4 client.25970 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.485+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aaa468e950 con 0x55aaa47a5eb0 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f77fa000640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa47a5eb0 0x55aaa47a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f77fa000640 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa47a5eb0 0x55aaa47a82d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4666d2a477845fdd server_cookie=2b0fdb880fecbcc8 in_seq=0 out_seq=0 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f77e4c00640 10 client.25970 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f77e4c00640 1 -- 172.21.15.18:0/621696220 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55aaa468e950 con 0x55aaa47a5eb0 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f77e4c00640 10 client.25970 handle_command_reply: tid=0 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f7804b8f740 1 client.25970 shutdown 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 msgr2=0x55aaa47379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.486+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec03f920 comp rx=0 tx=0).stop 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 shutdown_connections 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aaa4726fb0 0x55aaa4720480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aaa47a5eb0 0x55aaa47a82d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aaa471e3d0 0x55aaa4737ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 --2- 172.21.15.18:0/621696220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aaa471dab0 0x55aaa47379a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 >> 172.21.15.18:0/621696220 conn(0x55aaa47181e0 msgr2=0x55aaa4716bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f77e4c00640 0 client.25970 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 shutdown_connections 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 1 -- 172.21.15.18:0/621696220 wait complete. 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.487+0000 7f7804b8f740 20 client.25970 trim_cache size 0 max 16384 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stdout: "c595848f-8f04-4d8d-95bb-e3e07698f1bc": { 2024-04-21T22:35:53.490 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "c595848f-8f04-4d8d-95bb-e3e07698f1bc", 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:35:53.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 msgr2=0x7f77e00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 0x7f77e00a5240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005fd0 tx=0x7f77f4009500 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 msgr2=0x7f77fc1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f77e800e9f0 tx=0x7f77e800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 shutdown_connections 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77e00a2d80 0x7f77e00a5240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77fc10bb40 0x7f77fc19c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77fc103040 0x7f77fc1983e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 --2- 172.21.15.18:0/3879517823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77fc102720 0x7f77fc197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 >> 172.21.15.18:0/3879517823 conn(0x7f77fc0771f0 msgr2=0x7f77fc0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 shutdown_connections 2024-04-21T22:35:53.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:35:53.488+0000 7f77fbe00640 1 -- 172.21.15.18:0/3879517823 wait complete. 2024-04-21T22:35:53.509 INFO:tasks.cephfs.filesystem:scrub status for tag:c595848f-8f04-4d8d-95bb-e3e07698f1bc - {'path': '/', 'tag': 'c595848f-8f04-4d8d-95bb-e3e07698f1bc', 'options': 'recursive,force'} 2024-04-21T22:35:53.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:53 smithi018 ceph-mon[26614]: pgmap v58: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:53 smithi081 ceph-mon[31692]: pgmap v58: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:53 smithi047 ceph-mon[31561]: pgmap v58: 97 pgs: 97 active+clean; 20 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 523 KiB/s wr, 33 op/s 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:35:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:54 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:54 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:54 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:35:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:55 smithi047 ceph-mon[31561]: pgmap v59: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 579 KiB/s wr, 40 op/s 2024-04-21T22:35:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:55 smithi018 ceph-mon[26614]: pgmap v59: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 579 KiB/s wr, 40 op/s 2024-04-21T22:35:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:55 smithi081 ceph-mon[31692]: pgmap v59: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 579 KiB/s wr, 40 op/s 2024-04-21T22:35:55.949 INFO:tasks.workunit.client.0.smithi018.stderr:Updating files: 7% (321/4290) Updating files: 8% (344/4290) Updating files: 9% (387/4290) Updating files: 10% (429/4290) Updating files: 11% (472/4290) Updating files: 12% (515/4290) Updating files: 13% (558/4290) Updating files: 14% (601/4290) Updating files: 15% (644/4290) Updating files: 16% (687/4290) Updating files: 17% (730/4290) Updating files: 18% (773/4290) Updating files: 18% (781/4290) Updating files: 19% (816/4290) Updating files: 20% (858/4290) Updating files: 21% (901/4290) Updating files: 22% (944/4290) Updating files: 23% (987/4290) Updating files: 24% (1030/4290) Updating files: 25% (1073/4290) Updating files: 26% (1116/4290) Updating files: 27% (1159/4290) Updating files: 28% (1202/4290) Updating files: 29% (1245/4290) Updating files: 30% (1287/4290) Updating files: 30% (1288/4290) Updating files: 31% (1330/4290) Updating files: 32% (1373/4290) Updating files: 33% (1416/4290) Updating files: 34% (1459/4290) Updating files: 35% (1502/4290) Updating files: 36% (1545/4290) Updating files: 37% (1588/4290) Updating files: 37% (1619/4290) Updating files: 38% (1631/4290) Updating files: 39% (1674/4290) Updating files: 40% (1716/4290) Updating files: 41% (1759/4290) Updating files: 42% (1802/4290) Updating files: 43% (1845/4290) Updating files: 44% (1888/4290) Updating files: 45% (1931/4290) Updating files: 46% (1974/4290) Updating files: 47% (2017/4290) Updating files: 48% (2060/4290) Updating files: 48% (2096/4290) Updating files: 49% (2103/4290) Updating files: 50% (2145/4290) Updating files: 51% (2188/4290) Updating files: 52% (2231/4290) Updating files: 53% (2274/4290) Updating files: 54% (2317/4290) Updating files: 55% (2360/4290) Updating files: 56% (2403/4290) Updating files: 57% (2446/4290) Updating files: 57% (2484/4290) Updating files: 58% (2489/4290) Updating files: 59% (2532/4290) Updating files: 60% (2574/4290) Updating files: 61% (2617/4290) Updating files: 62% (2660/4290) Updating files: 63% (2703/4290) Updating files: 64% (2746/4290) Updating files: 64% (2784/4290) Updating files: 65% (2789/4290) Updating files: 66% (2832/4290) Updating files: 67% (2875/4290) Updating files: 68% (2918/4290) Updating files: 69% (2961/4290) Updating files: 70% (3003/4290) Updating files: 70% (3022/4290) Updating files: 71% (3046/4290) Updating files: 72% (3089/4290) Updating files: 73% (3132/4290) Updating files: 74% (3175/4290) Updating files: 75% (3218/4290) Updating files: 76% (3261/4290) Updating files: 77% (3304/4290) Updating files: 78% (3347/4290) Updating files: 79% (3390/4290) Updating files: 79% (3411/4290) Updating files: 80% (3432/4290) Updating files: 81% (3475/4290) Updating files: 82% (3518/4290) Updating files: 83% (3561/4290) Updating files: 84% (3604/4290) Updating files: 85% (3647/4290) Updating files: 86% (3690/4290) Updating files: 87% (3733/4290) Updating files: 88% (3776/4290) Updating files: 89% (3819/4290) Updating files: 90% (3861/4290) Updating files: 91% (3904/4290) Updating files: 91% (3936/4290) Updating files: 92% (3947/4290) Updating files: 93% (3990/4290) Updating files: 94% (4033/4290) Updating files: 95% (4076/4290) Updating files: 96% (4119/4290) Updating files: 97% (4162/4290) Updating files: 98% (4205/4290) Updating files: 99% (4248/4290) Updating files: 100% (4290/4290) Updating files: 100% (4290/4290), done. 2024-04-21T22:35:55.973 INFO:tasks.workunit.client.0.smithi018.stderr:+ cd xfstests-dev 2024-04-21T22:35:56.006 INFO:tasks.workunit.client.0.smithi018.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-04-21T22:35:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:57 smithi047 ceph-mon[31561]: pgmap v60: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 513 KiB/s wr, 30 op/s 2024-04-21T22:35:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:57 smithi018 ceph-mon[26614]: pgmap v60: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 513 KiB/s wr, 30 op/s 2024-04-21T22:35:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:57 smithi081 ceph-mon[31692]: pgmap v60: 97 pgs: 97 active+clean; 20 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 513 KiB/s wr, 30 op/s 2024-04-21T22:35:59.690 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:59 smithi081 ceph-mon[31692]: pgmap v61: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.2 MiB/s wr, 52 op/s 2024-04-21T22:35:59.690 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:35:59 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:59 smithi047 ceph-mon[31561]: pgmap v61: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.2 MiB/s wr, 52 op/s 2024-04-21T22:35:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:35:59 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:35:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:59 smithi018 ceph-mon[26614]: pgmap v61: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.2 MiB/s wr, 52 op/s 2024-04-21T22:35:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:35:59 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:36:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:01 smithi047 ceph-mon[31561]: pgmap v62: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:01 smithi018 ceph-mon[26614]: pgmap v62: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:01 smithi081 ceph-mon[31692]: pgmap v62: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:03.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:03 smithi047 ceph-mon[31561]: pgmap v63: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:03 smithi018 ceph-mon[26614]: pgmap v63: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:03 smithi081 ceph-mon[31692]: pgmap v63: 97 pgs: 97 active+clean; 28 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 790 KiB/s wr, 28 op/s 2024-04-21T22:36:04.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:04 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:36:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:04 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:36:04.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:04 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:36:05.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:05 smithi047 ceph-mon[31561]: pgmap v64: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-04-21T22:36:05.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:05 smithi018 ceph-mon[26614]: pgmap v64: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-04-21T22:36:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:05 smithi081 ceph-mon[31692]: pgmap v64: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-04-21T22:36:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:07 smithi018 ceph-mon[26614]: pgmap v65: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 46 op/s 2024-04-21T22:36:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:07 smithi081 ceph-mon[31692]: pgmap v65: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 46 op/s 2024-04-21T22:36:07.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:07 smithi047 ceph-mon[31561]: pgmap v65: 97 pgs: 97 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 46 op/s 2024-04-21T22:36:08.411 INFO:tasks.workunit.client.0.smithi018.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-04-21T22:36:08.411 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.411 INFO:tasks.workunit.client.0.smithi018.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-21T22:36:08.411 INFO:tasks.workunit.client.0.smithi018.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:state without impacting any branches by switching back to a branch. 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: git switch -c 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:Or undo this operation with: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: git switch - 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr: 2024-04-21T22:36:08.412 INFO:tasks.workunit.client.0.smithi018.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-04-21T22:36:08.424 INFO:tasks.workunit.client.0.smithi018.stderr:+ make -j4 2024-04-21T22:36:08.453 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize -cfi 2024-04-21T22:36:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:08 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:08 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:08.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:08 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:08.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:08 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:08.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:08 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:08.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:08 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:09 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:09 smithi018 ceph-mon[26614]: pgmap v66: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 216 op/s 2024-04-21T22:36:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:09 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:09 smithi081 ceph-mon[31692]: pgmap v66: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 216 op/s 2024-04-21T22:36:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:09 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:09 smithi047 ceph-mon[31561]: pgmap v66: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 216 op/s 2024-04-21T22:36:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:11 smithi018 ceph-mon[26614]: pgmap v67: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:11 smithi081 ceph-mon[31692]: pgmap v67: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:11 smithi047 ceph-mon[31561]: pgmap v67: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:12.495 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-21T22:36:12.495 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './config.guess' 2024-04-21T22:36:13.737 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './config.sub' 2024-04-21T22:36:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:13 smithi018 ceph-mon[26614]: pgmap v68: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:13 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:36:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:13 smithi081 ceph-mon[31692]: pgmap v68: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:13 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:36:13.930 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './install-sh' 2024-04-21T22:36:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:13 smithi047 ceph-mon[31561]: pgmap v68: 97 pgs: 97 active+clean; 52 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 193 op/s 2024-04-21T22:36:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:13 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:36:14.038 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file './ltmain.sh' 2024-04-21T22:36:14.180 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-21T22:36:14.180 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-21T22:36:14.203 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-21T22:36:14.224 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-21T22:36:14.240 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-21T22:36:14.260 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-21T22:36:14.281 INFO:tasks.workunit.client.0.smithi018.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-21T22:36:14.285 INFO:tasks.workunit.client.0.smithi018.stdout:cp include/install-sh . 2024-04-21T22:36:14.299 INFO:tasks.workunit.client.0.smithi018.stdout:aclocal -I m4 2024-04-21T22:36:14.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:14 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:36:14.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:14 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:36:14.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:14 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:36:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:14 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:36:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:14 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:36:14.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:14 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:36:14.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:14 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:36:14.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:14 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:36:14.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:14 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:36:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:15 smithi018 ceph-mon[26614]: pgmap v69: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2024-04-21T22:36:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:15 smithi081 ceph-mon[31692]: pgmap v69: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2024-04-21T22:36:15.942 INFO:tasks.workunit.client.0.smithi018.stdout:autoheader 2024-04-21T22:36:15.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:15 smithi047 ceph-mon[31561]: pgmap v69: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 605 op/s 2024-04-21T22:36:16.428 INFO:tasks.workunit.client.0.smithi018.stdout:autoconf 2024-04-21T22:36:16.728 INFO:tasks.workunit.client.0.smithi018.stdout:./configure \ 2024-04-21T22:36:16.728 INFO:tasks.workunit.client.0.smithi018.stdout: --libexecdir=/usr/lib \ 2024-04-21T22:36:16.728 INFO:tasks.workunit.client.0.smithi018.stdout: --exec_prefix=/var/lib 2024-04-21T22:36:17.239 INFO:tasks.workunit.client.0.smithi018.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-21T22:36:17.239 INFO:tasks.workunit.client.0.smithi018.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-21T22:36:17.244 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to print strings... printf 2024-04-21T22:36:17.245 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... gcc 2024-04-21T22:36:17.496 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the C compiler works... yes 2024-04-21T22:36:17.496 INFO:tasks.workunit.client.0.smithi018.stdout:checking for C compiler default output file name... a.out 2024-04-21T22:36:17.613 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of executables... 2024-04-21T22:36:17.725 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are cross compiling... no 2024-04-21T22:36:17.827 INFO:tasks.workunit.client.0.smithi018.stdout:checking for suffix of object files... o 2024-04-21T22:36:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:17 smithi018 ceph-mon[26614]: pgmap v70: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 580 op/s 2024-04-21T22:36:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:17 smithi081 ceph-mon[31692]: pgmap v70: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 580 op/s 2024-04-21T22:36:17.904 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... yes 2024-04-21T22:36:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:17 smithi047 ceph-mon[31561]: pgmap v70: 97 pgs: 97 active+clean; 77 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.2 MiB/s wr, 580 op/s 2024-04-21T22:36:17.982 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... yes 2024-04-21T22:36:18.142 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-21T22:36:18.154 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-04-21T22:36:18.165 INFO:tasks.workunit.client.0.smithi018.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-21T22:36:18.170 INFO:tasks.workunit.client.0.smithi018.stdout:checking for egrep... /usr/bin/grep -E 2024-04-21T22:36:18.174 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fgrep... /usr/bin/grep -F 2024-04-21T22:36:18.199 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ld used by gcc... /usr/bin/ld 2024-04-21T22:36:18.205 INFO:tasks.workunit.client.0.smithi018.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-04-21T22:36:18.216 INFO:tasks.workunit.client.0.smithi018.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-04-21T22:36:19.293 INFO:tasks.workunit.client.0.smithi018.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-04-21T22:36:19.293 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether ln -s works... yes 2024-04-21T22:36:19.369 INFO:tasks.workunit.client.0.smithi018.stdout:checking the maximum length of command line arguments... 1572864 2024-04-21T22:36:19.380 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-21T22:36:19.380 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-21T22:36:19.381 INFO:tasks.workunit.client.0.smithi018.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-04-21T22:36:19.382 INFO:tasks.workunit.client.0.smithi018.stdout:checking for objdump... objdump 2024-04-21T22:36:19.383 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to recognize dependent libraries... pass_all 2024-04-21T22:36:19.384 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dlltool... no 2024-04-21T22:36:19.384 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-21T22:36:19.386 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ar... ar 2024-04-21T22:36:19.580 INFO:tasks.workunit.client.0.smithi018.stdout:checking for archiver @FILE support... @ 2024-04-21T22:36:19.581 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strip... strip 2024-04-21T22:36:19.582 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ranlib... ranlib 2024-04-21T22:36:19.583 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gawk... gawk 2024-04-21T22:36:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:19 smithi018 ceph-mon[26614]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 739 op/s 2024-04-21T22:36:19.884 INFO:tasks.workunit.client.0.smithi018.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-04-21T22:36:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:19 smithi081 ceph-mon[31692]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 739 op/s 2024-04-21T22:36:19.899 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sysroot... no 2024-04-21T22:36:19.935 INFO:tasks.workunit.client.0.smithi018.stdout:checking for a working dd... /usr/bin/dd 2024-04-21T22:36:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:19 smithi047 ceph-mon[31561]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 739 op/s 2024-04-21T22:36:19.961 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-04-21T22:36:20.044 INFO:tasks.workunit.client.0.smithi018.stdout:checking for mt... no 2024-04-21T22:36:20.075 INFO:tasks.workunit.client.0.smithi018.stdout:checking if : is a manifest tool... no 2024-04-21T22:36:20.261 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to run the C preprocessor... gcc -E 2024-04-21T22:36:20.845 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ANSI C header files... yes 2024-04-21T22:36:20.948 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... yes 2024-04-21T22:36:21.065 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... yes 2024-04-21T22:36:21.186 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdlib.h... yes 2024-04-21T22:36:21.304 INFO:tasks.workunit.client.0.smithi018.stdout:checking for string.h... yes 2024-04-21T22:36:21.419 INFO:tasks.workunit.client.0.smithi018.stdout:checking for memory.h... yes 2024-04-21T22:36:21.533 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... yes 2024-04-21T22:36:21.657 INFO:tasks.workunit.client.0.smithi018.stdout:checking for inttypes.h... yes 2024-04-21T22:36:21.778 INFO:tasks.workunit.client.0.smithi018.stdout:checking for stdint.h... yes 2024-04-21T22:36:21.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:21 smithi018 ceph-mon[26614]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:21 smithi081 ceph-mon[31692]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:21.893 INFO:tasks.workunit.client.0.smithi018.stdout:checking for unistd.h... yes 2024-04-21T22:36:21.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:21 smithi047 ceph-mon[31561]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:22.044 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dlfcn.h... yes 2024-04-21T22:36:22.065 INFO:tasks.workunit.client.0.smithi018.stdout:checking for objdir... .libs 2024-04-21T22:36:22.407 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-21T22:36:22.407 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-21T22:36:22.515 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-21T22:36:22.618 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc static flag -static works... no 2024-04-21T22:36:22.780 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -c -o file.o... yes 2024-04-21T22:36:22.780 INFO:tasks.workunit.client.0.smithi018.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-21T22:36:22.807 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-21T22:36:22.948 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether -lc should be explicitly linked in... no 2024-04-21T22:36:23.174 INFO:tasks.workunit.client.0.smithi018.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-21T22:36:23.175 INFO:tasks.workunit.client.0.smithi018.stdout:checking how to hardcode library paths into programs... immediate 2024-04-21T22:36:23.180 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether stripping libraries is possible... yes 2024-04-21T22:36:23.180 INFO:tasks.workunit.client.0.smithi018.stdout:checking if libtool supports shared libraries... yes 2024-04-21T22:36:23.180 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether to build shared libraries... yes 2024-04-21T22:36:23.180 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether to build static libraries... yes 2024-04-21T22:36:23.203 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc... (cached) gcc 2024-04-21T22:36:23.341 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-21T22:36:23.341 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-21T22:36:23.343 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-21T22:36:23.344 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gmake... /usr/bin/gmake 2024-04-21T22:36:23.345 INFO:tasks.workunit.client.0.smithi018.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-04-21T22:36:23.345 INFO:tasks.workunit.client.0.smithi018.stdout:checking for tar... /bin/tar 2024-04-21T22:36:23.346 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gzip... /bin/gzip 2024-04-21T22:36:23.418 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether gcc -MM is supported... yes 2024-04-21T22:36:23.420 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sort... /bin/sort 2024-04-21T22:36:23.420 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether ln -s works... yes 2024-04-21T22:36:23.421 INFO:tasks.workunit.client.0.smithi018.stdout:checking for rpm... /bin/rpm 2024-04-21T22:36:23.439 INFO:tasks.workunit.client.0.smithi018.stdout:checking for rpmbuild... no 2024-04-21T22:36:23.439 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ANSI C header files... (cached) yes 2024-04-21T22:36:23.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:36:23.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:36:23.542 INFO:tasks.workunit.client.0.smithi018.stdout:checking assert.h usability... yes 2024-04-21T22:36:23.578 INFO:tasks.workunit.client.0.smithi018.stdout:checking assert.h presence... yes 2024-04-21T22:36:23.579 INFO:tasks.workunit.client.0.smithi018.stdout:checking for assert.h... yes 2024-04-21T22:36:23.694 INFO:tasks.workunit.client.0.smithi018.stdout:checking bstring.h usability... no 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 -- 172.21.15.18:0/3051775475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18109920 msgr2=0x7f7d18109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 --2- 172.21.15.18:0/3051775475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18109920 0x7f7d18109d00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009890 tx=0x7f7d0802bb70 comp rx=0 tx=0).stop 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 -- 172.21.15.18:0/3051775475 shutdown_connections 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 --2- 172.21.15.18:0/3051775475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d181042d0 0x7f7d181107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 --2- 172.21.15.18:0/3051775475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d18103910 0x7f7d18103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 --2- 172.21.15.18:0/3051775475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18109920 0x7f7d18109d00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 -- 172.21.15.18:0/3051775475 >> 172.21.15.18:0/3051775475 conn(0x7f7d180ff3c0 msgr2=0x7f7d181017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 -- 172.21.15.18:0/3051775475 shutdown_connections 2024-04-21T22:36:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.710+0000 7f7d1e000640 1 -- 172.21.15.18:0/3051775475 wait complete. 2024-04-21T22:36:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.711+0000 7f7d1e000640 1 Processor -- start 2024-04-21T22:36:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.711+0000 7f7d1e000640 1 -- start start 2024-04-21T22:36:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d181042d0 0x7f7d1819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18109920 0x7f7d1819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18113d30 con 0x7f7d18109920 2024-04-21T22:36:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18113bb0 con 0x7f7d181042d0 2024-04-21T22:36:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d1e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18113eb0 con 0x7f7d18103910 2024-04-21T22:36:23.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48922/0 (socket says 172.21.15.18:48922) 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 -- 172.21.15.18:0/1546608573 learned_addr learned my addr 172.21.15.18:0/1546608573 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d181042d0 0x7f7d1819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18109920 0x7f7d1819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 -- 172.21.15.18:0/1546608573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d181042d0 msgr2=0x7f7d1819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d181042d0 0x7f7d1819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 -- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18109920 msgr2=0x7f7d1819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18109920 0x7f7d1819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.712+0000 7f7d17400640 1 -- 172.21.15.18:0/1546608573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1819f260 con 0x7f7d18103910 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d17400640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d080057c0 tx=0x7f7d080045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d0fe00640 1 -- 172.21.15.18:0/1546608573 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08041020 con 0x7f7d18103910 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d0fe00640 1 -- 172.21.15.18:0/1546608573 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0802c9f0 con 0x7f7d18103910 2024-04-21T22:36:23.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1819f4f0 con 0x7f7d18103910 2024-04-21T22:36:23.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d0fe00640 1 -- 172.21.15.18:0/1546608573 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08039040 con 0x7f7d18103910 2024-04-21T22:36:23.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.713+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d181a6de0 con 0x7f7d18103910 2024-04-21T22:36:23.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.716+0000 7f7d0fe00640 1 -- 172.21.15.18:0/1546608573 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7d08044020 con 0x7f7d18103910 2024-04-21T22:36:23.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.716+0000 7f7d20beb740 1 Processor -- start 2024-04-21T22:36:23.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 -- start start 2024-04-21T22:36:23.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563a79831410 con 0x563a798d6dc0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563a797d97e0 con 0x563a798ce1e0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d20beb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563a7982d3d0 con 0x563a798cd8c0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48932/0 (socket says 172.21.15.18:48932) 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.717+0000 7f7d17e00640 1 -- 172.21.15.18:0/2529371376 learned_addr learned my addr 172.21.15.18:0/2529371376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17400640 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d16a00640 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 -- 172.21.15.18:0/2529371376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 msgr2=0x563a798d6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 -- 172.21.15.18:0/2529371376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 msgr2=0x563a798d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 -- 172.21.15.18:0/2529371376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7960f7d0 con 0x563a798cd8c0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d0fe00640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 0x7f7cfc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000e480 tx=0x7f7d100095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f399b5141474ba server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d0fe00640 1 -- 172.21.15.18:0/1546608573 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7d080f0b20 con 0x7f7d18103910 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d03e00640 1 -- 172.21.15.18:0/2529371376 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10003970 con 0x563a798cd8c0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d17400640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 0x7f7cfc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.718+0000 7f7d03e00640 1 -- 172.21.15.18:0/2529371376 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d1000d7d0 con 0x563a798cd8c0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d03e00640 1 -- 172.21.15.18:0/2529371376 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d100044d0 con 0x563a798cd8c0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 -- 172.21.15.18:0/2529371376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 msgr2=0x563a798cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d17400640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 0x7f7cfc0a51c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ee430 tx=0x7f7d080dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000e480 tx=0x7f7d100095c0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 -- 172.21.15.18:0/2529371376 shutdown_connections 2024-04-21T22:36:23.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2529371376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798cd8c0 0x563a798cdca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.719+0000 7f7d20beb740 1 -- 172.21.15.18:0/2529371376 >> 172.21.15.18:0/2529371376 conn(0x563a798c7ff0 msgr2=0x563a798c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.720+0000 7f7d20beb740 1 -- 172.21.15.18:0/2529371376 shutdown_connections 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.720+0000 7f7d20beb740 1 -- 172.21.15.18:0/2529371376 wait complete. 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.720+0000 7f7d20beb740 1 -- start start 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.720+0000 7f7d20beb740 1 Processor -- start 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798d6dc0 0x563a798d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563a798d9bb0 con 0x563a798cd8c0 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563a797ecc40 con 0x563a798d6dc0 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563a798d9d30 con 0x563a798ce1e0 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d20beb740 10 client.0 _ll_register_callbacks cb 0x563a797ec630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:23.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37998/0 (socket says 172.21.15.18:37998) 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48944/0 (socket says 172.21.15.18:48944) 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.721+0000 7f7d17e00640 1 -- 172.21.15.18:0/2676964153 learned_addr learned my addr 172.21.15.18:0/2676964153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798d6dc0 0x563a798d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 -- 172.21.15.18:0/2676964153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 msgr2=0x563a798d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 -- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798d6dc0 msgr2=0x563a798d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798d6dc0 0x563a798d48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 -- 172.21.15.18:0/2676964153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a795453f0 con 0x563a798cd8c0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d16a00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d17e00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009e40 tx=0x7f7d1000dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c89e566504128a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.722+0000 7f7d00c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:23.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10003e40 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d1000d7d0 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7d1001c040 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7d10005460 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d20beb740 10 client.15888 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a795050f0 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d1000d7d0 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.723+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7d1000b040 con 0x563a798cd8c0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 10 client.15888 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 20 client.15888 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a798e7190 0x563a798e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 4 client.15888 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a79844c40 con 0x563a798e7190 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.724+0000 7f7d16a00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a798e7190 0x563a798e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.725+0000 7f7d16a00640 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a798e7190 0x563a798e9580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ca4a6ab28eb9ae server_cookie=b42690fbcf59a2d3 in_seq=0 out_seq=0 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.725+0000 7f7d00c00640 10 client.15888 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d00c00640 1 -- 172.21.15.18:0/2676964153 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563a79844c40 con 0x563a798e7190 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d00c00640 10 client.15888 handle_command_reply: tid=0 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 client.15888 shutdown 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 msgr2=0x563a798d3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009e40 tx=0x7f7d1000dee0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 shutdown_connections 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798d6dc0 0x563a798d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a798e7190 0x563a798e9580 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798d4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 --2- 172.21.15.18:0/2676964153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798d3e40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.726+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 >> 172.21.15.18:0/2676964153 conn(0x563a798c7ff0 msgr2=0x563a798c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.727+0000 7f7d00c00640 0 client.15888 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.727+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 shutdown_connections 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.727+0000 7f7d20beb740 1 -- 172.21.15.18:0/2676964153 wait complete. 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.727+0000 7f7d20beb740 20 client.15888 trim_cache size 0 max 16384 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.747+0000 7f7d20beb740 1 Processor -- start 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.747+0000 7f7d20beb740 1 -- start start 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798cd8c0 0x563a798d6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181af6f0 con 0x563a798d6dc0 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181b13b0 con 0x563a798cd8c0 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d20beb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181afe80 con 0x563a798ce1e0 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:48958/0 (socket says 172.21.15.18:48958) 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 -- 172.21.15.18:0/1618439711 learned_addr learned my addr 172.21.15.18:0/1618439711 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798cd8c0 0x563a798d6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 -- 172.21.15.18:0/1618439711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798cd8c0 msgr2=0x563a798d6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798cd8c0 0x563a798d6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 -- 172.21.15.18:0/1618439711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 msgr2=0x563a798d46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d16a00640 1 -- 172.21.15.18:0/1618439711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a798c8930 con 0x563a798ce1e0 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.748+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.749+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d04000c00 tx=0x7f7d04005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0da78b22b09958 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.749+0000 7f7d03400640 1 -- 172.21.15.18:0/1618439711 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04004050 con 0x563a798ce1e0 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.749+0000 7f7d03400640 1 -- 172.21.15.18:0/1618439711 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d04026070 con 0x563a798ce1e0 2024-04-21T22:36:23.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.749+0000 7f7d03400640 1 -- 172.21.15.18:0/1618439711 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04003850 con 0x563a798ce1e0 2024-04-21T22:36:23.815 INFO:tasks.workunit.client.0.smithi018.stdout:checking bstring.h presence... no 2024-04-21T22:36:23.815 INFO:tasks.workunit.client.0.smithi018.stdout:checking for bstring.h... no 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- 172.21.15.18:0/1618439711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 msgr2=0x563a798e2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d04000c00 tx=0x7f7d04005f90 comp rx=0 tx=0).stop 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- 172.21.15.18:0/1618439711 shutdown_connections 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798d6dc0 0x563a798d46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798ce1e0 0x563a798e2a70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1618439711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798cd8c0 0x563a798d6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- 172.21.15.18:0/1618439711 >> 172.21.15.18:0/1618439711 conn(0x563a798c7ff0 msgr2=0x563a798d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- 172.21.15.18:0/1618439711 shutdown_connections 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- 172.21.15.18:0/1618439711 wait complete. 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 -- start start 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.750+0000 7f7d20beb740 1 Processor -- start 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798df170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 0x563a798d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181b0c20 con 0x563a798cd8c0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181b0550 con 0x563a798ce1e0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181ad6d0 con 0x563a798d6dc0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d20beb740 10 client.0 _ll_register_callbacks cb 0x7f7d10003ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d16a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798df170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38016/0 (socket says 172.21.15.18:38016) 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d17e00640 1 -- 172.21.15.18:0/1513797626 learned_addr learned my addr 172.21.15.18:0/1513797626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.751+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 0x563a798d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 -- 172.21.15.18:0/1513797626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 msgr2=0x563a798d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 0x563a798d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 -- 172.21.15.18:0/1513797626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 msgr2=0x563a798df170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798df170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 -- 172.21.15.18:0/1513797626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a798d0bb0 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 0x563a798d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d16a00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d00b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563a79831430 tx=0x7f7d04009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=640f81f6dbfe63a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.752+0000 7f7d00c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0402e020 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7d04004460 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d04026070 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7d04039050 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d20beb740 10 client.25988 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563a7994c6c0 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.753+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d04026070 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7d04004730 con 0x563a798ce1e0 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 10 client.25988 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 10 client.25988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 20 client.25988 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a7994ce10 0x563a7994f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 4 client.25988 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a7983e950 con 0x563a7994ce10 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.754+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a7994ce10 0x563a7994f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d17e00640 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a7994ce10 0x563a7994f230 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad0e61dde23fa2e0 server_cookie=8d3c5825348ec61c in_seq=0 out_seq=0 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d00c00640 10 client.25988 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d00c00640 1 -- 172.21.15.18:0/1513797626 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a7983e950 con 0x563a7994ce10 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d00c00640 10 client.25988 handle_command_reply: tid=0 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 client.25988 shutdown 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 msgr2=0x563a798d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d00b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563a79831430 tx=0x7f7d04009da0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 shutdown_connections 2024-04-21T22:36:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563a7994ce10 0x563a7994f230 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a798d6dc0 0x563a798d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563a798ce1e0 0x563a798d00b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 --2- 172.21.15.18:0/1513797626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a798cd8c0 0x563a798df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d00c00640 0 client.25988 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.755+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 >> 172.21.15.18:0/1513797626 conn(0x563a798c7ff0 msgr2=0x563a798d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.756+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 shutdown_connections 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.756+0000 7f7d20beb740 1 -- 172.21.15.18:0/1513797626 wait complete. 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.756+0000 7f7d20beb740 20 client.25988 trim_cache size 0 max 16384 2024-04-21T22:36:23.823 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:36:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:36:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:36:23.824 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:36:23.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 msgr2=0x7f7cfc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 0x7f7cfc0a51c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ee430 tx=0x7f7d080dd040 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 msgr2=0x7f7d1819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d080057c0 tx=0x7f7d080045d0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 shutdown_connections 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7cfc0a2d00 0x7f7cfc0a51c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d18109920 0x7f7d1819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d181042d0 0x7f7d1819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 --2- 172.21.15.18:0/1546608573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d18103910 0x7f7d1819a270 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d080057c0 tx=0x7f7d080045d0 comp rx=0 tx=0).stop 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 >> 172.21.15.18:0/1546608573 conn(0x7f7d180ff3c0 msgr2=0x7f7d180ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 shutdown_connections 2024-04-21T22:36:23.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:23.757+0000 7f7d1e000640 1 -- 172.21.15.18:0/1546608573 wait complete. 2024-04-21T22:36:23.826 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:23 smithi018 ceph-mon[26614]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:23.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:36:23.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:36:23.852 INFO:tasks.workunit.client.0.smithi018.stdout:checking libgen.h usability... yes 2024-04-21T22:36:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:23 smithi081 ceph-mon[31692]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:23.889 INFO:tasks.workunit.client.0.smithi018.stdout:checking libgen.h presence... yes 2024-04-21T22:36:23.890 INFO:tasks.workunit.client.0.smithi018.stdout:checking for libgen.h... yes 2024-04-21T22:36:23.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:23 smithi047 ceph-mon[31561]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 570 op/s 2024-04-21T22:36:24.021 INFO:tasks.workunit.client.0.smithi018.stdout:checking dirent.h usability... yes 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 -- 172.21.15.18:0/3733037100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914103290 msgr2=0x7fa91410b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 --2- 172.21.15.18:0/3733037100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914103290 0x7fa91410b770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa900009900 tx=0x7fa90002bcc0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 -- 172.21.15.18:0/3733037100 shutdown_connections 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 --2- 172.21.15.18:0/3733037100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa91410bd40 0x7fa91410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 --2- 172.21.15.18:0/3733037100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914103290 0x7fa91410b770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 --2- 172.21.15.18:0/3733037100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa914102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 -- 172.21.15.18:0/3733037100 >> 172.21.15.18:0/3733037100 conn(0x7fa914077820 msgr2=0x7fa914077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 -- 172.21.15.18:0/3733037100 shutdown_connections 2024-04-21T22:36:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.048+0000 7fa919200640 1 -- 172.21.15.18:0/3733037100 wait complete. 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.049+0000 7fa919200640 1 Processor -- start 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.049+0000 7fa919200640 1 -- start start 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa91419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 0x7fa91419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa91410bd40 0x7fa91419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa914111b10 con 0x7fa914103290 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa914111990 con 0x7fa91410bd40 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa919200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa914111c90 con 0x7fa914102970 2024-04-21T22:36:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa911400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 0x7fa91419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa911e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa91419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa911400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 0x7fa91419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38030/0 (socket says 172.21.15.18:38030) 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa911400640 1 -- 172.21.15.18:0/3054312774 learned_addr learned my addr 172.21.15.18:0/3054312774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.050+0000 7fa912800640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa91410bd40 0x7fa91419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 -- 172.21.15.18:0/3054312774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa91410bd40 msgr2=0x7fa91419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa91410bd40 0x7fa91419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 -- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 msgr2=0x7fa91419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 0x7fa91419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 -- 172.21.15.18:0/3054312774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91419f240 con 0x7fa914102970 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa911e00640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa91419a2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e9f0 tx=0x7fa90400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400ccc0 con 0x7fa914102970 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa904005020 con 0x7fa914102970 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040049e0 con 0x7fa914102970 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91419f530 con 0x7fa914102970 2024-04-21T22:36:24.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.051+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9141a6dc0 con 0x7fa914102970 2024-04-21T22:36:24.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.053+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91406a6b0 con 0x7fa914102970 2024-04-21T22:36:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.055+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa904005560 con 0x7fa914102970 2024-04-21T22:36:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.057+0000 7fa90aa00640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 0x7fa8f80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.057+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa9040cf410 con 0x7fa914102970 2024-04-21T22:36:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.057+0000 7fa911400640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 0x7fa8f80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.058+0000 7fa911400640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 0x7fa8f80a5240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9000096c0 tx=0x7fa90002df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.064+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fa9040051d0 con 0x7fa914102970 2024-04-21T22:36:24.065 INFO:tasks.workunit.client.0.smithi018.stdout:checking dirent.h presence... yes 2024-04-21T22:36:24.065 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dirent.h... yes 2024-04-21T22:36:24.172 INFO:tasks.workunit.client.0.smithi018.stdout:checking errno.h usability... yes 2024-04-21T22:36:24.210 INFO:tasks.workunit.client.0.smithi018.stdout:checking errno.h presence... yes 2024-04-21T22:36:24.210 INFO:tasks.workunit.client.0.smithi018.stdout:checking for errno.h... yes 2024-04-21T22:36:24.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.318+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9141a6fc0 con 0x7fa914102970 2024-04-21T22:36:24.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.319+0000 7fa90aa00640 1 -- 172.21.15.18:0/3054312774 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7fa90409c030 con 0x7fa914102970 2024-04-21T22:36:24.320 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:36:24.320 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:36:03.102173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:36:24.320 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 32 2024-04-21T22:36:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 msgr2=0x7fa8f80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 0x7fa8f80a5240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa9000096c0 tx=0x7fa90002df90 comp rx=0 tx=0).stop 2024-04-21T22:36:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 msgr2=0x7fa91419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa91419a2a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e9f0 tx=0x7fa90400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 shutdown_connections 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8f80a2d80 0x7fa8f80a5240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa91410bd40 0x7fa91419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa914103290 0x7fa91419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 --2- 172.21.15.18:0/3054312774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa914102970 0x7fa91419a2a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 >> 172.21.15.18:0/3054312774 conn(0x7fa914077820 msgr2=0x7fa914107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.321+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 shutdown_connections 2024-04-21T22:36:24.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.322+0000 7fa919200640 1 -- 172.21.15.18:0/3054312774 wait complete. 2024-04-21T22:36:24.324 INFO:tasks.workunit.client.0.smithi018.stdout:checking malloc.h usability... yes 2024-04-21T22:36:24.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:36:24.365 INFO:tasks.workunit.client.0.smithi018.stdout:checking malloc.h presence... yes 2024-04-21T22:36:24.365 INFO:tasks.workunit.client.0.smithi018.stdout:checking for malloc.h... yes 2024-04-21T22:36:24.474 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid.h usability... no 2024-04-21T22:36:24.532 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid.h presence... no 2024-04-21T22:36:24.532 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid.h... no 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 -- 172.21.15.18:0/2673511824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 msgr2=0x7f1cb8102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 --2- 172.21.15.18:0/2673511824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb8102d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009900 tx=0x7f1ca802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 -- 172.21.15.18:0/2673511824 shutdown_connections 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 --2- 172.21.15.18:0/2673511824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb810bcf0 0x7f1cb810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 --2- 172.21.15.18:0/2673511824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb81032d0 0x7f1cb810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 --2- 172.21.15.18:0/2673511824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb8102d90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 -- 172.21.15.18:0/2673511824 >> 172.21.15.18:0/2673511824 conn(0x7f1cb80777f0 msgr2=0x7f1cb8077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 -- 172.21.15.18:0/2673511824 shutdown_connections 2024-04-21T22:36:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.569+0000 7f1cbe600640 1 -- 172.21.15.18:0/2673511824 wait complete. 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.570+0000 7f1cbe600640 1 Processor -- start 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.570+0000 7f1cbe600640 1 -- start start 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb81032d0 0x7f1cb819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb810bcf0 0x7f1cb819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb8111b40 con 0x7f1cb81032d0 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81119c0 con 0x7f1cb810bcf0 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cbe600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb8111cc0 con 0x7f1cb81029b0 2024-04-21T22:36:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49020/0 (socket says 172.21.15.18:49020) 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 -- 172.21.15.18:0/211499440 learned_addr learned my addr 172.21.15.18:0/211499440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb81032d0 0x7f1cb819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb810bcf0 0x7f1cb819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 -- 172.21.15.18:0/211499440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb810bcf0 msgr2=0x7f1cb819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb810bcf0 0x7f1cb819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 -- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb81032d0 msgr2=0x7f1cb819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb81032d0 0x7f1cb819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.571+0000 7f1cb7400640 1 -- 172.21.15.18:0/211499440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb819f1f0 con 0x7f1cb81029b0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cb7400640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8000c00 tx=0x7f1ca8004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cafe00640 1 -- 172.21.15.18:0/211499440 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8042020 con 0x7f1cb81029b0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cafe00640 1 -- 172.21.15.18:0/211499440 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca80054e0 con 0x7f1cb81029b0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cafe00640 1 -- 172.21.15.18:0/211499440 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8003c90 con 0x7f1cb81029b0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb819f480 con 0x7f1cb81029b0 2024-04-21T22:36:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.572+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb81a6d70 con 0x7f1cb81029b0 2024-04-21T22:36:24.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.575+0000 7f1cafe00640 1 -- 172.21.15.18:0/211499440 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1ca8045020 con 0x7f1cb81029b0 2024-04-21T22:36:24.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.576+0000 7f1cc13a5740 1 Processor -- start 2024-04-21T22:36:24.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.576+0000 7f1cc13a5740 1 -- start start 2024-04-21T22:36:24.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.576+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.576+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae46a6a0 0x5607ae472d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae475670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5607ae3ce3a0 con 0x5607ae473280 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5607ae376930 con 0x5607ae46a6a0 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5607ae3ca360 con 0x5607ae469d80 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49024/0 (socket says 172.21.15.18:49024) 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 -- 172.21.15.18:0/1939496580 learned_addr learned my addr 172.21.15.18:0/1939496580 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae475670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7400640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae46a6a0 0x5607ae472d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 -- 172.21.15.18:0/1939496580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae46a6a0 msgr2=0x5607ae472d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae46a6a0 0x5607ae472d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 -- 172.21.15.18:0/1939496580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 msgr2=0x5607ae475670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae475670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb7e00640 1 -- 172.21.15.18:0/1939496580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ae0e23f0 con 0x5607ae469d80 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.577+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae475670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009f60 tx=0x7f1cb0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a232c47cdd463bf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cafe00640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 0x7f1c9c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cacc00640 1 -- 172.21.15.18:0/1939496580 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0016070 con 0x5607ae469d80 2024-04-21T22:36:24.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cacc00640 1 -- 172.21.15.18:0/1939496580 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cb0004d20 con 0x5607ae469d80 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cacc00640 1 -- 172.21.15.18:0/1939496580 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0012950 con 0x5607ae469d80 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cafe00640 1 -- 172.21.15.18:0/211499440 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1ca80f10d0 con 0x7f1cb81029b0 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.578+0000 7f1cb7400640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 0x7f1c9c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1939496580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 msgr2=0x5607ae46a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cb7400640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 0x7f1c9c0a5240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5607ae469850 tx=0x7f1ca80f4b80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009f60 tx=0x7f1cb0009f90 comp rx=0 tx=0).stop 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1939496580 shutdown_connections 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae475670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae46a6a0 0x5607ae472d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1939496580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae469d80 0x5607ae46a160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1939496580 >> 172.21.15.18:0/1939496580 conn(0x5607ae4644b0 msgr2=0x5607ae464890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1939496580 shutdown_connections 2024-04-21T22:36:24.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.579+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1939496580 wait complete. 2024-04-21T22:36:24.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.580+0000 7f1cc13a5740 1 -- start start 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.580+0000 7f1cc13a5740 1 Processor -- start 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.580+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae470300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.580+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae470d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5607ae476070 con 0x5607ae469d80 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5607ae389d80 con 0x5607ae473280 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5607ae4761f0 con 0x5607ae46a6a0 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cc13a5740 10 client.0 _ll_register_callbacks cb 0x5607ae3c62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49032/0 (socket says 172.21.15.18:49032) 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1537285608 learned_addr learned my addr 172.21.15.18:0/1537285608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae470300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae470d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1537285608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 msgr2=0x5607ae470d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae470d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 msgr2=0x5607ae470300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae470300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1537285608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ae1ac7d0 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae470300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b990 tx=0x7f1ca400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0bdc7b0b40dcd00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.581+0000 7f1ca1600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4003e00 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1ca4011440 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cb0004d20 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1ca4011640 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1cc13a5740 10 client.26032 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5607ae4823c0 con 0x5607ae46a6a0 2024-04-21T22:36:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cb0004d20 con 0x5607ae46a6a0 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.582+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f1ca401b9c0 con 0x5607ae46a6a0 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 10 client.26032 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 10 client.26032 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 20 client.26032 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae483880 0x5607ae485cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 4 client.26032 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607ae3db8e0 con 0x5607ae483880 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.583+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae483880 0x5607ae485cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.584+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae483880 0x5607ae485cc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5dae63e051862716 server_cookie=d2401cf2155b9c1b in_seq=0 out_seq=0 2024-04-21T22:36:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.584+0000 7f1ca1600640 10 client.26032 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:24.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.584+0000 7f1ca1600640 1 -- 172.21.15.18:0/1537285608 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5607ae3db8e0 con 0x5607ae483880 2024-04-21T22:36:24.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.584+0000 7f1ca1600640 10 client.26032 handle_command_reply: tid=0 2024-04-21T22:36:24.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.584+0000 7f1cc13a5740 1 client.26032 shutdown 2024-04-21T22:36:24.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 msgr2=0x5607ae470840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b990 tx=0x7f1ca400be50 comp rx=0 tx=0).stop 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 shutdown_connections 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae483880 0x5607ae485cc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae470d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae470840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1ca1600640 0 client.26032 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1537285608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae470300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 >> 172.21.15.18:0/1537285608 conn(0x5607ae4644b0 msgr2=0x5607ae466200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 shutdown_connections 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1537285608 wait complete. 2024-04-21T22:36:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.585+0000 7f1cc13a5740 20 client.26032 trim_cache size 0 max 16384 2024-04-21T22:36:24.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:24 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3054312774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:24.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 Processor -- start 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 -- start start 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae472a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae45f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81af710 con 0x5607ae469d80 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81b13d0 con 0x5607ae473280 2024-04-21T22:36:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81afea0 con 0x5607ae46a6a0 2024-04-21T22:36:24.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.601+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae472a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49040/0 (socket says 172.21.15.18:49040) 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1299218198 learned_addr learned my addr 172.21.15.18:0/1299218198 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1299218198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 msgr2=0x5607ae45f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae45f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1299218198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 msgr2=0x5607ae472a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae472a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1299218198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ae46f2b0 con 0x5607ae46a6a0 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.602+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400bf80 tx=0x7f1ca400bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c3c115ea656292 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.603+0000 7f1ca3e00640 1 -- 172.21.15.18:0/1299218198 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4003e80 con 0x5607ae46a6a0 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.603+0000 7f1ca3e00640 1 -- 172.21.15.18:0/1299218198 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca4011cc0 con 0x5607ae46a6a0 2024-04-21T22:36:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.603+0000 7f1ca3e00640 1 -- 172.21.15.18:0/1299218198 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40048e0 con 0x5607ae46a6a0 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.603+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1299218198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 msgr2=0x5607ae47ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.603+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400bf80 tx=0x7f1ca400bfb0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1299218198 shutdown_connections 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae473280 0x5607ae45f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47ef30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1299218198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae469d80 0x5607ae472a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1299218198 >> 172.21.15.18:0/1299218198 conn(0x5607ae4644b0 msgr2=0x5607ae463690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1299218198 shutdown_connections 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1299218198 wait complete. 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 -- start start 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.604+0000 7f1cc13a5740 1 Processor -- start 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 0x5607ae47b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae478490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81b0c40 con 0x5607ae473280 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81b0570 con 0x5607ae469d80 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb81ad6f0 con 0x5607ae46a6a0 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cc13a5740 10 client.0 _ll_register_callbacks cb 0x7f1ca4004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae478490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49052/0 (socket says 172.21.15.18:49052) 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1219359570 learned_addr learned my addr 172.21.15.18:0/1219359570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 0x5607ae47b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.605+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1219359570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 msgr2=0x5607ae47b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 0x5607ae47b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 msgr2=0x5607ae478490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae478490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb6a00640 1 -- 172.21.15.18:0/1219359570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ae478d10 con 0x5607ae46a6a0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 0x5607ae47b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cb6a00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400be90 tx=0x7f1ca40040b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9a3f4ce8fad3acd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1ca1600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40119f0 con 0x5607ae46a6a0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1ca4017070 con 0x5607ae46a6a0 2024-04-21T22:36:24.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ca4011cc0 con 0x5607ae46a6a0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.606+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1ca4005040 con 0x5607ae46a6a0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 10 client.26038 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5607ae4ea9b0 con 0x5607ae46a6a0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ca4011cc0 con 0x5607ae46a6a0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f1ca401b420 con 0x5607ae46a6a0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 10 client.26038 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 10 client.26038 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 20 client.26038 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae4eb010 0x5607ae4ed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 4 client.26038 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607ae3d5c30 con 0x5607ae4eb010 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.607+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae4eb010 0x5607ae4ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cb7e00640 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae4eb010 0x5607ae4ed430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=943210a174fdd6bd server_cookie=708dffc732f08038 in_seq=0 out_seq=0 2024-04-21T22:36:24.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1ca1600640 10 client.26038 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1ca1600640 1 -- 172.21.15.18:0/1219359570 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607ae3d5c30 con 0x5607ae4eb010 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1ca1600640 10 client.26038 handle_command_reply: tid=0 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 client.26038 shutdown 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 msgr2=0x5607ae47b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400be90 tx=0x7f1ca40040b0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 shutdown_connections 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5607ae4eb010 0x5607ae4ed430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5607ae473280 0x5607ae478490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1ca1600640 0 client.26038 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607ae46a6a0 0x5607ae47b980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 --2- 172.21.15.18:0/1219359570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5607ae469d80 0x5607ae47b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.608+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 >> 172.21.15.18:0/1219359570 conn(0x5607ae4644b0 msgr2=0x5607ae4702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 shutdown_connections 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cc13a5740 1 -- 172.21.15.18:0/1219359570 wait complete. 2024-04-21T22:36:24.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cc13a5740 20 client.26038 trim_cache size 0 max 16384 2024-04-21T22:36:24.613 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 msgr2=0x7f1c9c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 0x7f1c9c0a5240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5607ae469850 tx=0x7f1ca80f4b80 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 msgr2=0x7f1cb819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.609+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8000c00 tx=0x7f1ca8004430 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 shutdown_connections 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c9c0a2d80 0x7f1c9c0a5240 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb810bcf0 0x7f1cb819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cb81032d0 0x7f1cb819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 --2- 172.21.15.18:0/211499440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cb81029b0 0x7f1cb819a200 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 >> 172.21.15.18:0/211499440 conn(0x7f1cb80777f0 msgr2=0x7f1cb8101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 shutdown_connections 2024-04-21T22:36:24.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.610+0000 7f1cbe600640 1 -- 172.21.15.18:0/211499440 wait complete. 2024-04-21T22:36:24.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:36:24.644 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid/uuid.h usability... yes 2024-04-21T22:36:24.681 INFO:tasks.workunit.client.0.smithi018.stdout:checking uuid/uuid.h presence... yes 2024-04-21T22:36:24.682 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid/uuid.h... yes 2024-04-21T22:36:24.799 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/uuid.h usability... no 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 -- 172.21.15.18:0/292302695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 msgr2=0x7f4564076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 --2- 172.21.15.18:0/292302695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f4564076050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4558009900 tx=0x7f455802bc30 comp rx=0 tx=0).stop 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 -- 172.21.15.18:0/292302695 shutdown_connections 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 --2- 172.21.15.18:0/292302695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 --2- 172.21.15.18:0/292302695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 0x7f4564112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 --2- 172.21.15.18:0/292302695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f4564076050 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 -- 172.21.15.18:0/292302695 >> 172.21.15.18:0/292302695 conn(0x7f45640ff3d0 msgr2=0x7f45641017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 -- 172.21.15.18:0/292302695 shutdown_connections 2024-04-21T22:36:24.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.843+0000 7f456b400640 1 -- 172.21.15.18:0/292302695 wait complete. 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.844+0000 7f456b400640 1 Processor -- start 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.844+0000 7f456b400640 1 -- start start 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 0x7f456419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4564118180 con 0x7f4564075c70 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4564118000 con 0x7f45641125c0 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f456b400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4564118300 con 0x7f4564076590 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4568a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4568a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38104/0 (socket says 172.21.15.18:38104) 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56234/0 (socket says 172.21.15.18:56234) 2024-04-21T22:36:24.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4568a00640 1 -- 172.21.15.18:0/453295877 learned_addr learned my addr 172.21.15.18:0/453295877 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4563e00640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 0x7f456419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 -- 172.21.15.18:0/453295877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 msgr2=0x7f456419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 0x7f456419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 -- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 msgr2=0x7f456419e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.845+0000 7f4569400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4569400640 1 -- 172.21.15.18:0/453295877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45641a36d0 con 0x7f45641125c0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4568a00640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4569400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f455c005fd0 tx=0x7f455c00dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4561600640 1 -- 172.21.15.18:0/453295877 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c00bd40 con 0x7f45641125c0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45641a39c0 con 0x7f45641125c0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4561600640 1 -- 172.21.15.18:0/453295877 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f455c003e50 con 0x7f45641125c0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f4561600640 1 -- 172.21.15.18:0/453295877 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0106c0 con 0x7f45641125c0 2024-04-21T22:36:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.846+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45641ab250 con 0x7f45641125c0 2024-04-21T22:36:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 Processor -- start 2024-04-21T22:36:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f4561600640 1 -- 172.21.15.18:0/453295877 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f455c003970 con 0x7f45641125c0 2024-04-21T22:36:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 -- start start 2024-04-21T22:36:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 0x55a9273d9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9273323a0 con 0x55a9273d7280 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9272da930 con 0x55a9273cdd80 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.850+0000 7f456e1e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a92732e360 con 0x55a9273ce6a0 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4563e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49084/0 (socket says 172.21.15.18:49084) 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4563e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56236/0 (socket says 172.21.15.18:56236) 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 -- 172.21.15.18:0/2461453656 learned_addr learned my addr 172.21.15.18:0/2461453656 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4563e00640 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 0x55a9273d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 -- 172.21.15.18:0/2461453656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 msgr2=0x55a9273ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 -- 172.21.15.18:0/2461453656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 msgr2=0x55a9273d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 0x55a9273d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 -- 172.21.15.18:0/2461453656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9270463f0 con 0x55a9273ce6a0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4563e00640 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 0x55a9273d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.851+0000 7f4568a00640 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4558036040 tx=0x7f4558005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b0f0bed057ac1d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4561600640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 0x7f454c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4555c00640 1 -- 172.21.15.18:0/2461453656 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558004c70 con 0x55a9273ce6a0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4555c00640 1 -- 172.21.15.18:0/2461453656 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f455802c8b0 con 0x55a9273ce6a0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4555c00640 1 -- 172.21.15.18:0/2461453656 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558005550 con 0x55a9273ce6a0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4561600640 1 -- 172.21.15.18:0/453295877 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f455c0cf760 con 0x7f45641125c0 2024-04-21T22:36:24.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.852+0000 7f4563e00640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 0x7f454c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- 172.21.15.18:0/2461453656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 msgr2=0x55a9273d6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4558036040 tx=0x7f4558005e60 comp rx=0 tx=0).stop 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f4563e00640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 0x7f454c0a51c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55a9273c9640 tx=0x7f4550013040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- 172.21.15.18:0/2461453656 shutdown_connections 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273d7280 0x55a9273d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273ce6a0 0x55a9273d6d40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2461453656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- 172.21.15.18:0/2461453656 >> 172.21.15.18:0/2461453656 conn(0x55a9273c84b0 msgr2=0x55a9273c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- 172.21.15.18:0/2461453656 shutdown_connections 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- 172.21.15.18:0/2461453656 wait complete. 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.853+0000 7f456e1e6740 1 -- start start 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 Processor -- start 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9273da010 con 0x55a9273cdd80 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9272edd80 con 0x55a9273ce6a0 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a9273da190 con 0x55a9273d7280 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f456e1e6740 10 client.0 _ll_register_callbacks cb 0x55a92732a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f4568a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f4569400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f4569400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49090/0 (socket says 172.21.15.18:49090) 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f4569400640 1 -- 172.21.15.18:0/1279542151 learned_addr learned my addr 172.21.15.18:0/1279542151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.854+0000 7f4563e00640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 -- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 msgr2=0x55a9273d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273d4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 -- 172.21.15.18:0/1279542151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 msgr2=0x55a9273d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 -- 172.21.15.18:0/1279542151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9271107d0 con 0x55a9273d7280 2024-04-21T22:36:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4568a00640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f4569400640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f455c0985f0 tx=0x7f455c09c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d24c1ee3bf48e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f454a000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0a4890 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f455c0cd0d0 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.855+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f455802c8b0 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f455c003c60 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 10 client.26050 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a9273e6440 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f455802c8b0 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f455c024060 con 0x55a9273d7280 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 10 client.26050 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 10 client.26050 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 20 client.26050 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a9273e7950 0x55a9273e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 4 client.26050 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.856+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92733f8e0 con 0x55a9273e7950 2024-04-21T22:36:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.857+0000 7f4568a00640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a9273e7950 0x55a9273e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.857+0000 7f4568a00640 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a9273e7950 0x55a9273e9da0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=93b2559e735f3e5c server_cookie=44e86a8d59b64109 in_seq=0 out_seq=0 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.857+0000 7f454a000640 10 client.26050 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.858+0000 7f454a000640 1 -- 172.21.15.18:0/1279542151 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a92733f8e0 con 0x55a9273e7950 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.858+0000 7f454a000640 10 client.26050 handle_command_reply: tid=0 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.858+0000 7f456e1e6740 1 client.26050 shutdown 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 msgr2=0x55a9273d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f455c0985f0 tx=0x7f455c09c3e0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 shutdown_connections 2024-04-21T22:36:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a9273e7950 0x55a9273e9da0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d4e60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 --2- 172.21.15.18:0/1279542151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 >> 172.21.15.18:0/1279542151 conn(0x55a9273c84b0 msgr2=0x55a9273ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f454a000640 0 client.26050 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 shutdown_connections 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 1 -- 172.21.15.18:0/1279542151 wait complete. 2024-04-21T22:36:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.859+0000 7f456e1e6740 20 client.26050 trim_cache size 0 max 16384 2024-04-21T22:36:24.864 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/uuid.h presence... no 2024-04-21T22:36:24.864 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/uuid.h... no 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 Processor -- start 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 -- start start 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b3a80 con 0x55a9273cdd80 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b5740 con 0x55a9273ce6a0 2024-04-21T22:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.875+0000 7f456e1e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b4210 con 0x55a9273d7280 2024-04-21T22:36:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4568a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4568a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38124/0 (socket says 172.21.15.18:38124) 2024-04-21T22:36:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4568a00640 1 -- 172.21.15.18:0/876017514 learned_addr learned my addr 172.21.15.18:0/876017514 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4563e00640 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 -- 172.21.15.18:0/876017514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 msgr2=0x55a9273e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 -- 172.21.15.18:0/876017514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 msgr2=0x55a9273d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 -- 172.21.15.18:0/876017514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9273cd0a0 con 0x55a9273d7280 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4569400640 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273c7510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f455c09b920 tx=0x7f455c097ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d04456c32c40d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.876+0000 7f4555200640 1 -- 172.21.15.18:0/876017514 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c005e30 con 0x55a9273d7280 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.877+0000 7f4555200640 1 -- 172.21.15.18:0/876017514 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f455c0a4890 con 0x55a9273d7280 2024-04-21T22:36:24.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.877+0000 7f4555200640 1 -- 172.21.15.18:0/876017514 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c09b580 con 0x55a9273d7280 2024-04-21T22:36:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- 172.21.15.18:0/876017514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 msgr2=0x55a9273c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273c7510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f455c09b920 tx=0x7f455c097ff0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- 172.21.15.18:0/876017514 shutdown_connections 2024-04-21T22:36:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273c7510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273ce6a0 0x55a9273e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 --2- 172.21.15.18:0/876017514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273cdd80 0x55a9273d6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- 172.21.15.18:0/876017514 >> 172.21.15.18:0/876017514 conn(0x55a9273c84b0 msgr2=0x55a9273c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- 172.21.15.18:0/876017514 shutdown_connections 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- 172.21.15.18:0/876017514 wait complete. 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.878+0000 7f456e1e6740 1 -- start start 2024-04-21T22:36:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 Processor -- start 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273ce6a0 0x55a9273d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b4fb0 con 0x55a9273ce6a0 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b48e0 con 0x55a9273cdd80 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45641b1a60 con 0x55a9273d7280 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.879+0000 7f456e1e6740 10 client.0 _ll_register_callbacks cb 0x7f455c0092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4569400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56256/0 (socket says 172.21.15.18:56256) 2024-04-21T22:36:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 -- 172.21.15.18:0/2965310057 learned_addr learned my addr 172.21.15.18:0/2965310057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4563e00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273ce6a0 0x55a9273d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 -- 172.21.15.18:0/2965310057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 msgr2=0x55a9273d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 -- 172.21.15.18:0/2965310057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273ce6a0 msgr2=0x55a9273d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273ce6a0 0x55a9273d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 -- 172.21.15.18:0/2965310057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9273d17a0 con 0x55a9273cdd80 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4569400640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f4568a00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4b5fab15c1ebeb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.880+0000 7f454a000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455802c6d0 con 0x55a9273cdd80 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f455c0a4890 con 0x55a9273cdd80 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f45580051f0 con 0x55a9273cdd80 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4558064050 con 0x55a9273cdd80 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f456e1e6740 10 client.26027 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:24.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a92744dd00 con 0x55a9273cdd80 2024-04-21T22:36:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.881+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f455c0a4890 con 0x55a9273cdd80 2024-04-21T22:36:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f455804e040 con 0x55a9273cdd80 2024-04-21T22:36:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 10 client.26027 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:24.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 10 client.26027 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 20 client.26027 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a92744e040 0x55a927450430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 4 client.26027 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a927339c30 con 0x55a92744e040 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.882+0000 7f4563e00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a92744e040 0x55a927450430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f4563e00640 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a92744e040 0x55a927450430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4c2401406f0db2d8 server_cookie=50e498755c198c0a in_seq=0 out_seq=0 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f454a000640 10 client.26027 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f454a000640 1 -- 172.21.15.18:0/2965310057 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a927339c30 con 0x55a92744e040 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f454a000640 10 client.26027 handle_command_reply: tid=0 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 client.26027 shutdown 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 msgr2=0x55a9273df5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4558000c00 tx=0x7f4558005050 comp rx=0 tx=0).stop 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 shutdown_connections 2024-04-21T22:36:24.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55a92744e040 0x55a927450430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9273d7280 0x55a9273d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9273ce6a0 0x55a9273d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f454a000640 0 client.26027 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 --2- 172.21.15.18:0/2965310057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9273cdd80 0x55a9273df5d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 >> 172.21.15.18:0/2965310057 conn(0x55a9273c84b0 msgr2=0x55a9273c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 shutdown_connections 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.883+0000 7f456e1e6740 1 -- 172.21.15.18:0/2965310057 wait complete. 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456e1e6740 20 client.26027 trim_cache size 0 max 16384 2024-04-21T22:36:24.887 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 msgr2=0x7f454c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 0x7f454c0a51c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55a9273c9640 tx=0x7f4550013040 comp rx=0 tx=0).stop 2024-04-21T22:36:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 msgr2=0x7f45641a2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f455c005fd0 tx=0x7f455c00dea0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 shutdown_connections 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f454c0a2d00 0x7f454c0a51c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.884+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45641125c0 0x7f45641a2fa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.885+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4564076590 0x7f456419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.885+0000 7f456b400640 1 --2- 172.21.15.18:0/453295877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4564075c70 0x7f456419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.885+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 >> 172.21.15.18:0/453295877 conn(0x7f45640ff3d0 msgr2=0x7f4564113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.885+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 shutdown_connections 2024-04-21T22:36:24.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:24.885+0000 7f456b400640 1 -- 172.21.15.18:0/453295877 wait complete. 2024-04-21T22:36:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:24 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3054312774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:24.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:36:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:24 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3054312774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:24.963 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/file.h usability... yes 2024-04-21T22:36:25.002 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/file.h presence... yes 2024-04-21T22:36:25.002 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/file.h... yes 2024-04-21T22:36:25.143 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h usability... yes 2024-04-21T22:36:25.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 -- 172.21.15.18:0/1575458746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101f20 msgr2=0x7ff9a410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 --2- 172.21.15.18:0/1575458746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101f20 0x7ff9a410e3e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009ca0 tx=0x7ff99c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 -- 172.21.15.18:0/1575458746 shutdown_connections 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 --2- 172.21.15.18:0/1575458746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101f20 0x7ff9a410e3e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 --2- 172.21.15.18:0/1575458746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4101560 0x7ff9a41019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 --2- 172.21.15.18:0/1575458746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4107620 0x7ff9a4107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 -- 172.21.15.18:0/1575458746 >> 172.21.15.18:0/1575458746 conn(0x7ff9a40fd090 msgr2=0x7ff9a40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 -- 172.21.15.18:0/1575458746 shutdown_connections 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.162+0000 7ff9a3200640 1 -- 172.21.15.18:0/1575458746 wait complete. 2024-04-21T22:36:25.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.164+0000 7ff9a3200640 1 Processor -- start 2024-04-21T22:36:25.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.164+0000 7ff9a3200640 1 -- start start 2024-04-21T22:36:25.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101560 0x7ff9a4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 0x7ff9a41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41118e0 con 0x7ff9a4101560 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4111760 con 0x7ff9a4101f20 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a4111a60 con 0x7ff9a4107620 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 0x7ff9a41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101560 0x7ff9a4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49132/0 (socket says 172.21.15.18:49132) 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 0x7ff9a41982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56274/0 (socket says 172.21.15.18:56274) 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 -- 172.21.15.18:0/90695075 learned_addr learned my addr 172.21.15.18:0/90695075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 -- 172.21.15.18:0/90695075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 msgr2=0x7ff9a41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 0x7ff9a41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 -- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101560 msgr2=0x7ff9a4197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101560 0x7ff9a4197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.165+0000 7ff9a2800640 1 -- 172.21.15.18:0/90695075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a419cd50 con 0x7ff9a4107620 2024-04-21T22:36:25.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff9a2800640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff99c037040 tx=0x7ff99c032ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff99aa00640 1 -- 172.21.15.18:0/90695075 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c042020 con 0x7ff9a4107620 2024-04-21T22:36:25.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff99aa00640 1 -- 172.21.15.18:0/90695075 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff99c034640 con 0x7ff9a4107620 2024-04-21T22:36:25.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a419cfe0 con 0x7ff9a4107620 2024-04-21T22:36:25.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff99aa00640 1 -- 172.21.15.18:0/90695075 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c039040 con 0x7ff9a4107620 2024-04-21T22:36:25.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.166+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a41a48d0 con 0x7ff9a4107620 2024-04-21T22:36:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.171+0000 7ff9abde1740 1 Processor -- start 2024-04-21T22:36:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.171+0000 7ff99aa00640 1 -- 172.21.15.18:0/90695075 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff99c045020 con 0x7ff9a4107620 2024-04-21T22:36:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.171+0000 7ff9abde1740 1 -- start start 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb41350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb4a470 0x55f96cb4c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f96caa53a0 con 0x55f96cb40f70 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f96ca4d930 con 0x55f96cb41890 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9abde1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f96caa1360 con 0x55f96cb4a470 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb41350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56290/0 (socket says 172.21.15.18:56290) 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9a1e00640 1 -- 172.21.15.18:0/3733529228 learned_addr learned my addr 172.21.15.18:0/3733529228 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.172+0000 7ff9a1400640 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb4a470 0x55f96cb4c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 -- 172.21.15.18:0/3733529228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb4a470 msgr2=0x55f96cb4c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb4a470 0x55f96cb4c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 -- 172.21.15.18:0/3733529228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 msgr2=0x55f96cb41350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb41350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 -- 172.21.15.18:0/3733529228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96c7b93f0 con 0x55f96cb41890 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff99aa00640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 0x7ff9880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff994009cf0 tx=0x7ff994011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db3eddb08bc2f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff99aa00640 1 -- 172.21.15.18:0/90695075 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff99c0f0f70 con 0x7ff9a4107620 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff9a1400640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 0x7ff9880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.173+0000 7ff98f400640 1 -- 172.21.15.18:0/3733529228 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994004230 con 0x55f96cb41890 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.174+0000 7ff98f400640 1 -- 172.21.15.18:0/3733529228 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9940043d0 con 0x55f96cb41890 2024-04-21T22:36:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.174+0000 7ff98f400640 1 -- 172.21.15.18:0/3733529228 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940198c0 con 0x55f96cb41890 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.174+0000 7ff9abde1740 1 -- 172.21.15.18:0/3733529228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 msgr2=0x55f96cb49f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.174+0000 7ff9abde1740 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff994009cf0 tx=0x7ff994011810 comp rx=0 tx=0).stop 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.174+0000 7ff9a1400640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 0x7ff9880a51c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55f96cb3c830 tx=0x7ff990015040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 -- 172.21.15.18:0/3733529228 shutdown_connections 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb4a470 0x55f96cb4c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb41890 0x55f96cb49f30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 --2- 172.21.15.18:0/3733529228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb41350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 -- 172.21.15.18:0/3733529228 >> 172.21.15.18:0/3733529228 conn(0x55f96cb3b6a0 msgr2=0x55f96cb3ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 -- 172.21.15.18:0/3733529228 shutdown_connections 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 -- 172.21.15.18:0/3733529228 wait complete. 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.175+0000 7ff9abde1740 1 -- start start 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 Processor -- start 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 0x55f96cb474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb4a470 0x55f96cb47f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f96cb4d260 con 0x55f96cb4a470 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f96ca60d80 con 0x55f96cb40f70 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f96cb4d3e0 con 0x55f96cb41890 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9abde1740 10 client.0 _ll_register_callbacks cb 0x55f96ca9d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 0x55f96cb474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49142/0 (socket says 172.21.15.18:49142) 2024-04-21T22:36:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 0x55f96cb474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56296/0 (socket says 172.21.15.18:56296) 2024-04-21T22:36:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.176+0000 7ff9a1400640 1 -- 172.21.15.18:0/2009733588 learned_addr learned my addr 172.21.15.18:0/2009733588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 -- 172.21.15.18:0/2009733588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 msgr2=0x55f96cb474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 0x55f96cb474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 -- 172.21.15.18:0/2009733588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb4a470 msgr2=0x55f96cb47f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb4a470 0x55f96cb47f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 -- 172.21.15.18:0/2009733588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96c8837d0 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff9a1400640 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9900045e0 tx=0x7ff990005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35ec22056bd8413 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff983e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.177+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99000f740 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff99000f8e0 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9940043d0 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff99000fae0 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 10 client.26068 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f96cb59590 con 0x55f96cb41890 2024-04-21T22:36:25.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9940043d0 con 0x55f96cb41890 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff99001f070 con 0x55f96cb41890 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 10 client.26068 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 10 client.26068 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 20 client.26068 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.178+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cb5aaa0 0x55f96cb5cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.179+0000 7ff9abde1740 4 client.26068 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.179+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f96cab28e0 con 0x55f96cb5aaa0 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.179+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cb5aaa0 0x55f96cb5cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.179+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cb5aaa0 0x55f96cb5cf20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=131dc80bc3fa4cbb server_cookie=cf86f8670e23e822 in_seq=0 out_seq=0 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.179+0000 7ff983e00640 10 client.26068 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff983e00640 1 -- 172.21.15.18:0/2009733588 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f96cab28e0 con 0x55f96cb5aaa0 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff983e00640 10 client.26068 handle_command_reply: tid=0 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff9abde1740 1 client.26068 shutdown 2024-04-21T22:36:25.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 msgr2=0x55f96cb47a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9900045e0 tx=0x7ff990005f90 comp rx=0 tx=0).stop 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 shutdown_connections 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.180+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cb5aaa0 0x55f96cb5cf20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb4a470 0x55f96cb47f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb47a10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2009733588 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb40f70 0x55f96cb474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff983e00640 0 client.26068 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 >> 172.21.15.18:0/2009733588 conn(0x55f96cb3b6a0 msgr2=0x55f96cb3d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 shutdown_connections 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 1 -- 172.21.15.18:0/2009733588 wait complete. 2024-04-21T22:36:25.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.181+0000 7ff9abde1740 20 client.26068 trim_cache size 0 max 16384 2024-04-21T22:36:25.185 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fcntl.h presence... yes 2024-04-21T22:36:25.185 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fcntl.h... yes 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.196+0000 7ff9abde1740 1 Processor -- start 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.196+0000 7ff9abde1740 1 -- start start 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.196+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb46630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9abde1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41ad300 con 0x55f96cb40f70 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9abde1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41aefc0 con 0x55f96cb4a470 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9abde1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41ada90 con 0x55f96cb41890 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38178/0 (socket says 172.21.15.18:38178) 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49144/0 (socket says 172.21.15.18:49144) 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1e00640 1 -- 172.21.15.18:0/1757289199 learned_addr learned my addr 172.21.15.18:0/1757289199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a2800640 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb46630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 -- 172.21.15.18:0/1757289199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 msgr2=0x55f96cb46630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb46630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 -- 172.21.15.18:0/1757289199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 msgr2=0x55f96cb49c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1400640 1 -- 172.21.15.18:0/1757289199 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96cb4c860 con 0x55f96cb41890 2024-04-21T22:36:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.197+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:25.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.198+0000 7ff9a1400640 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff9900225b0 tx=0x7ff9900095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad12e6e433a028a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.198+0000 7ff98ea00640 1 -- 172.21.15.18:0/1757289199 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990038030 con 0x55f96cb41890 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.198+0000 7ff98ea00640 1 -- 172.21.15.18:0/1757289199 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9900043a0 con 0x55f96cb41890 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.198+0000 7ff98ea00640 1 -- 172.21.15.18:0/1757289199 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990022b70 con 0x55f96cb41890 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- 172.21.15.18:0/1757289199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 msgr2=0x55f96cb56120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff9900225b0 tx=0x7ff9900095b0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- 172.21.15.18:0/1757289199 shutdown_connections 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb46630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb41890 0x55f96cb56120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 --2- 172.21.15.18:0/1757289199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb40f70 0x55f96cb49c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- 172.21.15.18:0/1757289199 >> 172.21.15.18:0/1757289199 conn(0x55f96cb3b6a0 msgr2=0x55f96cb39e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- 172.21.15.18:0/1757289199 shutdown_connections 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- 172.21.15.18:0/1757289199 wait complete. 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.199+0000 7ff9abde1740 1 -- start start 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 Processor -- start 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 0x55f96cb4dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb4e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41ae830 con 0x55f96cb41890 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41ae160 con 0x55f96cb4a470 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a41ab2e0 con 0x55f96cb40f70 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9abde1740 10 client.0 _ll_register_callbacks cb 0x7ff990009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 0x55f96cb4dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9a1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 0x55f96cb4dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38186/0 (socket says 172.21.15.18:38186) 2024-04-21T22:36:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9a1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49156/0 (socket says 172.21.15.18:49156) 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.200+0000 7ff9a1400640 1 -- 172.21.15.18:0/2337725624 learned_addr learned my addr 172.21.15.18:0/2337725624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a2800640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb4e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 -- 172.21.15.18:0/2337725624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 msgr2=0x55f96cb4e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb4e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 -- 172.21.15.18:0/2337725624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 msgr2=0x55f96cb4dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 0x55f96cb4dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 -- 172.21.15.18:0/2337725624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96cb4e670 con 0x55f96cb40f70 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9a1e00640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff994014040 tx=0x7ff9940097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255df9e8640c9eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff983e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994005040 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff9940051e0 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.201+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f96caacc30 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff994039050 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 10 client.26074 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f96cbc0df0 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f96caacc30 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff994003710 con 0x55f96cb40f70 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 10 client.26074 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 10 client.26074 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 20 client.26074 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cbc14a0 0x55f96cbc38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 4 client.26074 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.202+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f96ca2a5a0 con 0x55f96cbc14a0 2024-04-21T22:36:25.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff9a1400640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cbc14a0 0x55f96cbc38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff9a1400640 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cbc14a0 0x55f96cbc38c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ebb5c75027a630f server_cookie=895ba9fe9c7eb781 in_seq=0 out_seq=0 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff983e00640 10 client.26074 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff983e00640 1 -- 172.21.15.18:0/2337725624 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f96ca2a5a0 con 0x55f96cbc14a0 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff983e00640 10 client.26074 handle_command_reply: tid=0 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.203+0000 7ff9abde1740 1 client.26074 shutdown 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 msgr2=0x55f96cb52740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff994014040 tx=0x7ff9940097a0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 shutdown_connections 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55f96cbc14a0 0x55f96cbc38c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f96cb4a470 0x55f96cb4e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f96cb41890 0x55f96cb4dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 --2- 172.21.15.18:0/2337725624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f96cb40f70 0x55f96cb52740 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff983e00640 0 client.26074 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 >> 172.21.15.18:0/2337725624 conn(0x55f96cb3b6a0 msgr2=0x55f96cb3d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 shutdown_connections 2024-04-21T22:36:25.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 1 -- 172.21.15.18:0/2337725624 wait complete. 2024-04-21T22:36:25.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.204+0000 7ff9abde1740 20 client.26074 trim_cache size 0 max 16384 2024-04-21T22:36:25.209 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 msgr2=0x7ff9880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 0x7ff9880a51c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55f96cb3c830 tx=0x7ff990015040 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 msgr2=0x7ff9a419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff99c037040 tx=0x7ff99c032ea0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 shutdown_connections 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9880a2d00 0x7ff9880a51c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9a4107620 0x7ff9a419c620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9a4101f20 0x7ff9a41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 --2- 172.21.15.18:0/90695075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9a4101560 0x7ff9a4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 >> 172.21.15.18:0/90695075 conn(0x7ff9a40fd090 msgr2=0x7ff9a40fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 shutdown_connections 2024-04-21T22:36:25.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.205+0000 7ff9a3200640 1 -- 172.21.15.18:0/90695075 wait complete. 2024-04-21T22:36:25.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:36:25.292 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/syssgi.h usability... no 2024-04-21T22:36:25.345 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/syssgi.h presence... no 2024-04-21T22:36:25.346 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/syssgi.h... no 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.461+0000 7f5030e00640 1 -- 172.21.15.18:0/1953355029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 msgr2=0x7f502c1149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.461+0000 7f5030e00640 1 --2- 172.21.15.18:0/1953355029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1149b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5024009c10 tx=0x7f502402bef0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 -- 172.21.15.18:0/1953355029 shutdown_connections 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 --2- 172.21.15.18:0/1953355029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1149b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 --2- 172.21.15.18:0/1953355029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 --2- 172.21.15.18:0/1953355029 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 0x7f502c076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 -- 172.21.15.18:0/1953355029 >> 172.21.15.18:0/1953355029 conn(0x7f502c0ff3b0 msgr2=0x7f502c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 -- 172.21.15.18:0/1953355029 shutdown_connections 2024-04-21T22:36:25.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.462+0000 7f5030e00640 1 -- 172.21.15.18:0/1953355029 wait complete. 2024-04-21T22:36:25.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 Processor -- start 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 -- start start 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 0x7f502c19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f502c118150 con 0x7f502c075c70 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f502c117fd0 con 0x7f502c076590 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.463+0000 7f5030e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1182d0 con 0x7f502c1125c0 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49166/0 (socket says 172.21.15.18:49166) 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 -- 172.21.15.18:0/3682405413 learned_addr learned my addr 172.21.15.18:0/3682405413 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f5029e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 0x7f502c19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f5029400640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 -- 172.21.15.18:0/3682405413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 msgr2=0x7f502c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 -- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 msgr2=0x7f502c19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 0x7f502c19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f502a800640 1 -- 172.21.15.18:0/3682405413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c1a3610 con 0x7f502c1125c0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.464+0000 7f5029400640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f502a800640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5024004af0 tx=0x7f50240336b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f5022a00640 1 -- 172.21.15.18:0/3682405413 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024043020 con 0x7f502c1125c0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f5022a00640 1 -- 172.21.15.18:0/3682405413 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5024003e50 con 0x7f502c1125c0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c1a38a0 con 0x7f502c1125c0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f5022a00640 1 -- 172.21.15.18:0/3682405413 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502403e450 con 0x7f502c1125c0 2024-04-21T22:36:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.465+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c1ab190 con 0x7f502c1125c0 2024-04-21T22:36:25.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.470+0000 7f5033a7c740 1 Processor -- start 2024-04-21T22:36:25.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.470+0000 7f5022a00640 1 -- 172.21.15.18:0/3682405413 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5024046020 con 0x7f502c1125c0 2024-04-21T22:36:25.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.470+0000 7f5033a7c740 1 -- start start 2024-04-21T22:36:25.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2c5280 0x5627ef2c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5627ef2203a0 con 0x5627ef2bc6a0 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5627ef1c8930 con 0x5627ef2c5280 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5033a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5627ef21c360 con 0x5627ef2bbd80 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49176/0 (socket says 172.21.15.18:49176) 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 -- 172.21.15.18:0/1745633954 learned_addr learned my addr 172.21.15.18:0/1745633954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029e00640 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2c5280 0x5627ef2c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 -- 172.21.15.18:0/1745633954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2c5280 msgr2=0x5627ef2c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2c5280 0x5627ef2c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 -- 172.21.15.18:0/1745633954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2bc6a0 msgr2=0x5627ef2c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.471+0000 7f5029400640 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5029400640 1 -- 172.21.15.18:0/1745633954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627eef343f0 con 0x5627ef2bbd80 2024-04-21T22:36:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5029400640 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50180127a0 tx=0x7f50180096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d389e8f0b9d661 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5022a00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 0x7f50100a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5017400640 1 -- 172.21.15.18:0/1745633954 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018012d20 con 0x5627ef2bbd80 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5017400640 1 -- 172.21.15.18:0/1745633954 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5018010cb0 con 0x5627ef2bbd80 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5017400640 1 -- 172.21.15.18:0/1745633954 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501801ebd0 con 0x5627ef2bbd80 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5022a00640 1 -- 172.21.15.18:0/3682405413 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f50240f18e0 con 0x7f502c1125c0 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.472+0000 7f5029e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 0x7f50100a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 -- 172.21.15.18:0/1745633954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 msgr2=0x5627ef2bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50180127a0 tx=0x7f50180096a0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 -- 172.21.15.18:0/1745633954 shutdown_connections 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2c5280 0x5627ef2c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1745633954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2bc160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 -- 172.21.15.18:0/1745633954 >> 172.21.15.18:0/1745633954 conn(0x5627ef2b64b0 msgr2=0x5627ef2b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5029e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 0x7f50100a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5627ef2bb850 tx=0x7f501c009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 -- 172.21.15.18:0/1745633954 shutdown_connections 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.473+0000 7f5033a7c740 1 -- 172.21.15.18:0/1745633954 wait complete. 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.474+0000 7f5033a7c740 1 -- start start 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.474+0000 7f5033a7c740 1 Processor -- start 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5627ef2c8070 con 0x5627ef2c5280 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5627ef1dbd80 con 0x5627ef2bc6a0 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5627ef2c81f0 con 0x5627ef2bbd80 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5033a7c740 10 client.0 _ll_register_callbacks cb 0x5627ef2182b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49186/0 (socket says 172.21.15.18:49186) 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 -- 172.21.15.18:0/3727063462 learned_addr learned my addr 172.21.15.18:0/3727063462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f502a800640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029400640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 -- 172.21.15.18:0/3727063462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bc6a0 msgr2=0x5627ef2c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 -- 172.21.15.18:0/3727063462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 msgr2=0x5627ef2c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f5029e00640 1 -- 172.21.15.18:0/3727063462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627eeffe7d0 con 0x5627ef2bbd80 2024-04-21T22:36:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.475+0000 7f502a800640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f5029e00640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f501c0045f0 tx=0x7f501c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e98d08a6b1e735 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f500be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c02d060 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f501c018030 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5018010cb0 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f501c020710 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f5033a7c740 10 client.26086 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.476+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5627ef2d4430 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5018010cb0 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f501c01db90 con 0x5627ef2bbd80 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 10 client.26086 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 10 client.26086 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 20 client.26086 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef2d58f0 0x5627ef2d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 4 client.26086 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:25.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627ef22d8e0 con 0x5627ef2d58f0 2024-04-21T22:36:25.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.477+0000 7f5029400640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef2d58f0 0x5627ef2d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.478+0000 7f5029400640 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef2d58f0 0x5627ef2d7d00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5468356fb9a4348 server_cookie=fc24095ed33a273b in_seq=0 out_seq=0 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.478+0000 7f500be00640 10 client.26086 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f500be00640 1 -- 172.21.15.18:0/3727063462 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5627ef22d8e0 con 0x5627ef2d58f0 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f500be00640 10 client.26086 handle_command_reply: tid=0 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 client.26086 shutdown 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 msgr2=0x5627ef2c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f501c0045f0 tx=0x7f501c004730 comp rx=0 tx=0).stop 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 shutdown_connections 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef2d58f0 0x5627ef2d7d00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f500be00640 0 client.26086 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 --2- 172.21.15.18:0/3727063462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bbd80 0x5627ef2c2370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 >> 172.21.15.18:0/3727063462 conn(0x5627ef2b64b0 msgr2=0x5627ef2b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 shutdown_connections 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 1 -- 172.21.15.18:0/3727063462 wait complete. 2024-04-21T22:36:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.479+0000 7f5033a7c740 20 client.26086 trim_cache size 0 max 16384 2024-04-21T22:36:25.485 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h usability... yes 2024-04-21T22:36:25.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 Processor -- start 2024-04-21T22:36:25.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 -- start start 2024-04-21T22:36:25.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2dd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b3af0 con 0x5627ef2c5280 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b57b0 con 0x5627ef2bbd80 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5033a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b4280 con 0x5627ef2bc6a0 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.496+0000 7f5029400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49200/0 (socket says 172.21.15.18:49200) 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 -- 172.21.15.18:0/1820017480 learned_addr learned my addr 172.21.15.18:0/1820017480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029e00640 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f502a800640 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2dd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 -- 172.21.15.18:0/1820017480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 msgr2=0x5627ef2d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 -- 172.21.15.18:0/1820017480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 msgr2=0x5627ef2dd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2dd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 -- 172.21.15.18:0/1820017480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ef2bdf50 con 0x5627ef2bc6a0 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5029400640 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5018012770 tx=0x7f50180096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240b45d8b000a25a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.497+0000 7f5016a00640 1 -- 172.21.15.18:0/1820017480 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501802d070 con 0x5627ef2bc6a0 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5016a00640 1 -- 172.21.15.18:0/1820017480 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5018010c80 con 0x5627ef2bc6a0 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5016a00640 1 -- 172.21.15.18:0/1820017480 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501801ed80 con 0x5627ef2bc6a0 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5033a7c740 1 -- 172.21.15.18:0/1820017480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 msgr2=0x5627ef2c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5018012770 tx=0x7f50180096a0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5033a7c740 1 -- 172.21.15.18:0/1820017480 shutdown_connections 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.498+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2c2c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 --2- 172.21.15.18:0/1820017480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 -- 172.21.15.18:0/1820017480 >> 172.21.15.18:0/1820017480 conn(0x5627ef2b64b0 msgr2=0x5627ef2b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 -- 172.21.15.18:0/1820017480 shutdown_connections 2024-04-21T22:36:25.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 -- 172.21.15.18:0/1820017480 wait complete. 2024-04-21T22:36:25.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 -- start start 2024-04-21T22:36:25.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.499+0000 7f5033a7c740 1 Processor -- start 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b5020 con 0x5627ef2c5280 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b4950 con 0x5627ef2bbd80 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1b1ad0 con 0x5627ef2bc6a0 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5033a7c740 10 client.0 _ll_register_callbacks cb 0x7f501c009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5029e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f502a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5029e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56352/0 (socket says 172.21.15.18:56352) 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5029e00640 1 -- 172.21.15.18:0/2381938346 learned_addr learned my addr 172.21.15.18:0/2381938346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.500+0000 7f5029400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 -- 172.21.15.18:0/2381938346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 msgr2=0x5627ef2bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 -- 172.21.15.18:0/2381938346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 msgr2=0x5627ef2bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 -- 172.21.15.18:0/2381938346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ef33af30 con 0x5627ef2bc6a0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029e00640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5029400640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2bf620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5627ef2bbab0 tx=0x7f5018005670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dab853238bf7350 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f500be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501802d070 con 0x5627ef2bc6a0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f50180109a0 con 0x5627ef2bc6a0 2024-04-21T22:36:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5018010c80 con 0x5627ef2bc6a0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.501+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f501802e260 con 0x5627ef2bc6a0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 10 client.26092 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5627ef33c210 con 0x5627ef2bc6a0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5018010c80 con 0x5627ef2bc6a0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f501801eac0 con 0x5627ef2bc6a0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 10 client.26092 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 10 client.26092 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 20 client.26092 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef33c730 0x5627ef33eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 4 client.26092 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627ef227c30 con 0x5627ef33c730 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.502+0000 7f5029e00640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef33c730 0x5627ef33eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5029e00640 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef33c730 0x5627ef33eb20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23a81c83552feebd server_cookie=1637d33dfd3c225d in_seq=0 out_seq=0 2024-04-21T22:36:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f500be00640 10 client.26092 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f500be00640 1 -- 172.21.15.18:0/2381938346 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627ef227c30 con 0x5627ef33c730 2024-04-21T22:36:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f500be00640 10 client.26092 handle_command_reply: tid=0 2024-04-21T22:36:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 client.26092 shutdown 2024-04-21T22:36:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 msgr2=0x5627ef2bf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2bf620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5627ef2bbab0 tx=0x7f5018005670 comp rx=0 tx=0).stop 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 shutdown_connections 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5627ef33c730 0x5627ef33eb20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627ef2c5280 0x5627ef2bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627ef2bc6a0 0x5627ef2bf620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 --2- 172.21.15.18:0/2381938346 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5627ef2bbd80 0x5627ef2bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 >> 172.21.15.18:0/2381938346 conn(0x5627ef2b64b0 msgr2=0x5627ef2b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.503+0000 7f500be00640 0 client.26092 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.504+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 shutdown_connections 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.504+0000 7f5033a7c740 1 -- 172.21.15.18:0/2381938346 wait complete. 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.504+0000 7f5033a7c740 20 client.26092 trim_cache size 0 max 16384 2024-04-21T22:36:25.508 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 msgr2=0x7f50100a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 0x7f50100a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5627ef2bb850 tx=0x7f501c009260 comp rx=0 tx=0).stop 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 msgr2=0x7f502c1a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5024004af0 tx=0x7f50240336b0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 shutdown_connections 2024-04-21T22:36:25.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50100a2d80 0x7f50100a5240 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c1125c0 0x7f502c1a2ee0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f502c076590 0x7f502c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 --2- 172.21.15.18:0/3682405413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f502c075c70 0x7f502c19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.505+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 >> 172.21.15.18:0/3682405413 conn(0x7f502c0ff3b0 msgr2=0x7f502c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.506+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 shutdown_connections 2024-04-21T22:36:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.506+0000 7f5030e00640 1 -- 172.21.15.18:0/3682405413 wait complete. 2024-04-21T22:36:25.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:36:25.529 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/param.h presence... yes 2024-04-21T22:36:25.529 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/param.h... yes 2024-04-21T22:36:25.557 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/stat.h... (cached) yes 2024-04-21T22:36:25.658 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/statvfs.h usability... yes 2024-04-21T22:36:25.698 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/statvfs.h presence... yes 2024-04-21T22:36:25.699 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/statvfs.h... yes 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 -- 172.21.15.18:0/1024625450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2324073b70 msgr2=0x7f2324073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 --2- 172.21.15.18:0/1024625450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2324073b70 0x7f2324073f50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2314009900 tx=0x7f231402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 -- 172.21.15.18:0/1024625450 shutdown_connections 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 --2- 172.21.15.18:0/1024625450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f232410dd70 0x7f23241101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 --2- 172.21.15.18:0/1024625450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324074490 0x7f232410d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 --2- 172.21.15.18:0/1024625450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2324073b70 0x7f2324073f50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 -- 172.21.15.18:0/1024625450 >> 172.21.15.18:0/1024625450 conn(0x7f23240fd060 msgr2=0x7f23240ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 -- 172.21.15.18:0/1024625450 shutdown_connections 2024-04-21T22:36:25.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.718+0000 7f2328e00640 1 -- 172.21.15.18:0/1024625450 wait complete. 2024-04-21T22:36:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 Processor -- start 2024-04-21T22:36:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 -- start start 2024-04-21T22:36:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2324074490 0x7f232419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f232410dd70 0x7f232419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2324113b60 con 0x7f2324073b70 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23241139e0 con 0x7f2324074490 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.719+0000 7f2328e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2324113ce0 con 0x7f232410dd70 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38252/0 (socket says 172.21.15.18:38252) 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 -- 172.21.15.18:0/3742739684 learned_addr learned my addr 172.21.15.18:0/3742739684 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f232410dd70 0x7f232419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2322a00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2324074490 0x7f232419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 -- 172.21.15.18:0/3742739684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f232410dd70 msgr2=0x7f232419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f232410dd70 0x7f232419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 -- 172.21.15.18:0/3742739684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2324074490 msgr2=0x7f232419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2324074490 0x7f232419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.720+0000 7f2323400640 1 -- 172.21.15.18:0/3742739684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232419f050 con 0x7f2324073b70 2024-04-21T22:36:25.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f2323400640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f2314004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f231be00640 1 -- 172.21.15.18:0/3742739684 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314042020 con 0x7f2324073b70 2024-04-21T22:36:25.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232419f2e0 con 0x7f2324073b70 2024-04-21T22:36:25.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f231be00640 1 -- 172.21.15.18:0/3742739684 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23140054e0 con 0x7f2324073b70 2024-04-21T22:36:25.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f231be00640 1 -- 172.21.15.18:0/3742739684 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314003b50 con 0x7f2324073b70 2024-04-21T22:36:25.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.721+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23241a6bd0 con 0x7f2324073b70 2024-04-21T22:36:25.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.724+0000 7f232d169740 1 Processor -- start 2024-04-21T22:36:25.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.724+0000 7f231be00640 1 -- 172.21.15.18:0/3742739684 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2314045020 con 0x7f2324073b70 2024-04-21T22:36:25.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 -- start start 2024-04-21T22:36:25.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55582d0193a0 con 0x55582d0b5890 2024-04-21T22:36:25.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55582cfc1930 con 0x55582d0be470 2024-04-21T22:36:25.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.725+0000 7f232d169740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55582d015360 con 0x55582d0b4f70 2024-04-21T22:36:25.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49228/0 (socket says 172.21.15.18:49228) 2024-04-21T22:36:25.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 -- 172.21.15.18:0/572582292 learned_addr learned my addr 172.21.15.18:0/572582292 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2322a00640 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 -- 172.21.15.18:0/572582292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 msgr2=0x55582d0c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 -- 172.21.15.18:0/572582292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 msgr2=0x55582d0bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0bdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f2323e00640 1 -- 172.21.15.18:0/572582292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582cd2d3f0 con 0x55582d0b4f70 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.726+0000 7f231be00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 0x7f23080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f2323e00640 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f231c009f50 tx=0x7f231c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1637aee0ead0c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f231be00640 1 -- 172.21.15.18:0/3742739684 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f23140f0eb0 con 0x7f2324073b70 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f2323400640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 0x7f23080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f2318c00640 1 -- 172.21.15.18:0/572582292 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c004d20 con 0x55582d0b4f70 2024-04-21T22:36:25.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f2318c00640 1 -- 172.21.15.18:0/572582292 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231c004050 con 0x55582d0b4f70 2024-04-21T22:36:25.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.727+0000 7f2318c00640 1 -- 172.21.15.18:0/572582292 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c005280 con 0x55582d0b4f70 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- 172.21.15.18:0/572582292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 msgr2=0x55582d0b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f231c009f50 tx=0x7f231c0118d0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f2323400640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 0x7f23080a5240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23140ee7c0 tx=0x7f23140f4a00 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- 172.21.15.18:0/572582292 shutdown_connections 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0bdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 --2- 172.21.15.18:0/572582292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b4f70 0x55582d0b5350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- 172.21.15.18:0/572582292 >> 172.21.15.18:0/572582292 conn(0x55582d0af6a0 msgr2=0x55582d0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- 172.21.15.18:0/572582292 shutdown_connections 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- 172.21.15.18:0/572582292 wait complete. 2024-04-21T22:36:25.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.728+0000 7f232d169740 1 -- start start 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 Processor -- start 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55582d0c1260 con 0x55582d0b4f70 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55582cfd4d80 con 0x55582d0be470 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55582d0c13e0 con 0x55582d0b5890 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f232d169740 10 client.0 _ll_register_callbacks cb 0x55582d0112b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f2322a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f2322a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49238/0 (socket says 172.21.15.18:49238) 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.729+0000 7f2322a00640 1 -- 172.21.15.18:0/3594409544 learned_addr learned my addr 172.21.15.18:0/3594409544 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2323e00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2323e00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 -- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 msgr2=0x55582d0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 -- 172.21.15.18:0/3594409544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 msgr2=0x55582d0bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 -- 172.21.15.18:0/3594409544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582cdf77d0 con 0x55582d0b5890 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2323e00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f2322a00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23100058c0 tx=0x7f231000e780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c17e11157136207 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.730+0000 7f230d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310025030 con 0x55582d0b5890 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231c004050 con 0x55582d0b5890 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2310005020 con 0x55582d0b5890 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f231002f050 con 0x55582d0b5890 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f232d169740 10 client.26104 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55582d0cd630 con 0x55582d0b5890 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.731+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231c004050 con 0x55582d0b5890 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f2310021610 con 0x55582d0b5890 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 10 client.26104 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 10 client.26104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 20 client.26104 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d0ceb40 0x55582d0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 4 client.26104 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55582d0268e0 con 0x55582d0ceb40 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.732+0000 7f2323e00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d0ceb40 0x55582d0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.733+0000 7f2323e00640 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d0ceb40 0x55582d0d0f70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424d5b32c0087eb4 server_cookie=e30d5d6af8ae7cf7 in_seq=0 out_seq=0 2024-04-21T22:36:25.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.733+0000 7f230d600640 10 client.26104 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.733+0000 7f230d600640 1 -- 172.21.15.18:0/3594409544 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55582d0268e0 con 0x55582d0ceb40 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.733+0000 7f230d600640 10 client.26104 handle_command_reply: tid=0 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.733+0000 7f232d169740 1 client.26104 shutdown 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 msgr2=0x55582d0bba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23100058c0 tx=0x7f231000e780 comp rx=0 tx=0).stop 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 shutdown_connections 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d0ceb40 0x55582d0d0f70 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0bba20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 --2- 172.21.15.18:0/3594409544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0bb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f230d600640 0 client.26104 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 >> 172.21.15.18:0/3594409544 conn(0x55582d0af6a0 msgr2=0x55582d0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 shutdown_connections 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 1 -- 172.21.15.18:0/3594409544 wait complete. 2024-04-21T22:36:25.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.734+0000 7f232d169740 20 client.26104 trim_cache size 0 max 16384 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.749+0000 7f232d169740 1 Processor -- start 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.749+0000 7f232d169740 1 -- start start 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 0x55582d0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0be470 0x55582d0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23241ab0c0 con 0x55582d0b5890 2024-04-21T22:36:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23241acd80 con 0x55582d0b4f70 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f232d169740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23241ab850 con 0x55582d0be470 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2322a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2322a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38282/0 (socket says 172.21.15.18:38282) 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2322a00640 1 -- 172.21.15.18:0/3377135305 learned_addr learned my addr 172.21.15.18:0/3377135305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2323e00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0be470 0x55582d0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2323e00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 0x55582d0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2322a00640 1 -- 172.21.15.18:0/3377135305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0be470 msgr2=0x55582d0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.750+0000 7f2322a00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0be470 0x55582d0ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f2322a00640 1 -- 172.21.15.18:0/3377135305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 msgr2=0x55582d0bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f2322a00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 0x55582d0bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f2322a00640 1 -- 172.21.15.18:0/3377135305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582d0b56c0 con 0x55582d0b5890 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f2323e00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 0x55582d0bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f2322a00640 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f231000a010 tx=0x7f231000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3e46e57c4e251 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f230fe00640 1 -- 172.21.15.18:0/3377135305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310025040 con 0x55582d0b5890 2024-04-21T22:36:25.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f230fe00640 1 -- 172.21.15.18:0/3377135305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2310037070 con 0x55582d0b5890 2024-04-21T22:36:25.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.751+0000 7f230fe00640 1 -- 172.21.15.18:0/3377135305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310003930 con 0x55582d0b5890 2024-04-21T22:36:25.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 -- 172.21.15.18:0/3377135305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 msgr2=0x55582d0ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f231000a010 tx=0x7f231000ed00 comp rx=0 tx=0).stop 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 -- 172.21.15.18:0/3377135305 shutdown_connections 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0be470 0x55582d0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b5890 0x55582d0ca150 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 --2- 172.21.15.18:0/3377135305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0b4f70 0x55582d0bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 -- 172.21.15.18:0/3377135305 >> 172.21.15.18:0/3377135305 conn(0x55582d0af6a0 msgr2=0x55582d0ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 -- 172.21.15.18:0/3377135305 shutdown_connections 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.752+0000 7f232d169740 1 -- 172.21.15.18:0/3377135305 wait complete. 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.753+0000 7f232d169740 1 -- start start 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.753+0000 7f232d169740 1 Processor -- start 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.753+0000 7f232d169740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23241ac5f0 con 0x55582d0b4f70 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23241abf20 con 0x55582d0be470 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23241a90c0 con 0x55582d0b5890 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f232d169740 10 client.0 _ll_register_callbacks cb 0x7f2310017d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:49256/0 (socket says 172.21.15.18:49256) 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 -- 172.21.15.18:0/2594859305 learned_addr learned my addr 172.21.15.18:0/2594859305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2323e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2323e00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 -- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 msgr2=0x55582d0c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 -- 172.21.15.18:0/2594859305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 msgr2=0x55582d0c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.754+0000 7f2322a00640 1 -- 172.21.15.18:0/2594859305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582d1342a0 con 0x55582d0b5890 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f2322a00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2310021c20 tx=0x7f2310009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3fd87602392fdbf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f230d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310025070 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2310005230 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2310037070 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f231004c050 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f232d169740 10 client.26110 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55582d135560 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.755+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2310037070 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f2310044020 con 0x55582d0b5890 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 10 client.26110 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 20 client.26110 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d135ca0 0x55582d1380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 4 client.26110 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55582d020c30 con 0x55582d135ca0 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.756+0000 7f2323e00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d135ca0 0x55582d1380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f2323e00640 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d135ca0 0x55582d1380c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0dcf2d43024767b server_cookie=18172027cc241ded in_seq=0 out_seq=0 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f230d600640 10 client.26110 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f230d600640 1 -- 172.21.15.18:0/2594859305 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55582d020c30 con 0x55582d135ca0 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f230d600640 10 client.26110 handle_command_reply: tid=0 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 client.26110 shutdown 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 msgr2=0x55582d0c2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2310021c20 tx=0x7f2310009bc0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 shutdown_connections 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55582d0be470 0x55582d0c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55582d135ca0 0x55582d1380c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55582d0b5890 0x55582d0c2730 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 --2- 172.21.15.18:0/2594859305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55582d0b4f70 0x55582d0c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 >> 172.21.15.18:0/2594859305 conn(0x55582d0af6a0 msgr2=0x55582d0bbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f230d600640 0 client.26110 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 shutdown_connections 2024-04-21T22:36:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 1 -- 172.21.15.18:0/2594859305 wait complete. 2024-04-21T22:36:25.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.757+0000 7f232d169740 20 client.26110 trim_cache size 0 max 16384 2024-04-21T22:36:25.763 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:25.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 msgr2=0x7f23080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 0x7f23080a5240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23140ee7c0 tx=0x7f23140f4a00 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 msgr2=0x7f232419a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f2314004360 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 shutdown_connections 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23080a2d80 0x7f23080a5240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f232410dd70 0x7f232419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2324074490 0x7f232419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 --2- 172.21.15.18:0/3742739684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2324073b70 0x7f232419a060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:25.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 >> 172.21.15.18:0/3742739684 conn(0x7f23240fd060 msgr2=0x7f23240fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:25.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 shutdown_connections 2024-04-21T22:36:25.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:25.758+0000 7f2328e00640 1 -- 172.21.15.18:0/3742739684 wait complete. 2024-04-21T22:36:25.776 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:25 smithi018 ceph-mon[26614]: pgmap v74: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 589 op/s 2024-04-21T22:36:25.801 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h usability... yes 2024-04-21T22:36:25.842 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/time.h presence... yes 2024-04-21T22:36:25.842 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/time.h... yes 2024-04-21T22:36:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:25 smithi081 ceph-mon[31692]: pgmap v74: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 589 op/s 2024-04-21T22:36:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:25 smithi047 ceph-mon[31561]: pgmap v74: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 589 op/s 2024-04-21T22:36:25.968 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h usability... yes 2024-04-21T22:36:26.009 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/ioctl.h presence... yes 2024-04-21T22:36:26.009 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/ioctl.h... yes 2024-04-21T22:36:26.156 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/wait.h usability... yes 2024-04-21T22:36:26.207 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/wait.h presence... yes 2024-04-21T22:36:26.207 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/wait.h... yes 2024-04-21T22:36:26.243 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/types.h... (cached) yes 2024-04-21T22:36:26.262 INFO:tasks.workunit.client.0.smithi018.stdout:checking for strings.h... (cached) yes 2024-04-21T22:36:26.364 INFO:tasks.workunit.client.0.smithi018.stdout:checking err.h usability... yes 2024-04-21T22:36:26.409 INFO:tasks.workunit.client.0.smithi018.stdout:checking err.h presence... yes 2024-04-21T22:36:26.409 INFO:tasks.workunit.client.0.smithi018.stdout:checking for err.h... yes 2024-04-21T22:36:26.542 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/falloc.h usability... yes 2024-04-21T22:36:26.582 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/falloc.h presence... yes 2024-04-21T22:36:26.582 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/falloc.h... yes 2024-04-21T22:36:26.715 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-04-21T22:36:26.778 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:36:26.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:36:26.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:36:26.789 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-04-21T22:36:26.789 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-21T22:36:26.894 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_itable.h usability... no 2024-04-21T22:36:26.960 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/fs/xfs_itable.h presence... no 2024-04-21T22:36:26.960 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 -- 172.21.15.18:0/1253360528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a01029b0 msgr2=0x7f15a0102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 --2- 172.21.15.18:0/1253360528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a01029b0 0x7f15a0102d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1594009900 tx=0x7f159402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 -- 172.21.15.18:0/1253360528 shutdown_connections 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 --2- 172.21.15.18:0/1253360528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a010bcf0 0x7f15a010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 --2- 172.21.15.18:0/1253360528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01032d0 0x7f15a010b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 --2- 172.21.15.18:0/1253360528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a01029b0 0x7f15a0102d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 -- 172.21.15.18:0/1253360528 >> 172.21.15.18:0/1253360528 conn(0x7f15a00777f0 msgr2=0x7f15a0077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 -- 172.21.15.18:0/1253360528 shutdown_connections 2024-04-21T22:36:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.995+0000 7f15a8400640 1 -- 172.21.15.18:0/1253360528 wait complete. 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.996+0000 7f15a8400640 1 Processor -- start 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.996+0000 7f15a8400640 1 -- start start 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a01032d0 0x7f15a0100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 0x7f15a0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0111b40 con 0x7f15a010bcf0 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01119c0 con 0x7f15a01032d0 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a8400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0111cc0 con 0x7f15a01029b0 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44586/0 (socket says 172.21.15.18:44586) 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 -- 172.21.15.18:0/3838443080 learned_addr learned my addr 172.21.15.18:0/3838443080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a6400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 0x7f15a0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5000640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a01032d0 0x7f15a0100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 -- 172.21.15.18:0/3838443080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a01032d0 msgr2=0x7f15a0100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a01032d0 0x7f15a0100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 -- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 msgr2=0x7f15a0101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 0x7f15a0101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a5a00640 1 -- 172.21.15.18:0/3838443080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01a64c0 con 0x7f15a01029b0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.997+0000 7f15a6400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 0x7f15a0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f15a5a00640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1594000c00 tx=0x7f1594004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f159e000640 1 -- 172.21.15.18:0/3838443080 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594042020 con 0x7f15a01029b0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f159e000640 1 -- 172.21.15.18:0/3838443080 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15940054e0 con 0x7f15a01029b0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a01a6750 con 0x7f15a01029b0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f159e000640 1 -- 172.21.15.18:0/3838443080 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594003af0 con 0x7f15a01029b0 2024-04-21T22:36:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:26.998+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a01a6ca0 con 0x7f15a01029b0 2024-04-21T22:36:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.001+0000 7f159e000640 1 -- 172.21.15.18:0/3838443080 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1594045020 con 0x7f15a01029b0 2024-04-21T22:36:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.003+0000 7f159e000640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 0x7f15880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.003+0000 7f159e000640 1 -- 172.21.15.18:0/3838443080 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f15940f10a0 con 0x7f15a01029b0 2024-04-21T22:36:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.003+0000 7f15ab022740 1 Processor -- start 2024-04-21T22:36:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.003+0000 7f15a5000640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 0x7f15880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.003+0000 7f15ab022740 1 -- start start 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbf040 0x55717bdc76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 0x55717bdca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55717bd1cdf0 con 0x55717bdc7c20 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55717bd22040 con 0x55717bdbe720 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15ab022740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55717bcca8c0 con 0x55717bdbf040 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a5000640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 0x7f15880a51c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15a0102090 tx=0x7f158c005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36506/0 (socket says 172.21.15.18:36506) 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a5a00640 1 -- 172.21.15.18:0/2275926883 learned_addr learned my addr 172.21.15.18:0/2275926883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a6400640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 0x55717bdca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.004+0000 7f15a5000640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbf040 0x55717bdc76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 -- 172.21.15.18:0/2275926883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbf040 msgr2=0x55717bdc76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbf040 0x55717bdc76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 -- 172.21.15.18:0/2275926883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 msgr2=0x55717bdca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 0x55717bdca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 -- 172.21.15.18:0/2275926883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717bafe7e0 con 0x55717bdbe720 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a6400640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 0x55717bdca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15940b9ad0 tx=0x7f15940035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea4237371968dd53 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f1592a00640 1 -- 172.21.15.18:0/2275926883 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940d6070 con 0x55717bdbe720 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f1592a00640 1 -- 172.21.15.18:0/2275926883 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15940bdd70 con 0x55717bdbe720 2024-04-21T22:36:27.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.005+0000 7f1592a00640 1 -- 172.21.15.18:0/2275926883 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940bba00 con 0x55717bdbe720 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.006+0000 7f15ab022740 1 -- 172.21.15.18:0/2275926883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 msgr2=0x55717bdbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.006+0000 7f15ab022740 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15940b9ad0 tx=0x7f15940035f0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 -- 172.21.15.18:0/2275926883 shutdown_connections 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdc7c20 0x55717bdca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbf040 0x55717bdc76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 --2- 172.21.15.18:0/2275926883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdbeb00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 -- 172.21.15.18:0/2275926883 >> 172.21.15.18:0/2275926883 conn(0x55717bdb8e50 msgr2=0x55717bdb9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 -- 172.21.15.18:0/2275926883 shutdown_connections 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 -- 172.21.15.18:0/2275926883 wait complete. 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.007+0000 7f15ab022740 1 -- start start 2024-04-21T22:36:27.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 Processor -- start 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdc5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdc7c20 0x55717bdc57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55717bcddd20 con 0x55717bdbf040 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55717bd1e000 con 0x55717bdc7c20 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.008+0000 7f15ab022740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55717bdca7d0 con 0x55717bdbe720 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15ab022740 10 client.0 _ll_register_callbacks cb 0x55717bd190a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44616/0 (socket says 172.21.15.18:44616) 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 -- 172.21.15.18:0/2599189756 learned_addr learned my addr 172.21.15.18:0/2599189756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5000640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdc5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a6400640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdc7c20 0x55717bdc57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 -- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdc7c20 msgr2=0x55717bdc57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdc7c20 0x55717bdc57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 -- 172.21.15.18:0/2599189756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 msgr2=0x55717bdc5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdc5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 -- 172.21.15.18:0/2599189756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717bb5ef70 con 0x55717bdbe720 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.009+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1594005c20 tx=0x7f15940a80c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37ab3d4cb8111ed server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940da020 con 0x55717bdbe720 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f15940b9ce0 con 0x55717bdbe720 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15940bdd70 con 0x55717bdbe720 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f15940a3050 con 0x55717bdbe720 2024-04-21T22:36:27.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f15ab022740 10 client.26122 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55717b9f6170 con 0x55717bdbe720 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15940bdd70 con 0x55717bdbe720 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.010+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f15940c5e50 con 0x55717bdbe720 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 10 client.26122 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 10 client.26122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 20 client.26122 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717bdd7af0 0x55717bdd9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 4 client.26122 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55717bd2f580 con 0x55717bdd7af0 2024-04-21T22:36:27.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.011+0000 7f15a5000640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717bdd7af0 0x55717bdd9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.012+0000 7f15a5000640 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717bdd7af0 0x55717bdd9ee0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=396186d67e317ba9 server_cookie=745ce207aa84ec45 in_seq=0 out_seq=0 2024-04-21T22:36:27.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.012+0000 7f1587400640 10 client.26122 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f1587400640 1 -- 172.21.15.18:0/2599189756 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55717bd2f580 con 0x55717bdd7af0 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f1587400640 10 client.26122 handle_command_reply: tid=0 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 client.26122 shutdown 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 msgr2=0x55717bdc4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1594005c20 tx=0x7f15940a80c0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 shutdown_connections 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdc7c20 0x55717bdc57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdc5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717bdd7af0 0x55717bdd9ee0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 --2- 172.21.15.18:0/2599189756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdbe720 0x55717bdc4d50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f1587400640 0 client.26122 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 >> 172.21.15.18:0/2599189756 conn(0x55717bdb8e50 msgr2=0x55717bdbaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 shutdown_connections 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.013+0000 7f15ab022740 1 -- 172.21.15.18:0/2599189756 wait complete. 2024-04-21T22:36:27.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.014+0000 7f15ab022740 20 client.26122 trim_cache size 0 max 16384 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 Processor -- start 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 -- start start 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbe720 0x55717bdd3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbf040 0x55717bddf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01af6b0 con 0x55717bdbe720 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01b1370 con 0x55717bdbf040 2024-04-21T22:36:27.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15ab022740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01afe40 con 0x55717bdc7c20 2024-04-21T22:36:27.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15a6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15a6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44618/0 (socket says 172.21.15.18:44618) 2024-04-21T22:36:27.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15a6400640 1 -- 172.21.15.18:0/2160343884 learned_addr learned my addr 172.21.15.18:0/2160343884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15a5000640 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbf040 0x55717bddf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.034+0000 7f15a5a00640 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbe720 0x55717bdd3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 -- 172.21.15.18:0/2160343884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbf040 msgr2=0x55717bddf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbf040 0x55717bddf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 -- 172.21.15.18:0/2160343884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbe720 msgr2=0x55717bdd3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbe720 0x55717bdd3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 -- 172.21.15.18:0/2160343884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717bdda250 con 0x55717bdc7c20 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f15a6400640 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1598012480 tx=0x7f1598009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9725f8f49f617ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.035+0000 7f1592000640 1 -- 172.21.15.18:0/2160343884 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1598004b20 con 0x55717bdc7c20 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f1592000640 1 -- 172.21.15.18:0/2160343884 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1598004cc0 con 0x55717bdc7c20 2024-04-21T22:36:27.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f1592000640 1 -- 172.21.15.18:0/2160343884 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159800f980 con 0x55717bdc7c20 2024-04-21T22:36:27.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 -- 172.21.15.18:0/2160343884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 msgr2=0x55717bddfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1598012480 tx=0x7f1598009500 comp rx=0 tx=0).stop 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 -- 172.21.15.18:0/2160343884 shutdown_connections 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bddfd30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbf040 0x55717bddf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 --2- 172.21.15.18:0/2160343884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbe720 0x55717bdd3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.036+0000 7f15ab022740 1 -- 172.21.15.18:0/2160343884 >> 172.21.15.18:0/2160343884 conn(0x55717bdb8e50 msgr2=0x55717bdba150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.037+0000 7f15ab022740 1 -- 172.21.15.18:0/2160343884 shutdown_connections 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.037+0000 7f15ab022740 1 -- 172.21.15.18:0/2160343884 wait complete. 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.037+0000 7f15ab022740 1 -- start start 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.037+0000 7f15ab022740 1 Processor -- start 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdcfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bdcc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01b0be0 con 0x55717bdbf040 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01b0510 con 0x55717bdbe720 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01ad690 con 0x55717bdc7c20 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15ab022740 10 client.0 _ll_register_callbacks cb 0x7f15940d4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdcfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36530/0 (socket says 172.21.15.18:36530) 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bdcc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 -- 172.21.15.18:0/168612153 learned_addr learned my addr 172.21.15.18:0/168612153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 -- 172.21.15.18:0/168612153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 msgr2=0x55717bdcc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bdcc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 -- 172.21.15.18:0/168612153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 msgr2=0x55717bdcfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdcfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.038+0000 7f15a5a00640 1 -- 172.21.15.18:0/168612153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717bdcd210 con 0x55717bdbe720 2024-04-21T22:36:27.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f15a5a00640 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15940c6250 tx=0x7f1594005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad9bc6dee5e880e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f1587400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940da040 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f15940c5e50 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1598004cc0 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f15940d6070 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f15ab022740 10 client.26096 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55717bdcd210 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.039+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1598004cc0 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f15940d1b90 con 0x55717bdbe720 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 10 client.26096 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 10 client.26096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 20 client.26096 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717be3ef90 0x55717be413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 4 client.26096 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:36:27.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55717bd298d0 con 0x55717be3ef90 2024-04-21T22:36:27.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.040+0000 7f15a5000640 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717be3ef90 0x55717be413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.041+0000 7f15a5000640 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717be3ef90 0x55717be413b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d0e5d3bdfea6cf server_cookie=7c5879c5b7e54d07 in_seq=0 out_seq=0 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.041+0000 7f1587400640 10 client.26096 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f1587400640 1 -- 172.21.15.18:0/168612153 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55717bd298d0 con 0x55717be3ef90 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f1587400640 10 client.26096 handle_command_reply: tid=0 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 client.26096 shutdown 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 msgr2=0x55717bdcf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f15940c6250 tx=0x7f1594005d50 comp rx=0 tx=0).stop 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 shutdown_connections 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55717be3ef90 0x55717be413b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55717bdc7c20 0x55717bdcc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55717bdbf040 0x55717bdcfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 --2- 172.21.15.18:0/168612153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55717bdbe720 0x55717bdcf990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f1587400640 0 client.26096 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 >> 172.21.15.18:0/168612153 conn(0x55717bdb8e50 msgr2=0x55717bdba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 shutdown_connections 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 1 -- 172.21.15.18:0/168612153 wait complete. 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.042+0000 7f15ab022740 20 client.26096 trim_cache size 0 max 16384 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "8789beab-6897-4f18-a733-61f8744a5201", 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:36:27.046 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 msgr2=0x7f15880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 0x7f15880a51c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15a0102090 tx=0x7f158c005f90 comp rx=0 tx=0).stop 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 msgr2=0x7f15a0100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1594000c00 tx=0x7f1594004360 comp rx=0 tx=0).stop 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 shutdown_connections 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f15880a2d00 0x7f15880a51c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a010bcf0 0x7f15a0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a01032d0 0x7f15a0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 --2- 172.21.15.18:0/3838443080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a01029b0 0x7f15a0100600 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.043+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 >> 172.21.15.18:0/3838443080 conn(0x7f15a00777f0 msgr2=0x7f15a00fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.044+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 shutdown_connections 2024-04-21T22:36:27.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.044+0000 7f15a8400640 1 -- 172.21.15.18:0/3838443080 wait complete. 2024-04-21T22:36:27.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:36:27.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:36:27.082 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/platform_defs.h usability... no 2024-04-21T22:36:27.210 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/platform_defs.h presence... no 2024-04-21T22:36:27.210 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/platform_defs.h... no 2024-04-21T22:36:27.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 -- 172.21.15.18:0/3807631570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c106690 msgr2=0x7fd71c106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 --2- 172.21.15.18:0/3807631570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c106690 0x7fd71c106a70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd714009cd0 tx=0x7fd71402c0f0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 -- 172.21.15.18:0/3807631570 shutdown_connections 2024-04-21T22:36:27.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 --2- 172.21.15.18:0/3807631570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c100fb0 0x7fd71c10d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 --2- 172.21.15.18:0/3807631570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 --2- 172.21.15.18:0/3807631570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c106690 0x7fd71c106a70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 -- 172.21.15.18:0/3807631570 >> 172.21.15.18:0/3807631570 conn(0x7fd71c077760 msgr2=0x7fd71c077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 -- 172.21.15.18:0/3807631570 shutdown_connections 2024-04-21T22:36:27.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.320+0000 7fd721400640 1 -- 172.21.15.18:0/3807631570 wait complete. 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.321+0000 7fd721400640 1 Processor -- start 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 -- start start 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c100fb0 0x7fd71c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 0x7fd71c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c111b10 con 0x7fd71c106690 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c111990 con 0x7fd71c1005f0 2024-04-21T22:36:27.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd721400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c111c90 con 0x7fd71c100fb0 2024-04-21T22:36:27.324 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfs/ioctl.h usability... no 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd71a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd71a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36552/0 (socket says 172.21.15.18:36552) 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd71a800640 1 -- 172.21.15.18:0/2539541901 learned_addr learned my addr 172.21.15.18:0/2539541901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.322+0000 7fd719e00640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c100fb0 0x7fd71c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71b200640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 0x7fd71c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 -- 172.21.15.18:0/2539541901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c100fb0 msgr2=0x7fd71c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c100fb0 0x7fd71c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 -- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 msgr2=0x7fd71c19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 0x7fd71c19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 -- 172.21.15.18:0/2539541901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c19cf80 con 0x7fd71c1005f0 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71b200640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 0x7fd71c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.323+0000 7fd71a800640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd714000f80 tx=0x7fd714032ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.324+0000 7fd713400640 1 -- 172.21.15.18:0/2539541901 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714049070 con 0x7fd71c1005f0 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.324+0000 7fd713400640 1 -- 172.21.15.18:0/2539541901 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd714003970 con 0x7fd71c1005f0 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.324+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71c19d210 con 0x7fd71c1005f0 2024-04-21T22:36:27.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.324+0000 7fd713400640 1 -- 172.21.15.18:0/2539541901 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7140043c0 con 0x7fd71c1005f0 2024-04-21T22:36:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.324+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71c10de80 con 0x7fd71c1005f0 2024-04-21T22:36:27.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.327+0000 7fd713400640 1 -- 172.21.15.18:0/2539541901 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd71404c070 con 0x7fd71c1005f0 2024-04-21T22:36:27.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.328+0000 7fd7241d1740 1 Processor -- start 2024-04-21T22:36:27.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 -- start start 2024-04-21T22:36:27.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee61e0 0x55bf72eee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72ef11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf72e49410 con 0x55bf72ee61e0 2024-04-21T22:36:27.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bf72df17e0 con 0x55bf72eeedc0 2024-04-21T22:36:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd7241d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf72e453d0 con 0x55bf72ee58c0 2024-04-21T22:36:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd71b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd71b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44668/0 (socket says 172.21.15.18:44668) 2024-04-21T22:36:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd71b200640 1 -- 172.21.15.18:0/1335331119 learned_addr learned my addr 172.21.15.18:0/1335331119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.329+0000 7fd71a800640 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee61e0 0x55bf72eee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 -- 172.21.15.18:0/1335331119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 msgr2=0x55bf72ef11b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72ef11b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 -- 172.21.15.18:0/1335331119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee61e0 msgr2=0x55bf72eee880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee61e0 0x55bf72eee880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 -- 172.21.15.18:0/1335331119 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf72c277d0 con 0x55bf72ee58c0 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd713400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 0x7fd7000a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.330+0000 7fd71b200640 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd704009cc0 tx=0x7fd7040117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a188c90fb092e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.331+0000 7fd713400640 1 -- 172.21.15.18:0/2539541901 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd7140f4b40 con 0x7fd71c1005f0 2024-04-21T22:36:27.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.331+0000 7fd70b400640 1 -- 172.21.15.18:0/1335331119 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704012450 con 0x55bf72ee58c0 2024-04-21T22:36:27.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.331+0000 7fd70b400640 1 -- 172.21.15.18:0/1335331119 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd704012ad0 con 0x55bf72ee58c0 2024-04-21T22:36:27.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.331+0000 7fd70b400640 1 -- 172.21.15.18:0/1335331119 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70400fc90 con 0x55bf72ee58c0 2024-04-21T22:36:27.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.331+0000 7fd71a800640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 0x7fd7000a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 -- 172.21.15.18:0/1335331119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 msgr2=0x55bf72ee5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd704009cc0 tx=0x7fd7040117b0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd71a800640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 0x7fd7000a5240 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55bf72ee5390 tx=0x7fd714009800 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 -- 172.21.15.18:0/1335331119 shutdown_connections 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72ef11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee61e0 0x55bf72eee880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 --2- 172.21.15.18:0/1335331119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72ee5ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 -- 172.21.15.18:0/1335331119 >> 172.21.15.18:0/1335331119 conn(0x55bf72edfff0 msgr2=0x55bf72ee03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 -- 172.21.15.18:0/1335331119 shutdown_connections 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.332+0000 7fd7241d1740 1 -- 172.21.15.18:0/1335331119 wait complete. 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.333+0000 7fd7241d1740 1 -- start start 2024-04-21T22:36:27.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.333+0000 7fd7241d1740 1 Processor -- start 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.333+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eebe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.333+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72eec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd7241d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bf72ef1bb0 con 0x55bf72ee58c0 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd7241d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bf72e04c40 con 0x55bf72eeedc0 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd7241d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bf72ef1d30 con 0x55bf72ee61e0 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd7241d1740 10 client.0 _ll_register_callbacks cb 0x55bf72e04630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44676/0 (socket says 172.21.15.18:44676) 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 -- 172.21.15.18:0/3979278692 learned_addr learned my addr 172.21.15.18:0/3979278692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd71b200640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72eec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd71b200640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eebe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 -- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 msgr2=0x55bf72eec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72eec900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 -- 172.21.15.18:0/3979278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 msgr2=0x55bf72eebe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eebe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd719e00640 1 -- 172.21.15.18:0/3979278692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf72b5d3f0 con 0x55bf72ee61e0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.334+0000 7fd71b200640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.335+0000 7fd719e00640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0116f0 tx=0x7fd70c011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=155e9ae8969e1847 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.335+0000 7fd6ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.335+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00f8c0 con 0x55bf72ee61e0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.335+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd70c00fa60 con 0x55bf72ee61e0 2024-04-21T22:36:27.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.335+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd704012ad0 con 0x55bf72ee61e0 2024-04-21T22:36:27.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.336+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd70c00fc60 con 0x55bf72ee61e0 2024-04-21T22:36:27.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.336+0000 7fd7241d1740 10 client.26140 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:27.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.336+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bf72b1d0f0 con 0x55bf72ee61e0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd704012ad0 con 0x55bf72ee61e0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fd70c018070 con 0x55bf72ee61e0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 10 client.26140 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 10 client.26140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 20 client.26140 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f07ae0 0x55bf72f09f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 4 client.26140 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf72e5cc40 con 0x55bf72f07ae0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.337+0000 7fd71b200640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f07ae0 0x55bf72f09f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.338+0000 7fd71b200640 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f07ae0 0x55bf72f09f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3c302dda0d9e84a server_cookie=351a3ab1c59ec739 in_seq=0 out_seq=0 2024-04-21T22:36:27.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.338+0000 7fd6ffe00640 10 client.26140 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.339+0000 7fd6ffe00640 1 -- 172.21.15.18:0/3979278692 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf72e5cc40 con 0x55bf72f07ae0 2024-04-21T22:36:27.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.339+0000 7fd6ffe00640 10 client.26140 handle_command_reply: tid=0 2024-04-21T22:36:27.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 client.26140 shutdown 2024-04-21T22:36:27.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 msgr2=0x55bf72eec3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0116f0 tx=0x7fd70c011bb0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 shutdown_connections 2024-04-21T22:36:27.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72eeedc0 0x55bf72eec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f07ae0 0x55bf72f09f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee61e0 0x55bf72eec3c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 --2- 172.21.15.18:0/3979278692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 >> 172.21.15.18:0/3979278692 conn(0x55bf72edfff0 msgr2=0x55bf72ee1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.340+0000 7fd6ffe00640 0 client.26140 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.341+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 shutdown_connections 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.341+0000 7fd7241d1740 1 -- 172.21.15.18:0/3979278692 wait complete. 2024-04-21T22:36:27.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.341+0000 7fd7241d1740 20 client.26140 trim_cache size 0 max 16384 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.370+0000 7fd7241d1740 1 Processor -- start 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.370+0000 7fd7241d1740 1 -- start start 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.370+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.370+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 0x55bf72f0fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd7241d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1ab2b0 con 0x55bf72ee58c0 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd7241d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1acf70 con 0x55bf72ee61e0 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd7241d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1aba40 con 0x55bf72eeedc0 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd719e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd71b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd71b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eee5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46260/0 (socket says 172.21.15.18:46260) 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd71b200640 1 -- 172.21.15.18:0/508402487 learned_addr learned my addr 172.21.15.18:0/508402487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd719e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36578/0 (socket says 172.21.15.18:36578) 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.371+0000 7fd71b200640 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 0x55bf72f0fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd719e00640 1 -- 172.21.15.18:0/508402487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 msgr2=0x55bf72f0fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd719e00640 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 0x55bf72f0fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd719e00640 1 -- 172.21.15.18:0/508402487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 msgr2=0x55bf72eee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd719e00640 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd719e00640 1 -- 172.21.15.18:0/508402487 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf72f0a2c0 con 0x55bf72ee61e0 2024-04-21T22:36:27.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.372+0000 7fd71b200640 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 0x55bf72f0fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.373+0000 7fd719e00640 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd70c01a650 tx=0x7fd70c009320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f746ddeebf834f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.373+0000 7fd70aa00640 1 -- 172.21.15.18:0/508402487 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c02f070 con 0x55bf72ee61e0 2024-04-21T22:36:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.373+0000 7fd70aa00640 1 -- 172.21.15.18:0/508402487 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd70c01a8c0 con 0x55bf72ee61e0 2024-04-21T22:36:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.373+0000 7fd70aa00640 1 -- 172.21.15.18:0/508402487 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00f790 con 0x55bf72ee61e0 2024-04-21T22:36:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 -- 172.21.15.18:0/508402487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 msgr2=0x55bf72f0f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd70c01a650 tx=0x7fd70c009320 comp rx=0 tx=0).stop 2024-04-21T22:36:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 -- 172.21.15.18:0/508402487 shutdown_connections 2024-04-21T22:36:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72eeedc0 0x55bf72f0fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72f0f860 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 --2- 172.21.15.18:0/508402487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72ee58c0 0x55bf72eee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 -- 172.21.15.18:0/508402487 >> 172.21.15.18:0/508402487 conn(0x55bf72edfff0 msgr2=0x55bf72eea750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 -- 172.21.15.18:0/508402487 shutdown_connections 2024-04-21T22:36:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.374+0000 7fd7241d1740 1 -- 172.21.15.18:0/508402487 wait complete. 2024-04-21T22:36:27.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.375+0000 7fd7241d1740 1 -- start start 2024-04-21T22:36:27.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.375+0000 7fd7241d1740 1 Processor -- start 2024-04-21T22:36:27.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72efad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72eeedc0 0x55bf72efb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1ac7e0 con 0x55bf72eeedc0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1ac110 con 0x55bf72ee61e0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c1a9290 con 0x55bf72ee58c0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd7241d1740 10 client.0 _ll_register_callbacks cb 0x7fd70c009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd719e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72efad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44694/0 (socket says 172.21.15.18:44694) 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 -- 172.21.15.18:0/941323631 learned_addr learned my addr 172.21.15.18:0/941323631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72eeedc0 0x55bf72efb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 -- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 msgr2=0x55bf72efad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72efad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 -- 172.21.15.18:0/941323631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72eeedc0 msgr2=0x55bf72efb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72eeedc0 0x55bf72efb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.376+0000 7fd71b200640 1 -- 172.21.15.18:0/941323631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf72f6c1c0 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd71b200640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd70401b000 tx=0x7fd704014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c22caa72fc6e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd6ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704005480 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd704020040 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd70c01a8c0 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd704005620 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd7241d1740 10 client.26146 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bf72f6d510 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.377+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd70c01a8c0 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fd70400fc50 con 0x55bf72ee58c0 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 10 client.26146 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 10 client.26146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 20 client.26146 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f6da30 0x55bf72f6fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 4 client.26146 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:36:27.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bf72e56950 con 0x55bf72f6da30 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.378+0000 7fd719e00640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f6da30 0x55bf72f6fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd719e00640 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f6da30 0x55bf72f6fe50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aad90f2a759b344 server_cookie=5bd5533e3544705d in_seq=0 out_seq=0 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd6ffe00640 10 client.26146 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd6ffe00640 1 -- 172.21.15.18:0/941323631 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bf72e56950 con 0x55bf72f6da30 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd6ffe00640 10 client.26146 handle_command_reply: tid=0 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 client.26146 shutdown 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 msgr2=0x55bf72efa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd70401b000 tx=0x7fd704014040 comp rx=0 tx=0).stop 2024-04-21T22:36:27.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 shutdown_connections 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bf72eeedc0 0x55bf72efb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bf72ee61e0 0x55bf72efad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bf72f6da30 0x55bf72f6fe50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 --2- 172.21.15.18:0/941323631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bf72ee58c0 0x55bf72efa7d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd6ffe00640 0 client.26146 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.379+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 >> 172.21.15.18:0/941323631 conn(0x55bf72edfff0 msgr2=0x55bf72eec6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 shutdown_connections 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd7241d1740 1 -- 172.21.15.18:0/941323631 wait complete. 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd7241d1740 20 client.26146 trim_cache size 0 max 16384 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:36:27.383 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: "8789beab-6897-4f18-a733-61f8744a5201": { 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "8789beab-6897-4f18-a733-61f8744a5201", 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:36:27.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 msgr2=0x7fd7000a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 0x7fd7000a5240 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55bf72ee5390 tx=0x7fd714009800 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 msgr2=0x7fd71c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.380+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd714000f80 tx=0x7fd714032ea0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 shutdown_connections 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd7000a2d80 0x7fd7000a5240 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd71c106690 0x7fd71c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd71c100fb0 0x7fd71c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 --2- 172.21.15.18:0/2539541901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd71c1005f0 0x7fd71c197f90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 >> 172.21.15.18:0/2539541901 conn(0x7fd71c077760 msgr2=0x7fd71c0ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 shutdown_connections 2024-04-21T22:36:27.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:27.381+0000 7fd721400640 1 -- 172.21.15.18:0/2539541901 wait complete. 2024-04-21T22:36:27.386 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfs/ioctl.h presence... no 2024-04-21T22:36:27.386 INFO:tasks.workunit.client.0.smithi018.stdout:checking for btrfs/ioctl.h... no 2024-04-21T22:36:27.401 INFO:tasks.cephfs.filesystem:scrub status for tag:8789beab-6897-4f18-a733-61f8744a5201 - {'path': '/', 'tag': '8789beab-6897-4f18-a733-61f8744a5201', 'options': 'recursive,force'} 2024-04-21T22:36:27.493 INFO:tasks.workunit.client.0.smithi018.stdout:checking cifs/ioctl.h usability... no 2024-04-21T22:36:27.553 INFO:tasks.workunit.client.0.smithi018.stdout:checking cifs/ioctl.h presence... no 2024-04-21T22:36:27.553 INFO:tasks.workunit.client.0.smithi018.stdout:checking for cifs/ioctl.h... no 2024-04-21T22:36:27.667 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/mman.h usability... yes 2024-04-21T22:36:27.709 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/mman.h presence... yes 2024-04-21T22:36:27.709 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/mman.h... yes 2024-04-21T22:36:27.822 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xfs_log_format.h... no 2024-04-21T22:36:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: pgmap v75: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 591 KiB/s wr, 178 op/s 2024-04-21T22:36:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:27 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: pgmap v75: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 591 KiB/s wr, 178 op/s 2024-04-21T22:36:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:27 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: pgmap v75: 97 pgs: 97 active+clean; 83 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 591 KiB/s wr, 178 op/s 2024-04-21T22:36:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:27.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:27.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:27.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:27 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:27.965 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid_compare... no 2024-04-21T22:36:28.077 INFO:tasks.workunit.client.0.smithi018.stdout:checking for uuid_compare in -luuid... yes 2024-04-21T22:36:28.209 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xfs.h... yes 2024-04-21T22:36:28.290 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/libxfs.h... no 2024-04-21T22:36:28.379 INFO:tasks.workunit.client.0.smithi018.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-21T22:36:28.488 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/xqm.h... yes 2024-04-21T22:36:28.637 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-21T22:36:28.736 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/handle.h usability... yes 2024-04-21T22:36:28.780 INFO:tasks.workunit.client.0.smithi018.stdout:checking xfs/handle.h presence... yes 2024-04-21T22:36:28.780 INFO:tasks.workunit.client.0.smithi018.stdout:checking for xfs/handle.h... yes 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:36:28.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:28 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:36:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:36:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:28 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.913 INFO:tasks.workunit.client.0.smithi018.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-21T22:36:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:36:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:28 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:36:29.042 INFO:tasks.workunit.client.0.smithi018.stdout:checking attr/attributes.h usability... yes 2024-04-21T22:36:29.085 INFO:tasks.workunit.client.0.smithi018.stdout:checking attr/attributes.h presence... yes 2024-04-21T22:36:29.086 INFO:tasks.workunit.client.0.smithi018.stdout:checking for attr/attributes.h... yes 2024-04-21T22:36:29.214 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/attributes.h usability... no 2024-04-21T22:36:29.283 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/attributes.h presence... no 2024-04-21T22:36:29.284 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/attributes.h... no 2024-04-21T22:36:29.401 INFO:tasks.workunit.client.0.smithi018.stdout:checking for attr_list in -lattr... yes 2024-04-21T22:36:29.514 INFO:tasks.workunit.client.0.smithi018.stdout:checking for attr_set in -lattr... yes 2024-04-21T22:36:29.629 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/acl.h usability... yes 2024-04-21T22:36:29.675 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/acl.h presence... yes 2024-04-21T22:36:29.676 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/acl.h... yes 2024-04-21T22:36:29.788 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:29 smithi081 ceph-mon[31692]: pgmap v76: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 727 KiB/s wr, 198 op/s 2024-04-21T22:36:29.796 INFO:tasks.workunit.client.0.smithi018.stdout:checking acl/libacl.h usability... yes 2024-04-21T22:36:29.836 INFO:tasks.workunit.client.0.smithi018.stdout:checking acl/libacl.h presence... yes 2024-04-21T22:36:29.836 INFO:tasks.workunit.client.0.smithi018.stdout:checking for acl/libacl.h... yes 2024-04-21T22:36:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:29 smithi018 ceph-mon[26614]: pgmap v76: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 727 KiB/s wr, 198 op/s 2024-04-21T22:36:29.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:29 smithi047 ceph-mon[31561]: pgmap v76: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 727 KiB/s wr, 198 op/s 2024-04-21T22:36:29.954 INFO:tasks.workunit.client.0.smithi018.stdout:checking for acl_init in -lacl... yes 2024-04-21T22:36:30.055 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm-ndbm.h usability... no 2024-04-21T22:36:30.124 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm-ndbm.h presence... no 2024-04-21T22:36:30.124 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gdbm-ndbm.h... no 2024-04-21T22:36:30.228 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm/ndbm.h usability... no 2024-04-21T22:36:30.295 INFO:tasks.workunit.client.0.smithi018.stdout:checking gdbm/ndbm.h presence... no 2024-04-21T22:36:30.295 INFO:tasks.workunit.client.0.smithi018.stdout:checking for gdbm/ndbm.h... no 2024-04-21T22:36:30.397 INFO:tasks.workunit.client.0.smithi018.stdout:checking ndbm.h usability... no 2024-04-21T22:36:30.466 INFO:tasks.workunit.client.0.smithi018.stdout:checking ndbm.h presence... no 2024-04-21T22:36:30.467 INFO:tasks.workunit.client.0.smithi018.stdout:checking for ndbm.h... no 2024-04-21T22:36:30.565 INFO:tasks.workunit.client.0.smithi018.stdout:checking libaio.h usability... yes 2024-04-21T22:36:30.611 INFO:tasks.workunit.client.0.smithi018.stdout:checking libaio.h presence... yes 2024-04-21T22:36:30.611 INFO:tasks.workunit.client.0.smithi018.stdout:checking for libaio.h... yes 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout:checking for dm_make_handle in -ldm... no 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout:WARNING: could not find a valid DMAPI base library. 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout:If you want DMAPI support please install the data migration 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-04-21T22:36:30.744 INFO:tasks.workunit.client.0.smithi018.stdout:from the dmapi source. 2024-04-21T22:36:30.745 INFO:tasks.workunit.client.0.smithi018.stdout: 2024-04-21T22:36:30.849 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fiemap.h usability... yes 2024-04-21T22:36:30.898 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fiemap.h presence... yes 2024-04-21T22:36:30.898 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/fiemap.h... yes 2024-04-21T22:36:31.020 INFO:tasks.workunit.client.0.smithi018.stdout:checking for fallocate... yes 2024-04-21T22:36:31.146 INFO:tasks.workunit.client.0.smithi018.stdout:checking for open_by_handle_at... yes 2024-04-21T22:36:31.288 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/prctl.h usability... yes 2024-04-21T22:36:31.332 INFO:tasks.workunit.client.0.smithi018.stdout:checking sys/prctl.h presence... yes 2024-04-21T22:36:31.333 INFO:tasks.workunit.client.0.smithi018.stdout:checking for sys/prctl.h... yes 2024-04-21T22:36:31.445 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fs.h usability... yes 2024-04-21T22:36:31.492 INFO:tasks.workunit.client.0.smithi018.stdout:checking linux/fs.h presence... yes 2024-04-21T22:36:31.492 INFO:tasks.workunit.client.0.smithi018.stdout:checking for linux/fs.h... yes 2024-04-21T22:36:31.605 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfsutil.h usability... no 2024-04-21T22:36:31.680 INFO:tasks.workunit.client.0.smithi018.stdout:checking btrfsutil.h presence... no 2024-04-21T22:36:31.680 INFO:tasks.workunit.client.0.smithi018.stdout:checking for btrfsutil.h... no 2024-04-21T22:36:31.805 INFO:tasks.workunit.client.0.smithi018.stdout:checking for copy_file_range... yes 2024-04-21T22:36:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:31 smithi018 ceph-mon[26614]: pgmap v77: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:31 smithi081 ceph-mon[31692]: pgmap v77: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:31.933 INFO:tasks.workunit.client.0.smithi018.stdout:checking for renameat2... yes 2024-04-21T22:36:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:31 smithi047 ceph-mon[31561]: pgmap v77: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:31.985 INFO:tasks.workunit.client.0.smithi018.stdout:configure: creating ./config.status 2024-04-21T22:36:33.314 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating include/builddefs 2024-04-21T22:36:33.363 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: creating include/config.h 2024-04-21T22:36:33.398 INFO:tasks.workunit.client.0.smithi018.stdout:config.status: executing libtool commands 2024-04-21T22:36:33.590 INFO:tasks.workunit.client.0.smithi018.stdout:Building include 2024-04-21T22:36:33.591 INFO:tasks.workunit.client.0.smithi018.stdout:Building lib 2024-04-21T22:36:33.592 INFO:tasks.workunit.client.0.smithi018.stdout:Building tests 2024-04-21T22:36:33.602 INFO:tasks.workunit.client.0.smithi018.stdout: [LTDEP] 2024-04-21T22:36:33.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:33 smithi018 ceph-mon[26614]: pgmap v78: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:33 smithi081 ceph-mon[31692]: pgmap v78: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:33 smithi047 ceph-mon[31561]: pgmap v78: 97 pgs: 97 active+clean; 84 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 220 KiB/s wr, 38 op/s 2024-04-21T22:36:34.002 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dataascii.lo 2024-04-21T22:36:34.003 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] databin.lo 2024-04-21T22:36:34.003 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] datapid.lo 2024-04-21T22:36:34.003 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] file_lock.lo 2024-04-21T22:36:34.243 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] forker.lo 2024-04-21T22:36:34.253 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] pattern.lo 2024-04-21T22:36:34.295 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] open_flags.lo 2024-04-21T22:36:34.302 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] random_range.lo 2024-04-21T22:36:34.496 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] string_to_tokens.lo 2024-04-21T22:36:34.522 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] str_to_bytes.lo 2024-04-21T22:36:34.588 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] tlibio.lo 2024-04-21T22:36:34.691 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] write_log.lo 2024-04-21T22:36:34.729 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] random.lo 2024-04-21T22:36:35.424 INFO:tasks.workunit.client.0.smithi018.stdout: [LD] 2024-04-21T22:36:35.832 INFO:tasks.workunit.client.0.smithi018.stdout:Building ltp 2024-04-21T22:36:35.833 INFO:tasks.workunit.client.0.smithi018.stdout:Building src 2024-04-21T22:36:35.833 INFO:tasks.workunit.client.0.smithi018.stdout:Building m4 2024-04-21T22:36:35.833 INFO:tasks.workunit.client.0.smithi018.stdout:Building common 2024-04-21T22:36:35.843 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-04-21T22:36:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:35 smithi018 ceph-mon[26614]: pgmap v79: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 307 KiB/s wr, 53 op/s 2024-04-21T22:36:35.868 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-04-21T22:36:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:35 smithi081 ceph-mon[31692]: pgmap v79: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 307 KiB/s wr, 53 op/s 2024-04-21T22:36:35.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:35 smithi047 ceph-mon[31561]: pgmap v79: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 307 KiB/s wr, 53 op/s 2024-04-21T22:36:36.484 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsstress 2024-04-21T22:36:36.484 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] doio 2024-04-21T22:36:36.485 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fsx 2024-04-21T22:36:36.790 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c: In function 'attr_list_path': 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~ 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:In file included from ../src/global.h:25, 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: from fsstress.c:12: 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~ 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c: In function 'attr_remove_path': 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~ 2024-04-21T22:36:36.791 INFO:tasks.workunit.client.0.smithi018.stderr:In file included from ../src/global.h:25, 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: from fsstress.c:12: 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~ 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c: In function 'attr_set_path': 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~ 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr:In file included from ../src/global.h:25, 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: from fsstress.c:12: 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-04-21T22:36:36.792 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~ 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c: In function 'allocsp_f': 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr: | XFS_IOC_RESVSP64 2024-04-21T22:36:36.803 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-04-21T22:36:36.824 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c: In function 'freesp_f': 2024-04-21T22:36:36.824 INFO:tasks.workunit.client.0.smithi018.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-21T22:36:36.824 INFO:tasks.workunit.client.0.smithi018.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-04-21T22:36:36.824 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-21T22:36:36.825 INFO:tasks.workunit.client.0.smithi018.stderr: | XFS_IOC_RESVSP64 2024-04-21T22:36:36.868 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[3]: *** [Makefile:47: fsstress] Error 1 2024-04-21T22:36:36.868 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr:doio.c: In function 'parse_cmdline': 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr: 3113 | fprintf(stderr, 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~ 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-04-21T22:36:37.251 INFO:tasks.workunit.client.0.smithi018.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:37.252 INFO:tasks.workunit.client.0.smithi018.stderr: 3115 | Prog, TagName, tok); 2024-04-21T22:36:37.252 INFO:tasks.workunit.client.0.smithi018.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr:fsx.c: In function 'main': 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-04-21T22:36:37.277 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:37.416 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-04-21T22:36:37.417 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-04-21T22:36:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:37 smithi018 ceph-mon[26614]: pgmap v80: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-04-21T22:36:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:37 smithi081 ceph-mon[31692]: pgmap v80: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-04-21T22:36:37.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:37 smithi047 ceph-mon[31561]: pgmap v80: 97 pgs: 97 active+clean; 85 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-04-21T22:36:38.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:38.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:38.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:38.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:38.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:39.321 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-04-21T22:36:39.321 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-04-21T22:36:39.321 INFO:tasks.workunit.client.0.smithi018.stdout: [DEP] 2024-04-21T22:36:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:39 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:39 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:36:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:39 smithi018 ceph-mon[26614]: pgmap v81: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 910 KiB/s wr, 112 op/s 2024-04-21T22:36:39.867 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dirstress 2024-04-21T22:36:39.873 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fill 2024-04-21T22:36:39.874 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fill2 2024-04-21T22:36:39.876 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] getpagesize 2024-04-21T22:36:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:39 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:39 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:36:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:39 smithi081 ceph-mon[31692]: pgmap v81: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 910 KiB/s wr, 112 op/s 2024-04-21T22:36:39.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:39 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:39.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:39 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:36:39.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:39 smithi047 ceph-mon[31561]: pgmap v81: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 910 KiB/s wr, 112 op/s 2024-04-21T22:36:40.294 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] holes 2024-04-21T22:36:40.297 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] lstat64 2024-04-21T22:36:40.353 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] nametest 2024-04-21T22:36:40.366 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] permname 2024-04-21T22:36:40.654 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] runas 2024-04-21T22:36:40.655 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] randholes 2024-04-21T22:36:40.718 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] truncfile 2024-04-21T22:36:40.756 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] usemem 2024-04-21T22:36:40.995 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] mmapcat 2024-04-21T22:36:41.056 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] append_reader 2024-04-21T22:36:41.083 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] append_writer 2024-04-21T22:36:41.096 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] dirperf 2024-04-21T22:36:41.285 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] metaperf 2024-04-21T22:36:41.339 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] devzero 2024-04-21T22:36:41.368 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] feature 2024-04-21T22:36:41.503 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] alloc 2024-04-21T22:36:41.659 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fault 2024-04-21T22:36:41.719 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] fstest 2024-04-21T22:36:41.728 INFO:tasks.workunit.client.0.smithi018.stdout: [CC] t_access_root 2024-04-21T22:36:41.751 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c: In function 'main': 2024-04-21T22:36:41.751 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-04-21T22:36:41.751 INFO:tasks.workunit.client.0.smithi018.stderr: 154 | bozo! 2024-04-21T22:36:41.751 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~ 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: 154 | bozo! 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: | ^ 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: | ; 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: 184 | rflag = 1; 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~ 2024-04-21T22:36:41.752 INFO:tasks.workunit.client.0.smithi018.stderr: | nflag 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr: 320 | bozo! 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr: | ^ 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr: | ; 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr: 128 | struct flock64 f; 2024-04-21T22:36:41.753 INFO:tasks.workunit.client.0.smithi018.stderr: | ^ 2024-04-21T22:36:41.762 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-04-21T22:36:41.762 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-21T22:36:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:41 smithi018 ceph-mon[26614]: pgmap v82: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:41 smithi081 ceph-mon[31692]: pgmap v82: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:41.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:41 smithi047 ceph-mon[31561]: pgmap v82: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c: In function 'run_child': 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~ 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.972 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~ 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~ 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~ 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-21T22:36:41.973 INFO:tasks.workunit.client.0.smithi018.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-21T22:36:42.083 INFO:tasks.workunit.client.0.smithi018.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-04-21T22:36:42.084 INFO:tasks.workunit.client.0.smithi018.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-04-21T22:36:42.084 INFO:tasks.workunit.client.0.smithi018.stderr:make: *** [Makefile:51: default] Error 2 2024-04-21T22:36:42.086 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-21T22:36:42.087 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-04-21T22:36:42.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-21T22:36:43.266 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi018 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=430e09df97c8fc7dc2b2ae424f68ed11366c540f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-21T22:36:43.538 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b60e3b9377784a7f834c8c1242ebb7e4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_430e09df97c8fc7dc2b2ae424f68ed11366c540f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi018 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=430e09df97c8fc7dc2b2ae424f68ed11366c540f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-21T22:36:43.541 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-21T22:36:43.551 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-21T22:36:43.551 INFO:teuthology.task.exec:Executing custom commands... 2024-04-21T22:36:43.552 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:36:43.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-21T22:36:43.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-21T22:36:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:43 smithi018 ceph-mon[26614]: pgmap v83: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:43 smithi081 ceph-mon[31692]: pgmap v83: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:43.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:43 smithi047 ceph-mon[31561]: pgmap v83: 97 pgs: 97 active+clean; 92 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 774 KiB/s wr, 93 op/s 2024-04-21T22:36:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:45 smithi018 ceph-mon[26614]: pgmap v84: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 965 KiB/s wr, 145 op/s 2024-04-21T22:36:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:45 smithi081 ceph-mon[31692]: pgmap v84: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 965 KiB/s wr, 145 op/s 2024-04-21T22:36:45.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:45 smithi047 ceph-mon[31561]: pgmap v84: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 965 KiB/s wr, 145 op/s 2024-04-21T22:36:46.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:46 smithi018 ceph-mon[26614]: pgmap v85: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 878 KiB/s wr, 130 op/s 2024-04-21T22:36:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:46 smithi081 ceph-mon[31692]: pgmap v85: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 878 KiB/s wr, 130 op/s 2024-04-21T22:36:46.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:46 smithi047 ceph-mon[31561]: pgmap v85: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 878 KiB/s wr, 130 op/s 2024-04-21T22:36:49.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:49 smithi047 ceph-mon[31561]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 922 KiB/s wr, 145 op/s 2024-04-21T22:36:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:49 smithi018 ceph-mon[26614]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 922 KiB/s wr, 145 op/s 2024-04-21T22:36:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:49 smithi081 ceph-mon[31692]: pgmap v86: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 922 KiB/s wr, 145 op/s 2024-04-21T22:36:51.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:51 smithi047 ceph-mon[31561]: pgmap v87: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:51.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:51 smithi018 ceph-mon[26614]: pgmap v87: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:51 smithi081 ceph-mon[31692]: pgmap v87: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:53.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:53 smithi047 ceph-mon[31561]: pgmap v88: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:53.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:53 smithi018 ceph-mon[26614]: pgmap v88: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:53 smithi081 ceph-mon[31692]: pgmap v88: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 235 KiB/s wr, 66 op/s 2024-04-21T22:36:55.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:55 smithi047 ceph-mon[31561]: pgmap v89: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 242 KiB/s wr, 71 op/s 2024-04-21T22:36:55.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:55 smithi018 ceph-mon[26614]: pgmap v89: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 242 KiB/s wr, 71 op/s 2024-04-21T22:36:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:55 smithi081 ceph-mon[31692]: pgmap v89: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 242 KiB/s wr, 71 op/s 2024-04-21T22:36:57.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:36:57.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:36:57.444 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:57 smithi047 ceph-mon[31561]: pgmap v90: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-04-21T22:36:57.485 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:57 smithi018 ceph-mon[26614]: pgmap v90: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-04-21T22:36:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:57 smithi081 ceph-mon[31692]: pgmap v90: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 19 op/s 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 -- 172.21.15.18:0/2478768353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac107620 msgr2=0x7fceac107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 --2- 172.21.15.18:0/2478768353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac107620 0x7fceac107a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009cd0 tx=0x7fce9c02c0e0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 -- 172.21.15.18:0/2478768353 shutdown_connections 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 --2- 172.21.15.18:0/2478768353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 0x7fceac10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 --2- 172.21.15.18:0/2478768353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac101560 0x7fceac1019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 --2- 172.21.15.18:0/2478768353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac107620 0x7fceac107a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 -- 172.21.15.18:0/2478768353 >> 172.21.15.18:0/2478768353 conn(0x7fceac0fd090 msgr2=0x7fceac0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 -- 172.21.15.18:0/2478768353 shutdown_connections 2024-04-21T22:36:57.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.640+0000 7fceabe00640 1 -- 172.21.15.18:0/2478768353 wait complete. 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.641+0000 7fceabe00640 1 Processor -- start 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.641+0000 7fceabe00640 1 -- start start 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.641+0000 7fceabe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.641+0000 7fceabe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 0x7fceac198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceabe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac107620 0x7fceac19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceabe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fceac111910 con 0x7fceac107620 2024-04-21T22:36:57.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceabe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fceac111790 con 0x7fceac101560 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceabe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fceac111a90 con 0x7fceac101f20 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42952/0 (socket says 172.21.15.18:42952) 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 -- 172.21.15.18:0/3182108900 learned_addr learned my addr 172.21.15.18:0/3182108900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceab400640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac107620 0x7fceac19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaa000640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 0x7fceac198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 -- 172.21.15.18:0/3182108900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 msgr2=0x7fceac198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 0x7fceac198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 -- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac107620 msgr2=0x7fceac19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac107620 0x7fceac19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.642+0000 7fceaaa00640 1 -- 172.21.15.18:0/3182108900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac19ce20 con 0x7fceac101560 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fceaaa00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce9c000f80 tx=0x7fce9c032460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fcea3400640 1 -- 172.21.15.18:0/3182108900 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c039040 con 0x7fceac101560 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fcea3400640 1 -- 172.21.15.18:0/3182108900 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9c044070 con 0x7fceac101560 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac19d0b0 con 0x7fceac101560 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fcea3400640 1 -- 172.21.15.18:0/3182108900 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0042a0 con 0x7fceac101560 2024-04-21T22:36:57.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.643+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac1a49a0 con 0x7fceac101560 2024-04-21T22:36:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 Processor -- start 2024-04-21T22:36:57.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 -- start start 2024-04-21T22:36:57.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fcea3400640 1 -- 172.21.15.18:0/3182108900 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fce9c003970 con 0x7fceac101560 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c8da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c8dfb0 0x563eb9c903a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563eb9be8410 con 0x563eb9c8dfb0 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563eb9b907e0 con 0x563eb9c84ab0 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.647+0000 7fceb499c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563eb9be43d0 con 0x563eb9c853d0 2024-04-21T22:36:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceaa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c8dfb0 0x563eb9c903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceaaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c8da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42966/0 (socket says 172.21.15.18:42966) 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 -- 172.21.15.18:0/2208573032 learned_addr learned my addr 172.21.15.18:0/2208573032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 -- 172.21.15.18:0/2208573032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 msgr2=0x563eb9c8da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c8da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 -- 172.21.15.18:0/2208573032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c8dfb0 msgr2=0x563eb9c903a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c8dfb0 0x563eb9c903a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.648+0000 7fceab400640 1 -- 172.21.15.18:0/2208573032 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb99c67d0 con 0x563eb9c84ab0 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fceab400640 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009ca0 tx=0x7fcea4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea38cebac64f84e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fce9be00640 1 -- 172.21.15.18:0/2208573032 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea401e070 con 0x563eb9c84ab0 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fce9be00640 1 -- 172.21.15.18:0/2208573032 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea4009e50 con 0x563eb9c84ab0 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fce9be00640 1 -- 172.21.15.18:0/2208573032 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea400eac0 con 0x563eb9c84ab0 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fcea3400640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 0x7fce900a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fcea3400640 1 -- 172.21.15.18:0/3182108900 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fce9c0f1820 con 0x7fceac101560 2024-04-21T22:36:57.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.649+0000 7fceaaa00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 0x7fce900a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- 172.21.15.18:0/2208573032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 msgr2=0x563eb9c84e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009ca0 tx=0x7fcea4011810 comp rx=0 tx=0).stop 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- 172.21.15.18:0/2208573032 shutdown_connections 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c8dfb0 0x563eb9c903a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c8da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 --2- 172.21.15.18:0/2208573032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c84ab0 0x563eb9c84e90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- 172.21.15.18:0/2208573032 >> 172.21.15.18:0/2208573032 conn(0x563eb9c7f1e0 msgr2=0x563eb9c7f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- 172.21.15.18:0/2208573032 shutdown_connections 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- 172.21.15.18:0/2208573032 wait complete. 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceaaa00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 0x7fce900a51c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563eb9c84580 tx=0x7fce9c0f7530 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.650+0000 7fceb499c740 1 -- start start 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 Processor -- start 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 0x563eb9c8b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563eb9c90da0 con 0x563eb9c84ab0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x563eb9ba3c40 con 0x563eb9c853d0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563eb9c90f20 con 0x563eb9c8dfb0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceb499c740 10 client.0 _ll_register_callbacks cb 0x563eb9ba3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.651+0000 7fceab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59476/0 (socket says 172.21.15.18:59476) 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceab400640 1 -- 172.21.15.18:0/2413691924 learned_addr learned my addr 172.21.15.18:0/2413691924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 0x563eb9c8b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceab400640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 -- 172.21.15.18:0/2413691924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c8dfb0 msgr2=0x563eb9c8baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 -- 172.21.15.18:0/2413691924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 msgr2=0x563eb9c8b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 -- 172.21.15.18:0/2413691924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb98fc3f0 con 0x563eb9c853d0 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.652+0000 7fceaa000640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 0x563eb9c8b5b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fceac106c40 tx=0x7fce94012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dbce4c4a1ad0b3b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fce98c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9400f920 con 0x563eb9c853d0 2024-04-21T22:36:57.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea4009e50 con 0x563eb9c853d0 2024-04-21T22:36:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fce9400fac0 con 0x563eb9c853d0 2024-04-21T22:36:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fce9400fcc0 con 0x563eb9c853d0 2024-04-21T22:36:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fceb499c740 10 client.26123 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563eb98bc0f0 con 0x563eb9c853d0 2024-04-21T22:36:57.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.653+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea4009e50 con 0x563eb9c853d0 2024-04-21T22:36:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fce9401c420 con 0x563eb9c853d0 2024-04-21T22:36:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 10 client.26123 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 10 client.26123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 20 client.26123 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9ca2890 0x563eb9ca4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 4 client.26123 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563eb9bfbc40 con 0x563eb9ca2890 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.654+0000 7fceab400640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9ca2890 0x563eb9ca4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.655+0000 7fceab400640 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9ca2890 0x563eb9ca4ce0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1ab213e4d7e0f89 server_cookie=935a9a4af5275d5f in_seq=0 out_seq=0 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.655+0000 7fce98c00640 10 client.26123 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fce98c00640 1 -- 172.21.15.18:0/2413691924 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563eb9bfbc40 con 0x563eb9ca2890 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fce98c00640 10 client.26123 handle_command_reply: tid=0 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 client.26123 shutdown 2024-04-21T22:36:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 msgr2=0x563eb9c8b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 0x563eb9c8b5b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fceac106c40 tx=0x7fce94012b60 comp rx=0 tx=0).stop 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 shutdown_connections 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9ca2890 0x563eb9ca4ce0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c853d0 0x563eb9c8b5b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fce98c00640 0 client.26123 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 --2- 172.21.15.18:0/2413691924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 >> 172.21.15.18:0/2413691924 conn(0x563eb9c7f1e0 msgr2=0x563eb9c80f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 shutdown_connections 2024-04-21T22:36:57.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 1 -- 172.21.15.18:0/2413691924 wait complete. 2024-04-21T22:36:57.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.656+0000 7fceb499c740 20 client.26123 trim_cache size 0 max 16384 2024-04-21T22:36:57.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 Processor -- start 2024-04-21T22:36:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 -- start start 2024-04-21T22:36:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c7f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1ab0d0 con 0x563eb9c84ab0 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1acd90 con 0x563eb9c8dfb0 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.679+0000 7fceb499c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1ab860 con 0x563eb9c853d0 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59484/0 (socket says 172.21.15.18:59484) 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceab400640 1 -- 172.21.15.18:0/3488227269 learned_addr learned my addr 172.21.15.18:0/3488227269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c7f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceab400640 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 -- 172.21.15.18:0/3488227269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 msgr2=0x563eb9c8a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 -- 172.21.15.18:0/3488227269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 msgr2=0x563eb9c8d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 -- 172.21.15.18:0/3488227269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563eb9c79660 con 0x563eb9c853d0 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.680+0000 7fceaa000640 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c7f5c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce9401ca80 tx=0x7fce94005d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c968f250ec75962 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fce9b400640 1 -- 172.21.15.18:0/3488227269 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9400f920 con 0x563eb9c853d0 2024-04-21T22:36:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fce9b400640 1 -- 172.21.15.18:0/3488227269 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9400fac0 con 0x563eb9c853d0 2024-04-21T22:36:57.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fce9b400640 1 -- 172.21.15.18:0/3488227269 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94003d30 con 0x563eb9c853d0 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 -- 172.21.15.18:0/3488227269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 msgr2=0x563eb9c7f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c7f5c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce9401ca80 tx=0x7fce94005d30 comp rx=0 tx=0).stop 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 -- 172.21.15.18:0/3488227269 shutdown_connections 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c8a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c853d0 0x563eb9c7f5c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 --2- 172.21.15.18:0/3488227269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c84ab0 0x563eb9c8d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.681+0000 7fceb499c740 1 -- 172.21.15.18:0/3488227269 >> 172.21.15.18:0/3488227269 conn(0x563eb9c7f1e0 msgr2=0x563eb9c805f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.682+0000 7fceb499c740 1 -- 172.21.15.18:0/3488227269 shutdown_connections 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.682+0000 7fceb499c740 1 -- 172.21.15.18:0/3488227269 wait complete. 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.682+0000 7fceb499c740 1 -- start start 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.682+0000 7fceb499c740 1 Processor -- start 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 0x563eb9c881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c88720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1ac600 con 0x563eb9c853d0 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1abf30 con 0x563eb9c8dfb0 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1a90b0 con 0x563eb9c84ab0 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceb499c740 10 client.0 _ll_register_callbacks cb 0x7fce94009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceab400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceab400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40096/0 (socket says 172.21.15.18:40096) 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceab400640 1 -- 172.21.15.18:0/414482780 learned_addr learned my addr 172.21.15.18:0/414482780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceab400640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c88720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.683+0000 7fceaa000640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 0x563eb9c881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 -- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 msgr2=0x563eb9c88720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c88720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 -- 172.21.15.18:0/414482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 msgr2=0x563eb9c881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 0x563eb9c881e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 -- 172.21.15.18:0/414482780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eb9d07e60 con 0x563eb9c84ab0 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceaa000640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 0x563eb9c881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceab400640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011d10 tx=0x7fcea402b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb29b278f07ba53 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fce98c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea401e040 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce9400fac0 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.684+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fcea4005640 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcea4042050 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 10 client.26164 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563eb9d090b0 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9400fac0 con 0x563eb9c84ab0 2024-04-21T22:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fcea4024040 con 0x563eb9c84ab0 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 10 client.26164 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 10 client.26164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 20 client.26164 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9d09710 0x563eb9d0bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 4 client.26164 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.685+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563eb9bf5950 con 0x563eb9d09710 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.686+0000 7fceaa000640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9d09710 0x563eb9d0bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.686+0000 7fceaa000640 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9d09710 0x563eb9d0bb00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1bf828bc12cd885 server_cookie=49d857450d32db4a in_seq=0 out_seq=0 2024-04-21T22:36:57.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.686+0000 7fce98c00640 10 client.26164 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fce98c00640 1 -- 172.21.15.18:0/414482780 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563eb9bf5950 con 0x563eb9d09710 2024-04-21T22:36:57.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fce98c00640 10 client.26164 handle_command_reply: tid=0 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 client.26164 shutdown 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 msgr2=0x563eb9c87ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011d10 tx=0x7fcea402b040 comp rx=0 tx=0).stop 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 shutdown_connections 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x563eb9c8dfb0 0x563eb9c88720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563eb9c853d0 0x563eb9c881e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x563eb9d09710 0x563eb9d0bb00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 --2- 172.21.15.18:0/414482780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563eb9c84ab0 0x563eb9c87ca0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 >> 172.21.15.18:0/414482780 conn(0x563eb9c7f1e0 msgr2=0x563eb9c8b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fce98c00640 0 client.26164 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 shutdown_connections 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 1 -- 172.21.15.18:0/414482780 wait complete. 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.687+0000 7fceb499c740 20 client.26164 trim_cache size 0 max 16384 2024-04-21T22:36:57.696 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:36:57.697 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:36:57.697 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:36:57.697 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:36:57.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 msgr2=0x7fce900a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 0x7fce900a51c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563eb9c84580 tx=0x7fce9c0f7530 comp rx=0 tx=0).stop 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 msgr2=0x7fceac197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce9c000f80 tx=0x7fce9c032460 comp rx=0 tx=0).stop 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 shutdown_connections 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fce900a2d00 0x7fce900a51c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceac107620 0x7fceac19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceac101f20 0x7fceac198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 --2- 172.21.15.18:0/3182108900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fceac101560 0x7fceac197e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 >> 172.21.15.18:0/3182108900 conn(0x7fceac0fd090 msgr2=0x7fceac0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 shutdown_connections 2024-04-21T22:36:57.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.688+0000 7fceabe00640 1 -- 172.21.15.18:0/3182108900 wait complete. 2024-04-21T22:36:57.706 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:36:57.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:36:57.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 -- 172.21.15.18:0/1134064912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 msgr2=0x7f5a90103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 --2- 172.21.15.18:0/1134064912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a90103c90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009900 tx=0x7f5a7c02bc40 comp rx=0 tx=0).stop 2024-04-21T22:36:57.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 -- 172.21.15.18:0/1134064912 shutdown_connections 2024-04-21T22:36:57.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 --2- 172.21.15.18:0/1134064912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 0x7f5a901106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 --2- 172.21.15.18:0/1134064912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a90103c90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 --2- 172.21.15.18:0/1134064912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a90109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 -- 172.21.15.18:0/1134064912 >> 172.21.15.18:0/1134064912 conn(0x7f5a900ff2c0 msgr2=0x7f5a901016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:57.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 -- 172.21.15.18:0/1134064912 shutdown_connections 2024-04-21T22:36:57.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.917+0000 7f5a94e00640 1 -- 172.21.15.18:0/1134064912 wait complete. 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.918+0000 7f5a94e00640 1 Processor -- start 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.918+0000 7f5a94e00640 1 -- start start 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.918+0000 7f5a94e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a9019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.918+0000 7f5a94e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 0x7f5a9019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.918+0000 7f5a94e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a94e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90113c80 con 0x7f5a90109820 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a94e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90113b00 con 0x7f5a90103810 2024-04-21T22:36:57.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a94e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90113e00 con 0x7f5a901041d0 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59508/0 (socket says 172.21.15.18:59508) 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 -- 172.21.15.18:0/33739916 learned_addr learned my addr 172.21.15.18:0/33739916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8ea00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 0x7f5a9019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8f400640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a9019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 -- 172.21.15.18:0/33739916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 msgr2=0x7f5a9019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 0x7f5a9019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 -- 172.21.15.18:0/33739916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 msgr2=0x7f5a9019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:57.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a9019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.919+0000 7f5a8fe00640 1 -- 172.21.15.18:0/33739916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9019f0b0 con 0x7f5a90109820 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a8fe00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800eb10 tx=0x7f5a8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88004b20 con 0x7f5a90109820 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9019f3a0 con 0x7f5a90109820 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a88004cc0 con 0x7f5a90109820 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88010760 con 0x7f5a90109820 2024-04-21T22:36:57.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.920+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a901a6c30 con 0x7f5a90109820 2024-04-21T22:36:57.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.921+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9004f570 con 0x7f5a90109820 2024-04-21T22:36:57.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.923+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5a88005020 con 0x7f5a90109820 2024-04-21T22:36:57.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.925+0000 7f5a87e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 0x7f5a740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:57.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.925+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5a880cfb50 con 0x7f5a90109820 2024-04-21T22:36:57.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.925+0000 7f5a8f400640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 0x7f5a740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:57.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.926+0000 7f5a8f400640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 0x7f5a740a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009b50 tx=0x7f5a80005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:57.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:57.931+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5a8809c710 con 0x7f5a90109820 2024-04-21T22:36:58.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.184+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a9010bd80 con 0x7f5a90109820 2024-04-21T22:36:58.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.185+0000 7f5a87e00640 1 -- 172.21.15.18:0/33739916 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7f5a880bc0d0 con 0x7f5a90109820 2024-04-21T22:36:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:36:58.186 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:36:03.102173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:36:58.186 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 32 2024-04-21T22:36:58.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 msgr2=0x7f5a740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 0x7f5a740a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009b50 tx=0x7f5a80005f90 comp rx=0 tx=0).stop 2024-04-21T22:36:58.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 msgr2=0x7f5a9019e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800eb10 tx=0x7f5a8800c2d0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 shutdown_connections 2024-04-21T22:36:58.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5a740a2cf0 0x7f5a740a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a90109820 0x7f5a9019e980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a901041d0 0x7f5a9019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 --2- 172.21.15.18:0/33739916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a90103810 0x7f5a9019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 >> 172.21.15.18:0/33739916 conn(0x7f5a900ff2c0 msgr2=0x7f5a900ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 shutdown_connections 2024-04-21T22:36:58.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.189+0000 7f5a94e00640 1 -- 172.21.15.18:0/33739916 wait complete. 2024-04-21T22:36:58.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:36:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 -- 172.21.15.18:0/1559705118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 msgr2=0x7fe6041107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 --2- 172.21.15.18:0/1559705118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe6041107f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009cd0 tx=0x7fe5fc02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 -- 172.21.15.18:0/1559705118 shutdown_connections 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 --2- 172.21.15.18:0/1559705118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe6041107f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 --2- 172.21.15.18:0/1559705118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 0x7fe604103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 --2- 172.21.15.18:0/1559705118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe604109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 -- 172.21.15.18:0/1559705118 >> 172.21.15.18:0/1559705118 conn(0x7fe6040ff3b0 msgr2=0x7fe6041017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 -- 172.21.15.18:0/1559705118 shutdown_connections 2024-04-21T22:36:58.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.425+0000 7fe60ba00640 1 -- 172.21.15.18:0/1559705118 wait complete. 2024-04-21T22:36:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.426+0000 7fe60ba00640 1 Processor -- start 2024-04-21T22:36:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.426+0000 7fe60ba00640 1 -- start start 2024-04-21T22:36:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 0x7fe60419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe60419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe604113d10 con 0x7fe6041042e0 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe604113b90 con 0x7fe604103920 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe60ba00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe604113e90 con 0x7fe604109930 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe603e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe603e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59534/0 (socket says 172.21.15.18:59534) 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe603e00640 1 -- 172.21.15.18:0/3563918986 learned_addr learned my addr 172.21.15.18:0/3563918986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609000640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 0x7fe60419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe60419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 -- 172.21.15.18:0/3563918986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 msgr2=0x7fe60419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 0x7fe60419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 -- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 msgr2=0x7fe60419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe609a00640 1 -- 172.21.15.18:0/3563918986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60419f230 con 0x7fe604109930 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.427+0000 7fe603e00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe609a00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe60419eb00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc037040 tx=0x7fe5fc032ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe601600640 1 -- 172.21.15.18:0/3563918986 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc041020 con 0x7fe604109930 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe601600640 1 -- 172.21.15.18:0/3563918986 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5fc034cd0 con 0x7fe604109930 2024-04-21T22:36:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60419f4c0 con 0x7fe604109930 2024-04-21T22:36:58.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe601600640 1 -- 172.21.15.18:0/3563918986 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc039040 con 0x7fe604109930 2024-04-21T22:36:58.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.428+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041a6db0 con 0x7fe604109930 2024-04-21T22:36:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.431+0000 7fe60e5eb740 1 Processor -- start 2024-04-21T22:36:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe601600640 1 -- 172.21.15.18:0/3563918986 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe5fc044020 con 0x7fe604109930 2024-04-21T22:36:58.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 -- start start 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea505160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea4693a0 con 0x55a5ea50e280 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea411930 con 0x55a5ea504d80 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea465360 con 0x55a5ea5056a0 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe603e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe609000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe609000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40146/0 (socket says 172.21.15.18:40146) 2024-04-21T22:36:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 -- 172.21.15.18:0/512185590 learned_addr learned my addr 172.21.15.18:0/512185590 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.432+0000 7fe603e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59546/0 (socket says 172.21.15.18:59546) 2024-04-21T22:36:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe603e00640 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea505160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 -- 172.21.15.18:0/512185590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 msgr2=0x55a5ea505160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea505160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 -- 172.21.15.18:0/512185590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 msgr2=0x55a5ea510670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 -- 172.21.15.18:0/512185590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ea17d3f0 con 0x55a5ea5056a0 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe603e00640 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe609000640 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009c70 tx=0x7fe5f4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ae2f6f92a07d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe601600640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 0x7fe5e80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.433+0000 7fe5fa000640 1 -- 172.21.15.18:0/512185590 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4004230 con 0x55a5ea5056a0 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe5fa000640 1 -- 172.21.15.18:0/512185590 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f40043d0 con 0x55a5ea5056a0 2024-04-21T22:36:58.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe5fa000640 1 -- 172.21.15.18:0/512185590 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4019760 con 0x55a5ea5056a0 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe601600640 1 -- 172.21.15.18:0/3563918986 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5fc0f0e80 con 0x7fe604109930 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe603e00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 0x7fe5e80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe60e5eb740 1 -- 172.21.15.18:0/512185590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 msgr2=0x55a5ea50dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009c70 tx=0x7fe5f4011810 comp rx=0 tx=0).stop 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.434+0000 7fe603e00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 0x7fe5e80a51c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55a5ea500640 tx=0x7fe5ec009550 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 -- 172.21.15.18:0/512185590 shutdown_connections 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea510670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50dd40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/512185590 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea505160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 -- 172.21.15.18:0/512185590 >> 172.21.15.18:0/512185590 conn(0x55a5ea4ff4b0 msgr2=0x55a5ea4ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 -- 172.21.15.18:0/512185590 shutdown_connections 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 -- 172.21.15.18:0/512185590 wait complete. 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 -- start start 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.435+0000 7fe60e5eb740 1 Processor -- start 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea50b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea50e280 0x55a5ea50bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea511070 con 0x55a5ea504d80 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea424d80 con 0x55a5ea50e280 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a5ea5111f0 con 0x55a5ea5056a0 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe60e5eb740 10 client.0 _ll_register_callbacks cb 0x55a5ea4612b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe609000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea50b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40154/0 (socket says 172.21.15.18:40154) 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 -- 172.21.15.18:0/380380949 learned_addr learned my addr 172.21.15.18:0/380380949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe609a00640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea50e280 0x55a5ea50bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 -- 172.21.15.18:0/380380949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea50e280 msgr2=0x55a5ea50bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea50e280 0x55a5ea50bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.436+0000 7fe603e00640 1 -- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 msgr2=0x55a5ea50b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe603e00640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea50b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe603e00640 1 -- 172.21.15.18:0/380380949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ea2477d0 con 0x55a5ea5056a0 2024-04-21T22:36:58.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe609000640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea50b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe603e00640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec004180 tx=0x7fe5ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9f0b1a3caa3369 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe5f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec003940 con 0x55a5ea5056a0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f40043d0 con 0x55a5ea5056a0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.437+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5ec003ae0 con 0x55a5ea5056a0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe5ec003ce0 con 0x55a5ea5056a0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 10 client.26182 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a5ea51d370 con 0x55a5ea5056a0 2024-04-21T22:36:58.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f40043d0 con 0x55a5ea5056a0 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fe5ec027070 con 0x55a5ea5056a0 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 10 client.26182 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 10 client.26182 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 20 client.26182 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea51e780 0x55a5ea520c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 4 client.26182 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.438+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ea4768e0 con 0x55a5ea51e780 2024-04-21T22:36:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.439+0000 7fe609000640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea51e780 0x55a5ea520c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.446 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:58 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/33739916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:58.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.439+0000 7fe609000640 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea51e780 0x55a5ea520c20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a6ebbc0ee17be35 server_cookie=8e4fb6a1ed820e59 in_seq=0 out_seq=0 2024-04-21T22:36:58.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.439+0000 7fe5f2a00640 10 client.26182 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe5f2a00640 1 -- 172.21.15.18:0/380380949 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5ea4768e0 con 0x55a5ea51e780 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe5f2a00640 10 client.26182 handle_command_reply: tid=0 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 client.26182 shutdown 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 msgr2=0x55a5ea50b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec004180 tx=0x7fe5ec004730 comp rx=0 tx=0).stop 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 shutdown_connections 2024-04-21T22:36:58.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea51e780 0x55a5ea520c20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea50e280 0x55a5ea50bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea50b7e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/380380949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea50b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe5f2a00640 0 client.26182 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.440+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 >> 172.21.15.18:0/380380949 conn(0x55a5ea4ff4b0 msgr2=0x55a5ea501200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.441+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 shutdown_connections 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.441+0000 7fe60e5eb740 1 -- 172.21.15.18:0/380380949 wait complete. 2024-04-21T22:36:58.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.441+0000 7fe60e5eb740 20 client.26182 trim_cache size 0 max 16384 2024-04-21T22:36:58.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 Processor -- start 2024-04-21T22:36:58.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 -- start start 2024-04-21T22:36:58.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea50d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea519f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041af790 con 0x55a5ea50e280 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041b1450 con 0x55a5ea504d80 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.456+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041aff20 con 0x55a5ea5056a0 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea50d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59568/0 (socket says 172.21.15.18:59568) 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 -- 172.21.15.18:0/2771458349 learned_addr learned my addr 172.21.15.18:0/2771458349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe603e00640 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea519f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 -- 172.21.15.18:0/2771458349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 msgr2=0x55a5ea519f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea519f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 -- 172.21.15.18:0/2771458349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 msgr2=0x55a5ea50d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea50d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 -- 172.21.15.18:0/2771458349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ea506050 con 0x55a5ea50e280 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe603e00640 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea519f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe609a00640 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0bd150 tx=0x7fe5fc003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bb26100493d686 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.457+0000 7fe5f9600640 1 -- 172.21.15.18:0/2771458349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0d6070 con 0x55a5ea50e280 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe5f9600640 1 -- 172.21.15.18:0/2771458349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5fc003e30 con 0x55a5ea50e280 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe5f9600640 1 -- 172.21.15.18:0/2771458349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0bb580 con 0x55a5ea50e280 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 -- 172.21.15.18:0/2771458349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 msgr2=0x55a5ea4fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0bd150 tx=0x7fe5fc003bc0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 -- 172.21.15.18:0/2771458349 shutdown_connections 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea50e280 0x55a5ea4fe510 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea5056a0 0x55a5ea519f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/2771458349 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea504d80 0x55a5ea50d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 -- 172.21.15.18:0/2771458349 >> 172.21.15.18:0/2771458349 conn(0x55a5ea4ff4b0 msgr2=0x55a5ea4fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 -- 172.21.15.18:0/2771458349 shutdown_connections 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.458+0000 7fe60e5eb740 1 -- 172.21.15.18:0/2771458349 wait complete. 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 -- start start 2024-04-21T22:36:58.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 Processor -- start 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea5056a0 0x55a5ea512560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea50e280 0x55a5ea512aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041b0cc0 con 0x55a5ea504d80 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041b05f0 con 0x55a5ea5056a0 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.459+0000 7fe60e5eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6041ad770 con 0x55a5ea50e280 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe60e5eb740 10 client.0 _ll_register_callbacks cb 0x7fe5ec004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59574/0 (socket says 172.21.15.18:59574) 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 -- 172.21.15.18:0/933299190 learned_addr learned my addr 172.21.15.18:0/933299190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609a00640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea50e280 0x55a5ea512aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe603e00640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea5056a0 0x55a5ea512560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 -- 172.21.15.18:0/933299190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea50e280 msgr2=0x55a5ea512aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea50e280 0x55a5ea512aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 -- 172.21.15.18:0/933299190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea5056a0 msgr2=0x55a5ea512560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea5056a0 0x55a5ea512560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.460+0000 7fe609000640 1 -- 172.21.15.18:0/933299190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ea583f30 con 0x55a5ea504d80 2024-04-21T22:36:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe609000640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55a5ea504850 tx=0x7fe5f4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df53245019a12656 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe5f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:58.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4005c50 con 0x55a5ea504d80 2024-04-21T22:36:58.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5f401f040 con 0x55a5ea504d80 2024-04-21T22:36:58.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5fc003e30 con 0x55a5ea504d80 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe5f403a050 con 0x55a5ea504d80 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe60e5eb740 10 client.16062 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a5ea5851f0 con 0x55a5ea504d80 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.461+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5fc003e30 con 0x55a5ea504d80 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fe5f4018070 con 0x55a5ea504d80 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 10 client.16062 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 10 client.16062 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:36:58.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 20 client.16062 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea585800 0x55a5ea587c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 4 client.16062 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5ea470c30 con 0x55a5ea585800 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe603e00640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea585800 0x55a5ea587c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.462+0000 7fe603e00640 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea585800 0x55a5ea587c20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c927846b5e32a866 server_cookie=bc1f8364815b36b5 in_seq=0 out_seq=0 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe5f2a00640 10 client.16062 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe5f2a00640 1 -- 172.21.15.18:0/933299190 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5ea470c30 con 0x55a5ea585800 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe5f2a00640 10 client.16062 handle_command_reply: tid=0 2024-04-21T22:36:58.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 client.16062 shutdown 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 msgr2=0x55a5ea512020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55a5ea504850 tx=0x7fe5f4009310 comp rx=0 tx=0).stop 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 shutdown_connections 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a5ea585800 0x55a5ea587c20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a5ea50e280 0x55a5ea512aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a5ea5056a0 0x55a5ea512560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 --2- 172.21.15.18:0/933299190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5ea504d80 0x55a5ea512020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 >> 172.21.15.18:0/933299190 conn(0x55a5ea4ff4b0 msgr2=0x55a5ea4fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe5f2a00640 0 client.16062 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:36:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 shutdown_connections 2024-04-21T22:36:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 1 -- 172.21.15.18:0/933299190 wait complete. 2024-04-21T22:36:58.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.463+0000 7fe60e5eb740 20 client.16062 trim_cache size 0 max 16384 2024-04-21T22:36:58.471 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 msgr2=0x7fe5e80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 0x7fe5e80a51c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55a5ea500640 tx=0x7fe5ec009550 comp rx=0 tx=0).stop 2024-04-21T22:36:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 msgr2=0x7fe60419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe60419eb00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc037040 tx=0x7fe5fc032ea0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 shutdown_connections 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5e80a2d00 0x7fe5e80a51c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe604109930 0x7fe60419eb00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6041042e0 0x7fe60419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 --2- 172.21.15.18:0/3563918986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe604103920 0x7fe60419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 >> 172.21.15.18:0/3563918986 conn(0x7fe6040ff3b0 msgr2=0x7fe6040ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 shutdown_connections 2024-04-21T22:36:58.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.464+0000 7fe60ba00640 1 -- 172.21.15.18:0/3563918986 wait complete. 2024-04-21T22:36:58.479 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:58 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/33739916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:58.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:36:58.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:58 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/33739916' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:36:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 -- 172.21.15.18:0/45332960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc107c80 msgr2=0x7fb7bc108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/45332960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc107c80 0x7fb7bc108100 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009890 tx=0x7fb7a402bb70 comp rx=0 tx=0).stop 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 -- 172.21.15.18:0/45332960 shutdown_connections 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/45332960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc1149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/45332960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc107c80 0x7fb7bc108100 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/45332960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc10dc00 0x7fb7bc10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 -- 172.21.15.18:0/45332960 >> 172.21.15.18:0/45332960 conn(0x7fb7bc077550 msgr2=0x7fb7bc106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 -- 172.21.15.18:0/45332960 shutdown_connections 2024-04-21T22:36:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.681+0000 7fb7c0c00640 1 -- 172.21.15.18:0/45332960 wait complete. 2024-04-21T22:36:58.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.682+0000 7fb7c0c00640 1 Processor -- start 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 -- start start 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 0x7fb7bc19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc10dc00 0x7fb7bc1a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc117f40 con 0x7fb7bc108640 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc117dc0 con 0x7fb7bc107c80 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7c0c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1180c0 con 0x7fb7bc10dc00 2024-04-21T22:36:58.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7bb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 0x7fb7bc19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59594/0 (socket says 172.21.15.18:59594) 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7baa00640 1 -- 172.21.15.18:0/576341763 learned_addr learned my addr 172.21.15.18:0/576341763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.683+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc10dc00 0x7fb7bc1a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 -- 172.21.15.18:0/576341763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc10dc00 msgr2=0x7fb7bc1a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc10dc00 0x7fb7bc1a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 -- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 msgr2=0x7fb7bc19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 -- 172.21.15.18:0/576341763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc1a3430 con 0x7fb7bc107c80 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7baa00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7bb400640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 0x7fb7bc19e440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009fd0 tx=0x7fb7b400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7b3e00640 1 -- 172.21.15.18:0/576341763 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4004b20 con 0x7fb7bc107c80 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc1a3720 con 0x7fb7bc107c80 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7b3e00640 1 -- 172.21.15.18:0/576341763 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7b4004cc0 con 0x7fb7bc107c80 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7b3e00640 1 -- 172.21.15.18:0/576341763 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40107b0 con 0x7fb7bc107c80 2024-04-21T22:36:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.684+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc1aafb0 con 0x7fb7bc107c80 2024-04-21T22:36:58.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.689+0000 7fb7c4f8b740 1 Processor -- start 2024-04-21T22:36:58.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.689+0000 7fb7c4f8b740 1 -- start start 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.689+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbad01f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad04860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557dbac5d3a0 con 0x557dbad02470 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557dbac05930 con 0x557dbacf8f70 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557dbac59360 con 0x557dbacf9890 2024-04-21T22:36:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7b3e00640 1 -- 172.21.15.18:0/576341763 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb7b4005020 con 0x7fb7bc107c80 2024-04-21T22:36:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad04860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43094/0 (socket says 172.21.15.18:43094) 2024-04-21T22:36:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 -- 172.21.15.18:0/139929337 learned_addr learned my addr 172.21.15.18:0/139929337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bb400640 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbad01f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 -- 172.21.15.18:0/139929337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 msgr2=0x557dbad01f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbad01f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 -- 172.21.15.18:0/139929337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 msgr2=0x557dbad04860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad04860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.690+0000 7fb7bbe00640 1 -- 172.21.15.18:0/139929337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dba9713f0 con 0x557dbacf8f70 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.691+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009c40 tx=0x7fb7ac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c8201d4a4865f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.691+0000 7fb7abe00640 1 -- 172.21.15.18:0/139929337 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac004230 con 0x557dbacf8f70 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.691+0000 7fb7abe00640 1 -- 172.21.15.18:0/139929337 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ac0043d0 con 0x557dbacf8f70 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.691+0000 7fb7abe00640 1 -- 172.21.15.18:0/139929337 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0198c0 con 0x557dbacf8f70 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7b3e00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 0x7fb7a00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7b3e00640 1 -- 172.21.15.18:0/576341763 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7b40cfb90 con 0x7fb7bc107c80 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/139929337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 msgr2=0x557dbacf9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009c40 tx=0x7fb7ac011810 comp rx=0 tx=0).stop 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/139929337 shutdown_connections 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad04860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbad01f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7bb400640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 0x7fb7a00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/139929337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbacf9350 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/139929337 >> 172.21.15.18:0/139929337 conn(0x557dbacf36a0 msgr2=0x557dbacf3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/139929337 shutdown_connections 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.692+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/139929337 wait complete. 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7bb400640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 0x7fb7a00a5240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x557dbacf8a40 tx=0x7fb7b40d3640 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 -- start start 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 Processor -- start 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbacffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbad02470 0x557dbacfffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557dbad05260 con 0x557dbacf8f70 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557dbac18d80 con 0x557dbacf9890 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.693+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557dbad053e0 con 0x557dbad02470 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7c4f8b740 10 client.0 _ll_register_callbacks cb 0x557dbac552b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59626/0 (socket says 172.21.15.18:59626) 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1144417551 learned_addr learned my addr 172.21.15.18:0/1144417551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbacffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbad02470 0x557dbacfffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1144417551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbad02470 msgr2=0x557dbacfffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbad02470 0x557dbacfffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 msgr2=0x557dbacffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbacffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1144417551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dbaa3b7d0 con 0x557dbacf8f70 2024-04-21T22:36:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbacffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009230 tx=0x7fb7ac0194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae536abc93be0ffe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.694+0000 7fb7a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac009890 con 0x557dbacf8f70 2024-04-21T22:36:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7ac003800 con 0x557dbacf8f70 2024-04-21T22:36:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ac0043d0 con 0x557dbacf8f70 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac036050 con 0x557dbacf8f70 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7c4f8b740 10 client.16074 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557dbad115c0 con 0x557dbacf8f70 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.695+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ac0043d0 con 0x557dbacf8f70 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb7ac0049d0 con 0x557dbacf8f70 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 10 client.16074 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 10 client.16074 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:36:58.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 20 client.16074 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad12a20 0x557dbad14e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 4 client.16074 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dbac6a8e0 con 0x557dbad12a20 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.696+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad12a20 0x557dbad14e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.697+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad12a20 0x557dbad14e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=14990c6f459afd83 server_cookie=f2c18dac37760482 in_seq=0 out_seq=0 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.697+0000 7fb7a8c00640 10 client.16074 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7a8c00640 1 -- 172.21.15.18:0/1144417551 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557dbac6a8e0 con 0x557dbad12a20 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7a8c00640 10 client.16074 handle_command_reply: tid=0 2024-04-21T22:36:58.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 client.16074 shutdown 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 msgr2=0x557dbacff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009230 tx=0x7fb7ac0194e0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 shutdown_connections 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad12a20 0x557dbad14e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbad02470 0x557dbacfffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbacffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1144417551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbacf8f70 0x557dbacff540 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7a8c00640 0 client.16074 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 >> 172.21.15.18:0/1144417551 conn(0x557dbacf36a0 msgr2=0x557dbacf53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 shutdown_connections 2024-04-21T22:36:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1144417551 wait complete. 2024-04-21T22:36:58.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.698+0000 7fb7c4f8b740 20 client.16074 trim_cache size 0 max 16384 2024-04-21T22:36:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.713+0000 7fb7c4f8b740 1 Processor -- start 2024-04-21T22:36:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 -- start start 2024-04-21T22:36:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbad0e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbacf5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b3970 con 0x557dbad02470 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b5630 con 0x557dbacf8f70 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b4100 con 0x557dbacf9890 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbad0e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59638/0 (socket says 172.21.15.18:59638) 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1751002199 learned_addr learned my addr 172.21.15.18:0/1751002199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.714+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbacf5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1751002199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 msgr2=0x557dbacf5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbacf5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1751002199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 msgr2=0x557dbad0e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbad0e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 -- 172.21.15.18:0/1751002199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dbacedae0 con 0x557dbad02470 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7baa00640 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbacf5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac004dd0 tx=0x7fb7ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2693065562bdfe6f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7ab400640 1 -- 172.21.15.18:0/1751002199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0041b0 con 0x557dbad02470 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7ab400640 1 -- 172.21.15.18:0/1751002199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ac02d070 con 0x557dbad02470 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.715+0000 7fb7ab400640 1 -- 172.21.15.18:0/1751002199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac003a60 con 0x557dbad02470 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1751002199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 msgr2=0x557dbacffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac004dd0 tx=0x7fb7ac000bc0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1751002199 shutdown_connections 2024-04-21T22:36:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbacffde0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf9890 0x557dbacf5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/1751002199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf8f70 0x557dbad0e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1751002199 >> 172.21.15.18:0/1751002199 conn(0x557dbacf36a0 msgr2=0x557dbacfe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1751002199 shutdown_connections 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.716+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/1751002199 wait complete. 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 -- start start 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 Processor -- start 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad05b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b4ea0 con 0x557dbad02470 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b47d0 con 0x557dbacf9890 2024-04-21T22:36:58.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1b1950 con 0x557dbacf8f70 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.717+0000 7fb7c4f8b740 10 client.0 _ll_register_callbacks cb 0x7fb7ac005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad05b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40254/0 (socket says 172.21.15.18:40254) 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7baa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43128/0 (socket says 172.21.15.18:43128) 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 -- 172.21.15.18:0/3162794004 learned_addr learned my addr 172.21.15.18:0/3162794004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 -- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 msgr2=0x557dbad0ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 -- 172.21.15.18:0/3162794004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 msgr2=0x557dbad05b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad05b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7bbe00640 1 -- 172.21.15.18:0/3162794004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dbad06330 con 0x557dbacf8f70 2024-04-21T22:36:58.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.718+0000 7fb7baa00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7bbe00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac006010 tx=0x7fb7ac011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987a841b4506aa66 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac003a00 con 0x557dbacf8f70 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ac02d070 con 0x557dbacf8f70 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb7ac019990 con 0x557dbacf8f70 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac0043c0 con 0x557dbacf8f70 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7c4f8b740 10 client.26206 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557dbad78a10 con 0x557dbacf8f70 2024-04-21T22:36:58.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.719+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ac02d070 con 0x557dbacf8f70 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb7ac004fc0 con 0x557dbacf8f70 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 10 client.26206 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 10 client.26206 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 20 client.26206 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad78fb0 0x557dbad7b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 4 client.26206 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dbac64c30 con 0x557dbad78fb0 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.720+0000 7fb7baa00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad78fb0 0x557dbad7b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7a8c00640 10 client.26206 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7baa00640 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad78fb0 0x557dbad7b3d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e3c81c183e3c22b8 server_cookie=52f036ae656c759d in_seq=0 out_seq=0 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7a8c00640 1 -- 172.21.15.18:0/3162794004 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557dbac64c30 con 0x557dbad78fb0 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7a8c00640 10 client.26206 handle_command_reply: tid=0 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 client.26206 shutdown 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 msgr2=0x557dbad0a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac006010 tx=0x7fb7ac011810 comp rx=0 tx=0).stop 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 shutdown_connections 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557dbad78fb0 0x557dbad7b3d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557dbad02470 0x557dbad05b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557dbacf9890 0x557dbad0ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7a8c00640 0 client.26206 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 --2- 172.21.15.18:0/3162794004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dbacf8f70 0x557dbad0a600 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.721+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 >> 172.21.15.18:0/3162794004 conn(0x557dbacf36a0 msgr2=0x557dbacfe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 shutdown_connections 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c4f8b740 1 -- 172.21.15.18:0/3162794004 wait complete. 2024-04-21T22:36:58.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c4f8b740 20 client.26206 trim_cache size 0 max 16384 2024-04-21T22:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:58.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 msgr2=0x7fb7a00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 0x7fb7a00a5240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x557dbacf8a40 tx=0x7fb7b40d3640 comp rx=0 tx=0).stop 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 msgr2=0x7fb7bc19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 0x7fb7bc19e440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009fd0 tx=0x7fb7b400ef90 comp rx=0 tx=0).stop 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 shutdown_connections 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7a00a2d80 0x7fb7a00a5240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7bc10dc00 0x7fb7bc1a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7bc108640 0x7fb7bc19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 --2- 172.21.15.18:0/576341763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb7bc107c80 0x7fb7bc19e440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.722+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 >> 172.21.15.18:0/576341763 conn(0x7fb7bc077550 msgr2=0x7fb7bc078790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.723+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 shutdown_connections 2024-04-21T22:36:58.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.723+0000 7fb7c0c00640 1 -- 172.21.15.18:0/576341763 wait complete. 2024-04-21T22:36:58.740 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:36:58.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 -- 172.21.15.18:0/526850583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29241042e0 msgr2=0x7f29241107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 --2- 172.21.15.18:0/526850583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29241042e0 0x7f29241107f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f291c009c10 tx=0x7f291c02bee0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 -- 172.21.15.18:0/526850583 shutdown_connections 2024-04-21T22:36:58.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 --2- 172.21.15.18:0/526850583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29241042e0 0x7f29241107f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 --2- 172.21.15.18:0/526850583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 0x7f2924103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 --2- 172.21.15.18:0/526850583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2924109930 0x7f2924109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 -- 172.21.15.18:0/526850583 >> 172.21.15.18:0/526850583 conn(0x7f29240ff3b0 msgr2=0x7f29241017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 -- 172.21.15.18:0/526850583 shutdown_connections 2024-04-21T22:36:58.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.949+0000 7f292ae00640 1 -- 172.21.15.18:0/526850583 wait complete. 2024-04-21T22:36:58.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.950+0000 7f292ae00640 1 Processor -- start 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.950+0000 7f292ae00640 1 -- start start 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.950+0000 7f292ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 0x7f292419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.950+0000 7f292ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.950+0000 7f292ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 0x7f292419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f292ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2924113d60 con 0x7f29241042e0 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f292ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2924113be0 con 0x7f2924103920 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f292ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2924113ee0 con 0x7f2924109930 2024-04-21T22:36:58.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 0x7f292419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59672/0 (socket says 172.21.15.18:59672) 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2923400640 1 -- 172.21.15.18:0/2364666254 learned_addr learned my addr 172.21.15.18:0/2364666254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2923e00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 0x7f292419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 -- 172.21.15.18:0/2364666254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 msgr2=0x7f292419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 0x7f292419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 -- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 msgr2=0x7f292419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2928e00640 1 -- 172.21.15.18:0/2364666254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292419f210 con 0x7f2924109930 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.951+0000 7f2923400640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f2928e00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 0x7f292419eae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f291c036040 tx=0x7f291c033a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f2920c00640 1 -- 172.21.15.18:0/2364666254 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c043020 con 0x7f2924109930 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f2920c00640 1 -- 172.21.15.18:0/2364666254 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291c003b80 con 0x7f2924109930 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292419f4a0 con 0x7f2924109930 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f2920c00640 1 -- 172.21.15.18:0/2364666254 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c03e7d0 con 0x7f2924109930 2024-04-21T22:36:58.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.952+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29241a6d90 con 0x7f2924109930 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.955+0000 7f292da26740 1 Processor -- start 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.955+0000 7f2920c00640 1 -- 172.21.15.18:0/2364666254 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f291c046020 con 0x7f2924109930 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 -- start start 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643c03023a0 con 0x5643c039dd80 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5643c02aa930 con 0x5643c039e6a0 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f292da26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5643c02fe360 con 0x5643c03a7280 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.956+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59686/0 (socket says 172.21.15.18:59686) 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923400640 1 -- 172.21.15.18:0/3006140071 learned_addr learned my addr 172.21.15.18:0/3006140071 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923400640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 -- 172.21.15.18:0/3006140071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 msgr2=0x5643c03a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 -- 172.21.15.18:0/3006140071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 msgr2=0x5643c039e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 -- 172.21.15.18:0/3006140071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c00163f0 con 0x5643c039e6a0 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923400640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2923e00640 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a6d40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2914009c20 tx=0x7f2914011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d0b1d72154a873b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.957+0000 7f2920c00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 0x7f29080a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.958+0000 7f2919600640 1 -- 172.21.15.18:0/3006140071 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914004050 con 0x5643c039e6a0 2024-04-21T22:36:58.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.958+0000 7f2920c00640 1 -- 172.21.15.18:0/2364666254 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f291c0f1a30 con 0x7f2924109930 2024-04-21T22:36:58.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.958+0000 7f2919600640 1 -- 172.21.15.18:0/3006140071 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2914005500 con 0x5643c039e6a0 2024-04-21T22:36:58.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.958+0000 7f2919600640 1 -- 172.21.15.18:0/3006140071 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914004d40 con 0x5643c039e6a0 2024-04-21T22:36:58.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.958+0000 7f2923400640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 0x7f29080a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- 172.21.15.18:0/3006140071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 msgr2=0x5643c03a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a6d40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2914009c20 tx=0x7f2914011810 comp rx=0 tx=0).stop 2024-04-21T22:36:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f2923400640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 0x7f29080a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29100094b0 tx=0x7f2910015040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- 172.21.15.18:0/3006140071 shutdown_connections 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a6d40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 --2- 172.21.15.18:0/3006140071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c039e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- 172.21.15.18:0/3006140071 >> 172.21.15.18:0/3006140071 conn(0x5643c03984b0 msgr2=0x5643c0398890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- 172.21.15.18:0/3006140071 shutdown_connections 2024-04-21T22:36:58.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- 172.21.15.18:0/3006140071 wait complete. 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 -- start start 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.959+0000 7f292da26740 1 Processor -- start 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5643c03aa070 con 0x5643c03a7280 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5643c02bdd80 con 0x5643c039e6a0 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5643c03aa1f0 con 0x5643c039dd80 2024-04-21T22:36:58.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f292da26740 10 client.0 _ll_register_callbacks cb 0x5643c02fa2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2928e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2923e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2928e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59692/0 (socket says 172.21.15.18:59692) 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2928e00640 1 -- 172.21.15.18:0/3531620816 learned_addr learned my addr 172.21.15.18:0/3531620816 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2923e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40302/0 (socket says 172.21.15.18:40302) 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.960+0000 7f2923400640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 -- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 msgr2=0x5643c03a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 -- 172.21.15.18:0/3531620816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 msgr2=0x5643c03a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 -- 172.21.15.18:0/3531620816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c00e07d0 con 0x5643c03a7280 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2923e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f2928e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f291c02c420 tx=0x7f291c0bdc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bbed01d49c4683 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f290e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c0be000 con 0x5643c03a7280 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f291c0b8b70 con 0x5643c03a7280 2024-04-21T22:36:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.961+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2914005500 con 0x5643c03a7280 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f291c0c23b0 con 0x5643c03a7280 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 10 client.16092 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5643c03b63c0 con 0x5643c03a7280 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2914005500 con 0x5643c03a7280 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f291c004bb0 con 0x5643c03a7280 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 10 client.16092 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 10 client.16092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:36:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 20 client.16092 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c03b7930 0x5643c03b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 4 client.16092 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.962+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643c030f8e0 con 0x5643c03b7930 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.963+0000 7f2923e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c03b7930 0x5643c03b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.963+0000 7f2923e00640 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c03b7930 0x5643c03b9df0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22ec57928921eef8 server_cookie=b4244db826466528 in_seq=0 out_seq=0 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.963+0000 7f290e000640 10 client.16092 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.964+0000 7f290e000640 1 -- 172.21.15.18:0/3531620816 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5643c030f8e0 con 0x5643c03b7930 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.964+0000 7f290e000640 10 client.16092 handle_command_reply: tid=0 2024-04-21T22:36:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.964+0000 7f292da26740 1 client.16092 shutdown 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.964+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 msgr2=0x5643c03a4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.964+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f291c02c420 tx=0x7f291c0bdc30 comp rx=0 tx=0).stop 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 shutdown_connections 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c03b7930 0x5643c03b9df0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c03a7280 0x5643c03a4d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039e6a0 0x5643c03a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 --2- 172.21.15.18:0/3531620816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039dd80 0x5643c03a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f290e000640 0 client.16092 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:58.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 >> 172.21.15.18:0/3531620816 conn(0x5643c03984b0 msgr2=0x5643c039a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 shutdown_connections 2024-04-21T22:36:58.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 1 -- 172.21.15.18:0/3531620816 wait complete. 2024-04-21T22:36:58.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.965+0000 7f292da26740 20 client.16092 trim_cache size 0 max 16384 2024-04-21T22:36:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 Processor -- start 2024-04-21T22:36:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 -- start start 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039e6a0 0x5643c03a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 0x5643c039a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29241af670 con 0x5643c039dd80 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29241b1330 con 0x5643c03a7280 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.980+0000 7f292da26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29241afe00 con 0x5643c039e6a0 2024-04-21T22:36:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59694/0 (socket says 172.21.15.18:59694) 2024-04-21T22:36:58.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 -- 172.21.15.18:0/2743518149 learned_addr learned my addr 172.21.15.18:0/2743518149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923400640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039e6a0 0x5643c03a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2928e00640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 0x5643c039a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 -- 172.21.15.18:0/2743518149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039e6a0 msgr2=0x5643c03a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039e6a0 0x5643c03a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 -- 172.21.15.18:0/2743518149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 msgr2=0x5643c039a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 0x5643c039a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.981+0000 7f2923e00640 1 -- 172.21.15.18:0/2743518149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c039f050 con 0x5643c039dd80 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.982+0000 7f2928e00640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 0x5643c039a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.982+0000 7f2923e00640 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2914009c20 tx=0x7f2914004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25298236fbd3aee server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.982+0000 7f2918c00640 1 -- 172.21.15.18:0/2743518149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914034070 con 0x5643c039dd80 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.982+0000 7f2918c00640 1 -- 172.21.15.18:0/2743518149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291402e8c0 con 0x5643c039dd80 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.982+0000 7f2918c00640 1 -- 172.21.15.18:0/2743518149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140035f0 con 0x5643c039dd80 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 -- 172.21.15.18:0/2743518149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 msgr2=0x5643c03b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2914009c20 tx=0x7f2914004470 comp rx=0 tx=0).stop 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 -- 172.21.15.18:0/2743518149 shutdown_connections 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c03a7280 0x5643c039a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c039e6a0 0x5643c03a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 --2- 172.21.15.18:0/2743518149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039dd80 0x5643c03b2f90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 -- 172.21.15.18:0/2743518149 >> 172.21.15.18:0/2743518149 conn(0x5643c03984b0 msgr2=0x5643c0398890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 -- 172.21.15.18:0/2743518149 shutdown_connections 2024-04-21T22:36:58.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.983+0000 7f292da26740 1 -- 172.21.15.18:0/2743518149 wait complete. 2024-04-21T22:36:58.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 -- start start 2024-04-21T22:36:58.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 Processor -- start 2024-04-21T22:36:58.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 0x5643c03aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29241b0ba0 con 0x5643c039e6a0 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f29241b04d0 con 0x5643c039dd80 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29241ad650 con 0x5643c03a7280 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.984+0000 7f292da26740 10 client.0 _ll_register_callbacks cb 0x7f291c009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:58.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2928e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59700/0 (socket says 172.21.15.18:59700) 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 -- 172.21.15.18:0/3508620898 learned_addr learned my addr 172.21.15.18:0/3508620898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923e00640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 0x5643c03aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 -- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 msgr2=0x5643c03aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 -- 172.21.15.18:0/3508620898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 msgr2=0x5643c03aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 0x5643c03aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 -- 172.21.15.18:0/3508620898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c041c210 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923e00640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 0x5643c03aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f2923400640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f29100096c0 tx=0x7f2910009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd78b58629cb6dfc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.985+0000 7f290e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910032060 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f291001c030 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291402e8c0 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2910024d80 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f292da26740 10 client.16098 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5643c041d510 con 0x5643c039e6a0 2024-04-21T22:36:58.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.986+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291402e8c0 con 0x5643c039e6a0 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f291002d4a0 con 0x5643c039e6a0 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 10 client.16098 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 10 client.16098 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 20 client.16098 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c041dd50 0x5643c0420170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 4 client.16098 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643c0309c30 con 0x5643c041dd50 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f2923e00640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c041dd50 0x5643c0420170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:58.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f2923e00640 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c041dd50 0x5643c0420170 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8195688869b01fc6 server_cookie=b081edce0241e9ca in_seq=0 out_seq=0 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.987+0000 7f290e000640 10 client.16098 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f290e000640 1 -- 172.21.15.18:0/3508620898 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643c0309c30 con 0x5643c041dd50 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f290e000640 10 client.16098 handle_command_reply: tid=0 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 client.16098 shutdown 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 msgr2=0x5643c03aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f29100096c0 tx=0x7f2910009260 comp rx=0 tx=0).stop 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 shutdown_connections 2024-04-21T22:36:58.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5643c041dd50 0x5643c0420170 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5643c03a7280 0x5643c03aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5643c039e6a0 0x5643c03aa9a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f290e000640 0 client.16098 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 --2- 172.21.15.18:0/3508620898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5643c039dd80 0x5643c03aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 >> 172.21.15.18:0/3508620898 conn(0x5643c03984b0 msgr2=0x5643c03a4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 shutdown_connections 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 1 -- 172.21.15.18:0/3508620898 wait complete. 2024-04-21T22:36:58.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.988+0000 7f292da26740 20 client.16098 trim_cache size 0 max 16384 2024-04-21T22:36:58.996 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:58.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 msgr2=0x7f29080a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 0x7f29080a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29100094b0 tx=0x7f2910015040 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 msgr2=0x7f292419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 0x7f292419eae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f291c036040 tx=0x7f291c033a20 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 shutdown_connections 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f29080a2d00 0x7f29080a51c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2924109930 0x7f292419eae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29241042e0 0x7f292419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 --2- 172.21.15.18:0/2364666254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2924103920 0x7f292419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:58.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 >> 172.21.15.18:0/2364666254 conn(0x7f29240ff3b0 msgr2=0x7f29240ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:58.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 shutdown_connections 2024-04-21T22:36:58.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:58.989+0000 7f292ae00640 1 -- 172.21.15.18:0/2364666254 wait complete. 2024-04-21T22:36:59.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:36:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 -- 172.21.15.18:0/1783920994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e8810cb40 msgr2=0x7f0e8810cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 --2- 172.21.15.18:0/1783920994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e8810cb40 0x7f0e8810cf20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009900 tx=0x7f0e7802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 -- 172.21.15.18:0/1783920994 shutdown_connections 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 --2- 172.21.15.18:0/1783920994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88108540 0x7f0e88114a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 --2- 172.21.15.18:0/1783920994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e88107b80 0x7f0e88108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 --2- 172.21.15.18:0/1783920994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e8810cb40 0x7f0e8810cf20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 -- 172.21.15.18:0/1783920994 >> 172.21.15.18:0/1783920994 conn(0x7f0e880773d0 msgr2=0x7f0e880797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 -- 172.21.15.18:0/1783920994 shutdown_connections 2024-04-21T22:36:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.221+0000 7f0e8d000640 1 -- 172.21.15.18:0/1783920994 wait complete. 2024-04-21T22:36:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.222+0000 7f0e8d000640 1 Processor -- start 2024-04-21T22:36:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 -- start start 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88107b80 0x7f0e8819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8810cb40 0x7f0e881a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88117fa0 con 0x7f0e88108540 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88117e20 con 0x7f0e88107b80 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e8d000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88118120 con 0x7f0e8810cb40 2024-04-21T22:36:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59708/0 (socket says 172.21.15.18:59708) 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.223+0000 7f0e86a00640 1 -- 172.21.15.18:0/231443127 learned_addr learned my addr 172.21.15.18:0/231443127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e87400640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88107b80 0x7f0e8819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e87e00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8810cb40 0x7f0e881a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 -- 172.21.15.18:0/231443127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8810cb40 msgr2=0x7f0e881a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8810cb40 0x7f0e881a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 -- 172.21.15.18:0/231443127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88107b80 msgr2=0x7f0e8819e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88107b80 0x7f0e8819e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 -- 172.21.15.18:0/231443127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e881a34b0 con 0x7f0e88108540 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.224+0000 7f0e86a00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e9f0 tx=0x7f0e7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.225+0000 7f0e7fe00640 1 -- 172.21.15.18:0/231443127 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400cd80 con 0x7f0e88108540 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.225+0000 7f0e7fe00640 1 -- 172.21.15.18:0/231443127 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e74010910 con 0x7f0e88108540 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.225+0000 7f0e7fe00640 1 -- 172.21.15.18:0/231443127 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74018990 con 0x7f0e88108540 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.225+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e881a37a0 con 0x7f0e88108540 2024-04-21T22:36:59.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.225+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e881ab030 con 0x7f0e88108540 2024-04-21T22:36:59.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.228+0000 7f0e91219740 1 Processor -- start 2024-04-21T22:36:59.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.228+0000 7f0e91219740 1 -- start start 2024-04-21T22:36:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cc8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56cd3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cf56c2c3a0 con 0x55cf56cc7f70 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf56bd4930 con 0x55cf56cc8890 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e91219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cf56c28360 con 0x55cf56cd1470 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e7fe00640 1 -- 172.21.15.18:0/231443127 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f0e74010ac0 con 0x7f0e88108540 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e87400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e87e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cc8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e87400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43214/0 (socket says 172.21.15.18:43214) 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e87400640 1 -- 172.21.15.18:0/2858296637 learned_addr learned my addr 172.21.15.18:0/2858296637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.229+0000 7f0e86a00640 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56cd3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 -- 172.21.15.18:0/2858296637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 msgr2=0x55cf56cd3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56cd3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 -- 172.21.15.18:0/2858296637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 msgr2=0x55cf56cc8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cc8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 -- 172.21.15.18:0/2858296637 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf569403f0 con 0x55cf56cc8890 2024-04-21T22:36:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e87400640 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e78005ab0 tx=0x7f0e78009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3827500059786e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e7cc00640 1 -- 172.21.15.18:0/2858296637 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78043070 con 0x55cf56cc8890 2024-04-21T22:36:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e7cc00640 1 -- 172.21.15.18:0/2858296637 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7802c6f0 con 0x55cf56cc8890 2024-04-21T22:36:59.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.230+0000 7f0e7cc00640 1 -- 172.21.15.18:0/2858296637 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78004ae0 con 0x55cf56cc8890 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e7fe00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 0x7f0e6c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e7fe00640 1 -- 172.21.15.18:0/231443127 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e740cf710 con 0x7f0e88108540 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e87e00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 0x7f0e6c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 -- 172.21.15.18:0/2858296637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 msgr2=0x55cf56cd0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0e78005ab0 tx=0x7f0e78009560 comp rx=0 tx=0).stop 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 -- 172.21.15.18:0/2858296637 shutdown_connections 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56cd3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56cd0f30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 --2- 172.21.15.18:0/2858296637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cc8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 -- 172.21.15.18:0/2858296637 >> 172.21.15.18:0/2858296637 conn(0x55cf56cc26a0 msgr2=0x55cf56cc2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.231+0000 7f0e91219740 1 -- 172.21.15.18:0/2858296637 shutdown_connections 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.232+0000 7f0e91219740 1 -- 172.21.15.18:0/2858296637 wait complete. 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.232+0000 7f0e87e00640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 0x7f0e6c0a5240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e80005fd0 tx=0x7f0e80009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.232+0000 7f0e91219740 1 -- start start 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.232+0000 7f0e91219740 1 Processor -- start 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 0x55cf56cce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cf56cd4200 con 0x55cf56cc8890 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cf56be7d80 con 0x55cf56cd1470 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cf56cd4380 con 0x55cf56cc7f70 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e91219740 10 client.0 _ll_register_callbacks cb 0x55cf56c242b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 0x55cf56cce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e87e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43220/0 (socket says 172.21.15.18:43220) 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 0x55cf56cce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59724/0 (socket says 172.21.15.18:59724) 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e87e00640 1 -- 172.21.15.18:0/134322880 learned_addr learned my addr 172.21.15.18:0/134322880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.233+0000 7f0e87400640 1 -- 172.21.15.18:0/134322880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 msgr2=0x55cf56cceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87400640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87400640 1 -- 172.21.15.18:0/134322880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 msgr2=0x55cf56cce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87400640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 0x55cf56cce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87400640 1 -- 172.21.15.18:0/134322880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf56a0a7d0 con 0x55cf56cc7f70 2024-04-21T22:36:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87e00640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e87400640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cce420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009900 tx=0x7f0e7802cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67761e4d59a7dba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e71600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78043050 con 0x55cf56cc7f70 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e780050e0 con 0x55cf56cc7f70 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.234+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e7802c6f0 con 0x55cf56cc7f70 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e78058050 con 0x55cf56cc7f70 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 10 client.26236 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cf56cd4200 con 0x55cf56cc7f70 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e7802c6f0 con 0x55cf56cc7f70 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f0e78048c70 con 0x55cf56cc7f70 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 10 client.26236 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 10 client.26236 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 20 client.26236 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56ce1650 0x55cf56ce3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 4 client.26236 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.235+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf56c398e0 con 0x55cf56ce1650 2024-04-21T22:36:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.236+0000 7f0e86a00640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56ce1650 0x55cf56ce3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.236+0000 7f0e86a00640 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56ce1650 0x55cf56ce3a40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=171b8c2746af1346 server_cookie=59b74e373c04652b in_seq=0 out_seq=0 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.236+0000 7f0e71600640 10 client.26236 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e71600640 1 -- 172.21.15.18:0/134322880 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf56c398e0 con 0x55cf56ce1650 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e71600640 10 client.26236 handle_command_reply: tid=0 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 client.26236 shutdown 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 msgr2=0x55cf56cce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cce420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009900 tx=0x7f0e7802cb50 comp rx=0 tx=0).stop 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 shutdown_connections 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56ce1650 0x55cf56ce3a40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cd1470 0x55cf56cceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc8890 0x55cf56cce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 --2- 172.21.15.18:0/134322880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cce420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e71600640 0 client.26236 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 >> 172.21.15.18:0/134322880 conn(0x55cf56cc26a0 msgr2=0x55cf56cc43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 shutdown_connections 2024-04-21T22:36:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.237+0000 7f0e91219740 1 -- 172.21.15.18:0/134322880 wait complete. 2024-04-21T22:36:59.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.238+0000 7f0e91219740 20 client.26236 trim_cache size 0 max 16384 2024-04-21T22:36:59.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.252+0000 7f0e91219740 1 Processor -- start 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 -- start start 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cdd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 0x55cf56ce9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b3a00 con 0x55cf56cd1470 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b56c0 con 0x55cf56cc8890 2024-04-21T22:36:59.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e91219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b4190 con 0x55cf56cc7f70 2024-04-21T22:36:59.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e87e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 0x55cf56ce9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cdd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e87e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 0x55cf56ce9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59728/0 (socket says 172.21.15.18:59728) 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e87e00640 1 -- 172.21.15.18:0/568996127 learned_addr learned my addr 172.21.15.18:0/568996127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.253+0000 7f0e86a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 -- 172.21.15.18:0/568996127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 msgr2=0x55cf56cdd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cdd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 -- 172.21.15.18:0/568996127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 msgr2=0x55cf56ce9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 0x55cf56ce9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 -- 172.21.15.18:0/568996127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf56ce3fd0 con 0x55cf56cc8890 2024-04-21T22:36:59.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e87400640 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cdd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e86a00640 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccecc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e740cce00 tx=0x7f0e74018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ded2ab263a2fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e73e00640 1 -- 172.21.15.18:0/568996127 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e740a4840 con 0x55cf56cc8890 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e73e00640 1 -- 172.21.15.18:0/568996127 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e74099f80 con 0x55cf56cc8890 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.254+0000 7f0e73e00640 1 -- 172.21.15.18:0/568996127 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74018b30 con 0x55cf56cc8890 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 -- 172.21.15.18:0/568996127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 msgr2=0x55cf56ccecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccecc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e740cce00 tx=0x7f0e74018420 comp rx=0 tx=0).stop 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 -- 172.21.15.18:0/568996127 shutdown_connections 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cd1470 0x55cf56ce9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccecc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 --2- 172.21.15.18:0/568996127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cc7f70 0x55cf56cdd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 -- 172.21.15.18:0/568996127 >> 172.21.15.18:0/568996127 conn(0x55cf56cc26a0 msgr2=0x55cf56cc1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 -- 172.21.15.18:0/568996127 shutdown_connections 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.255+0000 7f0e91219740 1 -- 172.21.15.18:0/568996127 wait complete. 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 -- start start 2024-04-21T22:36:59.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 Processor -- start 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56ccb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b4f30 con 0x55cf56cc7f70 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b4860 con 0x55cf56cc8890 2024-04-21T22:36:59.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881b19e0 con 0x55cf56cd1470 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.256+0000 7f0e91219740 10 client.0 _ll_register_callbacks cb 0x7f0e80009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59732/0 (socket says 172.21.15.18:59732) 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 -- 172.21.15.18:0/2772587222 learned_addr learned my addr 172.21.15.18:0/2772587222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87e00640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56ccb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e86a00640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 -- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 msgr2=0x55cf56ccb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56ccb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 -- 172.21.15.18:0/2772587222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 msgr2=0x55cf56ccac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 -- 172.21.15.18:0/2772587222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf56cc7da0 con 0x55cf56cc7f70 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e86a00640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e87400640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e7802c2e0 tx=0x7f0e78005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c438f4175d61ad69 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.257+0000 7f0e71600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78043040 con 0x55cf56cc7f70 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0e7803fc70 con 0x55cf56cc7f70 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e74099f80 con 0x55cf56cc7f70 2024-04-21T22:36:59.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e7803f7e0 con 0x55cf56cc7f70 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 10 client.16116 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cf56d476f0 con 0x55cf56cc7f70 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e74099f80 con 0x55cf56cc7f70 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f0e78004ee0 con 0x55cf56cc7f70 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 10 client.16116 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 10 client.16116 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 20 client.16116 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56d47db0 0x55cf56d4a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 4 client.16116 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.258+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf56c33c30 con 0x55cf56d47db0 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.259+0000 7f0e86a00640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56d47db0 0x55cf56d4a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.259+0000 7f0e86a00640 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56d47db0 0x55cf56d4a1a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=249b6f761ef842f5 server_cookie=33d4a89fcdc356b7 in_seq=0 out_seq=0 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.259+0000 7f0e71600640 10 client.16116 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.259+0000 7f0e71600640 1 -- 172.21.15.18:0/2772587222 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf56c33c30 con 0x55cf56d47db0 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.259+0000 7f0e71600640 10 client.16116 handle_command_reply: tid=0 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 client.16116 shutdown 2024-04-21T22:36:59.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 msgr2=0x55cf56cd9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e7802c2e0 tx=0x7f0e78005cb0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 shutdown_connections 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cf56d47db0 0x55cf56d4a1a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf56cd1470 0x55cf56ccb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cf56cc8890 0x55cf56ccac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 --2- 172.21.15.18:0/2772587222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf56cc7f70 0x55cf56cd9890 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 >> 172.21.15.18:0/2772587222 conn(0x55cf56cc26a0 msgr2=0x55cf56cc36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e71600640 0 client.16116 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:36:59.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 shutdown_connections 2024-04-21T22:36:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 1 -- 172.21.15.18:0/2772587222 wait complete. 2024-04-21T22:36:59.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.260+0000 7f0e91219740 20 client.16116 trim_cache size 0 max 16384 2024-04-21T22:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 msgr2=0x7f0e6c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 0x7f0e6c0a5240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e80005fd0 tx=0x7f0e80009500 comp rx=0 tx=0).stop 2024-04-21T22:36:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 msgr2=0x7f0e8819ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e9f0 tx=0x7f0e7400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 shutdown_connections 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f0e6c0a2d80 0x7f0e6c0a5240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8810cb40 0x7f0e881a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e88108540 0x7f0e8819ea00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 --2- 172.21.15.18:0/231443127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e88107b80 0x7f0e8819e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 >> 172.21.15.18:0/231443127 conn(0x7f0e880773d0 msgr2=0x7f0e88077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 shutdown_connections 2024-04-21T22:36:59.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.261+0000 7f0e8d000640 1 -- 172.21.15.18:0/231443127 wait complete. 2024-04-21T22:36:59.276 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:36:59 smithi018 ceph-mon[26614]: pgmap v91: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-04-21T22:36:59.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:36:59.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 -- 172.21.15.18:0/488692848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe494108640 msgr2=0x7fe4941149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 --2- 172.21.15.18:0/488692848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe494108640 0x7fe4941149c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009ca0 tx=0x7fe48c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 -- 172.21.15.18:0/488692848 shutdown_connections 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 --2- 172.21.15.18:0/488692848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe494108640 0x7fe4941149c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 --2- 172.21.15.18:0/488692848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe494108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 --2- 172.21.15.18:0/488692848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe49410dc00 0x7fe49410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 -- 172.21.15.18:0/488692848 >> 172.21.15.18:0/488692848 conn(0x7fe494077550 msgr2=0x7fe494106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 -- 172.21.15.18:0/488692848 shutdown_connections 2024-04-21T22:36:59.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.472+0000 7fe498a00640 1 -- 172.21.15.18:0/488692848 wait complete. 2024-04-21T22:36:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.473+0000 7fe498a00640 1 Processor -- start 2024-04-21T22:36:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.473+0000 7fe498a00640 1 -- start start 2024-04-21T22:36:59.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe49419e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494108640 0x7fe49419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe494117f40 con 0x7fe49410dc00 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe494117dc0 con 0x7fe494108640 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe498a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941180c0 con 0x7fe494107c80 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe493200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe492800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe49419e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe493200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59764/0 (socket says 172.21.15.18:59764) 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe493200640 1 -- 172.21.15.18:0/2291366139 learned_addr learned my addr 172.21.15.18:0/2291366139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.474+0000 7fe489e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494108640 0x7fe49419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 -- 172.21.15.18:0/2291366139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 msgr2=0x7fe49419e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe49419e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 -- 172.21.15.18:0/2291366139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494108640 msgr2=0x7fe49419e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494108640 0x7fe49419e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 -- 172.21.15.18:0/2291366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4941a3320 con 0x7fe49410dc00 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe492800640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe49419e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe493200640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe48c037040 tx=0x7fe48c032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe48be00640 1 -- 172.21.15.18:0/2291366139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c042020 con 0x7fe49410dc00 2024-04-21T22:36:59.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe48be00640 1 -- 172.21.15.18:0/2291366139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c034640 con 0x7fe49410dc00 2024-04-21T22:36:59.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4941a35b0 con 0x7fe49410dc00 2024-04-21T22:36:59.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe48be00640 1 -- 172.21.15.18:0/2291366139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c039040 con 0x7fe49410dc00 2024-04-21T22:36:59.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.475+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4941aaea0 con 0x7fe49410dc00 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 Processor -- start 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe48be00640 1 -- 172.21.15.18:0/2291366139 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe48c045020 con 0x7fe49410dc00 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 -- start start 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f72350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f7d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556762ed63a0 con 0x556762f7b470 2024-04-21T22:36:59.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556762e7e930 con 0x556762f71f70 2024-04-21T22:36:59.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.479+0000 7fe49c055740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556762ed2360 con 0x556762f72890 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe489e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f7d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe489e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f72350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40392/0 (socket says 172.21.15.18:40392) 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 -- 172.21.15.18:0/869193262 learned_addr learned my addr 172.21.15.18:0/869193262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 -- 172.21.15.18:0/869193262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 msgr2=0x556762f72350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f72350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 -- 172.21.15.18:0/869193262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 msgr2=0x556762f7d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f7d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe48be00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 0x7fe4780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 -- 172.21.15.18:0/869193262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556762bea3f0 con 0x556762f72890 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe489e00640 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f72350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe48be00640 1 -- 172.21.15.18:0/2291366139 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe48c0f0ed0 con 0x7fe49410dc00 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe493200640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 0x7fe4780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.480+0000 7fe492800640 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe484011540 tx=0x7fe484011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37451a90d6929ce8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.481+0000 7fe483400640 1 -- 172.21.15.18:0/869193262 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48400f640 con 0x556762f72890 2024-04-21T22:36:59.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.481+0000 7fe483400640 1 -- 172.21.15.18:0/869193262 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48400fcc0 con 0x556762f72890 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.481+0000 7fe483400640 1 -- 172.21.15.18:0/869193262 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484019d30 con 0x556762f72890 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- 172.21.15.18:0/869193262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 msgr2=0x556762f7af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe493200640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 0x7fe4780a51c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0b9960 tx=0x7fe48c0095c0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe484011540 tx=0x7fe484011a00 comp rx=0 tx=0).stop 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- 172.21.15.18:0/869193262 shutdown_connections 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f7d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f7af30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 --2- 172.21.15.18:0/869193262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f72350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- 172.21.15.18:0/869193262 >> 172.21.15.18:0/869193262 conn(0x556762f6c6a0 msgr2=0x556762f6ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- 172.21.15.18:0/869193262 shutdown_connections 2024-04-21T22:36:59.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- 172.21.15.18:0/869193262 wait complete. 2024-04-21T22:36:59.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 -- start start 2024-04-21T22:36:59.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.482+0000 7fe49c055740 1 Processor -- start 2024-04-21T22:36:59.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f7b470 0x556762f78f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556762f7e260 con 0x556762f72890 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556762e91d80 con 0x556762f71f70 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556762f7e3e0 con 0x556762f7b470 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe49c055740 10 client.0 _ll_register_callbacks cb 0x556762ece2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe492800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe492800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59784/0 (socket says 172.21.15.18:59784) 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe492800640 1 -- 172.21.15.18:0/1385855884 learned_addr learned my addr 172.21.15.18:0/1385855884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.483+0000 7fe489e00640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f7b470 0x556762f78f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe489e00640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 -- 172.21.15.18:0/1385855884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f7b470 msgr2=0x556762f78f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f7b470 0x556762f78f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 -- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 msgr2=0x556762f784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 -- 172.21.15.18:0/1385855884 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556762cb47d0 con 0x556762f72890 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe492800640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe48401b040 tx=0x7fe484005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea23298e2c716f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe477e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:36:59.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.484+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484026020 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe48400f850 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe48400fcc0 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe484031050 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe49c055740 10 client.16128 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556762f8a560 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48400fcc0 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.485+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fe4840046c0 con 0x556762f72890 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 10 client.16128 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:59.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 20 client.16128 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762f8ba20 0x556762f8de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 4 client.16128 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556762ee38e0 con 0x556762f8ba20 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe489e00640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762f8ba20 0x556762f8de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.486+0000 7fe489e00640 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762f8ba20 0x556762f8de10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767e494860030a3f server_cookie=de2eb0149d9d1977 in_seq=0 out_seq=0 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.487+0000 7fe477e00640 10 client.16128 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.487+0000 7fe477e00640 1 -- 172.21.15.18:0/1385855884 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556762ee38e0 con 0x556762f8ba20 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.487+0000 7fe477e00640 10 client.16128 handle_command_reply: tid=0 2024-04-21T22:36:59.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.487+0000 7fe49c055740 1 client.16128 shutdown 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 msgr2=0x556762f78a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe48401b040 tx=0x7fe484005d30 comp rx=0 tx=0).stop 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 shutdown_connections 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762f8ba20 0x556762f8de10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f7b470 0x556762f78f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f72890 0x556762f78a10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 --2- 172.21.15.18:0/1385855884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe477e00640 0 client.16128 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:59.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 >> 172.21.15.18:0/1385855884 conn(0x556762f6c6a0 msgr2=0x556762f6e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 shutdown_connections 2024-04-21T22:36:59.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 1 -- 172.21.15.18:0/1385855884 wait complete. 2024-04-21T22:36:59.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.488+0000 7fe49c055740 20 client.16128 trim_cache size 0 max 16384 2024-04-21T22:36:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 Processor -- start 2024-04-21T22:36:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 -- start start 2024-04-21T22:36:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f7ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f87150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f6e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b3830 con 0x556762f7b470 2024-04-21T22:36:59.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b54f0 con 0x556762f71f70 2024-04-21T22:36:59.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.503+0000 7fe49c055740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b3fc0 con 0x556762f72890 2024-04-21T22:36:59.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe489e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f6e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe489e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f7ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f87150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe489e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f7ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43290/0 (socket says 172.21.15.18:43290) 2024-04-21T22:36:59.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe489e00640 1 -- 172.21.15.18:0/4129253296 learned_addr learned my addr 172.21.15.18:0/4129253296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 -- 172.21.15.18:0/4129253296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 msgr2=0x556762f7ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f7ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 -- 172.21.15.18:0/4129253296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 msgr2=0x556762f6e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f6e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 -- 172.21.15.18:0/4129253296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556762f7e140 con 0x556762f72890 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.504+0000 7fe492800640 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f87150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe484011a40 tx=0x7fe484011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83d84f39cd3c2a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe482a00640 1 -- 172.21.15.18:0/4129253296 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484026070 con 0x556762f72890 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe482a00640 1 -- 172.21.15.18:0/4129253296 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe484015030 con 0x556762f72890 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe482a00640 1 -- 172.21.15.18:0/4129253296 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484005280 con 0x556762f72890 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 -- 172.21.15.18:0/4129253296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 msgr2=0x556762f87150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f87150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe484011a40 tx=0x7fe484011440 comp rx=0 tx=0).stop 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 -- 172.21.15.18:0/4129253296 shutdown_connections 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f6e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f72890 0x556762f87150 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 --2- 172.21.15.18:0/4129253296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f71f70 0x556762f7ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 -- 172.21.15.18:0/4129253296 >> 172.21.15.18:0/4129253296 conn(0x556762f6c6a0 msgr2=0x556762f6daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 -- 172.21.15.18:0/4129253296 shutdown_connections 2024-04-21T22:36:59.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.505+0000 7fe49c055740 1 -- 172.21.15.18:0/4129253296 wait complete. 2024-04-21T22:36:59.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.506+0000 7fe49c055740 1 -- start start 2024-04-21T22:36:59.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.506+0000 7fe49c055740 1 Processor -- start 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.506+0000 7fe49c055740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f71f70 0x556762f750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f75b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b4d60 con 0x556762f7b470 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b4690 con 0x556762f72890 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4941b1810 con 0x556762f71f70 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe49c055740 10 client.0 _ll_register_callbacks cb 0x7fe47c009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:36:59.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe489e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f71f70 0x556762f750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43298/0 (socket says 172.21.15.18:43298) 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 -- 172.21.15.18:0/1894439087 learned_addr learned my addr 172.21.15.18:0/1894439087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe489e00640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f75b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 -- 172.21.15.18:0/1894439087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f71f70 msgr2=0x556762f750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f71f70 0x556762f750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 -- 172.21.15.18:0/1894439087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 msgr2=0x556762f75b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f75b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.507+0000 7fe492800640 1 -- 172.21.15.18:0/1894439087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556762ff0e50 con 0x556762f72890 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe492800640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe48401b010 tx=0x7fe484019910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f528199462b64a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe477e00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484026070 con 0x556762f72890 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe484015030 con 0x556762f72890 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe48400fa50 con 0x556762f72890 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe48400fc70 con 0x556762f72890 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe49c055740 10 client.26225 fetch_fsmap learned FSMap version 32 2024-04-21T22:36:59.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556762ff2080 con 0x556762f72890 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.508+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe484015030 con 0x556762f72890 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fe4840035f0 con 0x556762f72890 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 10 client.26225 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 10 client.26225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 20 client.26225 populate_metadata read hostname 'smithi018' 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762ff27d0 0x556762ff4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 4 client.26225 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:36:59.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556762eddc30 con 0x556762ff27d0 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe489e00640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762ff27d0 0x556762ff4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe489e00640 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762ff27d0 0x556762ff4bf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66291f2492d45f16 server_cookie=fe5c94de66f4badd in_seq=0 out_seq=0 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.509+0000 7fe477e00640 10 client.26225 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe477e00640 1 -- 172.21.15.18:0/1894439087 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556762eddc30 con 0x556762ff27d0 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe477e00640 10 client.26225 handle_command_reply: tid=0 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 client.26225 shutdown 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 msgr2=0x556762f75600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe48401b010 tx=0x7fe484019910 comp rx=0 tx=0).stop 2024-04-21T22:36:59.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 shutdown_connections 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556762f7b470 0x556762f75b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556762f72890 0x556762f75600 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556762ff27d0 0x556762ff4bf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 --2- 172.21.15.18:0/1894439087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556762f71f70 0x556762f750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 >> 172.21.15.18:0/1894439087 conn(0x556762f6c6a0 msgr2=0x556762f78d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe477e00640 0 client.26225 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 shutdown_connections 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 1 -- 172.21.15.18:0/1894439087 wait complete. 2024-04-21T22:36:59.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.510+0000 7fe49c055740 20 client.26225 trim_cache size 0 max 16384 2024-04-21T22:36:59.518 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 msgr2=0x7fe4780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 0x7fe4780a51c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0b9960 tx=0x7fe48c0095c0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 msgr2=0x7fe4941a2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe48c037040 tx=0x7fe48c032ea0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 shutdown_connections 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe4780a2d00 0x7fe4780a51c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe49410dc00 0x7fe4941a2bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe494108640 0x7fe49419e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 --2- 172.21.15.18:0/2291366139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe494107c80 0x7fe49419e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:36:59.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 >> 172.21.15.18:0/2291366139 conn(0x7fe494077550 msgr2=0x7fe494078490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:36:59.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 shutdown_connections 2024-04-21T22:36:59.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:36:59.511+0000 7fe498a00640 1 -- 172.21.15.18:0/2291366139 wait complete. 2024-04-21T22:36:59.539 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:36:59 smithi081 ceph-mon[31692]: pgmap v91: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-04-21T22:36:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:36:59 smithi047 ceph-mon[31561]: pgmap v91: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-04-21T22:37:00.529 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:37:00.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:37:00.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:37:00.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 -- 172.21.15.18:0/1360169963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc564074490 msgr2=0x7fc56410d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 --2- 172.21.15.18:0/1360169963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc564074490 0x7fc56410d840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc550009900 tx=0x7fc55002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 -- 172.21.15.18:0/1360169963 shutdown_connections 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 --2- 172.21.15.18:0/1360169963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56410dd80 0x7fc5641101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 --2- 172.21.15.18:0/1360169963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc564074490 0x7fc56410d840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 --2- 172.21.15.18:0/1360169963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 0x7fc564073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 -- 172.21.15.18:0/1360169963 >> 172.21.15.18:0/1360169963 conn(0x7fc5640fd050 msgr2=0x7fc5640ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 -- 172.21.15.18:0/1360169963 shutdown_connections 2024-04-21T22:37:00.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.729+0000 7fc568e00640 1 -- 172.21.15.18:0/1360169963 wait complete. 2024-04-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.730+0000 7fc568e00640 1 Processor -- start 2024-04-21T22:37:00.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.730+0000 7fc568e00640 1 -- start start 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 0x7fc56419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56410dd80 0x7fc56419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc564113ae0 con 0x7fc56410dd80 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc564113960 con 0x7fc564074490 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc568e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc564113c60 con 0x7fc564073b70 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc562a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc562a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43312/0 (socket says 172.21.15.18:43312) 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc562a00640 1 -- 172.21.15.18:0/3869159008 learned_addr learned my addr 172.21.15.18:0/3869159008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc563400640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 0x7fc56419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.731+0000 7fc563e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56410dd80 0x7fc56419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 -- 172.21.15.18:0/3869159008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 msgr2=0x7fc56419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 0x7fc56419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 -- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56410dd80 msgr2=0x7fc56419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56410dd80 0x7fc56419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 -- 172.21.15.18:0/3869159008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56419f0b0 con 0x7fc564074490 2024-04-21T22:37:00.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.732+0000 7fc562a00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc550005940 tx=0x7fc55002cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.733+0000 7fc55be00640 1 -- 172.21.15.18:0/3869159008 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550041070 con 0x7fc564074490 2024-04-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.733+0000 7fc55be00640 1 -- 172.21.15.18:0/3869159008 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc550004450 con 0x7fc564074490 2024-04-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.733+0000 7fc55be00640 1 -- 172.21.15.18:0/3869159008 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550003d80 con 0x7fc564074490 2024-04-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.733+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56419f340 con 0x7fc564074490 2024-04-21T22:37:00.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.733+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5641a6c30 con 0x7fc564074490 2024-04-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.736+0000 7fc56d00d740 1 Processor -- start 2024-04-21T22:37:00.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.736+0000 7fc56d00d740 1 -- start start 2024-04-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.736+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.736+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d8978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d89a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc56d00d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56037d7ecdf0 con 0x56037d88e8e0 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc55be00640 1 -- 172.21.15.18:0/3869159008 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc550044070 con 0x7fc564074490 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc56d00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56037d7f2040 con 0x56037d88f200 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc56d00d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56037d79a8c0 con 0x56037d897de0 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59822/0 (socket says 172.21.15.18:59822) 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 -- 172.21.15.18:0/466355126 learned_addr learned my addr 172.21.15.18:0/466355126 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:00.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc562a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d89a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563400640 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d8978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 -- 172.21.15.18:0/466355126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 msgr2=0x56037d89a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d89a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 -- 172.21.15.18:0/466355126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 msgr2=0x56037d8978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d8978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563e00640 1 -- 172.21.15.18:0/466355126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037d5ce7e0 con 0x56037d88e8e0 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.737+0000 7fc563400640 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d8978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:00.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.738+0000 7fc563e00640 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009c20 tx=0x7fc55c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e2ede481550486 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.738+0000 7fc558c00640 1 -- 172.21.15.18:0/466355126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c01e070 con 0x56037d88e8e0 2024-04-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.738+0000 7fc558c00640 1 -- 172.21.15.18:0/466355126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c019b10 con 0x56037d88e8e0 2024-04-21T22:37:00.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.738+0000 7fc558c00640 1 -- 172.21.15.18:0/466355126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00eae0 con 0x56037d88e8e0 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 -- 172.21.15.18:0/466355126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 msgr2=0x56037d88ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009c20 tx=0x7fc55c011810 comp rx=0 tx=0).stop 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc55be00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 0x7fc5480a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc55be00640 1 -- 172.21.15.18:0/3869159008 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc5500f0e30 con 0x7fc564074490 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 -- 172.21.15.18:0/466355126 shutdown_connections 2024-04-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d89a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d8978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 --2- 172.21.15.18:0/466355126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d88ecc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc56d00d740 1 -- 172.21.15.18:0/466355126 >> 172.21.15.18:0/466355126 conn(0x56037d889010 msgr2=0x56037d8893f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.739+0000 7fc563e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 0x7fc5480a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.740+0000 7fc56d00d740 1 -- 172.21.15.18:0/466355126 shutdown_connections 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.740+0000 7fc56d00d740 1 -- 172.21.15.18:0/466355126 wait complete. 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.740+0000 7fc563e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 0x7fc5480a51c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009a30 tx=0x7fc55c000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 -- start start 2024-04-21T22:37:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 Processor -- start 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d895900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56037d7add20 con 0x56037d88f200 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56037d7ee000 con 0x56037d897de0 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56037d89abd0 con 0x56037d88e8e0 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.741+0000 7fc56d00d740 10 client.0 _ll_register_callbacks cb 0x56037d7e90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:00.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40460/0 (socket says 172.21.15.18:40460) 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 -- 172.21.15.18:0/4089787013 learned_addr learned my addr 172.21.15.18:0/4089787013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563e00640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d895900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc562a00640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 -- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 msgr2=0x56037d895900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d895900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 -- 172.21.15.18:0/4089787013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 msgr2=0x56037d8953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 -- 172.21.15.18:0/4089787013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037d62ef70 con 0x56037d88e8e0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563e00640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d895900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc563400640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc554011d10 tx=0x7fc55400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13aeb100151658a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.742+0000 7fc54d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554004b20 con 0x56037d88e8e0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc55c019b10 con 0x56037d88e8e0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc554003970 con 0x56037d88e8e0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc554003bb0 con 0x56037d88e8e0 2024-04-21T22:37:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc56d00d740 10 client.26272 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56037d4c6170 con 0x56037d88e8e0 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c019b10 con 0x56037d88e8e0 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fc554022670 con 0x56037d88e8e0 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc56d00d740 10 client.26272 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.743+0000 7fc56d00d740 10 client.26272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.744+0000 7fc56d00d740 20 client.26272 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.744+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d8a8100 0x56037d8aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.744+0000 7fc56d00d740 4 client.26272 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.744+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56037d7ff580 con 0x56037d8a8100 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.744+0000 7fc562a00640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d8a8100 0x56037d8aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.745+0000 7fc562a00640 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d8a8100 0x56037d8aa570 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d8fba90d805e9f4 server_cookie=3fb1d4c7694a5ccd in_seq=0 out_seq=0 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.745+0000 7fc54d600640 10 client.26272 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.745+0000 7fc54d600640 1 -- 172.21.15.18:0/4089787013 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56037d7ff580 con 0x56037d8a8100 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.745+0000 7fc54d600640 10 client.26272 handle_command_reply: tid=0 2024-04-21T22:37:00.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 client.26272 shutdown 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 msgr2=0x56037d894e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc554011d10 tx=0x7fc55400f790 comp rx=0 tx=0).stop 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 shutdown_connections 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d895900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d8a8100 0x56037d8aa570 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 --2- 172.21.15.18:0/4089787013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d894e80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 >> 172.21.15.18:0/4089787013 conn(0x56037d889010 msgr2=0x56037d88ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc54d600640 0 client.26272 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 shutdown_connections 2024-04-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 1 -- 172.21.15.18:0/4089787013 wait complete. 2024-04-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.746+0000 7fc56d00d740 20 client.26272 trim_cache size 0 max 16384 2024-04-21T22:37:00.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 Processor -- start 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 -- start start 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d8975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8a3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641af570 con 0x56037d88f200 2024-04-21T22:37:00.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641b1230 con 0x56037d897de0 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.766+0000 7fc56d00d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641afd00 con 0x56037d88e8e0 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc562a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43340/0 (socket says 172.21.15.18:43340) 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 -- 172.21.15.18:0/3531550302 learned_addr learned my addr 172.21.15.18:0/3531550302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563400640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d8975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 -- 172.21.15.18:0/3531550302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 msgr2=0x56037d8975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d8975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 -- 172.21.15.18:0/3531550302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 msgr2=0x56037d8a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 -- 172.21.15.18:0/3531550302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037d8933d0 con 0x56037d897de0 2024-04-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563400640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d8975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:00.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc562a00640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.767+0000 7fc563e00640 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc55c01c040 tx=0x7fc55c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82d4c556b27ea03f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.768+0000 7fc54fe00640 1 -- 172.21.15.18:0/3531550302 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c026040 con 0x56037d897de0 2024-04-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.768+0000 7fc54fe00640 1 -- 172.21.15.18:0/3531550302 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c019910 con 0x56037d897de0 2024-04-21T22:37:00.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.768+0000 7fc54fe00640 1 -- 172.21.15.18:0/3531550302 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c004c50 con 0x56037d897de0 2024-04-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.768+0000 7fc56d00d740 1 -- 172.21.15.18:0/3531550302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 msgr2=0x56037d88ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.768+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc55c01c040 tx=0x7fc55c011810 comp rx=0 tx=0).stop 2024-04-21T22:37:00.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 -- 172.21.15.18:0/3531550302 shutdown_connections 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d897de0 0x56037d88ab50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88f200 0x56037d8a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3531550302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d88e8e0 0x56037d8975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 -- 172.21.15.18:0/3531550302 >> 172.21.15.18:0/3531550302 conn(0x56037d889010 msgr2=0x56037d88a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 -- 172.21.15.18:0/3531550302 shutdown_connections 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 -- 172.21.15.18:0/3531550302 wait complete. 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 -- start start 2024-04-21T22:37:00.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.769+0000 7fc56d00d740 1 Processor -- start 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d89c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d9077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641b0aa0 con 0x56037d88e8e0 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641b03d0 con 0x56037d88f200 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5641ad550 con 0x56037d897de0 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc56d00d740 10 client.0 _ll_register_callbacks cb 0x7fc554009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59854/0 (socket says 172.21.15.18:59854) 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 -- 172.21.15.18:0/3749150654 learned_addr learned my addr 172.21.15.18:0/3749150654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563e00640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d9077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc562a00640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d89c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 -- 172.21.15.18:0/3749150654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 msgr2=0x56037d9077a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d9077a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 -- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 msgr2=0x56037d89c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d89c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.770+0000 7fc563400640 1 -- 172.21.15.18:0/3749150654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037d907de0 con 0x56037d88e8e0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc563400640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc554011ce0 tx=0x7fc55401a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9012f90a5aeebbdd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc54d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55401a710 con 0x56037d88e8e0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc55401a8b0 con 0x56037d88e8e0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc55c019910 con 0x56037d88e8e0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc554038050 con 0x56037d88e8e0 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc56d00d740 10 client.16152 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:00.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.771+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56037d90f190 con 0x56037d88e8e0 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c019910 con 0x56037d88e8e0 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fc5540054e0 con 0x56037d88e8e0 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 10 client.16152 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 20 client.16152 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d90f9f0 0x56037d911e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 4 client.16152 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:37:00.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56037d7f98d0 con 0x56037d90f9f0 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.772+0000 7fc562a00640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d90f9f0 0x56037d911e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.773+0000 7fc562a00640 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d90f9f0 0x56037d911e10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da1e885f2c9fba55 server_cookie=f42859c4b99d8e87 in_seq=0 out_seq=0 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.773+0000 7fc54d600640 10 client.16152 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.774+0000 7fc54d600640 1 -- 172.21.15.18:0/3749150654 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56037d7f98d0 con 0x56037d90f9f0 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.774+0000 7fc54d600640 10 client.16152 handle_command_reply: tid=0 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.774+0000 7fc56d00d740 1 client.16152 shutdown 2024-04-21T22:37:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 msgr2=0x56037d89c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc554011ce0 tx=0x7fc55401a410 comp rx=0 tx=0).stop 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 shutdown_connections 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56037d90f9f0 0x56037d911e10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56037d897de0 0x56037d9077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56037d88f200 0x56037d89c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 --2- 172.21.15.18:0/3749150654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56037d88e8e0 0x56037d89c110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 >> 172.21.15.18:0/3749150654 conn(0x56037d889010 msgr2=0x56037d88acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc54d600640 0 client.16152 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 shutdown_connections 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 1 -- 172.21.15.18:0/3749150654 wait complete. 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.775+0000 7fc56d00d740 20 client.16152 trim_cache size 0 max 16384 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:37:00.783 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "fc17ed25-62bc-4952-92a1-53ec6e810216", 2024-04-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:37:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 msgr2=0x7fc5480a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 0x7fc5480a51c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009a30 tx=0x7fc55c000bc0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 msgr2=0x7fc56419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc550005940 tx=0x7fc55002cbd0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 shutdown_connections 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc5480a2d00 0x7fc5480a51c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56410dd80 0x7fc56419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc564074490 0x7fc56419a650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 --2- 172.21.15.18:0/3869159008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc564073b70 0x7fc56419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 >> 172.21.15.18:0/3869159008 conn(0x7fc5640fd050 msgr2=0x7fc5640fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 shutdown_connections 2024-04-21T22:37:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:00.776+0000 7fc568e00640 1 -- 172.21.15.18:0/3869159008 wait complete. 2024-04-21T22:37:00.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:37:00.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 -- 172.21.15.18:0/1961859093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108f40 msgr2=0x7f260c114a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 --2- 172.21.15.18:0/1961859093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108f40 0x7f260c114a50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2604009cd0 tx=0x7f260402c0e0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 -- 172.21.15.18:0/1961859093 shutdown_connections 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 --2- 172.21.15.18:0/1961859093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108f40 0x7f260c114a50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 --2- 172.21.15.18:0/1961859093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c108580 0x7f260c108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 --2- 172.21.15.18:0/1961859093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c10cbc0 0x7f260c10cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 -- 172.21.15.18:0/1961859093 >> 172.21.15.18:0/1961859093 conn(0x7f260c077190 msgr2=0x7f260c0795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 -- 172.21.15.18:0/1961859093 shutdown_connections 2024-04-21T22:37:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.024+0000 7f2612c00640 1 -- 172.21.15.18:0/1961859093 wait complete. 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.025+0000 7f2612c00640 1 Processor -- start 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.025+0000 7f2612c00640 1 -- start start 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c108f40 0x7f260c19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 0x7f260c1a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f260c117fa0 con 0x7f260c108f40 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f260c117e20 con 0x7f260c10cbc0 2024-04-21T22:37:01.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f260c118120 con 0x7f260c108580 2024-04-21T22:37:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2611800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2611800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40484/0 (socket says 172.21.15.18:40484) 2024-04-21T22:37:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2611800640 1 -- 172.21.15.18:0/3197702254 learned_addr learned my addr 172.21.15.18:0/3197702254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2610e00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c108f40 0x7f260c19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.026+0000 7f2612200640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 0x7f260c1a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 -- 172.21.15.18:0/3197702254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 msgr2=0x7f260c1a2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 0x7f260c1a2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 -- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c108f40 msgr2=0x7f260c19e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c108f40 0x7f260c19e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 -- 172.21.15.18:0/3197702254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c1a3390 con 0x7f260c108580 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2612200640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 0x7f260c1a2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2611800640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f260000e9f0 tx=0x7f260000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f260a000640 1 -- 172.21.15.18:0/3197702254 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260000cd80 con 0x7f260c108580 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f260a000640 1 -- 172.21.15.18:0/3197702254 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2600010910 con 0x7f260c108580 2024-04-21T22:37:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f260a000640 1 -- 172.21.15.18:0/3197702254 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26000188f0 con 0x7f260c108580 2024-04-21T22:37:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.027+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c1a3680 con 0x7f260c108580 2024-04-21T22:37:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.028+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1aaf10 con 0x7f260c108580 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 Processor -- start 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 -- start start 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f260a000640 1 -- 172.21.15.18:0/3197702254 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2600010ac0 con 0x7f260c108580 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c9865a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c9865fb0 0x55d4c98683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d4c97c0410 con 0x55d4c985d3d0 2024-04-21T22:37:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4c97687e0 con 0x55d4c9865fb0 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.033+0000 7f2616e83740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d4c97bc3d0 con 0x55d4c985cab0 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40494/0 (socket says 172.21.15.18:40494) 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 -- 172.21.15.18:0/3817890592 learned_addr learned my addr 172.21.15.18:0/3817890592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2611800640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c9865a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2610e00640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c9865fb0 0x55d4c98683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 -- 172.21.15.18:0/3817890592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c9865fb0 msgr2=0x55d4c98683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c9865fb0 0x55d4c98683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 -- 172.21.15.18:0/3817890592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 msgr2=0x55d4c9865a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c9865a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2612200640 1 -- 172.21.15.18:0/3817890592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c959e7d0 con 0x55d4c985cab0 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.034+0000 7f2611800640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c9865a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.035+0000 7f2612200640 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2604004af0 tx=0x7f26040323d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79b71fb9e467551 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.035+0000 7f260a000640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 0x7f25f40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.035+0000 7f25fea00640 1 -- 172.21.15.18:0/3817890592 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604039050 con 0x55d4c985cab0 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.035+0000 7f25fea00640 1 -- 172.21.15.18:0/3817890592 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2604045070 con 0x55d4c985cab0 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.036+0000 7f260a000640 1 -- 172.21.15.18:0/3197702254 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f26000cf8b0 con 0x7f260c108580 2024-04-21T22:37:01.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.036+0000 7f25fea00640 1 -- 172.21.15.18:0/3817890592 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604004040 con 0x55d4c985cab0 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.036+0000 7f2611800640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 0x7f25f40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.036+0000 7f2616e83740 1 -- 172.21.15.18:0/3817890592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 msgr2=0x55d4c985ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.036+0000 7f2616e83740 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2604004af0 tx=0x7f26040323d0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 -- 172.21.15.18:0/3817890592 shutdown_connections 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c9865fb0 0x55d4c98683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c9865a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 --2- 172.21.15.18:0/3817890592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985cab0 0x55d4c985ce90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 -- 172.21.15.18:0/3817890592 >> 172.21.15.18:0/3817890592 conn(0x55d4c98571e0 msgr2=0x55d4c98575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2611800640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 0x7f25f40a51c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26000cd0b0 tx=0x7f26000d5550 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 -- 172.21.15.18:0/3817890592 shutdown_connections 2024-04-21T22:37:01.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 -- 172.21.15.18:0/3817890592 wait complete. 2024-04-21T22:37:01.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.037+0000 7f2616e83740 1 -- start start 2024-04-21T22:37:01.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 Processor -- start 2024-04-21T22:37:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c9863090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c98635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d4c9868d40 con 0x55d4c985d3d0 2024-04-21T22:37:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d4c977bc40 con 0x55d4c985cab0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d4c9868ec0 con 0x55d4c9865fb0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.038+0000 7f2616e83740 10 client.0 _ll_register_callbacks cb 0x55d4c977b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40500/0 (socket says 172.21.15.18:40500) 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 -- 172.21.15.18:0/3402277439 learned_addr learned my addr 172.21.15.18:0/3402277439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c9863090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2610e00640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c98635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 -- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 msgr2=0x55d4c9863090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c9863090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 -- 172.21.15.18:0/3402277439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 msgr2=0x55d4c98635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c98635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.039+0000 7f2612200640 1 -- 172.21.15.18:0/3402277439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c94d43f0 con 0x55d4c9865fb0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f2612200640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2604003cb0 tx=0x7f2604003bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c07802010bd204e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f25f3400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260404f020 con 0x55d4c9865fb0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2604004220 con 0x55d4c9865fb0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2604045070 con 0x55d4c9865fb0 2024-04-21T22:37:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.040+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f260405d050 con 0x55d4c9865fb0 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 10 client.26290 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4c94940f0 con 0x55d4c9865fb0 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2604045070 con 0x55d4c9865fb0 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f26040407a0 con 0x55d4c9865fb0 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 10 client.26290 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 10 client.26290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 20 client.26290 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c9876220 0x55d4c9878610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 4 client.26290 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.041+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4c97d3c40 con 0x55d4c9876220 2024-04-21T22:37:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.042+0000 7f2610e00640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c9876220 0x55d4c9878610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.042+0000 7f2610e00640 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c9876220 0x55d4c9878610 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9322f2656a26644f server_cookie=6ac6496154df8ece in_seq=0 out_seq=0 2024-04-21T22:37:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.042+0000 7f25f3400640 10 client.26290 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:01.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.043+0000 7f25f3400640 1 -- 172.21.15.18:0/3402277439 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d4c97d3c40 con 0x55d4c9876220 2024-04-21T22:37:01.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.043+0000 7f25f3400640 10 client.26290 handle_command_reply: tid=0 2024-04-21T22:37:01.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.043+0000 7f2616e83740 1 client.26290 shutdown 2024-04-21T22:37:01.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.043+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 msgr2=0x55d4c9863b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.043+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2604003cb0 tx=0x7f2604003bb0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 shutdown_connections 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c9876220 0x55d4c9878610 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c9863b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985d3d0 0x55d4c98635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 --2- 172.21.15.18:0/3402277439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c9863090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f25f3400640 0 client.26290 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 >> 172.21.15.18:0/3402277439 conn(0x55d4c98571e0 msgr2=0x55d4c9856440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 shutdown_connections 2024-04-21T22:37:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 1 -- 172.21.15.18:0/3402277439 wait complete. 2024-04-21T22:37:01.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.044+0000 7f2616e83740 20 client.26290 trim_cache size 0 max 16384 2024-04-21T22:37:01.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 Processor -- start 2024-04-21T22:37:01.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 -- start start 2024-04-21T22:37:01.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985cab0 0x55d4c98657c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c987dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b3810 con 0x55d4c985cab0 2024-04-21T22:37:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b54d0 con 0x55d4c985d3d0 2024-04-21T22:37:01.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.069+0000 7f2616e83740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b3fa0 con 0x55d4c9865fb0 2024-04-21T22:37:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43378/0 (socket says 172.21.15.18:43378) 2024-04-21T22:37:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2612200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985cab0 0x55d4c98657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 -- 172.21.15.18:0/2107276018 learned_addr learned my addr 172.21.15.18:0/2107276018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2612200640 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c987dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 -- 172.21.15.18:0/2107276018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 msgr2=0x55d4c987dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c987dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 -- 172.21.15.18:0/2107276018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985cab0 msgr2=0x55d4c98657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985cab0 0x55d4c98657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.070+0000 7f2610e00640 1 -- 172.21.15.18:0/2107276018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c9857f70 con 0x55d4c985d3d0 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.071+0000 7f2610e00640 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d4c9858370 tx=0x7f25f8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11794a441e4ee7d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.071+0000 7f25fe000640 1 -- 172.21.15.18:0/2107276018 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8025070 con 0x55d4c985d3d0 2024-04-21T22:37:01.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.071+0000 7f25fe000640 1 -- 172.21.15.18:0/2107276018 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8003c40 con 0x55d4c985d3d0 2024-04-21T22:37:01.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.071+0000 7f25fe000640 1 -- 172.21.15.18:0/2107276018 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8010890 con 0x55d4c985d3d0 2024-04-21T22:37:01.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.072+0000 7f2616e83740 1 -- 172.21.15.18:0/2107276018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 msgr2=0x55d4c9863930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.072+0000 7f2616e83740 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55d4c9858370 tx=0x7f25f8005f90 comp rx=0 tx=0).stop 2024-04-21T22:37:01.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 -- 172.21.15.18:0/2107276018 shutdown_connections 2024-04-21T22:37:01.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c9865fb0 0x55d4c987dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985d3d0 0x55d4c9863930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 --2- 172.21.15.18:0/2107276018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c985cab0 0x55d4c98657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 -- 172.21.15.18:0/2107276018 >> 172.21.15.18:0/2107276018 conn(0x55d4c98571e0 msgr2=0x55d4c98584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 -- 172.21.15.18:0/2107276018 shutdown_connections 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 -- 172.21.15.18:0/2107276018 wait complete. 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.073+0000 7f2616e83740 1 -- start start 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 Processor -- start 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c986e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 0x55d4c986e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c9865fb0 0x55d4c986b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b4d40 con 0x55d4c9865fb0 2024-04-21T22:37:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b4670 con 0x55d4c985cab0 2024-04-21T22:37:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f260c1b17f0 con 0x55d4c985d3d0 2024-04-21T22:37:01.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.074+0000 7f2616e83740 10 client.0 _ll_register_callbacks cb 0x7f2604009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2610e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 0x55d4c986e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2610e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 0x55d4c986e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40514/0 (socket says 172.21.15.18:40514) 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2610e00640 1 -- 172.21.15.18:0/575398212 learned_addr learned my addr 172.21.15.18:0/575398212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c986e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c9865fb0 0x55d4c986b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 -- 172.21.15.18:0/575398212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 msgr2=0x55d4c986e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 0x55d4c986e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 -- 172.21.15.18:0/575398212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c9865fb0 msgr2=0x55d4c986b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c9865fb0 0x55d4c986b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.075+0000 7f2612200640 1 -- 172.21.15.18:0/575398212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c986b750 con 0x55d4c985cab0 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.076+0000 7f2612200640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c986e110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f260402c620 tx=0x7f2604003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2586bddccc1b6107 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.076+0000 7f25f3400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.076+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604039070 con 0x55d4c985cab0 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.076+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f8003c40 con 0x55d4c985cab0 2024-04-21T22:37:01.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.077+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2604004b40 con 0x55d4c985cab0 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.077+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f260404f070 con 0x55d4c985cab0 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.077+0000 7f2616e83740 10 client.26258 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.077+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4c98dced0 con 0x55d4c985cab0 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8003c40 con 0x55d4c985cab0 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f26040348c0 con 0x55d4c985cab0 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 10 client.26258 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 10 client.26258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 20 client.26258 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:01.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c98dd570 0x55d4c98df990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:01.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 4 client.26258 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:37:01.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4c97cd950 con 0x55d4c98dd570 2024-04-21T22:37:01.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.078+0000 7f2610e00640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c98dd570 0x55d4c98df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2610e00640 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c98dd570 0x55d4c98df990 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7cafa7ffedeb2b7 server_cookie=52317e0c95d03005 in_seq=0 out_seq=0 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f25f3400640 10 client.26258 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f25f3400640 1 -- 172.21.15.18:0/575398212 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d4c97cd950 con 0x55d4c98dd570 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f25f3400640 10 client.26258 handle_command_reply: tid=0 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 client.26258 shutdown 2024-04-21T22:37:01.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 msgr2=0x55d4c986e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c986e110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f260402c620 tx=0x7f2604003f60 comp rx=0 tx=0).stop 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 shutdown_connections 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4c9865fb0 0x55d4c986b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55d4c98dd570 0x55d4c98df990 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4c985d3d0 0x55d4c986e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 --2- 172.21.15.18:0/575398212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d4c985cab0 0x55d4c986e110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 >> 172.21.15.18:0/575398212 conn(0x55d4c98571e0 msgr2=0x55d4c9858d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.079+0000 7f25f3400640 0 client.26258 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.080+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 shutdown_connections 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.080+0000 7f2616e83740 1 -- 172.21.15.18:0/575398212 wait complete. 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.080+0000 7f2616e83740 20 client.26258 trim_cache size 0 max 16384 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:37:01.084 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: "fc17ed25-62bc-4952-92a1-53ec6e810216": { 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "fc17ed25-62bc-4952-92a1-53ec6e810216", 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:37:01.085 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:37:01.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 msgr2=0x7f25f40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 0x7f25f40a51c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f26000cd0b0 tx=0x7f26000d5550 comp rx=0 tx=0).stop 2024-04-21T22:37:01.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 msgr2=0x7f260c19e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:01.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f260000e9f0 tx=0x7f260000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 shutdown_connections 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25f40a2d00 0x7f25f40a51c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f260c10cbc0 0x7f260c1a2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f260c108f40 0x7f260c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 --2- 172.21.15.18:0/3197702254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f260c108580 0x7f260c19e3a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 >> 172.21.15.18:0/3197702254 conn(0x7f260c077190 msgr2=0x7f260c10e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 shutdown_connections 2024-04-21T22:37:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:01.081+0000 7f2612c00640 1 -- 172.21.15.18:0/3197702254 wait complete. 2024-04-21T22:37:01.102 INFO:tasks.cephfs.filesystem:scrub status for tag:fc17ed25-62bc-4952-92a1-53ec6e810216 - {'path': '/', 'tag': 'fc17ed25-62bc-4952-92a1-53ec6e810216', 'options': 'recursive,force'} 2024-04-21T22:37:01.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: pgmap v92: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:01.203 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:37:01.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:01.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:01.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:01.204 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:01 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: pgmap v92: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:37:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:01.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:01 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: pgmap v92: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:01.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:37:01.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:01.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:01.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:01.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:01 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:02.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:02 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:02 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:02.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:02.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:02 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:03.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:03 smithi018 ceph-mon[26614]: pgmap v93: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:03 smithi081 ceph-mon[31692]: pgmap v93: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:03 smithi047 ceph-mon[31561]: pgmap v93: 97 pgs: 97 active+clean; 94 MiB data, 740 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-04-21T22:37:05.497 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:05 smithi047 ceph-mon[31561]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 179 KiB/s wr, 33 op/s 2024-04-21T22:37:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:05 smithi018 ceph-mon[26614]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 179 KiB/s wr, 33 op/s 2024-04-21T22:37:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:05 smithi081 ceph-mon[31692]: pgmap v94: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 179 KiB/s wr, 33 op/s 2024-04-21T22:37:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:07 smithi018 ceph-mon[26614]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-04-21T22:37:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:07 smithi081 ceph-mon[31692]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-04-21T22:37:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:07 smithi047 ceph-mon[31561]: pgmap v95: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-04-21T22:37:09.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:09 smithi018 ceph-mon[26614]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 172 KiB/s wr, 33 op/s 2024-04-21T22:37:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:09 smithi081 ceph-mon[31692]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 172 KiB/s wr, 33 op/s 2024-04-21T22:37:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:09 smithi047 ceph-mon[31561]: pgmap v96: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 172 KiB/s wr, 33 op/s 2024-04-21T22:37:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:11 smithi018 ceph-mon[26614]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:11 smithi081 ceph-mon[31692]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:11 smithi047 ceph-mon[31561]: pgmap v97: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:13.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:13 smithi018 ceph-mon[26614]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:13 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:13 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:13.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:13 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:13 smithi081 ceph-mon[31692]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:13 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:13 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:13 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:13 smithi047 ceph-mon[31561]: pgmap v98: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-04-21T22:37:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:13 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:13 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:13 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:14.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:14 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:14.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:14 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:14.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:14 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:14.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:14 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:14.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:14 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:14.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:14 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:15.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:15 smithi018 ceph-mon[26614]: pgmap v99: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 173 KiB/s wr, 33 op/s 2024-04-21T22:37:15.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:15 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:37:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:15 smithi081 ceph-mon[31692]: pgmap v99: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 173 KiB/s wr, 33 op/s 2024-04-21T22:37:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:15 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:37:15.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:15 smithi047 ceph-mon[31561]: pgmap v99: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 173 KiB/s wr, 33 op/s 2024-04-21T22:37:15.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:15 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:37:16.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:16 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:37:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:16 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:37:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:16 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:37:16.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:16 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:37:16.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:16 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:37:16.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:16 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:37:16.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:16 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:37:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:16 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:37:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:16 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:37:17.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:17 smithi018 ceph-mon[26614]: pgmap v100: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-04-21T22:37:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:17 smithi081 ceph-mon[31692]: pgmap v100: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-04-21T22:37:17.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:17 smithi047 ceph-mon[31561]: pgmap v100: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-04-21T22:37:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:19 smithi018 ceph-mon[26614]: pgmap v101: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-04-21T22:37:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:19 smithi081 ceph-mon[31692]: pgmap v101: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-04-21T22:37:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:19 smithi047 ceph-mon[31561]: pgmap v101: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-04-21T22:37:21.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:21 smithi018 ceph-mon[26614]: pgmap v102: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:21.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:21 smithi081 ceph-mon[31692]: pgmap v102: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:21 smithi047 ceph-mon[31561]: pgmap v102: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:23 smithi018 ceph-mon[26614]: pgmap v103: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:23 smithi081 ceph-mon[31692]: pgmap v103: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:23.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:23 smithi047 ceph-mon[31561]: pgmap v103: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-21T22:37:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:25 smithi018 ceph-mon[26614]: pgmap v104: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-04-21T22:37:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:25 smithi081 ceph-mon[31692]: pgmap v104: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-04-21T22:37:25.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:25 smithi047 ceph-mon[31561]: pgmap v104: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-04-21T22:37:27.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:27 smithi018 ceph-mon[26614]: pgmap v105: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-21T22:37:27.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:27 smithi081 ceph-mon[31692]: pgmap v105: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-21T22:37:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:27 smithi047 ceph-mon[31561]: pgmap v105: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-04-21T22:37:29.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:29 smithi018 ceph-mon[26614]: pgmap v106: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:29.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:29 smithi081 ceph-mon[31692]: pgmap v106: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:29.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:29 smithi047 ceph-mon[31561]: pgmap v106: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:31.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:37:31.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:37:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.334+0000 7fab18c00640 1 -- 172.21.15.18:0/2427157088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab14073b10 msgr2=0x7fab14073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.334+0000 7fab18c00640 1 --2- 172.21.15.18:0/2427157088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab14073b10 0x7fab14073ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab04009900 tx=0x7fab0402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 -- 172.21.15.18:0/2427157088 shutdown_connections 2024-04-21T22:37:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 --2- 172.21.15.18:0/2427157088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab1410ddb0 0x7fab141101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 --2- 172.21.15.18:0/2427157088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14074430 0x7fab1410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 --2- 172.21.15.18:0/2427157088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab14073b10 0x7fab14073ef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 -- 172.21.15.18:0/2427157088 >> 172.21.15.18:0/2427157088 conn(0x7fab140fd020 msgr2=0x7fab140ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 -- 172.21.15.18:0/2427157088 shutdown_connections 2024-04-21T22:37:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.335+0000 7fab18c00640 1 -- 172.21.15.18:0/2427157088 wait complete. 2024-04-21T22:37:31.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 Processor -- start 2024-04-21T22:37:31.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 -- start start 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 0x7fab1419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab1410ddb0 0x7fab1419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab14113b60 con 0x7fab14074430 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab141139e0 con 0x7fab14073b10 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab18c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab14113ce0 con 0x7fab1410ddb0 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.336+0000 7fab0be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42760/0 (socket says 172.21.15.18:42760) 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab13400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 0x7fab1419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 -- 172.21.15.18:0/2543780448 learned_addr learned my addr 172.21.15.18:0/2543780448 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab13e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab1410ddb0 0x7fab1419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 -- 172.21.15.18:0/2543780448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab1410ddb0 msgr2=0x7fab1419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab1410ddb0 0x7fab1419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 -- 172.21.15.18:0/2543780448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 msgr2=0x7fab1419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 0x7fab1419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 -- 172.21.15.18:0/2543780448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1419f0a0 con 0x7fab14074430 2024-04-21T22:37:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab13400640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 0x7fab1419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.337+0000 7fab0be00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faafc00ea60 tx=0x7faafc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.338+0000 7fab10c00640 1 -- 172.21.15.18:0/2543780448 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc00cde0 con 0x7fab14074430 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.338+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1419f390 con 0x7fab14074430 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.338+0000 7fab10c00640 1 -- 172.21.15.18:0/2543780448 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc0035f0 con 0x7fab14074430 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.338+0000 7fab10c00640 1 -- 172.21.15.18:0/2543780448 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc010670 con 0x7fab14074430 2024-04-21T22:37:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.338+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab141a6c20 con 0x7fab14074430 2024-04-21T22:37:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.341+0000 7fab1cf8b740 1 Processor -- start 2024-04-21T22:37:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.341+0000 7fab10c00640 1 -- 172.21.15.18:0/2543780448 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7faafc0037a0 con 0x7fab14074430 2024-04-21T22:37:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.341+0000 7fab1cf8b740 1 -- start start 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c533e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a01c497410 con 0x55a01c53cfb0 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a01c43f7e0 con 0x55a01c5343d0 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a01c4933d0 con 0x55a01c533ab0 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab13400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab13400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41342/0 (socket says 172.21.15.18:41342) 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab13400640 1 -- 172.21.15.18:0/1676532059 learned_addr learned my addr 172.21.15.18:0/1676532059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab0be00640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.342+0000 7fab13e00640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c533e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 -- 172.21.15.18:0/1676532059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 msgr2=0x55a01c533e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c533e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 -- 172.21.15.18:0/1676532059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 msgr2=0x55a01c53f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 -- 172.21.15.18:0/1676532059 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01c2757d0 con 0x55a01c5343d0 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13e00640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c533e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab13400640 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab04009230 tx=0x7fab04009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f07f500caae1fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab10c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 0x7faaf80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab10c00640 1 -- 172.21.15.18:0/2543780448 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7faafc0cf780 con 0x7fab14074430 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab03e00640 1 -- 172.21.15.18:0/1676532059 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04043070 con 0x55a01c5343d0 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab03e00640 1 -- 172.21.15.18:0/1676532059 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0402c6f0 con 0x55a01c5343d0 2024-04-21T22:37:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.343+0000 7fab03e00640 1 -- 172.21.15.18:0/1676532059 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04004ee0 con 0x55a01c5343d0 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab13e00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 0x7faaf80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1676532059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 msgr2=0x55a01c53ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab04009230 tx=0x7fab04009560 comp rx=0 tx=0).stop 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab13e00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 0x7faaf80a51c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009fd0 tx=0x7fab0c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1676532059 shutdown_connections 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53ca70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1676532059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c533e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1676532059 >> 172.21.15.18:0/1676532059 conn(0x55a01c52e1e0 msgr2=0x55a01c52e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1676532059 shutdown_connections 2024-04-21T22:37:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.344+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1676532059 wait complete. 2024-04-21T22:37:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.345+0000 7fab1cf8b740 1 -- start start 2024-04-21T22:37:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.345+0000 7fab1cf8b740 1 Processor -- start 2024-04-21T22:37:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a01c53fd40 con 0x55a01c53cfb0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a01c452c40 con 0x55a01c5343d0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a01c53fec0 con 0x55a01c533ab0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab1cf8b740 10 client.0 _ll_register_callbacks cb 0x55a01c452630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab0be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50800/0 (socket says 172.21.15.18:50800) 2024-04-21T22:37:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 -- 172.21.15.18:0/117991846 learned_addr learned my addr 172.21.15.18:0/117991846 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 -- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 msgr2=0x55a01c53a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 -- 172.21.15.18:0/117991846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 msgr2=0x55a01c53a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.346+0000 7fab13400640 1 -- 172.21.15.18:0/117991846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01c1ab3f0 con 0x55a01c533ab0 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.347+0000 7fab13400640 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab0402c8c0 tx=0x7fab0402c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22b2ec4d16a45c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.347+0000 7fab00c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.347+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04043040 con 0x55a01c533ab0 2024-04-21T22:37:31.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.347+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fab040053b0 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.347+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab0402c6f0 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fab04059050 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 10 client.26308 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a01c16b0f0 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab0402c6f0 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fab0403f520 con 0x55a01c533ab0 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 10 client.26308 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 10 client.26308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 20 client.26308 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c54d130 0x55a01c54f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 4 client.26308 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.348+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a01c4aac40 con 0x55a01c54d130 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.349+0000 7fab0be00640 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c54d130 0x55a01c54f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.349+0000 7fab0be00640 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c54d130 0x55a01c54f520 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94339df941143a server_cookie=f71e288e5d7c744f in_seq=0 out_seq=0 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.349+0000 7fab00c00640 10 client.26308 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.350+0000 7fab00c00640 1 -- 172.21.15.18:0/117991846 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a01c4aac40 con 0x55a01c54d130 2024-04-21T22:37:31.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.350+0000 7fab00c00640 10 client.26308 handle_command_reply: tid=0 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.350+0000 7fab1cf8b740 1 client.26308 shutdown 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 msgr2=0x55a01c539f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fab0402c8c0 tx=0x7fab0402c9a0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 shutdown_connections 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c53cfb0 0x55a01c53a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c53a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c54d130 0x55a01c54f520 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/117991846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c533ab0 0x55a01c539f70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab00c00640 0 client.26308 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 >> 172.21.15.18:0/117991846 conn(0x55a01c52e1e0 msgr2=0x55a01c52ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 shutdown_connections 2024-04-21T22:37:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 1 -- 172.21.15.18:0/117991846 wait complete. 2024-04-21T22:37:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.351+0000 7fab1cf8b740 20 client.26308 trim_cache size 0 max 16384 2024-04-21T22:37:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 Processor -- start 2024-04-21T22:37:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 -- start start 2024-04-21T22:37:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 0x55a01c53c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c554be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab141af550 con 0x55a01c5343d0 2024-04-21T22:37:31.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab141b1210 con 0x55a01c533ab0 2024-04-21T22:37:31.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.371+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab141afce0 con 0x55a01c53cfb0 2024-04-21T22:37:31.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42794/0 (socket says 172.21.15.18:42794) 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 -- 172.21.15.18:0/648553159 learned_addr learned my addr 172.21.15.18:0/648553159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab13e00640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c554be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab13400640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 0x55a01c53c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 -- 172.21.15.18:0/648553159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 msgr2=0x55a01c554be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c554be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 -- 172.21.15.18:0/648553159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 msgr2=0x55a01c53c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 0x55a01c53c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab0be00640 1 -- 172.21.15.18:0/648553159 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01c534200 con 0x55a01c5343d0 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.372+0000 7fab13400640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 0x55a01c53c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.373+0000 7fab0be00640 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faafc098610 tx=0x7faafc0d5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252e5e8ff9cbaf10 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.373+0000 7fab03400640 1 -- 172.21.15.18:0/648553159 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc09b780 con 0x55a01c5343d0 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.373+0000 7fab03400640 1 -- 172.21.15.18:0/648553159 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc086030 con 0x55a01c5343d0 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.373+0000 7fab03400640 1 -- 172.21.15.18:0/648553159 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc09b5a0 con 0x55a01c5343d0 2024-04-21T22:37:31.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- 172.21.15.18:0/648553159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 msgr2=0x55a01c548c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faafc098610 tx=0x7faafc0d5530 comp rx=0 tx=0).stop 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- 172.21.15.18:0/648553159 shutdown_connections 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c554be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c5343d0 0x55a01c548c30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/648553159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c533ab0 0x55a01c53c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- 172.21.15.18:0/648553159 >> 172.21.15.18:0/648553159 conn(0x55a01c52e1e0 msgr2=0x55a01c52e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- 172.21.15.18:0/648553159 shutdown_connections 2024-04-21T22:37:31.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- 172.21.15.18:0/648553159 wait complete. 2024-04-21T22:37:31.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 -- start start 2024-04-21T22:37:31.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.374+0000 7fab1cf8b740 1 Processor -- start 2024-04-21T22:37:31.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c536800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c536d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab141b0a80 con 0x55a01c533ab0 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab141b03b0 con 0x55a01c5343d0 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab141ad530 con 0x55a01c53cfb0 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab1cf8b740 10 client.0 _ll_register_callbacks cb 0x7fab04009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab13400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab13400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42800/0 (socket says 172.21.15.18:42800) 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab13400640 1 -- 172.21.15.18:0/1653199193 learned_addr learned my addr 172.21.15.18:0/1653199193 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab13e00640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c536d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.375+0000 7fab0be00640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c536800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 -- 172.21.15.18:0/1653199193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 msgr2=0x55a01c536d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c536d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 -- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 msgr2=0x55a01c536800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c536800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 -- 172.21.15.18:0/1653199193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01c537400 con 0x55a01c533ab0 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13e00640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c536d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:31.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab13400640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fab04000c00 tx=0x7fab0403fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d24da6e088fc7d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab00c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04043040 con 0x55a01c533ab0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fab040051b0 con 0x55a01c533ab0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.376+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faafc086030 con 0x55a01c533ab0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fab0402c6f0 con 0x55a01c533ab0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 10 client.16188 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a01c5b3310 con 0x55a01c533ab0 2024-04-21T22:37:31.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc086030 con 0x55a01c533ab0 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fab040489d0 con 0x55a01c533ab0 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 10 client.16188 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 20 client.16188 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c5b3ae0 0x55a01c5b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 4 client.16188 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.377+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a01c4a4950 con 0x55a01c5b3ae0 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.378+0000 7fab0be00640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c5b3ae0 0x55a01c5b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.378+0000 7fab0be00640 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c5b3ae0 0x55a01c5b5f00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c479c4071a9e375 server_cookie=38590eb45c455ac6 in_seq=0 out_seq=0 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.378+0000 7fab00c00640 10 client.16188 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab00c00640 1 -- 172.21.15.18:0/1653199193 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a01c4a4950 con 0x55a01c5b3ae0 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab00c00640 10 client.16188 handle_command_reply: tid=0 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 client.16188 shutdown 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 msgr2=0x55a01c545410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fab04000c00 tx=0x7fab0403fde0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 shutdown_connections 2024-04-21T22:37:31.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a01c5b3ae0 0x55a01c5b5f00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a01c53cfb0 0x55a01c536d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a01c5343d0 0x55a01c536800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 --2- 172.21.15.18:0/1653199193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a01c533ab0 0x55a01c545410 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab00c00640 0 client.16188 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 >> 172.21.15.18:0/1653199193 conn(0x55a01c52e1e0 msgr2=0x55a01c52cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 shutdown_connections 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 1 -- 172.21.15.18:0/1653199193 wait complete. 2024-04-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.379+0000 7fab1cf8b740 20 client.16188 trim_cache size 0 max 16384 2024-04-21T22:37:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:37:31.387 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:37:31.387 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:37:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 msgr2=0x7faaf80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 0x7faaf80a51c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009fd0 tx=0x7fab0c009500 comp rx=0 tx=0).stop 2024-04-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 msgr2=0x7fab1419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faafc00ea60 tx=0x7faafc00ef20 comp rx=0 tx=0).stop 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 shutdown_connections 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7faaf80a2d00 0x7faaf80a51c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab1410ddb0 0x7fab1419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab14074430 0x7fab1419a640 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 --2- 172.21.15.18:0/2543780448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab14073b10 0x7fab1419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 >> 172.21.15.18:0/2543780448 conn(0x7fab140fd020 msgr2=0x7fab140fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 shutdown_connections 2024-04-21T22:37:31.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.380+0000 7fab18c00640 1 -- 172.21.15.18:0/2543780448 wait complete. 2024-04-21T22:37:31.399 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:37:31.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:37:31.467 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:31 smithi018 ceph-mon[26614]: pgmap v107: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:31.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.607+0000 7f816be00640 1 -- 172.21.15.18:0/2145597690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 msgr2=0x7f816c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.607+0000 7f816be00640 1 --2- 172.21.15.18:0/2145597690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c10d960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8158009900 tx=0x7f815802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 -- 172.21.15.18:0/2145597690 shutdown_connections 2024-04-21T22:37:31.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 --2- 172.21.15.18:0/2145597690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 --2- 172.21.15.18:0/2145597690 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c10d960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 --2- 172.21.15.18:0/2145597690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 -- 172.21.15.18:0/2145597690 >> 172.21.15.18:0/2145597690 conn(0x7f816c0fd150 msgr2=0x7f816c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 -- 172.21.15.18:0/2145597690 shutdown_connections 2024-04-21T22:37:31.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.608+0000 7f816be00640 1 -- 172.21.15.18:0/2145597690 wait complete. 2024-04-21T22:37:31.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 Processor -- start 2024-04-21T22:37:31.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 -- start start 2024-04-21T22:37:31.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f816c113c10 con 0x7f816c073af0 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f816c113a90 con 0x7f816c074410 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f816c113d90 con 0x7f816c10dea0 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.609+0000 7f816aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c19a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42812/0 (socket says 172.21.15.18:42812) 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816aa00640 1 -- 172.21.15.18:0/1163314405 learned_addr learned my addr 172.21.15.18:0/1163314405 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816a000640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 -- 172.21.15.18:0/1163314405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 msgr2=0x7f816c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 -- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 msgr2=0x7f816c19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 -- 172.21.15.18:0/1163314405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c19f0d0 con 0x7f816c10dea0 2024-04-21T22:37:31.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.610+0000 7f816b400640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c19e9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f816400e940 tx=0x7f816400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.611+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164004d20 con 0x7f816c10dea0 2024-04-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.611+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8164005020 con 0x7f816c10dea0 2024-04-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.611+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c19f3c0 con 0x7f816c10dea0 2024-04-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.611+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81640116b0 con 0x7f816c10dea0 2024-04-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.611+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c1a6c50 con 0x7f816c10dea0 2024-04-21T22:37:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.612+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c04f570 con 0x7f816c10dea0 2024-04-21T22:37:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.614+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f81640054d0 con 0x7f816c10dea0 2024-04-21T22:37:31.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.615+0000 7f8170a00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 0x7f81500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.615+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f81640cf4a0 con 0x7f816c10dea0 2024-04-21T22:37:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.616+0000 7f816aa00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 0x7f81500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:31.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.616+0000 7f816aa00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 0x7f81500a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f815c005fd0 tx=0x7f815c00b480 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.620+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8164016030 con 0x7f816c10dea0 2024-04-21T22:37:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:31 smithi081 ceph-mon[31692]: pgmap v107: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:31.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:31 smithi047 ceph-mon[31561]: pgmap v107: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.867+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816c109080 con 0x7f816c10dea0 2024-04-21T22:37:31.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.868+0000 7f8170a00640 1 -- 172.21.15.18:0/1163314405 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11928 (secure 0 0 0) 0x7f816409ba10 con 0x7f816c10dea0 2024-04-21T22:37:31.869 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:37:31.869 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:36:03.102173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24496,24538,24509,24568,24596]},"id":1}]} 2024-04-21T22:37:31.869 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 32 2024-04-21T22:37:31.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.871+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 msgr2=0x7f81500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.871+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 0x7f81500a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f815c005fd0 tx=0x7f815c00b480 comp rx=0 tx=0).stop 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.871+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 msgr2=0x7f816c19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.871+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c19e9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f816400e940 tx=0x7f816400ee00 comp rx=0 tx=0).stop 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 shutdown_connections 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f81500a2cf0 0x7f81500a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816c10dea0 0x7f816c19e9a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f816c074410 0x7f816c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 --2- 172.21.15.18:0/1163314405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f816c073af0 0x7f816c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:31.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 >> 172.21.15.18:0/1163314405 conn(0x7f816c0fd150 msgr2=0x7f816c0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:31.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 shutdown_connections 2024-04-21T22:37:31.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:31.872+0000 7f816be00640 1 -- 172.21.15.18:0/1163314405 wait complete. 2024-04-21T22:37:31.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:37:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 -- 172.21.15.18:0/1827795285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c101ef0 msgr2=0x7f834c10e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 --2- 172.21.15.18:0/1827795285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c101ef0 0x7f834c10e3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8344009ca0 tx=0x7f834402c100 comp rx=0 tx=0).stop 2024-04-21T22:37:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 -- 172.21.15.18:0/1827795285 shutdown_connections 2024-04-21T22:37:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 --2- 172.21.15.18:0/1827795285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c101ef0 0x7f834c10e3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 --2- 172.21.15.18:0/1827795285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101530 0x7f834c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.113+0000 7f8352200640 1 --2- 172.21.15.18:0/1827795285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c1075f0 0x7f834c1079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.114+0000 7f8352200640 1 -- 172.21.15.18:0/1827795285 >> 172.21.15.18:0/1827795285 conn(0x7f834c0fd020 msgr2=0x7f834c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.114+0000 7f8352200640 1 -- 172.21.15.18:0/1827795285 shutdown_connections 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.114+0000 7f8352200640 1 -- 172.21.15.18:0/1827795285 wait complete. 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 Processor -- start 2024-04-21T22:37:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 -- start start 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 0x7f834c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101ef0 0x7f834c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 0x7f834c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1118d0 con 0x7f834c1075f0 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f834c111750 con 0x7f834c101ef0 2024-04-21T22:37:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.115+0000 7f8352200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f834c111a50 con 0x7f834c101530 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 0x7f834c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8350e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 0x7f834c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8350e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 0x7f834c197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50840/0 (socket says 172.21.15.18:50840) 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8350e00640 1 -- 172.21.15.18:0/1445115547 learned_addr learned my addr 172.21.15.18:0/1445115547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8343e00640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101ef0 0x7f834c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 -- 172.21.15.18:0/1445115547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 msgr2=0x7f834c197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 0x7f834c197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 -- 172.21.15.18:0/1445115547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101ef0 msgr2=0x7f834c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101ef0 0x7f834c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.116+0000 7f8351800640 1 -- 172.21.15.18:0/1445115547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c19cd40 con 0x7f834c1075f0 2024-04-21T22:37:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f8351800640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 0x7f834c19c610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8344009bf0 tx=0x7f8344034670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f834a000640 1 -- 172.21.15.18:0/1445115547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344039050 con 0x7f834c1075f0 2024-04-21T22:37:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f834a000640 1 -- 172.21.15.18:0/1445115547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8344045070 con 0x7f834c1075f0 2024-04-21T22:37:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c19cfd0 con 0x7f834c1075f0 2024-04-21T22:37:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f834a000640 1 -- 172.21.15.18:0/1445115547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83440044c0 con 0x7f834c1075f0 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.117+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1a48c0 con 0x7f834c1075f0 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.120+0000 7f834a000640 1 -- 172.21.15.18:0/1445115547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8344004660 con 0x7f834c1075f0 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.120+0000 7f835646b740 1 Processor -- start 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 -- start start 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad1eca0 0x5589bad1f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad2c880 0x5589bad2ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589bac833a0 con 0x5589bad2c880 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5589bac2b930 con 0x5589bad1f5c0 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f835646b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5589bac7f360 con 0x5589bad1eca0 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.121+0000 7f8343e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad1eca0 0x5589bad1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41404/0 (socket says 172.21.15.18:41404) 2024-04-21T22:37:32.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 -- 172.21.15.18:0/1176008313 learned_addr learned my addr 172.21.15.18:0/1176008313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8343e00640 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad2c880 0x5589bad2ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 -- 172.21.15.18:0/1176008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad1eca0 msgr2=0x5589bad1f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad1eca0 0x5589bad1f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 -- 172.21.15.18:0/1176008313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad2c880 msgr2=0x5589bad2ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad2c880 0x5589bad2ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 -- 172.21.15.18:0/1176008313 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ba9973f0 con 0x5589bad1f5c0 2024-04-21T22:37:32.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f8350e00640 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e10 tx=0x7f833c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63851d5e6283457f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.122+0000 7f834a000640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 0x7f83300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.123+0000 7f8342000640 1 -- 172.21.15.18:0/1176008313 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c01e070 con 0x5589bad1f5c0 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.123+0000 7f834a000640 1 -- 172.21.15.18:0/1445115547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f83440f18a0 con 0x7f834c1075f0 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.123+0000 7f8343e00640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 0x7f83300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.123+0000 7f8342000640 1 -- 172.21.15.18:0/1176008313 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f833c019b10 con 0x5589bad1f5c0 2024-04-21T22:37:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.123+0000 7f8342000640 1 -- 172.21.15.18:0/1176008313 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c00fbd0 con 0x5589bad1f5c0 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- 172.21.15.18:0/1176008313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 msgr2=0x5589bad2c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e10 tx=0x7f833c011810 comp rx=0 tx=0).stop 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f8343e00640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 0x7f83300a51c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5589bad1a830 tx=0x7f8334013040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- 172.21.15.18:0/1176008313 shutdown_connections 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad2c880 0x5589bad2ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad2c340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 --2- 172.21.15.18:0/1176008313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad1eca0 0x5589bad1f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- 172.21.15.18:0/1176008313 >> 172.21.15.18:0/1176008313 conn(0x5589bad196a0 msgr2=0x5589bad19a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- 172.21.15.18:0/1176008313 shutdown_connections 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- 172.21.15.18:0/1176008313 wait complete. 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.124+0000 7f835646b740 1 -- start start 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 Processor -- start 2024-04-21T22:37:32.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad29ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad2a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589bad2f640 con 0x5589bad1f5c0 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5589bac3ed80 con 0x5589bad1eca0 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5589bad2f7c0 con 0x5589bad2c880 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f835646b740 10 client.0 _ll_register_callbacks cb 0x5589bac7b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f8350e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f8350e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41414/0 (socket says 172.21.15.18:41414) 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f8350e00640 1 -- 172.21.15.18:0/1010124498 learned_addr learned my addr 172.21.15.18:0/1010124498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.125+0000 7f8351800640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad2a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8343e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad29ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 -- 172.21.15.18:0/1010124498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 msgr2=0x5589bad2a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad2a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 -- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 msgr2=0x5589bad29ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad29ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 -- 172.21.15.18:0/1010124498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589baa617d0 con 0x5589bad1eca0 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8343e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad29ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f8350e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833c00f750 tx=0x7f833c00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1fd8de092e89e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.126+0000 7f833aa00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c026020 con 0x5589bad1eca0 2024-04-21T22:37:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c019b10 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f833c019630 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f833c031050 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f835646b740 10 client.26294 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.127+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589bad3ba60 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f833c019b10 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f833c0046c0 con 0x5589bad1eca0 2024-04-21T22:37:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 10 client.26294 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 10 client.26294 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 20 client.26294 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bad3ce10 0x5589bad3f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 4 client.26294 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589bac908e0 con 0x5589bad3ce10 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.128+0000 7f8343e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bad3ce10 0x5589bad3f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.129+0000 7f8343e00640 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bad3ce10 0x5589bad3f200 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1960dd336731a712 server_cookie=1c2abe2503a8443d in_seq=0 out_seq=0 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.129+0000 7f833aa00640 10 client.26294 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f833aa00640 1 -- 172.21.15.18:0/1010124498 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5589bac908e0 con 0x5589bad3ce10 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f833aa00640 10 client.26294 handle_command_reply: tid=0 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 client.26294 shutdown 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 msgr2=0x5589bad299a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833c00f750 tx=0x7f833c00f670 comp rx=0 tx=0).stop 2024-04-21T22:37:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 shutdown_connections 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bad3ce10 0x5589bad3f200 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad2a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad29ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 --2- 172.21.15.18:0/1010124498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad299a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f833aa00640 0 client.26294 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:37:32.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 >> 172.21.15.18:0/1010124498 conn(0x5589bad196a0 msgr2=0x5589bad1b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 shutdown_connections 2024-04-21T22:37:32.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 1 -- 172.21.15.18:0/1010124498 wait complete. 2024-04-21T22:37:32.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.130+0000 7f835646b740 20 client.26294 trim_cache size 0 max 16384 2024-04-21T22:37:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.145+0000 7f835646b740 1 Processor -- start 2024-04-21T22:37:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 -- start start 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad2c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad18510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ab090 con 0x5589bad1f5c0 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1acd50 con 0x5589bad1eca0 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f835646b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ab820 con 0x5589bad2c880 2024-04-21T22:37:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f8343e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f8343e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42870/0 (socket says 172.21.15.18:42870) 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f8343e00640 1 -- 172.21.15.18:0/97089525 learned_addr learned my addr 172.21.15.18:0/97089525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f8351800640 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad18510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.146+0000 7f8350e00640 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad2c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 -- 172.21.15.18:0/97089525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 msgr2=0x5589bad18510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad18510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 -- 172.21.15.18:0/97089525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 msgr2=0x5589bad2c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad2c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 -- 172.21.15.18:0/97089525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589bad14f60 con 0x5589bad1f5c0 2024-04-21T22:37:32.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8343e00640 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5589bad29200 tx=0x7f8334009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d1a4eb0bffad00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8341600640 1 -- 172.21.15.18:0/97089525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833400fd90 con 0x5589bad1f5c0 2024-04-21T22:37:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8341600640 1 -- 172.21.15.18:0/97089525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8334022110 con 0x5589bad1f5c0 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.147+0000 7f8341600640 1 -- 172.21.15.18:0/97089525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334022930 con 0x5589bad1f5c0 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- 172.21.15.18:0/97089525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 msgr2=0x5589bad38540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5589bad29200 tx=0x7f8334009770 comp rx=0 tx=0).stop 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- 172.21.15.18:0/97089525 shutdown_connections 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad18510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1f5c0 0x5589bad38540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 --2- 172.21.15.18:0/97089525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1eca0 0x5589bad2c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- 172.21.15.18:0/97089525 >> 172.21.15.18:0/97089525 conn(0x5589bad196a0 msgr2=0x5589bad17e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- 172.21.15.18:0/97089525 shutdown_connections 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- 172.21.15.18:0/97089525 wait complete. 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.148+0000 7f835646b740 1 -- start start 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 Processor -- start 2024-04-21T22:37:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad34f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1ac5c0 con 0x5589bad1eca0 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1abef0 con 0x5589bad1f5c0 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f834c1a9070 con 0x5589bad2c880 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.149+0000 7f835646b740 10 client.0 _ll_register_callbacks cb 0x7f833c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42884/0 (socket says 172.21.15.18:42884) 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 -- 172.21.15.18:0/2712990211 learned_addr learned my addr 172.21.15.18:0/2712990211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8351800640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8343e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad34f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 -- 172.21.15.18:0/2712990211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 msgr2=0x5589bad23760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad23760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 -- 172.21.15.18:0/2712990211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 msgr2=0x5589bad34f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad34f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 -- 172.21.15.18:0/2712990211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589bad23f90 con 0x5589bad1eca0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f8350e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f833c009b80 tx=0x7f833c0048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493bc5de41891de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.150+0000 7f833aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c026040 con 0x5589bad1eca0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f833c019430 con 0x5589bad1eca0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8334022110 con 0x5589bad1eca0 2024-04-21T22:37:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f833c043050 con 0x5589bad1eca0 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f835646b740 10 client.16212 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5589bada7af0 con 0x5589bad1eca0 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.151+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8334022110 con 0x5589bad1eca0 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f833c0196c0 con 0x5589bad1eca0 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 10 client.16212 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 10 client.16212 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 20 client.16212 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bada8150 0x5589badaa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 4 client.16212 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589bac8ac30 con 0x5589bada8150 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.152+0000 7f8343e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bada8150 0x5589badaa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f8343e00640 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bada8150 0x5589badaa540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e78f601dcda4a0af server_cookie=2a1359899069ecb4 in_seq=0 out_seq=0 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f833aa00640 10 client.16212 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:37:32.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f833aa00640 1 -- 172.21.15.18:0/2712990211 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589bac8ac30 con 0x5589bada8150 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f833aa00640 10 client.16212 handle_command_reply: tid=0 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 client.16212 shutdown 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 msgr2=0x5589bad34a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f833c009b80 tx=0x7f833c0048b0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 shutdown_connections 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5589bada8150 0x5589badaa540 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589bad2c880 0x5589bad23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589bad1f5c0 0x5589bad34f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 --2- 172.21.15.18:0/2712990211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589bad1eca0 0x5589bad34a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f833aa00640 0 client.16212 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 >> 172.21.15.18:0/2712990211 conn(0x5589bad196a0 msgr2=0x5589bad18690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 shutdown_connections 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 1 -- 172.21.15.18:0/2712990211 wait complete. 2024-04-21T22:37:32.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.153+0000 7f835646b740 20 client.16212 trim_cache size 0 max 16384 2024-04-21T22:37:32.163 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:37:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 msgr2=0x7f83300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 0x7f83300a51c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5589bad1a830 tx=0x7f8334013040 comp rx=0 tx=0).stop 2024-04-21T22:37:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 msgr2=0x7f834c19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 0x7f834c19c610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8344009bf0 tx=0x7f8344034670 comp rx=0 tx=0).stop 2024-04-21T22:37:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 shutdown_connections 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f83300a2d00 0x7f83300a51c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f834c1075f0 0x7f834c19c610 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f834c101ef0 0x7f834c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 --2- 172.21.15.18:0/1445115547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f834c101530 0x7f834c197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.154+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 >> 172.21.15.18:0/1445115547 conn(0x7f834c0fd020 msgr2=0x7f834c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.155+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 shutdown_connections 2024-04-21T22:37:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.155+0000 7f8352200640 1 -- 172.21.15.18:0/1445115547 wait complete. 2024-04-21T22:37:32.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:37:32.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 -- 172.21.15.18:0/3700121540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4076590 msgr2=0x7fbbc4111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/3700121540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4076590 0x7fbbc4111e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009930 tx=0x7fbbb002bc30 comp rx=0 tx=0).stop 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 -- 172.21.15.18:0/3700121540 shutdown_connections 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/3700121540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc41123c0 0x7fbbc41147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/3700121540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc4076590 0x7fbbc4111e80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/3700121540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 0x7fbbc4076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 -- 172.21.15.18:0/3700121540 >> 172.21.15.18:0/3700121540 conn(0x7fbbc40ff210 msgr2=0x7fbbc4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 -- 172.21.15.18:0/3700121540 shutdown_connections 2024-04-21T22:37:32.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.378+0000 7fbbc8a00640 1 -- 172.21.15.18:0/3700121540 wait complete. 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 Processor -- start 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 -- start start 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 0x7fbbc419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 0x7fbbc41a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4117f20 con 0x7fbbc4076590 2024-04-21T22:37:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4117da0 con 0x7fbbc4075c70 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.380+0000 7fbbc8a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41180a0 con 0x7fbbc41123c0 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42902/0 (socket says 172.21.15.18:42902) 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc1e00640 1 -- 172.21.15.18:0/4040000602 learned_addr learned my addr 172.21.15.18:0/4040000602 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 0x7fbbc419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 0x7fbbc41a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 -- 172.21.15.18:0/4040000602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 msgr2=0x7fbbc419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 0x7fbbc419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 -- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 msgr2=0x7fbbc419ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc3200640 1 -- 172.21.15.18:0/4040000602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41a34d0 con 0x7fbbc41123c0 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.381+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbc3200640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 0x7fbbc41a2da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc005fd0 tx=0x7fbbbc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbbb400640 1 -- 172.21.15.18:0/4040000602 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc003b70 con 0x7fbbc41123c0 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbbb400640 1 -- 172.21.15.18:0/4040000602 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbbc003d10 con 0x7fbbc41123c0 2024-04-21T22:37:32.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc41a37c0 con 0x7fbbc41123c0 2024-04-21T22:37:32.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbbb400640 1 -- 172.21.15.18:0/4040000602 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc010830 con 0x7fbbc41123c0 2024-04-21T22:37:32.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.382+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41ab050 con 0x7fbbc41123c0 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.385+0000 7fbbbb400640 1 -- 172.21.15.18:0/4040000602 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fbbbc004020 con 0x7fbbc41123c0 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.385+0000 7fbbcc077740 1 Processor -- start 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.385+0000 7fbbcc077740 1 -- start start 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152adee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56152ad473a0 con 0x56152adec470 2024-04-21T22:37:32.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56152acef930 con 0x56152ade2f70 2024-04-21T22:37:32.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbcc077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56152ad43360 con 0x56152ade3890 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152adee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.386+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50914/0 (socket says 172.21.15.18:50914) 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152adee860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42910/0 (socket says 172.21.15.18:42910) 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 -- 172.21.15.18:0/2981443118 learned_addr learned my addr 172.21.15.18:0/2981443118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 -- 172.21.15.18:0/2981443118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 msgr2=0x56152ade3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 -- 172.21.15.18:0/2981443118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 msgr2=0x56152adee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152adee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 -- 172.21.15.18:0/2981443118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152aa5b3f0 con 0x56152ade3890 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbbb400640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 0x7fbba80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbbb400640 1 -- 172.21.15.18:0/4040000602 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbbbc0cfa10 con 0x7fbbc41123c0 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc2800640 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009cf0 tx=0x7fbbb4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8cfdcd86a1bfe8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.387+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 0x7fbba80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbaf400640 1 -- 172.21.15.18:0/2981443118 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4004230 con 0x56152ade3890 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbaf400640 1 -- 172.21.15.18:0/2981443118 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb40043d0 con 0x56152ade3890 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbaf400640 1 -- 172.21.15.18:0/2981443118 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4019840 con 0x56152ade3890 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbcc077740 1 -- 172.21.15.18:0/2981443118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 msgr2=0x56152adebf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbcc077740 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009cf0 tx=0x7fbbb4011810 comp rx=0 tx=0).stop 2024-04-21T22:37:32.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.388+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 0x7fbba80a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000c00 tx=0x7fbbb0043040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 -- 172.21.15.18:0/2981443118 shutdown_connections 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152adee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adebf30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 --2- 172.21.15.18:0/2981443118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 -- 172.21.15.18:0/2981443118 >> 172.21.15.18:0/2981443118 conn(0x56152addd6a0 msgr2=0x56152addda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 -- 172.21.15.18:0/2981443118 shutdown_connections 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 -- 172.21.15.18:0/2981443118 wait complete. 2024-04-21T22:37:32.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 -- start start 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.389+0000 7fbbcc077740 1 Processor -- start 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152ade9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56152adef260 con 0x56152adec470 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56152ad02d80 con 0x56152ade2f70 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56152adef3e0 con 0x56152ade3890 2024-04-21T22:37:32.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbcc077740 10 client.0 _ll_register_callbacks cb 0x56152ad3f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152ade9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152ade9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50928/0 (socket says 172.21.15.18:50928) 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41476/0 (socket says 172.21.15.18:41476) 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc1e00640 1 -- 172.21.15.18:0/3206874312 learned_addr learned my addr 172.21.15.18:0/3206874312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.390+0000 7fbbc3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42914/0 (socket says 172.21.15.18:42914) 2024-04-21T22:37:32.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 -- 172.21.15.18:0/3206874312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 msgr2=0x56152ade9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152ade9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 -- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 msgr2=0x56152ade9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 -- 172.21.15.18:0/3206874312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152ab257d0 con 0x56152adec470 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbc3200640 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0cd100 tx=0x7fbbbc09ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ab1c82930dbf92 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbba3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0b4070 con 0x56152adec470 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbbbc0a48b0 con 0x56152adec470 2024-04-21T22:37:32.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb40043d0 con 0x56152adec470 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbbbc081050 con 0x56152adec470 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbcc077740 10 client.16224 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.391+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56152adfb5f0 con 0x56152adec470 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb40043d0 con 0x56152adec470 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fbbbc004c60 con 0x56152adec470 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 10 client.16224 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 10 client.16224 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:37:32.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 20 client.16224 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152adfcab0 0x56152adfeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 4 client.16224 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.392+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56152ad548e0 con 0x56152adfcab0 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.393+0000 7fbbc2800640 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152adfcab0 0x56152adfeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.393+0000 7fbbc2800640 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152adfcab0 0x56152adfeee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=107769385d5ca660 server_cookie=39339e0d72cd5660 in_seq=0 out_seq=0 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.393+0000 7fbba3e00640 10 client.16224 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.394+0000 7fbba3e00640 1 -- 172.21.15.18:0/3206874312 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56152ad548e0 con 0x56152adfcab0 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.394+0000 7fbba3e00640 10 client.16224 handle_command_reply: tid=0 2024-04-21T22:37:32.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.394+0000 7fbbcc077740 1 client.16224 shutdown 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 msgr2=0x56152ade9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0cd100 tx=0x7fbbbc09ba10 comp rx=0 tx=0).stop 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 shutdown_connections 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152adfcab0 0x56152adfeee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152adec470 0x56152ade9fa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbba3e00640 0 client.16224 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152ade9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3206874312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade2f70 0x56152ade9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 >> 172.21.15.18:0/3206874312 conn(0x56152addd6a0 msgr2=0x56152addf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 shutdown_connections 2024-04-21T22:37:32.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 1 -- 172.21.15.18:0/3206874312 wait complete. 2024-04-21T22:37:32.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.395+0000 7fbbcc077740 20 client.16224 trim_cache size 0 max 16384 2024-04-21T22:37:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.410+0000 7fbbcc077740 1 Processor -- start 2024-04-21T22:37:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.410+0000 7fbbcc077740 1 -- start start 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adf8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adec470 0x56152addc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b39a0 con 0x56152ade2f70 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b5660 con 0x56152adec470 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbcc077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b4130 con 0x56152ade3890 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42920/0 (socket says 172.21.15.18:42920) 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 -- 172.21.15.18:0/1434627219 learned_addr learned my addr 172.21.15.18:0/1434627219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adf8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc3200640 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adec470 0x56152addc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 -- 172.21.15.18:0/1434627219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 msgr2=0x56152adf8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adf8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 -- 172.21.15.18:0/1434627219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adec470 msgr2=0x56152addc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adec470 0x56152addc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.411+0000 7fbbc2800640 1 -- 172.21.15.18:0/1434627219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56152adff560 con 0x56152ade2f70 2024-04-21T22:37:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.412+0000 7fbbc2800640 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009c40 tx=0x7fbbb4019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5bf49fcac6efa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.412+0000 7fbbaea00640 1 -- 172.21.15.18:0/1434627219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4031070 con 0x56152ade2f70 2024-04-21T22:37:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.412+0000 7fbbaea00640 1 -- 172.21.15.18:0/1434627219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb4005520 con 0x56152ade2f70 2024-04-21T22:37:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.412+0000 7fbbaea00640 1 -- 172.21.15.18:0/1434627219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb402b6d0 con 0x56152ade2f70 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- 172.21.15.18:0/1434627219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 msgr2=0x56152adebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009c40 tx=0x7fbbb4019420 comp rx=0 tx=0).stop 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- 172.21.15.18:0/1434627219 shutdown_connections 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152adec470 0x56152addc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152ade3890 0x56152adf8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 --2- 172.21.15.18:0/1434627219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adebbe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- 172.21.15.18:0/1434627219 >> 172.21.15.18:0/1434627219 conn(0x56152addd6a0 msgr2=0x56152addbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- 172.21.15.18:0/1434627219 shutdown_connections 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- 172.21.15.18:0/1434627219 wait complete. 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.413+0000 7fbbcc077740 1 -- start start 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 Processor -- start 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade3890 0x56152adf0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152adec470 0x56152adf0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b4ed0 con 0x56152ade2f70 2024-04-21T22:37:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b4800 con 0x56152ade3890 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41b1980 con 0x56152adec470 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbcc077740 10 client.0 _ll_register_callbacks cb 0x7fbbbc00cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.414+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42922/0 (socket says 172.21.15.18:42922) 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 -- 172.21.15.18:0/3239753020 learned_addr learned my addr 172.21.15.18:0/3239753020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc3200640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152adec470 0x56152adf0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade3890 0x56152adf0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 -- 172.21.15.18:0/3239753020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152adec470 msgr2=0x56152adf0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152adec470 0x56152adf0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 -- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade3890 msgr2=0x56152adf0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade3890 0x56152adf0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 -- 172.21.15.18:0/3239753020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56152ae620d0 con 0x56152ade2f70 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbbc2800640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e678d997f64b6c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.415+0000 7fbba3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4031070 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb4005520 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbbb40052b0 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbbb402b670 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 10 client.16230 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56152ae633b0 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb4005520 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fbbb4003ad0 con 0x56152ade2f70 2024-04-21T22:37:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 10 client.16230 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 10 client.16230 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 20 client.16230 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.416+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152ae63950 0x56152ae65d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.417+0000 7fbbcc077740 4 client.16230 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.417+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56152ad4ec30 con 0x56152ae63950 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.417+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152ae63950 0x56152ae65d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.417+0000 7fbbc1e00640 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152ae63950 0x56152ae65d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=94b9105a30df6dc2 server_cookie=828903dbd896c163 in_seq=0 out_seq=0 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.417+0000 7fbba3e00640 10 client.16230 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbba3e00640 1 -- 172.21.15.18:0/3239753020 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56152ad4ec30 con 0x56152ae63950 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbba3e00640 10 client.16230 handle_command_reply: tid=0 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 client.16230 shutdown 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 msgr2=0x56152adf00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009ab0 tx=0x7fbbb4005760 comp rx=0 tx=0).stop 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 shutdown_connections 2024-04-21T22:37:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x56152ae63950 0x56152ae65d70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56152adec470 0x56152adf0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56152ade3890 0x56152adf0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 --2- 172.21.15.18:0/3239753020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56152ade2f70 0x56152adf00f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbba3e00640 0 client.16230 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 >> 172.21.15.18:0/3239753020 conn(0x56152addd6a0 msgr2=0x56152ade94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 shutdown_connections 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 1 -- 172.21.15.18:0/3239753020 wait complete. 2024-04-21T22:37:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.418+0000 7fbbcc077740 20 client.16230 trim_cache size 0 max 16384 2024-04-21T22:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:37:32.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 msgr2=0x7fbba80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 0x7fbba80a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000c00 tx=0x7fbbb0043040 comp rx=0 tx=0).stop 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 msgr2=0x7fbbc41a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 0x7fbbc41a2da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc005fd0 tx=0x7fbbbc00c6a0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 shutdown_connections 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbba80a2d00 0x7fbba80a51c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc41123c0 0x7fbbc41a2da0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbc4076590 0x7fbbc419ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 --2- 172.21.15.18:0/4040000602 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc4075c70 0x7fbbc419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 >> 172.21.15.18:0/4040000602 conn(0x7fbbc40ff210 msgr2=0x7fbbc4113a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 shutdown_connections 2024-04-21T22:37:32.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.419+0000 7fbbc8a00640 1 -- 172.21.15.18:0/4040000602 wait complete. 2024-04-21T22:37:32.434 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:32 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1163314405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:37:32.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:37:32.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 -- 172.21.15.18:0/823655153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4103760 msgr2=0x7f98b4103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 --2- 172.21.15.18:0/823655153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4103760 0x7f98b4103be0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f989c009860 tx=0x7f989c02bb70 comp rx=0 tx=0).stop 2024-04-21T22:37:32.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 -- 172.21.15.18:0/823655153 shutdown_connections 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 --2- 172.21.15.18:0/823655153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4104120 0x7f98b4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 --2- 172.21.15.18:0/823655153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4103760 0x7f98b4103be0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 --2- 172.21.15.18:0/823655153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4109770 0x7f98b4109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 -- 172.21.15.18:0/823655153 >> 172.21.15.18:0/823655153 conn(0x7f98b40ff230 msgr2=0x7f98b4101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 -- 172.21.15.18:0/823655153 shutdown_connections 2024-04-21T22:37:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.638+0000 7f98b8a00640 1 -- 172.21.15.18:0/823655153 wait complete. 2024-04-21T22:37:32.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:32 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1163314405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.639+0000 7f98b8a00640 1 Processor -- start 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 -- start start 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 0x7f98b419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 0x7f98b419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4109770 0x7f98b419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b4113b80 con 0x7f98b4104120 2024-04-21T22:37:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98b4113a00 con 0x7f98b4109770 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98b8a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98b4113d00 con 0x7f98b4103760 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.640+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 0x7f98b419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 0x7f98b419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 0x7f98b419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42936/0 (socket says 172.21.15.18:42936) 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98aaa00640 1 -- 172.21.15.18:0/1512067231 learned_addr learned my addr 172.21.15.18:0/1512067231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4109770 0x7f98b419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 -- 172.21.15.18:0/1512067231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4109770 msgr2=0x7f98b419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4109770 0x7f98b419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 -- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 msgr2=0x7f98b419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 0x7f98b419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 -- 172.21.15.18:0/1512067231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b419f040 con 0x7f98b4103760 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.641+0000 7f98b3400640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 0x7f98b419a0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98a400e790 tx=0x7f98a400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.642+0000 7f98b0c00640 1 -- 172.21.15.18:0/1512067231 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a400eea0 con 0x7f98b4103760 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.642+0000 7f98b0c00640 1 -- 172.21.15.18:0/1512067231 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a400ccc0 con 0x7f98b4103760 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.642+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b419f330 con 0x7f98b4103760 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.642+0000 7f98b0c00640 1 -- 172.21.15.18:0/1512067231 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4018780 con 0x7f98b4103760 2024-04-21T22:37:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.642+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b41a6bc0 con 0x7f98b4103760 2024-04-21T22:37:32.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.645+0000 7f98bce2d740 1 Processor -- start 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.645+0000 7f98b0c00640 1 -- 172.21.15.18:0/1512067231 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f98a4010430 con 0x7f98b4103760 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.645+0000 7f98bce2d740 1 -- start start 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.645+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f212b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.645+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f21e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98bce2d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d1f16e3a0 con 0x562d1f212780 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98bce2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d1f116930 con 0x562d1f21bc80 2024-04-21T22:37:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98bce2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d1f16a360 con 0x562d1f2130a0 2024-04-21T22:37:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f212b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50958/0 (socket says 172.21.15.18:50958) 2024-04-21T22:37:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 -- 172.21.15.18:0/4240614999 learned_addr learned my addr 172.21.15.18:0/4240614999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98aaa00640 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f21e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 -- 172.21.15.18:0/4240614999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 msgr2=0x562d1f21e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f21e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 -- 172.21.15.18:0/4240614999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 msgr2=0x562d1f212b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f212b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98b3400640 1 -- 172.21.15.18:0/4240614999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1ee823f0 con 0x562d1f2130a0 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.646+0000 7f98aaa00640 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f21e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.647+0000 7f98b3400640 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f98a40ccb70 tx=0x7f98a40d5b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece19dcf6cfc9199 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.647+0000 7f98a3e00640 1 -- 172.21.15.18:0/4240614999 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a40e2070 con 0x562d1f2130a0 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.647+0000 7f98a3e00640 1 -- 172.21.15.18:0/4240614999 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a40d1550 con 0x562d1f2130a0 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.647+0000 7f98a3e00640 1 -- 172.21.15.18:0/4240614999 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a40d7af0 con 0x562d1f2130a0 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98b0c00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 0x7f98980a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 -- 172.21.15.18:0/4240614999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 msgr2=0x562d1f21b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f98a40ccb70 tx=0x7f98a40d5b10 comp rx=0 tx=0).stop 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 -- 172.21.15.18:0/4240614999 shutdown_connections 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f21e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f21b740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 --2- 172.21.15.18:0/4240614999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f212b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 -- 172.21.15.18:0/4240614999 >> 172.21.15.18:0/4240614999 conn(0x562d1f20ceb0 msgr2=0x562d1f20d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98b0c00640 1 -- 172.21.15.18:0/1512067231 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f98a40cf540 con 0x7f98b4103760 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 0x7f98980a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 -- 172.21.15.18:0/4240614999 shutdown_connections 2024-04-21T22:37:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.648+0000 7f98bce2d740 1 -- 172.21.15.18:0/4240614999 wait complete. 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 -- start start 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 0x7f98980a5240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005fd0 tx=0x7f98ac009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 Processor -- start 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f219800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562d1f21ea70 con 0x562d1f2130a0 2024-04-21T22:37:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562d1f129d80 con 0x562d1f21bc80 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.649+0000 7f98bce2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562d1f21ebf0 con 0x562d1f212780 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98bce2d740 10 client.0 _ll_register_callbacks cb 0x562d1f1662b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42948/0 (socket says 172.21.15.18:42948) 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50974/0 (socket says 172.21.15.18:50974) 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98aaa00640 1 -- 172.21.15.18:0/1244773725 learned_addr learned my addr 172.21.15.18:0/1244773725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f219800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 -- 172.21.15.18:0/1244773725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 msgr2=0x562d1f219800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f219800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 -- 172.21.15.18:0/1244773725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 msgr2=0x562d1f2192c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98b3400640 1 -- 172.21.15.18:0/1244773725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1ef4c7d0 con 0x562d1f212780 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.650+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98b3400640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f98a40d74b0 tx=0x7f98a40cf7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33116d00ae060d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4097d50 con 0x562d1f212780 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a40d1550 con 0x562d1f212780 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f98a4010720 con 0x562d1f212780 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f98a409b410 con 0x562d1f212780 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98bce2d740 10 client.26368 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.651+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562d1f21ea70 con 0x562d1f212780 2024-04-21T22:37:32.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a40d1550 con 0x562d1f212780 2024-04-21T22:37:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f98a40cceb0 con 0x562d1f212780 2024-04-21T22:37:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 10 client.26368 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 10 client.26368 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:37:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 20 client.26368 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f22bf70 0x562d1f22e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 4 client.26368 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d1f17b8e0 con 0x562d1f22bf70 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.652+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f22bf70 0x562d1f22e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.653+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f22bf70 0x562d1f22e360 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3f649eaed081940 server_cookie=b0686976ec29238a in_seq=0 out_seq=0 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.653+0000 7f98a0c00640 10 client.26368 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98a0c00640 1 -- 172.21.15.18:0/1244773725 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d1f17b8e0 con 0x562d1f22bf70 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98a0c00640 10 client.26368 handle_command_reply: tid=0 2024-04-21T22:37:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 client.26368 shutdown 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 msgr2=0x562d1f218d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f98a40d74b0 tx=0x7f98a40cf7c0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 shutdown_connections 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f22bf70 0x562d1f22e360 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f219800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f2192c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98a0c00640 0 client.26368 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1244773725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f212780 0x562d1f218d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 >> 172.21.15.18:0/1244773725 conn(0x562d1f20ceb0 msgr2=0x562d1f20ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 shutdown_connections 2024-04-21T22:37:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 1 -- 172.21.15.18:0/1244773725 wait complete. 2024-04-21T22:37:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.654+0000 7f98bce2d740 20 client.26368 trim_cache size 0 max 16384 2024-04-21T22:37:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.669+0000 7f98bce2d740 1 Processor -- start 2024-04-21T22:37:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.669+0000 7f98bce2d740 1 -- start start 2024-04-21T22:37:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f227930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f203510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41ab1e0 con 0x562d1f212780 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41acea0 con 0x562d1f21bc80 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98bce2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41ab970 con 0x562d1f2130a0 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f203510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42958/0 (socket says 172.21.15.18:42958) 2024-04-21T22:37:32.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 -- 172.21.15.18:0/2061717829 learned_addr learned my addr 172.21.15.18:0/2061717829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98aaa00640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f227930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 -- 172.21.15.18:0/2061717829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 msgr2=0x562d1f227930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f227930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 -- 172.21.15.18:0/2061717829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 msgr2=0x562d1f203510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f203510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3400640 1 -- 172.21.15.18:0/2061717829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1f21e640 con 0x562d1f212780 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98aaa00640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f227930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.670+0000 7f98b3e00640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f203510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:32.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.671+0000 7f98b3400640 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98a4098430 tx=0x7f98a4099fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8669521cc0bbc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.671+0000 7f98a3400640 1 -- 172.21.15.18:0/2061717829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a409b5f0 con 0x562d1f212780 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.671+0000 7f98a3400640 1 -- 172.21.15.18:0/2061717829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a40a4670 con 0x562d1f212780 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.671+0000 7f98a3400640 1 -- 172.21.15.18:0/2061717829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a409b880 con 0x562d1f212780 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- 172.21.15.18:0/2061717829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 msgr2=0x562d1f21b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f98a4098430 tx=0x7f98a4099fc0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- 172.21.15.18:0/2061717829 shutdown_connections 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f21bc80 0x562d1f203510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f2130a0 0x562d1f227930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 --2- 172.21.15.18:0/2061717829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f212780 0x562d1f21b4b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- 172.21.15.18:0/2061717829 >> 172.21.15.18:0/2061717829 conn(0x562d1f20ceb0 msgr2=0x562d1f202e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- 172.21.15.18:0/2061717829 shutdown_connections 2024-04-21T22:37:32.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- 172.21.15.18:0/2061717829 wait complete. 2024-04-21T22:37:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.672+0000 7f98bce2d740 1 -- start start 2024-04-21T22:37:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 Processor -- start 2024-04-21T22:37:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f212780 0x562d1f224210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 0x562d1f21fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41ac710 con 0x562d1f2130a0 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41ac040 con 0x562d1f212780 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98b41a91c0 con 0x562d1f21bc80 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98bce2d740 10 client.0 _ll_register_callbacks cb 0x7f98a40e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42970/0 (socket says 172.21.15.18:42970) 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98aaa00640 1 -- 172.21.15.18:0/1982465613 learned_addr learned my addr 172.21.15.18:0/1982465613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.673+0000 7f98b3400640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f212780 0x562d1f224210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 0x562d1f21fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 -- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 msgr2=0x562d1f21fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 0x562d1f21fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 -- 172.21.15.18:0/1982465613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f212780 msgr2=0x562d1f224210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f212780 0x562d1f224210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 -- 172.21.15.18:0/1982465613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1f2202f0 con 0x562d1f2130a0 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98b3e00640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 0x562d1f21fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98aaa00640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f989c009830 tx=0x7f989c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82eecdec0ca662c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.674+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c04b030 con 0x562d1f2130a0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a40a4670 con 0x562d1f2130a0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f989c047bc0 con 0x562d1f2130a0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f989c039040 con 0x562d1f2130a0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 10 client.16248 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562d1f292290 con 0x562d1f2130a0 2024-04-21T22:37:32.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98a40a4670 con 0x562d1f2130a0 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f989c047730 con 0x562d1f2130a0 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 10 client.16248 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 10 client.16248 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 20 client.16248 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f292ab0 0x562d1f294ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 4 client.16248 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.675+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d1f175c30 con 0x562d1f292ab0 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.676+0000 7f98b3400640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f292ab0 0x562d1f294ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.676+0000 7f98b3400640 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f292ab0 0x562d1f294ed0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f35440ae739067f server_cookie=fb987fd6c383cd5c in_seq=0 out_seq=0 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.676+0000 7f98a0c00640 10 client.16248 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98a0c00640 1 -- 172.21.15.18:0/1982465613 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d1f175c30 con 0x562d1f292ab0 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98a0c00640 10 client.16248 handle_command_reply: tid=0 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 client.16248 shutdown 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 msgr2=0x562d1f21f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f989c009830 tx=0x7f989c0056d0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 shutdown_connections 2024-04-21T22:37:32.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562d1f292ab0 0x562d1f294ed0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562d1f21bc80 0x562d1f21fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d1f2130a0 0x562d1f21f5d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 --2- 172.21.15.18:0/1982465613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562d1f212780 0x562d1f224210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 >> 172.21.15.18:0/1982465613 conn(0x562d1f20ceb0 msgr2=0x562d1f203690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98a0c00640 0 client.16248 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 shutdown_connections 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 1 -- 172.21.15.18:0/1982465613 wait complete. 2024-04-21T22:37:32.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.677+0000 7f98bce2d740 20 client.16248 trim_cache size 0 max 16384 2024-04-21T22:37:32.686 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:37:32.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 msgr2=0x7f98980a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 0x7f98980a5240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005fd0 tx=0x7f98ac009500 comp rx=0 tx=0).stop 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 msgr2=0x7f98b419a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 0x7f98b419a0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f98a400e790 tx=0x7f98a400ec50 comp rx=0 tx=0).stop 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 shutdown_connections 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f98980a2d80 0x7f98980a5240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98b4109770 0x7f98b419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98b4104120 0x7f98b419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 --2- 172.21.15.18:0/1512067231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b4103760 0x7f98b419a0a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 >> 172.21.15.18:0/1512067231 conn(0x7f98b40ff230 msgr2=0x7f98b40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 shutdown_connections 2024-04-21T22:37:32.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.678+0000 7f98b8a00640 1 -- 172.21.15.18:0/1512067231 wait complete. 2024-04-21T22:37:32.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:32 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1163314405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:37:32.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:37:32.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 -- 172.21.15.18:0/3963334977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878104120 msgr2=0x7fa878110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 --2- 172.21.15.18:0/3963334977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878104120 0x7fa878110630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa870009cd0 tx=0x7fa87002c0e0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 -- 172.21.15.18:0/3963334977 shutdown_connections 2024-04-21T22:37:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 --2- 172.21.15.18:0/3963334977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878104120 0x7fa878110630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 --2- 172.21.15.18:0/3963334977 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 0x7fa878103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 --2- 172.21.15.18:0/3963334977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878109770 0x7fa878109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 -- 172.21.15.18:0/3963334977 >> 172.21.15.18:0/3963334977 conn(0x7fa8780ff230 msgr2=0x7fa878101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 -- 172.21.15.18:0/3963334977 shutdown_connections 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.909+0000 7fa877e00640 1 -- 172.21.15.18:0/3963334977 wait complete. 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.910+0000 7fa877e00640 1 Processor -- start 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.910+0000 7fa877e00640 1 -- start start 2024-04-21T22:37:32.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.910+0000 7fa877e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 0x7fa87819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.910+0000 7fa877e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 0x7fa87819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.910+0000 7fa877e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa878113b40 con 0x7fa878109770 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781139c0 con 0x7fa878103760 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa878113cc0 con 0x7fa878104120 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa876000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 0x7fa87819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42994/0 (socket says 172.21.15.18:42994) 2024-04-21T22:37:32.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 -- 172.21.15.18:0/1664028451 learned_addr learned my addr 172.21.15.18:0/1664028451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa876a00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 0x7fa87819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 -- 172.21.15.18:0/1664028451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 msgr2=0x7fa87819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 0x7fa87819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 -- 172.21.15.18:0/1664028451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 msgr2=0x7fa87819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 0x7fa87819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa877400640 1 -- 172.21.15.18:0/1664028451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87819f030 con 0x7fa878109770 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.911+0000 7fa876000640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 0x7fa87819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa877400640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa870005e30 tx=0x7fa870035d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa86f400640 1 -- 172.21.15.18:0/1664028451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870039040 con 0x7fa878109770 2024-04-21T22:37:32.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa86f400640 1 -- 172.21.15.18:0/1664028451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa870044070 con 0x7fa878109770 2024-04-21T22:37:32.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa86f400640 1 -- 172.21.15.18:0/1664028451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870004330 con 0x7fa878109770 2024-04-21T22:37:32.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87819f2c0 con 0x7fa878109770 2024-04-21T22:37:32.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.912+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781a6bb0 con 0x7fa878109770 2024-04-21T22:37:32.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.915+0000 7fa88043e740 1 Processor -- start 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa86f400640 1 -- 172.21.15.18:0/1664028451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa8700044d0 con 0x7fa878109770 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 -- start start 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ecdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ed0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555a55e293a0 con 0x555a55ece470 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a55dd1930 con 0x555a55ec5890 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.916+0000 7fa88043e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a55e25360 con 0x555a55ec4f70 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51004/0 (socket says 172.21.15.18:51004) 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 -- 172.21.15.18:0/270801834 learned_addr learned my addr 172.21.15.18:0/270801834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ed0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876a00640 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ecdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 -- 172.21.15.18:0/270801834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 msgr2=0x555a55ecdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ecdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 -- 172.21.15.18:0/270801834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 msgr2=0x555a55ed0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ed0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.917+0000 7fa876000640 1 -- 172.21.15.18:0/270801834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55b3d3f0 con 0x555a55ec4f70 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa86f400640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 0x7fa85c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa876000640 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa864011be0 tx=0x7fa864009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2468f6243e9467 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa86f400640 1 -- 172.21.15.18:0/1664028451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa8700f17e0 con 0x7fa878109770 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa863e00640 1 -- 172.21.15.18:0/270801834 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400fc50 con 0x555a55ec4f70 2024-04-21T22:37:32.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa863e00640 1 -- 172.21.15.18:0/270801834 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa86400fdf0 con 0x555a55ec4f70 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa863e00640 1 -- 172.21.15.18:0/270801834 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400e720 con 0x555a55ec4f70 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.918+0000 7fa876a00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 0x7fa85c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa876a00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 0x7fa85c0a51c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x555a55ec4a40 tx=0x7fa86800b390 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 -- 172.21.15.18:0/270801834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 msgr2=0x555a55ec5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa864011be0 tx=0x7fa864009ba0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 -- 172.21.15.18:0/270801834 shutdown_connections 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ed0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ecdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 --2- 172.21.15.18:0/270801834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec4f70 0x555a55ec5350 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 -- 172.21.15.18:0/270801834 >> 172.21.15.18:0/270801834 conn(0x555a55ebf6a0 msgr2=0x555a55ebfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 -- 172.21.15.18:0/270801834 shutdown_connections 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.919+0000 7fa88043e740 1 -- 172.21.15.18:0/270801834 wait complete. 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 -- start start 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 Processor -- start 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55ecb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ecbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555a55ed1260 con 0x555a55ece470 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555a55de4d80 con 0x555a55ec4f70 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.920+0000 7fa88043e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555a55ed13e0 con 0x555a55ec5890 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa88043e740 10 client.0 _ll_register_callbacks cb 0x555a55e212b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51016/0 (socket says 172.21.15.18:51016) 2024-04-21T22:37:32.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 -- 172.21.15.18:0/1977390841 learned_addr learned my addr 172.21.15.18:0/1977390841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa877400640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ecbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876a00640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55ecb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 -- 172.21.15.18:0/1977390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 msgr2=0x555a55ecb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55ecb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 -- 172.21.15.18:0/1977390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 msgr2=0x555a55ecbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ecbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 -- 172.21.15.18:0/1977390841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55c077d0 con 0x555a55ec5890 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876a00640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55ecb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa876000640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa864004430 tx=0x7fa86400ffa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5ef21bc958bc09 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.921+0000 7fa860c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86400fc50 con 0x555a55ec5890 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa864005440 con 0x555a55ec5890 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa86400fdf0 con 0x555a55ec5890 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa864005640 con 0x555a55ec5890 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa88043e740 10 client.26386 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a55edd530 con 0x555a55ec5890 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa86400fdf0 con 0x555a55ec5890 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa86401d020 con 0x555a55ec5890 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa88043e740 10 client.26386 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.922+0000 7fa88043e740 10 client.26386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa88043e740 20 client.26386 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55ede8e0 0x555a55ee0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa88043e740 4 client.26386 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a55e368e0 con 0x555a55ede8e0 2024-04-21T22:37:32.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa876a00640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55ede8e0 0x555a55ee0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa876a00640 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55ede8e0 0x555a55ee0cd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92b3f5d77ed4b8d1 server_cookie=22cffaf77d8bd90d in_seq=0 out_seq=0 2024-04-21T22:37:32.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.923+0000 7fa860c00640 10 client.26386 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.924+0000 7fa860c00640 1 -- 172.21.15.18:0/1977390841 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a55e368e0 con 0x555a55ede8e0 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa860c00640 10 client.26386 handle_command_reply: tid=0 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 client.26386 shutdown 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 msgr2=0x555a55ecb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa864004430 tx=0x7fa86400ffa0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 shutdown_connections 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55ede8e0 0x555a55ee0cd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ece470 0x555a55ecbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ec5890 0x555a55ecb9e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 --2- 172.21.15.18:0/1977390841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55ecb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa860c00640 0 client.26386 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 >> 172.21.15.18:0/1977390841 conn(0x555a55ebf6a0 msgr2=0x555a55ec13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 shutdown_connections 2024-04-21T22:37:32.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 1 -- 172.21.15.18:0/1977390841 wait complete. 2024-04-21T22:37:32.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.925+0000 7fa88043e740 20 client.26386 trim_cache size 0 max 16384 2024-04-21T22:37:32.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.940+0000 7fa88043e740 1 Processor -- start 2024-04-21T22:37:32.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.940+0000 7fa88043e740 1 -- start start 2024-04-21T22:37:32.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55eda150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 0x555a55ec0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781af550 con 0x555a55ec5890 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781b1210 con 0x555a55ec4f70 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa88043e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781afce0 con 0x555a55ece470 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa876000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 0x555a55ec0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51020/0 (socket says 172.21.15.18:51020) 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa876000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 0x555a55ec0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43022/0 (socket says 172.21.15.18:43022) 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 -- 172.21.15.18:0/2164882735 learned_addr learned my addr 172.21.15.18:0/2164882735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa876a00640 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55eda150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 -- 172.21.15.18:0/2164882735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 msgr2=0x555a55eda150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55eda150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 -- 172.21.15.18:0/2164882735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 msgr2=0x555a55ec0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 0x555a55ec0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.941+0000 7fa877400640 1 -- 172.21.15.18:0/2164882735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55ec19a0 con 0x555a55ece470 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.942+0000 7fa877400640 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa870035fb0 tx=0x7fa8700bdb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c97e24a5cd7be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.942+0000 7fa863400640 1 -- 172.21.15.18:0/2164882735 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700be4b0 con 0x555a55ece470 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.942+0000 7fa863400640 1 -- 172.21.15.18:0/2164882735 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8700c1070 con 0x555a55ece470 2024-04-21T22:37:32.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.942+0000 7fa863400640 1 -- 172.21.15.18:0/2164882735 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700ba420 con 0x555a55ece470 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- 172.21.15.18:0/2164882735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 msgr2=0x555a55ecbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa870035fb0 tx=0x7fa8700bdb80 comp rx=0 tx=0).stop 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- 172.21.15.18:0/2164882735 shutdown_connections 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ecbd40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec5890 0x555a55ec0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 --2- 172.21.15.18:0/2164882735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec4f70 0x555a55eda150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- 172.21.15.18:0/2164882735 >> 172.21.15.18:0/2164882735 conn(0x555a55ebf6a0 msgr2=0x555a55eca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- 172.21.15.18:0/2164882735 shutdown_connections 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- 172.21.15.18:0/2164882735 wait complete. 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 -- start start 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.943+0000 7fa88043e740 1 Processor -- start 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec4f70 0x555a55ed6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ed1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781b0a80 con 0x555a55ec4f70 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781b03b0 con 0x555a55ec5890 2024-04-21T22:37:32.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8781ad530 con 0x555a55ece470 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa88043e740 10 client.0 _ll_register_callbacks cb 0x7fa8640116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa877400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa877400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51032/0 (socket says 172.21.15.18:51032) 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa877400640 1 -- 172.21.15.18:0/2491209683 learned_addr learned my addr 172.21.15.18:0/2491209683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa876a00640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec4f70 0x555a55ed6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.944+0000 7fa876000640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ed1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 -- 172.21.15.18:0/2491209683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 msgr2=0x555a55ed1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ed1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 -- 172.21.15.18:0/2491209683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec4f70 msgr2=0x555a55ed6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec4f70 0x555a55ed6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 -- 172.21.15.18:0/2491209683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55ee1040 con 0x555a55ece470 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa877400640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ba210 tx=0x7fa8700eef80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3feb7975f965e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa860c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700be210 con 0x555a55ece470 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa8700c6590 con 0x555a55ece470 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8700c1070 con 0x555a55ece470 2024-04-21T22:37:32.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa8700c2160 con 0x555a55ece470 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa88043e740 10 client.26392 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.945+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555a55f44a80 con 0x555a55ece470 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8700c1070 con 0x555a55ece470 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa8700a8040 con 0x555a55ece470 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 10 client.26392 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 10 client.26392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 20 client.26392 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:32.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55f45090 0x555a55f47480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 4 client.26392 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:37:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a55e30c30 con 0x555a55f45090 2024-04-21T22:37:32.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.946+0000 7fa876a00640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55f45090 0x555a55f47480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:32.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa876a00640 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55f45090 0x555a55f47480 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c52e4ffdb298a5 server_cookie=3821988a6ac5b469 in_seq=0 out_seq=0 2024-04-21T22:37:32.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa860c00640 10 client.26392 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:37:32.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa860c00640 1 -- 172.21.15.18:0/2491209683 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a55e30c30 con 0x555a55f45090 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa860c00640 10 client.26392 handle_command_reply: tid=0 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 client.26392 shutdown 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 msgr2=0x555a55ed2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ba210 tx=0x7fa8700eef80 comp rx=0 tx=0).stop 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 shutdown_connections 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555a55f45090 0x555a55f47480 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a55ece470 0x555a55ed2240 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555a55ec5890 0x555a55ed1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 --2- 172.21.15.18:0/2491209683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555a55ec4f70 0x555a55ed6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa860c00640 0 client.26392 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.947+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 >> 172.21.15.18:0/2491209683 conn(0x555a55ebf6a0 msgr2=0x555a55eca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 shutdown_connections 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa88043e740 1 -- 172.21.15.18:0/2491209683 wait complete. 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa88043e740 20 client.26392 trim_cache size 0 max 16384 2024-04-21T22:37:32.957 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:37:32.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 msgr2=0x7fa85c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 0x7fa85c0a51c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x555a55ec4a40 tx=0x7fa86800b390 comp rx=0 tx=0).stop 2024-04-21T22:37:32.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 msgr2=0x7fa87819e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.948+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa870005e30 tx=0x7fa870035d10 comp rx=0 tx=0).stop 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 shutdown_connections 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa85c0a2d00 0x7fa85c0a51c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa878109770 0x7fa87819e900 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa878104120 0x7fa87819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 --2- 172.21.15.18:0/1664028451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa878103760 0x7fa87819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 >> 172.21.15.18:0/1664028451 conn(0x7fa8780ff230 msgr2=0x7fa8780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:32.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 shutdown_connections 2024-04-21T22:37:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:32.949+0000 7fa877e00640 1 -- 172.21.15.18:0/1664028451 wait complete. 2024-04-21T22:37:32.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:37:33.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 -- 172.21.15.18:0/4219489843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 msgr2=0x7f735010b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 --2- 172.21.15.18:0/4219489843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735010b580 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f733c009900 tx=0x7f733c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 -- 172.21.15.18:0/4219489843 shutdown_connections 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 --2- 172.21.15.18:0/4219489843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 0x7f735010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 --2- 172.21.15.18:0/4219489843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735010b580 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 --2- 172.21.15.18:0/4219489843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 0x7f7350102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 -- 172.21.15.18:0/4219489843 >> 172.21.15.18:0/4219489843 conn(0x7f73500771f0 msgr2=0x7f73500fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.186+0000 7f7356800640 1 -- 172.21.15.18:0/4219489843 shutdown_connections 2024-04-21T22:37:33.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.187+0000 7f7356800640 1 -- 172.21.15.18:0/4219489843 wait complete. 2024-04-21T22:37:33.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.187+0000 7f7356800640 1 Processor -- start 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 -- start start 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 0x7f735019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 0x7f735019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73501118e0 con 0x7f73501030a0 2024-04-21T22:37:33.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7350111760 con 0x7f735010bb50 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7356800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7350111a60 con 0x7f7350102780 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7354a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7354a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43030/0 (socket says 172.21.15.18:43030) 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7354a00640 1 -- 172.21.15.18:0/2735556137 learned_addr learned my addr 172.21.15.18:0/2735556137 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7355400640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 0x7f735019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.188+0000 7f7355e00640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 0x7f735019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 -- 172.21.15.18:0/2735556137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 msgr2=0x7f735019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 0x7f735019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 -- 172.21.15.18:0/2735556137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 msgr2=0x7f735019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 0x7f735019e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 -- 172.21.15.18:0/2735556137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735019f0f0 con 0x7f73501030a0 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7354a00640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f733c036040 tx=0x7f733c02cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f734e000640 1 -- 172.21.15.18:0/2735556137 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c043020 con 0x7f73501030a0 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.189+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735019f380 con 0x7f73501030a0 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.190+0000 7f734e000640 1 -- 172.21.15.18:0/2735556137 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f733c0054e0 con 0x7f73501030a0 2024-04-21T22:37:33.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.190+0000 7f734e000640 1 -- 172.21.15.18:0/2735556137 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c003bb0 con 0x7f73501030a0 2024-04-21T22:37:33.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.190+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73501a6c70 con 0x7f73501030a0 2024-04-21T22:37:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f735abe4740 1 Processor -- start 2024-04-21T22:37:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f735abe4740 1 -- start start 2024-04-21T22:37:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f734e000640 1 -- 172.21.15.18:0/2735556137 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f733c046020 con 0x7f73501030a0 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f735abe4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f735abe4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.193+0000 7f735abe4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f735abe4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56301050f3a0 con 0x5630105ab890 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f735abe4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5630104b7930 con 0x5630105aaf70 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f735abe4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56301050b360 con 0x5630105b4470 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7354a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41626/0 (socket says 172.21.15.18:41626) 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 -- 172.21.15.18:0/2730152713 learned_addr learned my addr 172.21.15.18:0/2730152713 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7354a00640 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51058/0 (socket says 172.21.15.18:51058) 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 -- 172.21.15.18:0/2730152713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 msgr2=0x5630105b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 -- 172.21.15.18:0/2730152713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 msgr2=0x5630105b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355e00640 1 -- 172.21.15.18:0/2730152713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630102233f0 con 0x5630105aaf70 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.194+0000 7f7355400640 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f7355e00640 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7348009f60 tx=0x7f7348009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d2d3f9896a468e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f734e000640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 0x7f73380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f7342600640 1 -- 172.21.15.18:0/2730152713 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734801e070 con 0x5630105aaf70 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f734e000640 1 -- 172.21.15.18:0/2735556137 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f733c0f13c0 con 0x7f73501030a0 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f7342600640 1 -- 172.21.15.18:0/2730152713 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7348003c30 con 0x5630105aaf70 2024-04-21T22:37:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f7342600640 1 -- 172.21.15.18:0/2730152713 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800f980 con 0x5630105aaf70 2024-04-21T22:37:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.195+0000 7f7355400640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 0x7f73380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 -- 172.21.15.18:0/2730152713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 msgr2=0x5630105ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7348009f60 tx=0x7f7348009f90 comp rx=0 tx=0).stop 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f7355400640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 0x7f73380a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5630105aaa40 tx=0x7f7344005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 -- 172.21.15.18:0/2730152713 shutdown_connections 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 --2- 172.21.15.18:0/2730152713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105ab350 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 -- 172.21.15.18:0/2730152713 >> 172.21.15.18:0/2730152713 conn(0x5630105a56a0 msgr2=0x5630105a5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 -- 172.21.15.18:0/2730152713 shutdown_connections 2024-04-21T22:37:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.196+0000 7f735abe4740 1 -- 172.21.15.18:0/2730152713 wait complete. 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.197+0000 7f735abe4740 1 -- start start 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.197+0000 7f735abe4740 1 Processor -- start 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.197+0000 7f735abe4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.197+0000 7f735abe4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f735abe4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f735abe4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630105b7260 con 0x5630105aaf70 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f735abe4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5630104cad80 con 0x5630105ab890 2024-04-21T22:37:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f735abe4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5630105b73e0 con 0x5630105b4470 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f735abe4740 10 client.0 _ll_register_callbacks cb 0x5630105072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43052/0 (socket says 172.21.15.18:43052) 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 -- 172.21.15.18:0/2190534659 learned_addr learned my addr 172.21.15.18:0/2190534659 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355e00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7354a00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 -- 172.21.15.18:0/2190534659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 msgr2=0x5630105b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 -- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 msgr2=0x5630105b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355400640 1 -- 172.21.15.18:0/2190534659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630102ed7d0 con 0x5630105aaf70 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7355e00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.198+0000 7f7354a00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f7355400640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f73440097c0 tx=0x7f7344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b97f1c2baa30953 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f7336a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734402e060 con 0x5630105aaf70 2024-04-21T22:37:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7344018030 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7348003c30 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7344009be0 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f735abe4740 10 client.16278 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.199+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5630105c3620 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7348003c30 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f734401c670 con 0x5630105aaf70 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 10 client.16278 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 20 client.16278 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5630105c4b80 0x5630105c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 4 client.16278 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.200+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56301051c8e0 con 0x5630105c4b80 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.201+0000 7f7354a00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5630105c4b80 0x5630105c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.201+0000 7f7354a00640 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5630105c4b80 0x5630105c6fe0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5996115db4aff server_cookie=97b19047362ab250 in_seq=0 out_seq=0 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.201+0000 7f7336a00640 10 client.16278 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f7336a00640 1 -- 172.21.15.18:0/2190534659 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56301051c8e0 con 0x5630105c4b80 2024-04-21T22:37:33.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f7336a00640 10 client.16278 handle_command_reply: tid=0 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 client.16278 shutdown 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 msgr2=0x5630105b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f73440097c0 tx=0x7f7344004730 comp rx=0 tx=0).stop 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 shutdown_connections 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5630105c4b80 0x5630105c6fe0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 --2- 172.21.15.18:0/2190534659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105b1540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 >> 172.21.15.18:0/2190534659 conn(0x5630105a56a0 msgr2=0x5630105a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.202+0000 7f7336a00640 0 client.16278 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.203+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 shutdown_connections 2024-04-21T22:37:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.203+0000 7f735abe4740 1 -- 172.21.15.18:0/2190534659 wait complete. 2024-04-21T22:37:33.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.203+0000 7f735abe4740 20 client.16278 trim_cache size 0 max 16384 2024-04-21T22:37:33.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 Processor -- start 2024-04-21T22:37:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 -- start start 2024-04-21T22:37:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73501af5e0 con 0x5630105aaf70 2024-04-21T22:37:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f73501b12a0 con 0x5630105ab890 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.218+0000 7f735abe4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73501afd70 con 0x5630105b4470 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43054/0 (socket says 172.21.15.18:43054) 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 -- 172.21.15.18:0/1033849533 learned_addr learned my addr 172.21.15.18:0/1033849533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355e00640 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7354a00640 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 -- 172.21.15.18:0/1033849533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 msgr2=0x5630105a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 -- 172.21.15.18:0/1033849533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 msgr2=0x5630105b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 -- 172.21.15.18:0/1033849533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630105b7330 con 0x5630105aaf70 2024-04-21T22:37:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.219+0000 7f7355400640 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f73440058c0 tx=0x7f73440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdeb5e0c57583f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f7341c00640 1 -- 172.21.15.18:0/1033849533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734401cd80 con 0x5630105aaf70 2024-04-21T22:37:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f7341c00640 1 -- 172.21.15.18:0/1033849533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f734401c880 con 0x5630105aaf70 2024-04-21T22:37:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f7341c00640 1 -- 172.21.15.18:0/1033849533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344029cf0 con 0x5630105aaf70 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 -- 172.21.15.18:0/1033849533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 msgr2=0x5630105c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f73440058c0 tx=0x7f73440046c0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 -- 172.21.15.18:0/1033849533 shutdown_connections 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105ab890 0x5630105b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 --2- 172.21.15.18:0/1033849533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105aaf70 0x5630105c0150 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.220+0000 7f735abe4740 1 -- 172.21.15.18:0/1033849533 >> 172.21.15.18:0/1033849533 conn(0x5630105a56a0 msgr2=0x5630105a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.221+0000 7f735abe4740 1 -- 172.21.15.18:0/1033849533 shutdown_connections 2024-04-21T22:37:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.221+0000 7f735abe4740 1 -- 172.21.15.18:0/1033849533 wait complete. 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.221+0000 7f735abe4740 1 -- start start 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.221+0000 7f735abe4740 1 Processor -- start 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73501b0b10 con 0x5630105ab890 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f73501b0440 con 0x5630105aaf70 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73501ad5c0 con 0x5630105b4470 2024-04-21T22:37:33.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f735abe4740 10 client.0 _ll_register_callbacks cb 0x7f7344009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41642/0 (socket says 172.21.15.18:41642) 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 -- 172.21.15.18:0/2468682362 learned_addr learned my addr 172.21.15.18:0/2468682362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7354a00640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 -- 172.21.15.18:0/2468682362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 msgr2=0x5630105b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 -- 172.21.15.18:0/2468682362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 msgr2=0x5630105b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355400640 1 -- 172.21.15.18:0/2468682362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630105b8a90 con 0x5630105aaf70 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.222+0000 7f7355e00640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f7355400640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7344019040 tx=0x7f7344009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a563e43a6cac9f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f7336a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344049060 con 0x5630105aaf70 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630105ad140 con 0x5630105aaf70 2024-04-21T22:37:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7344024040 con 0x5630105aaf70 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7344005b90 con 0x5630105aaf70 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f735abe4740 10 client.26372 fetch_fsmap learned FSMap version 32 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.223+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56301062b080 con 0x5630105aaf70 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5630105ad140 con 0x5630105aaf70 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7344004730 con 0x5630105aaf70 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 10 client.26372 fetch_fsmap finished waiting for FSMap version 32 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 10 client.26372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 20 client.26372 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:33.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56301062b710 0x56301062db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 4 client.26372 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:37:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.224+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563010516c30 con 0x56301062b710 2024-04-21T22:37:33.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f7354a00640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56301062b710 0x56301062db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f7354a00640 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56301062b710 0x56301062db30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215ea90415da8caf server_cookie=dab18c799238386f in_seq=0 out_seq=0 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f7336a00640 10 client.26372 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f7336a00640 1 -- 172.21.15.18:0/2468682362 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563010516c30 con 0x56301062b710 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f7336a00640 10 client.26372 handle_command_reply: tid=0 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.225+0000 7f735abe4740 1 client.26372 shutdown 2024-04-21T22:37:33.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 msgr2=0x5630105bc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7344019040 tx=0x7f7344009950 comp rx=0 tx=0).stop 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 shutdown_connections 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x56301062b710 0x56301062db30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630105b4470 0x5630105b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630105ab890 0x5630105b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 --2- 172.21.15.18:0/2468682362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630105aaf70 0x5630105bc9b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 >> 172.21.15.18:0/2468682362 conn(0x5630105a56a0 msgr2=0x5630105a7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f7336a00640 0 client.26372 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:33.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 shutdown_connections 2024-04-21T22:37:33.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 1 -- 172.21.15.18:0/2468682362 wait complete. 2024-04-21T22:37:33.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.226+0000 7f735abe4740 20 client.26372 trim_cache size 0 max 16384 2024-04-21T22:37:33.233 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:37:33.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 msgr2=0x7f73380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 0x7f73380a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5630105aaa40 tx=0x7f7344005f90 comp rx=0 tx=0).stop 2024-04-21T22:37:33.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 msgr2=0x7f735019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:33.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f733c036040 tx=0x7f733c02cbc0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 shutdown_connections 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f73380a2d00 0x7f73380a51c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f735010bb50 0x7f735019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73501030a0 0x7f735019a640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 --2- 172.21.15.18:0/2735556137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7350102780 0x7f735019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 >> 172.21.15.18:0/2735556137 conn(0x7f73500771f0 msgr2=0x7f7350100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 shutdown_connections 2024-04-21T22:37:33.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:33.227+0000 7f7356800640 1 -- 172.21.15.18:0/2735556137 wait complete. 2024-04-21T22:37:33.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:33 smithi018 ceph-mon[26614]: pgmap v108: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:33 smithi081 ceph-mon[31692]: pgmap v108: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:33 smithi047 ceph-mon[31561]: pgmap v108: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-21T22:37:34.245 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:37:34.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:37:34.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:37:34.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 -- 172.21.15.18:0/415403881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 msgr2=0x7fa8941019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 --2- 172.21.15.18:0/415403881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa8941019b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa880009930 tx=0x7fa88002bc20 comp rx=0 tx=0).stop 2024-04-21T22:37:34.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 -- 172.21.15.18:0/415403881 shutdown_connections 2024-04-21T22:37:34.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 --2- 172.21.15.18:0/415403881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 0x7fa89410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 --2- 172.21.15.18:0/415403881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa8941019b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 --2- 172.21.15.18:0/415403881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa8941079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 -- 172.21.15.18:0/415403881 >> 172.21.15.18:0/415403881 conn(0x7fa8940fd020 msgr2=0x7fa8940ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 -- 172.21.15.18:0/415403881 shutdown_connections 2024-04-21T22:37:34.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.472+0000 7fa893e00640 1 -- 172.21.15.18:0/415403881 wait complete. 2024-04-21T22:37:34.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.474+0000 7fa893e00640 1 Processor -- start 2024-04-21T22:37:34.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.474+0000 7fa893e00640 1 -- start start 2024-04-21T22:37:34.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.474+0000 7fa893e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.474+0000 7fa893e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 0x7fa89419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.474+0000 7fa893e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa89419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa893e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa894111920 con 0x7fa894101ef0 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa893e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941117a0 con 0x7fa8941075f0 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa893e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa894111aa0 con 0x7fa894101530 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51114/0 (socket says 172.21.15.18:51114) 2024-04-21T22:37:34.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 -- 172.21.15.18:0/3363057385 learned_addr learned my addr 172.21.15.18:0/3363057385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892000640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 0x7fa89419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa893400640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa89419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 -- 172.21.15.18:0/3363057385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 msgr2=0x7fa89419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa89419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 -- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 msgr2=0x7fa89419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 0x7fa89419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa892a00640 1 -- 172.21.15.18:0/3363057385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89419f0d0 con 0x7fa894101530 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.475+0000 7fa893400640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa89419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa892a00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e9f0 tx=0x7fa88400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa88b400640 1 -- 172.21.15.18:0/3363057385 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88400cd80 con 0x7fa894101530 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa88b400640 1 -- 172.21.15.18:0/3363057385 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa884005500 con 0x7fa894101530 2024-04-21T22:37:34.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa88b400640 1 -- 172.21.15.18:0/3363057385 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884010690 con 0x7fa894101530 2024-04-21T22:37:34.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89419f3c0 con 0x7fa894101530 2024-04-21T22:37:34.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.476+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8941a6c50 con 0x7fa894101530 2024-04-21T22:37:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.479+0000 7fa88b400640 1 -- 172.21.15.18:0/3363057385 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa8840046c0 con 0x7fa894101530 2024-04-21T22:37:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.479+0000 7fa89c62b740 1 Processor -- start 2024-04-21T22:37:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 -- start start 2024-04-21T22:37:34.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe62cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe6b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9efdc0df0 con 0x55a9efe6bde0 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9efdc6040 con 0x55a9efe628e0 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.480+0000 7fa89c62b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a9efd6e8c0 con 0x55a9efe63200 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa893400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe62cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43092/0 (socket says 172.21.15.18:43092) 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 -- 172.21.15.18:0/4002273515 learned_addr learned my addr 172.21.15.18:0/4002273515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa893400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe62cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41666/0 (socket says 172.21.15.18:41666) 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892a00640 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe6b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 -- 172.21.15.18:0/4002273515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 msgr2=0x55a9efe6b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe6b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 -- 172.21.15.18:0/4002273515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 msgr2=0x55a9efe62cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe62cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa892000640 1 -- 172.21.15.18:0/4002273515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9efba27e0 con 0x55a9efe6bde0 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa88b400640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 0x7fa8780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.481+0000 7fa88b400640 1 -- 172.21.15.18:0/3363057385 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa8840cf910 con 0x7fa894101530 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.482+0000 7fa892000640 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa880005ab0 tx=0x7fa880005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e15e4c9a67b7f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.482+0000 7fa893400640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 0x7fa8780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.482+0000 7fa87fe00640 1 -- 172.21.15.18:0/4002273515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880045070 con 0x55a9efe6bde0 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.482+0000 7fa87fe00640 1 -- 172.21.15.18:0/4002273515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88002c640 con 0x55a9efe6bde0 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.482+0000 7fa87fe00640 1 -- 172.21.15.18:0/4002273515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa880004b80 con 0x55a9efe6bde0 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 -- 172.21.15.18:0/4002273515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 msgr2=0x55a9efe6e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa893400640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 0x7fa8780a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa88c005fd0 tx=0x7fa88c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa880005ab0 tx=0x7fa880005e40 comp rx=0 tx=0).stop 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 -- 172.21.15.18:0/4002273515 shutdown_connections 2024-04-21T22:37:34.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe6e1d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe6b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 --2- 172.21.15.18:0/4002273515 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe62cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 -- 172.21.15.18:0/4002273515 >> 172.21.15.18:0/4002273515 conn(0x55a9efe5d010 msgr2=0x55a9efe5d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 -- 172.21.15.18:0/4002273515 shutdown_connections 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.483+0000 7fa89c62b740 1 -- 172.21.15.18:0/4002273515 wait complete. 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 -- start start 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 Processor -- start 2024-04-21T22:37:34.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe68de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe69320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe6bde0 0x55a9efe69860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a9efd81d20 con 0x55a9efe63200 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a9efdc2000 con 0x55a9efe628e0 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.484+0000 7fa89c62b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a9efe6eb70 con 0x55a9efe6bde0 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa89c62b740 10 client.0 _ll_register_callbacks cb 0x55a9efdbd0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:34.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe69320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa893400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe6bde0 0x55a9efe69860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe68de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe69320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43102/0 (socket says 172.21.15.18:43102) 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892000640 1 -- 172.21.15.18:0/1652232203 learned_addr learned my addr 172.21.15.18:0/1652232203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 -- 172.21.15.18:0/1652232203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe6bde0 msgr2=0x55a9efe69860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe6bde0 0x55a9efe69860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 -- 172.21.15.18:0/1652232203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 msgr2=0x55a9efe69320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe69320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.485+0000 7fa892a00640 1 -- 172.21.15.18:0/1652232203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9efc02f70 con 0x55a9efe628e0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa892a00640 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe68de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa8840cd000 tx=0x7fa884005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f37bdaacc2d1f2b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa87cc00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88409b730 con 0x55a9efe628e0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa8840a47b0 con 0x55a9efe628e0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa88002c640 con 0x55a9efe628e0 2024-04-21T22:37:34.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa8840cd490 con 0x55a9efe628e0 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa89c62b740 10 client.26384 fetch_fsmap learned FSMap version 33 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a9efa9a170 con 0x55a9efe628e0 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.486+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88002c640 con 0x55a9efe628e0 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fa8840b1030 con 0x55a9efe628e0 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 10 client.26384 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 10 client.26384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:34.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 20 client.26384 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efe7c080 0x55a9efe7e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 4 client.26384 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9efdd3580 con 0x55a9efe7c080 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.487+0000 7fa892000640 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efe7c080 0x55a9efe7e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.488+0000 7fa892000640 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efe7c080 0x55a9efe7e4f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf4ac5a7cefe7e1 server_cookie=6e918fbf72a44584 in_seq=0 out_seq=0 2024-04-21T22:37:34.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.488+0000 7fa87cc00640 10 client.26384 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.488+0000 7fa87cc00640 1 -- 172.21.15.18:0/1652232203 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a9efdd3580 con 0x55a9efe7c080 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa87cc00640 10 client.26384 handle_command_reply: tid=0 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 client.26384 shutdown 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 msgr2=0x55a9efe68de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe68de0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa8840cd000 tx=0x7fa884005730 comp rx=0 tx=0).stop 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 shutdown_connections 2024-04-21T22:37:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efe7c080 0x55a9efe7e4f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe6bde0 0x55a9efe69860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe69320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1652232203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe68de0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa87cc00640 0 client.26384 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 >> 172.21.15.18:0/1652232203 conn(0x55a9efe5d010 msgr2=0x55a9efe5ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 shutdown_connections 2024-04-21T22:37:34.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 1 -- 172.21.15.18:0/1652232203 wait complete. 2024-04-21T22:37:34.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.489+0000 7fa89c62b740 20 client.26384 trim_cache size 0 max 16384 2024-04-21T22:37:34.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 Processor -- start 2024-04-21T22:37:34.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 -- start start 2024-04-21T22:37:34.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe6b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941af4b0 con 0x55a9efe6bde0 2024-04-21T22:37:34.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941b10e0 con 0x55a9efe628e0 2024-04-21T22:37:34.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa89c62b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941afc40 con 0x55a9efe63200 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa893400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa893400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43118/0 (socket says 172.21.15.18:43118) 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.509+0000 7fa893400640 1 -- 172.21.15.18:0/1192267060 learned_addr learned my addr 172.21.15.18:0/1192267060 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa892000640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa892a00640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe6b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 -- 172.21.15.18:0/1192267060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 msgr2=0x55a9efe778e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe778e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 -- 172.21.15.18:0/1192267060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 msgr2=0x55a9efe6b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe6b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 -- 172.21.15.18:0/1192267060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9efe61c00 con 0x55a9efe6bde0 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa892a00640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe6b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.510+0000 7fa893400640 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa88c010a60 tx=0x7fa88c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286edf6eec630fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa87f400640 1 -- 172.21.15.18:0/1192267060 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c01e9a0 con 0x55a9efe6bde0 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa87f400640 1 -- 172.21.15.18:0/1192267060 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88c01eb40 con 0x55a9efe6bde0 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa87f400640 1 -- 172.21.15.18:0/1192267060 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00e620 con 0x55a9efe6bde0 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 -- 172.21.15.18:0/1192267060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 msgr2=0x55a9efe5bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa88c010a60 tx=0x7fa88c019000 comp rx=0 tx=0).stop 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 -- 172.21.15.18:0/1192267060 shutdown_connections 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe6bde0 0x55a9efe5bf00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe63200 0x55a9efe778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 --2- 172.21.15.18:0/1192267060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe628e0 0x55a9efe6b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 -- 172.21.15.18:0/1192267060 >> 172.21.15.18:0/1192267060 conn(0x55a9efe5d010 msgr2=0x55a9efe5b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 -- 172.21.15.18:0/1192267060 shutdown_connections 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.511+0000 7fa89c62b740 1 -- 172.21.15.18:0/1192267060 wait complete. 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.512+0000 7fa89c62b740 1 -- start start 2024-04-21T22:37:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.512+0000 7fa89c62b740 1 Processor -- start 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.512+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe6fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe6bde0 0x55a9efe70420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941b09e0 con 0x55a9efe63200 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941b0310 con 0x55a9efe6bde0 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941ad490 con 0x55a9efe628e0 2024-04-21T22:37:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa89c62b740 10 client.0 _ll_register_callbacks cb 0x7fa88400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51150/0 (socket says 172.21.15.18:51150) 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe6fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 -- 172.21.15.18:0/3178690439 learned_addr learned my addr 172.21.15.18:0/3178690439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa893400640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe6bde0 0x55a9efe70420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 -- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe6bde0 msgr2=0x55a9efe70420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe6bde0 0x55a9efe70420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 -- 172.21.15.18:0/3178690439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 msgr2=0x55a9efe6fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe6fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 -- 172.21.15.18:0/3178690439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9efee1800 con 0x55a9efe628e0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.513+0000 7fa892a00640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa884098750 tx=0x7fa8840a47c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2fdf0138f441484 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88409b730 con 0x55a9efe628e0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fa884097d30 con 0x55a9efe628e0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa88c01eb40 con 0x55a9efe628e0 2024-04-21T22:37:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa88409c4d0 con 0x55a9efe628e0 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 10 client.26428 fetch_fsmap learned FSMap version 33 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a9efee2b00 con 0x55a9efe628e0 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa88c01eb40 con 0x55a9efe628e0 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fa8840b1070 con 0x55a9efe628e0 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 10 client.26428 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 10 client.26428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 20 client.26428 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efee30e0 0x55a9efee54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.514+0000 7fa89c62b740 4 client.26428 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:37:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.515+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a9efdcd8d0 con 0x55a9efee30e0 2024-04-21T22:37:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.515+0000 7fa892000640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efee30e0 0x55a9efee54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.515+0000 7fa892000640 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efee30e0 0x55a9efee54d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c63c955b4df41922 server_cookie=dd3308a78e31ebf3 in_seq=0 out_seq=0 2024-04-21T22:37:34.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.515+0000 7fa87cc00640 10 client.26428 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.516+0000 7fa87cc00640 1 -- 172.21.15.18:0/3178690439 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a9efdcd8d0 con 0x55a9efee30e0 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.516+0000 7fa87cc00640 10 client.26428 handle_command_reply: tid=0 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.516+0000 7fa89c62b740 1 client.26428 shutdown 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 msgr2=0x55a9efe6f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa884098750 tx=0x7fa8840a47c0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 shutdown_connections 2024-04-21T22:37:34.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a9efe6bde0 0x55a9efe70420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a9efe63200 0x55a9efe6fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a9efee30e0 0x55a9efee54d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 --2- 172.21.15.18:0/3178690439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a9efe628e0 0x55a9efe6f9a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa87cc00640 0 client.26428 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 >> 172.21.15.18:0/3178690439 conn(0x55a9efe5d010 msgr2=0x55a9efe5c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 shutdown_connections 2024-04-21T22:37:34.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 1 -- 172.21.15.18:0/3178690439 wait complete. 2024-04-21T22:37:34.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.517+0000 7fa89c62b740 20 client.26428 trim_cache size 0 max 16384 2024-04-21T22:37:34.530 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:37:34.531 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:37:34.531 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "68e8784c-7766-4ec1-9402-1f83342d3b68", 2024-04-21T22:37:34.531 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:37:34.531 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 msgr2=0x7fa8780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 0x7fa8780a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa88c005fd0 tx=0x7fa88c009500 comp rx=0 tx=0).stop 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 msgr2=0x7fa89419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e9f0 tx=0x7fa88400edf0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 shutdown_connections 2024-04-21T22:37:34.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa8780a2d00 0x7fa8780a51c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa8941075f0 0x7fa89419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa894101ef0 0x7fa89419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 --2- 172.21.15.18:0/3363057385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa894101530 0x7fa89419a0e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 >> 172.21.15.18:0/3363057385 conn(0x7fa8940fd020 msgr2=0x7fa8940fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 shutdown_connections 2024-04-21T22:37:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.518+0000 7fa893e00640 1 -- 172.21.15.18:0/3363057385 wait complete. 2024-04-21T22:37:34.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:37:34.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:37:34.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:34 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:34.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:34 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:34.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:34 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 -- 172.21.15.18:0/1764713321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 msgr2=0x7fb3c0073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 --2- 172.21.15.18:0/1764713321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c0073ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009900 tx=0x7fb3b002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 -- 172.21.15.18:0/1764713321 shutdown_connections 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 --2- 172.21.15.18:0/1764713321 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c010dde0 0x7fb3c01101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 --2- 172.21.15.18:0/1764713321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c0074430 0x7fb3c010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 --2- 172.21.15.18:0/1764713321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c0073ef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 -- 172.21.15.18:0/1764713321 >> 172.21.15.18:0/1764713321 conn(0x7fb3c00fd090 msgr2=0x7fb3c00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 -- 172.21.15.18:0/1764713321 shutdown_connections 2024-04-21T22:37:34.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.772+0000 7fb3c5600640 1 -- 172.21.15.18:0/1764713321 wait complete. 2024-04-21T22:37:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.773+0000 7fb3c5600640 1 Processor -- start 2024-04-21T22:37:34.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.773+0000 7fb3c5600640 1 -- start start 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 0x7fb3c019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c010dde0 0x7fb3c019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0113b90 con 0x7fb3c010dde0 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0113a10 con 0x7fb3c0074430 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3c5600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0113d10 con 0x7fb3c0073b10 2024-04-21T22:37:34.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.774+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 0x7fb3c019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51162/0 (socket says 172.21.15.18:51162) 2024-04-21T22:37:34.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bfe00640 1 -- 172.21.15.18:0/2639807447 learned_addr learned my addr 172.21.15.18:0/2639807447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c010dde0 0x7fb3c019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 -- 172.21.15.18:0/2639807447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 msgr2=0x7fb3c019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 -- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c010dde0 msgr2=0x7fb3c019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c010dde0 0x7fb3c019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bf400640 1 -- 172.21.15.18:0/2639807447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c019f090 con 0x7fb3c0074430 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.775+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3bf400640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 0x7fb3c019a630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005fd0 tx=0x7fb3ac00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3bcc00640 1 -- 172.21.15.18:0/2639807447 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac009c30 con 0x7fb3c0074430 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3bcc00640 1 -- 172.21.15.18:0/2639807447 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3ac009dd0 con 0x7fb3c0074430 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3bcc00640 1 -- 172.21.15.18:0/2639807447 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac010460 con 0x7fb3c0074430 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c019f380 con 0x7fb3c0074430 2024-04-21T22:37:34.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.776+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c01a6c10 con 0x7fb3c0074430 2024-04-21T22:37:34.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.780+0000 7fb3c9979740 1 Processor -- start 2024-04-21T22:37:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 -- start start 2024-04-21T22:37:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3bcc00640 1 -- 172.21.15.18:0/2639807447 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb3ac003ef0 con 0x7fb3c0074430 2024-04-21T22:37:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 0x55792ead7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eada3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55792ea32410 con 0x55792eacf3d0 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55792e9da7e0 con 0x55792ead7fb0 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.781+0000 7fb3c9979740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55792ea2e3d0 con 0x55792eaceab0 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eada3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 0x55792ead7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:51170/0 (socket says 172.21.15.18:51170) 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2281914002 learned_addr learned my addr 172.21.15.18:0/2281914002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2281914002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 msgr2=0x55792eada3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eada3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2281914002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 msgr2=0x55792ead7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 0x55792ead7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2281914002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792e8107d0 con 0x55792eaceab0 2024-04-21T22:37:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 0x55792ead7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.782+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ec0 tx=0x7fb3b80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8179d22043bf6d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3b5200640 1 -- 172.21.15.18:0/2281914002 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004d20 con 0x55792eaceab0 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3bcc00640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 0x7fb3a40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3b5200640 1 -- 172.21.15.18:0/2281914002 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8003e50 con 0x55792eaceab0 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3b5200640 1 -- 172.21.15.18:0/2281914002 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8005280 con 0x55792eaceab0 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3bcc00640 1 -- 172.21.15.18:0/2639807447 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb3ac0cef50 con 0x7fb3c0074430 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.783+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 0x7fb3a40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 -- 172.21.15.18:0/2281914002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 msgr2=0x55792eacee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ec0 tx=0x7fb3b80107a0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 -- 172.21.15.18:0/2281914002 shutdown_connections 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eada3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eacf3d0 0x55792ead7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2281914002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eaceab0 0x55792eacee90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 -- 172.21.15.18:0/2281914002 >> 172.21.15.18:0/2281914002 conn(0x55792eac91e0 msgr2=0x55792eac95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 -- 172.21.15.18:0/2281914002 shutdown_connections 2024-04-21T22:37:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3c9979740 1 -- 172.21.15.18:0/2281914002 wait complete. 2024-04-21T22:37:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.784+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 0x7fb3a40a5240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55792eace580 tx=0x7fb3b0005a20 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 -- start start 2024-04-21T22:37:34.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 Processor -- start 2024-04-21T22:37:34.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792ead5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 0x55792ead5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55792eadada0 con 0x55792eaceab0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55792e9edc40 con 0x55792eacf3d0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55792eadaf20 con 0x55792ead7fb0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.785+0000 7fb3c9979740 10 client.0 _ll_register_callbacks cb 0x55792e9ed630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41750/0 (socket says 172.21.15.18:41750) 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792ead5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3bf400640 1 -- 172.21.15.18:0/2558419801 learned_addr learned my addr 172.21.15.18:0/2558419801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 0x55792ead5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 msgr2=0x55792ead55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2558419801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 msgr2=0x55792ead5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792ead5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3c4c00640 1 -- 172.21.15.18:0/2558419801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792e7463f0 con 0x55792ead7fb0 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.786+0000 7fb3bf400640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 0x55792ead5ae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8000f80 tx=0x7fb3b8003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4cfbb6d10fb93f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3a9600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:34.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8004830 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb3b8004c50 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b8003e50 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb3b8004e50 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3c9979740 10 client.26440 fetch_fsmap learned FSMap version 33 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.787+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55792e7060f0 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8003e50 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fb3b8011440 con 0x55792ead7fb0 2024-04-21T22:37:34.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 10 client.26440 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 10 client.26440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 20 client.26440 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eae8360 0x55792eaea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 4 client.26440 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.788+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55792ea45c40 con 0x55792eae8360 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.789+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eae8360 0x55792eaea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.789+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eae8360 0x55792eaea750 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faffc4306f575b1e server_cookie=e2141a18a32dce9e in_seq=0 out_seq=0 2024-04-21T22:37:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.789+0000 7fb3a9600640 10 client.26440 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.790+0000 7fb3a9600640 1 -- 172.21.15.18:0/2558419801 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55792ea45c40 con 0x55792eae8360 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.790+0000 7fb3a9600640 10 client.26440 handle_command_reply: tid=0 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.790+0000 7fb3c9979740 1 client.26440 shutdown 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 msgr2=0x55792ead5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 0x55792ead5ae0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8000f80 tx=0x7fb3b8003ba0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 shutdown_connections 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eae8360 0x55792eaea750 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792ead7fb0 0x55792ead5ae0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eacf3d0 0x55792ead55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 --2- 172.21.15.18:0/2558419801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792ead5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 >> 172.21.15.18:0/2558419801 conn(0x55792eac91e0 msgr2=0x55792eac8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3a9600640 0 client.26440 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 shutdown_connections 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 1 -- 172.21.15.18:0/2558419801 wait complete. 2024-04-21T22:37:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.791+0000 7fb3c9979740 20 client.26440 trim_cache size 0 max 16384 2024-04-21T22:37:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 Processor -- start 2024-04-21T22:37:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 -- start start 2024-04-21T22:37:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792eae3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01af620 con 0x55792eaceab0 2024-04-21T22:37:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01b1250 con 0x55792ead7fb0 2024-04-21T22:37:34.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c9979740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01afdb0 con 0x55792eacf3d0 2024-04-21T22:37:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.819+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792eae3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41752/0 (socket says 172.21.15.18:41752) 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 -- 172.21.15.18:0/3673652958 learned_addr learned my addr 172.21.15.18:0/3673652958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 -- 172.21.15.18:0/3673652958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 msgr2=0x55792ead5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 -- 172.21.15.18:0/3673652958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 msgr2=0x55792eae3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792eae3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 -- 172.21.15.18:0/3673652958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792eada900 con 0x55792ead7fb0 2024-04-21T22:37:34.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3bf400640 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.820+0000 7fb3c4c00640 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8006010 tx=0x7fb3b8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc3cd988cd0827a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.821+0000 7fb3abe00640 1 -- 172.21.15.18:0/3673652958 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8011440 con 0x55792ead7fb0 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.821+0000 7fb3abe00640 1 -- 172.21.15.18:0/3673652958 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b80115e0 con 0x55792ead7fb0 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.821+0000 7fb3abe00640 1 -- 172.21.15.18:0/3673652958 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b801b900 con 0x55792ead7fb0 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- 172.21.15.18:0/3673652958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 msgr2=0x55792eac82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8006010 tx=0x7fb3b8009c60 comp rx=0 tx=0).stop 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- 172.21.15.18:0/3673652958 shutdown_connections 2024-04-21T22:37:34.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792ead7fb0 0x55792eac82c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 --2- 172.21.15.18:0/3673652958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792eaceab0 0x55792eae3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- 172.21.15.18:0/3673652958 >> 172.21.15.18:0/3673652958 conn(0x55792eac91e0 msgr2=0x55792eac7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- 172.21.15.18:0/3673652958 shutdown_connections 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- 172.21.15.18:0/3673652958 wait complete. 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.822+0000 7fb3c9979740 1 -- start start 2024-04-21T22:37:34.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 Processor -- start 2024-04-21T22:37:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 0x55792eae0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 0x55792ead1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01b0b50 con 0x55792ead7fb0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01b0480 con 0x55792eaceab0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c01ad600 con 0x55792eacf3d0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.823+0000 7fb3c9979740 10 client.0 _ll_register_callbacks cb 0x7fb3b80046b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 0x55792ead1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3c4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 0x55792ead1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43198/0 (socket says 172.21.15.18:43198) 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3c4c00640 1 -- 172.21.15.18:0/1349150240 learned_addr learned my addr 172.21.15.18:0/1349150240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:37:34.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 0x55792eae0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 -- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 msgr2=0x55792eae0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 0x55792eae0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 -- 172.21.15.18:0/1349150240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 msgr2=0x55792ead1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 0x55792ead1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 -- 172.21.15.18:0/1349150240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792ead2430 con 0x55792eacf3d0 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 0x55792eae0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3bf400640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead18b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009610 tx=0x7fb3ac0d2670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd7367d6118ab19 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:37:34.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.824+0000 7fb3a9600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac09add0 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb3ac097ae0 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b80115e0 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb3ac09bb70 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3c9979740 10 client.26446 fetch_fsmap learned FSMap version 33 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55792eb56ca0 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b80115e0 con 0x55792eacf3d0 2024-04-21T22:37:34.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.825+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fb3ac0d10b0 con 0x55792eacf3d0 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 10 client.26446 fetch_fsmap finished waiting for FSMap version 33 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 10 client.26446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 20 client.26446 populate_metadata read hostname 'smithi018' 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eb57400 0x55792eb59820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 4 client.26446 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55792ea3f950 con 0x55792eb57400 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.826+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eb57400 0x55792eb59820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:37:34.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.827+0000 7fb3bfe00640 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eb57400 0x55792eb59820 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5d8c95fdfbc20e server_cookie=68ab6f9afbac476a in_seq=0 out_seq=0 2024-04-21T22:37:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.827+0000 7fb3a9600640 10 client.26446 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.827+0000 7fb3a9600640 1 -- 172.21.15.18:0/1349150240 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55792ea3f950 con 0x55792eb57400 2024-04-21T22:37:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.827+0000 7fb3a9600640 10 client.26446 handle_command_reply: tid=0 2024-04-21T22:37:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.827+0000 7fb3c9979740 1 client.26446 shutdown 2024-04-21T22:37:34.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 msgr2=0x55792ead18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead18b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009610 tx=0x7fb3ac0d2670 comp rx=0 tx=0).stop 2024-04-21T22:37:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 shutdown_connections 2024-04-21T22:37:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55792ead7fb0 0x55792ead1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55792eb57400 0x55792eb59820 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55792eacf3d0 0x55792ead18b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 --2- 172.21.15.18:0/1349150240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55792eaceab0 0x55792eae0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3a9600640 0 client.26446 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 >> 172.21.15.18:0/1349150240 conn(0x55792eac91e0 msgr2=0x55792eac7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 shutdown_connections 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 1 -- 172.21.15.18:0/1349150240 wait complete. 2024-04-21T22:37:34.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.828+0000 7fb3c9979740 20 client.26446 trim_cache size 0 max 16384 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "68e8784c-7766-4ec1-9402-1f83342d3b68": { 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "68e8784c-7766-4ec1-9402-1f83342d3b68", 2024-04-21T22:37:34.836 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:37:34.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:37:34.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:37:34.837 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:37:34.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 msgr2=0x7fb3a40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 0x7fb3a40a5240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55792eace580 tx=0x7fb3b0005a20 comp rx=0 tx=0).stop 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 msgr2=0x7fb3c019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 0x7fb3c019a630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005fd0 tx=0x7fb3ac00dde0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 shutdown_connections 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb3a40a2d80 0x7fb3a40a5240 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3c010dde0 0x7fb3c019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb3c0074430 0x7fb3c019a630 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 --2- 172.21.15.18:0/2639807447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3c0073b10 0x7fb3c019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:37:34.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 >> 172.21.15.18:0/2639807447 conn(0x7fb3c00fd090 msgr2=0x7fb3c00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:37:34.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 shutdown_connections 2024-04-21T22:37:34.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:37:34.829+0000 7fb3c5600640 1 -- 172.21.15.18:0/2639807447 wait complete. 2024-04-21T22:37:34.850 INFO:tasks.cephfs.filesystem:scrub status for tag:68e8784c-7766-4ec1-9402-1f83342d3b68 - {'path': '/', 'tag': '68e8784c-7766-4ec1-9402-1f83342d3b68', 'options': 'recursive,force'} 2024-04-21T22:37:35.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: pgmap v109: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:35.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:37:35.596 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.597 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.598 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:37:35.598 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.598 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.598 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:35 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.598 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: pgmap v109: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.599 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:37:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:35 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: pgmap v109: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-04-21T22:37:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:37:35.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:35.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:35 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:37:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:37 smithi081 ceph-mon[31692]: pgmap v110: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T22:37:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:37 smithi047 ceph-mon[31561]: pgmap v110: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T22:37:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:37 smithi018 ceph-mon[26614]: pgmap v110: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-21T22:37:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:39 smithi081 ceph-mon[31692]: pgmap v111: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:39 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:39 smithi047 ceph-mon[31561]: pgmap v111: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:39 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:39 smithi018 ceph-mon[26614]: pgmap v111: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:39.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:39 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:41 smithi081 ceph-mon[31692]: pgmap v112: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:41 smithi047 ceph-mon[31561]: pgmap v112: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:41 smithi018 ceph-mon[26614]: pgmap v112: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:43 smithi081 ceph-mon[31692]: pgmap v113: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:43 smithi047 ceph-mon[31561]: pgmap v113: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:43 smithi018 ceph-mon[26614]: pgmap v113: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-04-21T22:37:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:45 smithi081 ceph-mon[31692]: pgmap v114: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-04-21T22:37:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:45 smithi047 ceph-mon[31561]: pgmap v114: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-04-21T22:37:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:45 smithi018 ceph-mon[26614]: pgmap v114: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-04-21T22:37:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:47 smithi081 ceph-mon[31692]: pgmap v115: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:37:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:47 smithi047 ceph-mon[31561]: pgmap v115: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:37:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:47 smithi018 ceph-mon[26614]: pgmap v115: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:37:48.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:48 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:48.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:48 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:48.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:48 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:48.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:48 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:48 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:48.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:48 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:48.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:48 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:48.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:48 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:48.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:48 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:49 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:49.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:49 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:37:49.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:49 smithi047 ceph-mon[31561]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:49 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:49.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:49 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:37:49.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:49 smithi018 ceph-mon[26614]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:49 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:49.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:49 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:37:49.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:49 smithi081 ceph-mon[31692]: pgmap v116: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:37:51.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:51 smithi018 ceph-mon[26614]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:51 smithi047 ceph-mon[31561]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:51 smithi081 ceph-mon[31692]: pgmap v117: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:53 smithi047 ceph-mon[31561]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:53 smithi018 ceph-mon[26614]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:53 smithi081 ceph-mon[31692]: pgmap v118: 97 pgs: 97 active+clean; 95 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:37:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:54 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:54.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:54 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:54.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:54 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:37:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:55 smithi047 ceph-mon[31561]: pgmap v119: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-04-21T22:37:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:55 smithi018 ceph-mon[26614]: pgmap v119: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-04-21T22:37:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:55 smithi081 ceph-mon[31692]: pgmap v119: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-04-21T22:37:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:57 smithi047 ceph-mon[31561]: pgmap v120: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-04-21T22:37:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:57 smithi018 ceph-mon[26614]: pgmap v120: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-04-21T22:37:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:57 smithi081 ceph-mon[31692]: pgmap v120: 97 pgs: 97 active+clean; 96 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-04-21T22:37:59.691 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:37:59 smithi081 ceph-mon[31692]: pgmap v121: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-21T22:37:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:37:59 smithi047 ceph-mon[31561]: pgmap v121: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-21T22:37:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:37:59 smithi018 ceph-mon[26614]: pgmap v121: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 13 op/s 2024-04-21T22:38:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:01 smithi018 ceph-mon[26614]: pgmap v122: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:01 smithi081 ceph-mon[31692]: pgmap v122: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:01 smithi047 ceph-mon[31561]: pgmap v122: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:03 smithi018 ceph-mon[26614]: pgmap v123: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:03 smithi081 ceph-mon[31692]: pgmap v123: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:03.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:03 smithi047 ceph-mon[31561]: pgmap v123: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-04-21T22:38:04.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:38:04.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:38:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 -- 172.21.15.18:0/727143455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b01066b0 msgr2=0x7ff9b0106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/727143455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b01066b0 0x7ff9b0106a90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009860 tx=0x7ff9a002bb70 comp rx=0 tx=0).stop 2024-04-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 -- 172.21.15.18:0/727143455 shutdown_connections 2024-04-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/727143455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b0100fd0 0x7ff9b010d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/727143455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/727143455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b01066b0 0x7ff9b0106a90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 -- 172.21.15.18:0/727143455 >> 172.21.15.18:0/727143455 conn(0x7ff9b00777f0 msgr2=0x7ff9b0077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 -- 172.21.15.18:0/727143455 shutdown_connections 2024-04-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.082+0000 7ff9b6c00640 1 -- 172.21.15.18:0/727143455 wait complete. 2024-04-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.083+0000 7ff9b6c00640 1 Processor -- start 2024-04-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.083+0000 7ff9b6c00640 1 -- start start 2024-04-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 0x7ff9b019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 0x7ff9b019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0111b30 con 0x7ff9b0100610 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01119b0 con 0x7ff9b0100fd0 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b6c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b0111cb0 con 0x7ff9b01066b0 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44500/0 (socket says 172.21.15.18:44500) 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 0x7ff9b019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9afe00640 1 -- 172.21.15.18:0/40394456 learned_addr learned my addr 172.21.15.18:0/40394456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.084+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 0x7ff9b019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 -- 172.21.15.18:0/40394456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 msgr2=0x7ff9b019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 0x7ff9b019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 -- 172.21.15.18:0/40394456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 msgr2=0x7ff9b019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 0x7ff9b019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 -- 172.21.15.18:0/40394456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b019f210 con 0x7ff9b0100610 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9af400640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 0x7ff9b019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 0x7ff9b019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9afe00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0037040 tx=0x7ff9a0004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9acc00640 1 -- 172.21.15.18:0/40394456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0041020 con 0x7ff9b0100610 2024-04-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9acc00640 1 -- 172.21.15.18:0/40394456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a002c9f0 con 0x7ff9b0100610 2024-04-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b019f4a0 con 0x7ff9b0100610 2024-04-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.085+0000 7ff9acc00640 1 -- 172.21.15.18:0/40394456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0039040 con 0x7ff9b0100610 2024-04-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.086+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b01a6d90 con 0x7ff9b0100610 2024-04-21T22:38:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9acc00640 1 -- 172.21.15.18:0/40394456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff9a0044020 con 0x7ff9b0100610 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 Processor -- start 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 -- start start 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836cd1e0 0x556f836d5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f83630410 con 0x556f836cd1e0 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f835d87e0 con 0x556f836cc8c0 2024-04-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.089+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556f8362c3d0 con 0x556f836d5dc0 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836cd1e0 0x556f836d5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:36514/0 (socket says 172.21.15.18:36514) 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 -- 172.21.15.18:0/3872921589 learned_addr learned my addr 172.21.15.18:0/3872921589 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 -- 172.21.15.18:0/3872921589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 msgr2=0x556f836ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 -- 172.21.15.18:0/3872921589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836cd1e0 msgr2=0x556f836d5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836cd1e0 0x556f836d5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.090+0000 7ff9af400640 1 -- 172.21.15.18:0/3872921589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8340e7d0 con 0x556f836d5dc0 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9af400640 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff9980114f0 tx=0x7ff9980119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b980e45c979f5f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9acc00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 0x7ff9940a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9acc00640 1 -- 172.21.15.18:0/40394456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff9a00f0bd0 con 0x7ff9b0100610 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9a5200640 1 -- 172.21.15.18:0/3872921589 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99801e070 con 0x556f836d5dc0 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9a5200640 1 -- 172.21.15.18:0/3872921589 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9980035f0 con 0x556f836d5dc0 2024-04-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9a5200640 1 -- 172.21.15.18:0/3872921589 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99800f7c0 con 0x556f836d5dc0 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.091+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 0x7ff9940a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3872921589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 msgr2=0x556f836d81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff9980114f0 tx=0x7ff9980119b0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 0x7ff9940a5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009fd0 tx=0x7ff9a8010040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3872921589 shutdown_connections 2024-04-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836d5dc0 0x556f836d81b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836cd1e0 0x556f836d5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3872921589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3872921589 >> 172.21.15.18:0/3872921589 conn(0x556f836c6ff0 msgr2=0x556f836c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3872921589 shutdown_connections 2024-04-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3872921589 wait complete. 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.092+0000 7ff9b99b8740 1 -- start start 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 Processor -- start 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f836d8bb0 con 0x556f836d5dc0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556f835ebc40 con 0x556f836cc8c0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556f836d8d30 con 0x556f836cd1e0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b99b8740 10 client.0 _ll_register_callbacks cb 0x556f835eb630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.093+0000 7ff9b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44522/0 (socket says 172.21.15.18:44522) 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9b4c00640 1 -- 172.21.15.18:0/1151892702 learned_addr learned my addr 172.21.15.18:0/1151892702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9af400640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 -- 172.21.15.18:0/1151892702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 msgr2=0x556f836d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 -- 172.21.15.18:0/1151892702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 msgr2=0x556f836d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 -- 172.21.15.18:0/1151892702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f833443f0 con 0x556f836cc8c0 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9b4c00640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9af400640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d2e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00ee3a0 tx=0x7ff9a00324b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2edcca8e0779ea6a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff99d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.094+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00bcf70 con 0x556f836cc8c0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff9a00dd0b0 con 0x556f836cc8c0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9980035f0 con 0x556f836cc8c0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff9a00bcb00 con 0x556f836cc8c0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 10 client.26417 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556f833040f0 con 0x556f836cc8c0 2024-04-21T22:38:05.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9980035f0 con 0x556f836cc8c0 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ff9a003c030 con 0x556f836cc8c0 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 10 client.26417 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 10 client.26417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 20 client.26417 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f836e6160 0x556f836e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 4 client.26417 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:05.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.095+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f83643c40 con 0x556f836e6160 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.096+0000 7ff9af400640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f836e6160 0x556f836e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.096+0000 7ff9af400640 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f836e6160 0x556f836e85e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a143d6a5d4756ef2 server_cookie=50fcb4a7397f06f1 in_seq=0 out_seq=0 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.096+0000 7ff99d600640 10 client.26417 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.097+0000 7ff99d600640 1 -- 172.21.15.18:0/1151892702 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556f83643c40 con 0x556f836e6160 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.097+0000 7ff99d600640 10 client.26417 handle_command_reply: tid=0 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 client.26417 shutdown 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 msgr2=0x556f836d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d2e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00ee3a0 tx=0x7ff9a00324b0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 shutdown_connections 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f836e6160 0x556f836e85e0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1151892702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d2e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 >> 172.21.15.18:0/1151892702 conn(0x556f836c6ff0 msgr2=0x556f836c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff99d600640 0 client.26417 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:05.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 shutdown_connections 2024-04-21T22:38:05.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1151892702 wait complete. 2024-04-21T22:38:05.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.098+0000 7ff9b99b8740 20 client.26417 trim_cache size 0 max 16384 2024-04-21T22:38:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.118+0000 7ff9b99b8740 1 Processor -- start 2024-04-21T22:38:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.118+0000 7ff9b99b8740 1 -- start start 2024-04-21T22:38:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.118+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01af740 con 0x556f836d5dc0 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b1310 con 0x556f836cc8c0 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01afe70 con 0x556f836cd1e0 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42684/0 (socket says 172.21.15.18:42684) 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 -- 172.21.15.18:0/1396600711 learned_addr learned my addr 172.21.15.18:0/1396600711 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9af400640 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 -- 172.21.15.18:0/1396600711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 msgr2=0x556f836e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836e1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 -- 172.21.15.18:0/1396600711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 msgr2=0x556f836edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.119+0000 7ff9afe00640 1 -- 172.21.15.18:0/1396600711 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f836d8a90 con 0x556f836cc8c0 2024-04-21T22:38:05.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff9afe00640 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00b9600 tx=0x7ff9a0032740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5deb33a2816a7b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff99fe00640 1 -- 172.21.15.18:0/1396600711 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00bcce0 con 0x556f836cc8c0 2024-04-21T22:38:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff99fe00640 1 -- 172.21.15.18:0/1396600711 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a00bd8a0 con 0x556f836cc8c0 2024-04-21T22:38:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff99fe00640 1 -- 172.21.15.18:0/1396600711 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00dd0b0 con 0x556f836cc8c0 2024-04-21T22:38:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1396600711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 msgr2=0x556f836d5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.120+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00b9600 tx=0x7ff9a0032740 comp rx=0 tx=0).stop 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1396600711 shutdown_connections 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/1396600711 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d5570 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1396600711 >> 172.21.15.18:0/1396600711 conn(0x556f836c6ff0 msgr2=0x556f836d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1396600711 shutdown_connections 2024-04-21T22:38:05.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 -- 172.21.15.18:0/1396600711 wait complete. 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 -- start start 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.121+0000 7ff9b99b8740 1 Processor -- start 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b0c10 con 0x556f836d5dc0 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01b0540 con 0x556f836cc8c0 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b01ad720 con 0x556f836cd1e0 2024-04-21T22:38:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b99b8740 10 client.0 _ll_register_callbacks cb 0x7ff9a0005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42686/0 (socket says 172.21.15.18:42686) 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9afe00640 1 -- 172.21.15.18:0/3654494998 learned_addr learned my addr 172.21.15.18:0/3654494998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.122+0000 7ff9af400640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 -- 172.21.15.18:0/3654494998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 msgr2=0x556f836d9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 -- 172.21.15.18:0/3654494998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 msgr2=0x556f836d99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 -- 172.21.15.18:0/3654494998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8374a820 con 0x556f836cc8c0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9afe00640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff9a002cbc0 tx=0x7ff9a00d6210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69169a85f19cf0c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff99d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00bcce0 con 0x556f836cc8c0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff9a00c5b80 con 0x556f836cc8c0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.123+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a00bd8a0 con 0x556f836cc8c0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff9a00bcf70 con 0x556f836cc8c0 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 10 client.26423 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:05.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556f8374bb10 con 0x556f836cc8c0 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9a00bd8a0 con 0x556f836cc8c0 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ff9a00bc5f0 con 0x556f836cc8c0 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 10 client.26423 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 10 client.26423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 20 client.26423 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f8374bfc0 0x556f8374e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 4 client.26423 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:38:05.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f8363d950 con 0x556f8374bfc0 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.124+0000 7ff9af400640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f8374bfc0 0x556f8374e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9af400640 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f8374bfc0 0x556f8374e3e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9ac36bc2bccc1a server_cookie=b1976d61d2c187af in_seq=0 out_seq=0 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff99d600640 10 client.26423 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff99d600640 1 -- 172.21.15.18:0/3654494998 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556f8363d950 con 0x556f8374bfc0 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff99d600640 10 client.26423 handle_command_reply: tid=0 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 client.26423 shutdown 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 msgr2=0x556f836d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff9a002cbc0 tx=0x7ff9a00d6210 comp rx=0 tx=0).stop 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 shutdown_connections 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f836d5dc0 0x556f836d99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556f8374bfc0 0x556f8374e3e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f836cd1e0 0x556f836d9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 --2- 172.21.15.18:0/3654494998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556f836cc8c0 0x556f836d8f40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff99d600640 0 client.26423 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.125+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 >> 172.21.15.18:0/3654494998 conn(0x556f836c6ff0 msgr2=0x556f836d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 shutdown_connections 2024-04-21T22:38:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b99b8740 1 -- 172.21.15.18:0/3654494998 wait complete. 2024-04-21T22:38:05.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b99b8740 20 client.26423 trim_cache size 0 max 16384 2024-04-21T22:38:05.135 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:05.136 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:38:05.136 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:38:05.136 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:05.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 msgr2=0x7ff9940a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 0x7ff9940a5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009fd0 tx=0x7ff9a8010040 comp rx=0 tx=0).stop 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 msgr2=0x7ff9b019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0037040 tx=0x7ff9a0004590 comp rx=0 tx=0).stop 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.126+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 shutdown_connections 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff9940a2d80 0x7ff9940a5240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b01066b0 0x7ff9b019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9b0100fd0 0x7ff9b019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 --2- 172.21.15.18:0/40394456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b0100610 0x7ff9b019a220 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 >> 172.21.15.18:0/40394456 conn(0x7ff9b00777f0 msgr2=0x7ff9b010bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 shutdown_connections 2024-04-21T22:38:05.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.127+0000 7ff9b6c00640 1 -- 172.21.15.18:0/40394456 wait complete. 2024-04-21T22:38:05.146 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:38:05.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:38:05.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 -- 172.21.15.18:0/1601088291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 msgr2=0x7f0888107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 --2- 172.21.15.18:0/1601088291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f0888107a10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0878009900 tx=0x7f087802bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 -- 172.21.15.18:0/1601088291 shutdown_connections 2024-04-21T22:38:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 --2- 172.21.15.18:0/1601088291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f088810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 --2- 172.21.15.18:0/1601088291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 --2- 172.21.15.18:0/1601088291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f0888107a10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 -- 172.21.15.18:0/1601088291 >> 172.21.15.18:0/1601088291 conn(0x7f08880fd130 msgr2=0x7f08880ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 -- 172.21.15.18:0/1601088291 shutdown_connections 2024-04-21T22:38:05.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.354+0000 7f088d600640 1 -- 172.21.15.18:0/1601088291 wait complete. 2024-04-21T22:38:05.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.355+0000 7f088d600640 1 Processor -- start 2024-04-21T22:38:05.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 -- start start 2024-04-21T22:38:05.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f0888073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f08880744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0888111a40 con 0x7f0888101620 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08881118c0 con 0x7f0888107630 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0888111bc0 con 0x7f0888101fe0 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f0887e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f0887e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44558/0 (socket says 172.21.15.18:44558) 2024-04-21T22:38:05.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f0887e00640 1 -- 172.21.15.18:0/3065955750 learned_addr learned my addr 172.21.15.18:0/3065955750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f0887400640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f0888073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.356+0000 7f088cc00640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f08880744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 -- 172.21.15.18:0/3065955750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 msgr2=0x7f0888073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f0888073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 -- 172.21.15.18:0/3065955750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 msgr2=0x7f08880744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f08880744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 -- 172.21.15.18:0/3065955750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08881a63e0 con 0x7f0888101620 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887400640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f0888073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0887e00640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0878005940 tx=0x7f0878004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.357+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878041070 con 0x7f0888101620 2024-04-21T22:38:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.358+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08780054e0 con 0x7f0888101620 2024-04-21T22:38:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.358+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08881a6670 con 0x7f0888101620 2024-04-21T22:38:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.358+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878003d00 con 0x7f0888101620 2024-04-21T22:38:05.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.358+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08881a6b60 con 0x7f0888101620 2024-04-21T22:38:05.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.359+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088804f570 con 0x7f0888101620 2024-04-21T22:38:05.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.362+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f0878044070 con 0x7f0888101620 2024-04-21T22:38:05.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.362+0000 7f0884c00640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 0x7f086c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.362+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f08780f0fe0 con 0x7f0888101620 2024-04-21T22:38:05.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.363+0000 7f0887400640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 0x7f086c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.363+0000 7f0887400640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 0x7f086c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08880754d0 tx=0x7f0874005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.367+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f08780bd680 con 0x7f0888101620 2024-04-21T22:38:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:05 smithi018 ceph-mon[26614]: pgmap v124: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T22:38:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.619+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0888109b90 con 0x7f0888101620 2024-04-21T22:38:05.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.621+0000 7f0884c00640 1 -- 172.21.15.18:0/3065955750 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11918 (secure 0 0 0) 0x7f08780c1980 con 0x7f0888101620 2024-04-21T22:38:05.622 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:38:05.622 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:37:53.103468+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24568,24596,24509,24538,24496]},"id":1}]} 2024-04-21T22:38:05.622 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-04-21T22:38:05.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 msgr2=0x7f086c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 0x7f086c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08880754d0 tx=0x7f0874005f90 comp rx=0 tx=0).stop 2024-04-21T22:38:05.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 msgr2=0x7f0888073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0878005940 tx=0x7f0878004270 comp rx=0 tx=0).stop 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 shutdown_connections 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f086c0a2cf0 0x7f086c0a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0888107630 0x7f08880744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0888101fe0 0x7f0888073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 --2- 172.21.15.18:0/3065955750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0888101620 0x7f0888073a40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 >> 172.21.15.18:0/3065955750 conn(0x7f08880fd130 msgr2=0x7f08880fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.623+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 shutdown_connections 2024-04-21T22:38:05.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.624+0000 7f088d600640 1 -- 172.21.15.18:0/3065955750 wait complete. 2024-04-21T22:38:05.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:38:05.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:05 smithi047 ceph-mon[31561]: pgmap v124: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T22:38:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 -- 172.21.15.18:0/2834128113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 msgr2=0x7fea50110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 --2- 172.21.15.18:0/2834128113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea50110630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fea48009cd0 tx=0x7fea4802c0e0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 -- 172.21.15.18:0/2834128113 shutdown_connections 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 --2- 172.21.15.18:0/2834128113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea50110630 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 --2- 172.21.15.18:0/2834128113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 0x7fea50103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 --2- 172.21.15.18:0/2834128113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea50109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 -- 172.21.15.18:0/2834128113 >> 172.21.15.18:0/2834128113 conn(0x7fea500ff230 msgr2=0x7fea50101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 -- 172.21.15.18:0/2834128113 shutdown_connections 2024-04-21T22:38:05.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.855+0000 7fea4fe00640 1 -- 172.21.15.18:0/2834128113 wait complete. 2024-04-21T22:38:05.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.856+0000 7fea4fe00640 1 Processor -- start 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.856+0000 7fea4fe00640 1 -- start start 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 0x7fea5019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea5019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea50113b80 con 0x7fea50104120 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea50113a00 con 0x7fea50109770 2024-04-21T22:38:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea50113d00 con 0x7fea50103760 2024-04-21T22:38:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44256/0 (socket says 172.21.15.18:44256) 2024-04-21T22:38:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4e000640 1 -- 172.21.15.18:0/3074626667 learned_addr learned my addr 172.21.15.18:0/3074626667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea5019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4ea00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 0x7fea5019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 -- 172.21.15.18:0/3074626667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 msgr2=0x7fea5019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 0x7fea5019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 -- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 msgr2=0x7fea5019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4f400640 1 -- 172.21.15.18:0/3074626667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5019f040 con 0x7fea50109770 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.857+0000 7fea4e000640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea4f400640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea5019e910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea48037040 tx=0x7fea48032460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea54a00640 1 -- 172.21.15.18:0/3074626667 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48039040 con 0x7fea50109770 2024-04-21T22:38:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea54a00640 1 -- 172.21.15.18:0/3074626667 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea48044070 con 0x7fea50109770 2024-04-21T22:38:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5019f2d0 con 0x7fea50109770 2024-04-21T22:38:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea54a00640 1 -- 172.21.15.18:0/3074626667 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480042a0 con 0x7fea50109770 2024-04-21T22:38:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.858+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea501a6bc0 con 0x7fea50109770 2024-04-21T22:38:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 Processor -- start 2024-04-21T22:38:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea54a00640 1 -- 172.21.15.18:0/3074626667 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fea48032590 con 0x7fea50109770 2024-04-21T22:38:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 -- start start 2024-04-21T22:38:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40bb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608c40143a0 con 0x5608c40b0890 2024-04-21T22:38:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5608c3fbc930 con 0x5608c40aff70 2024-04-21T22:38:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.862+0000 7fea58a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608c4010360 con 0x5608c40b9470 2024-04-21T22:38:05.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44262/0 (socket says 172.21.15.18:44262) 2024-04-21T22:38:05.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 -- 172.21.15.18:0/186729666 learned_addr learned my addr 172.21.15.18:0/186729666 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4e000640 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 -- 172.21.15.18:0/186729666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 msgr2=0x5608c40bb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40bb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 -- 172.21.15.18:0/186729666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 msgr2=0x5608c40b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 -- 172.21.15.18:0/186729666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c3d283f0 con 0x5608c40b0890 2024-04-21T22:38:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea54a00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 0x7fea340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.863+0000 7fea4ea00640 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea40009c70 tx=0x7fea40011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d158a270dec95d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea54a00640 1 -- 172.21.15.18:0/3074626667 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fea480f1790 con 0x7fea50109770 2024-04-21T22:38:05.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea4e000640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 0x7fea340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea3be00640 1 -- 172.21.15.18:0/186729666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40004230 con 0x5608c40b0890 2024-04-21T22:38:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea3be00640 1 -- 172.21.15.18:0/186729666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea400043d0 con 0x5608c40b0890 2024-04-21T22:38:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea3be00640 1 -- 172.21.15.18:0/186729666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40019820 con 0x5608c40b0890 2024-04-21T22:38:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea58a7c740 1 -- 172.21.15.18:0/186729666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 msgr2=0x5608c40b8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea4e000640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 0x7fea340a51c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5608c40ab830 tx=0x7fea3c015040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.864+0000 7fea58a7c740 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea40009c70 tx=0x7fea40011810 comp rx=0 tx=0).stop 2024-04-21T22:38:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 -- 172.21.15.18:0/186729666 shutdown_connections 2024-04-21T22:38:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40bb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b8f30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 --2- 172.21.15.18:0/186729666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 -- 172.21.15.18:0/186729666 >> 172.21.15.18:0/186729666 conn(0x5608c40aa6a0 msgr2=0x5608c40aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 -- 172.21.15.18:0/186729666 shutdown_connections 2024-04-21T22:38:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 -- 172.21.15.18:0/186729666 wait complete. 2024-04-21T22:38:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 -- start start 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.865+0000 7fea58a7c740 1 Processor -- start 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5608c40bc260 con 0x5608c40b0890 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5608c3fcfd80 con 0x5608c40aff70 2024-04-21T22:38:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5608c40bc3e0 con 0x5608c40b9470 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea58a7c740 10 client.0 _ll_register_callbacks cb 0x5608c400c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44278/0 (socket says 172.21.15.18:44278) 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea4e000640 1 -- 172.21.15.18:0/1361248825 learned_addr learned my addr 172.21.15.18:0/1361248825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea4ea00640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.866+0000 7fea4f400640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 -- 172.21.15.18:0/1361248825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 msgr2=0x5608c40b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 -- 172.21.15.18:0/1361248825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 msgr2=0x5608c40b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 -- 172.21.15.18:0/1361248825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c3df27d0 con 0x5608c40b0890 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4f400640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4ea00640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea4e000640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009ea0 tx=0x7fea3c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f62911082ff00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea38c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c021d00 con 0x5608c40b0890 2024-04-21T22:38:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fea3c005020 con 0x5608c40b0890 2024-04-21T22:38:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.867+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea400043d0 con 0x5608c40b0890 2024-04-21T22:38:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fea3c005220 con 0x5608c40b0890 2024-04-21T22:38:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 10 client.16356 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:05.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5608c40c85c0 con 0x5608c40b0890 2024-04-21T22:38:05.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea400043d0 con 0x5608c40b0890 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fea3c0355c0 con 0x5608c40b0890 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 10 client.16356 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 10 client.16356 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 20 client.16356 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c40c9a70 0x5608c40cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 4 client.16356 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:05.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.868+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608c40218e0 con 0x5608c40c9a70 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.869+0000 7fea4ea00640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c40c9a70 0x5608c40cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.869+0000 7fea4ea00640 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c40c9a70 0x5608c40cbeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a19da08c60babf6f server_cookie=3c5c580833be8d2c in_seq=0 out_seq=0 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.869+0000 7fea38c00640 10 client.16356 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea38c00640 1 -- 172.21.15.18:0/1361248825 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5608c40218e0 con 0x5608c40c9a70 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea38c00640 10 client.16356 handle_command_reply: tid=0 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 client.16356 shutdown 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 msgr2=0x5608c40b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009ea0 tx=0x7fea3c005f90 comp rx=0 tx=0).stop 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 shutdown_connections 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c40c9a70 0x5608c40cbeb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.870+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40b6a50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea58a7c740 1 --2- 172.21.15.18:0/1361248825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea38c00640 0 client.16356 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 >> 172.21.15.18:0/1361248825 conn(0x5608c40aa6a0 msgr2=0x5608c40ac3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 shutdown_connections 2024-04-21T22:38:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea58a7c740 1 -- 172.21.15.18:0/1361248825 wait complete. 2024-04-21T22:38:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.871+0000 7fea58a7c740 20 client.16356 trim_cache size 0 max 16384 2024-04-21T22:38:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:05 smithi081 ceph-mon[31692]: pgmap v124: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-04-21T22:38:05.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 Processor -- start 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 -- start start 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 0x5608c40d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea501af5d0 con 0x5608c40b9470 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b11a0 con 0x5608c40aff70 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.886+0000 7fea58a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea501afd00 con 0x5608c40b0890 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 0x5608c40d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54098/0 (socket says 172.21.15.18:54098) 2024-04-21T22:38:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4e000640 1 -- 172.21.15.18:0/3104578849 learned_addr learned my addr 172.21.15.18:0/3104578849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4ea00640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 -- 172.21.15.18:0/3104578849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 msgr2=0x5608c40c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 -- 172.21.15.18:0/3104578849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 msgr2=0x5608c40b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 -- 172.21.15.18:0/3104578849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c40a4ae0 con 0x5608c40b9470 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4ea00640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4e000640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.887+0000 7fea4f400640 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 0x5608c40d1780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fea480eeff0 tx=0x7fea480093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59eb0825431cee2c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea3b400640 1 -- 172.21.15.18:0/3104578849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480bde50 con 0x5608c40b9470 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea3b400640 1 -- 172.21.15.18:0/3104578849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea480c0070 con 0x5608c40b9470 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea3b400640 1 -- 172.21.15.18:0/3104578849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea480be0b0 con 0x5608c40b9470 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 -- 172.21.15.18:0/3104578849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 msgr2=0x5608c40d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 0x5608c40d1780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fea480eeff0 tx=0x7fea480093f0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 -- 172.21.15.18:0/3104578849 shutdown_connections 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b9470 0x5608c40d1780 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b0890 0x5608c40c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 --2- 172.21.15.18:0/3104578849 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 -- 172.21.15.18:0/3104578849 >> 172.21.15.18:0/3104578849 conn(0x5608c40aa6a0 msgr2=0x5608c40b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.888+0000 7fea58a7c740 1 -- 172.21.15.18:0/3104578849 shutdown_connections 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.889+0000 7fea58a7c740 1 -- 172.21.15.18:0/3104578849 wait complete. 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.889+0000 7fea58a7c740 1 -- start start 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.889+0000 7fea58a7c740 1 Processor -- start 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b0aa0 con 0x5608c40b0890 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b03d0 con 0x5608c40aff70 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea501ad5b0 con 0x5608c40b9470 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea58a7c740 10 client.0 _ll_register_callbacks cb 0x7fea3c010d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53468/0 (socket says 172.21.15.18:53468) 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4ea00640 1 -- 172.21.15.18:0/4128488327 learned_addr learned my addr 172.21.15.18:0/4128488327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 -- 172.21.15.18:0/4128488327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 msgr2=0x5608c40b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 -- 172.21.15.18:0/4128488327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 msgr2=0x5608c40c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.890+0000 7fea4e000640 1 -- 172.21.15.18:0/4128488327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c40b3590 con 0x5608c40b0890 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea4e000640 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40c1b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00a010 tx=0x7fea3c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0670ba998fcbb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea38c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c021d10 con 0x5608c40b0890 2024-04-21T22:38:05.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fea3c0047a0 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea480c0070 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fea3c0049a0 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea58a7c740 10 client.16362 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.891+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5608c412fbd0 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea480c0070 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fea3c040800 con 0x5608c40b0890 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 10 client.16362 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:05.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 10 client.16362 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:38:05.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 20 client.16362 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:05.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c41302f0 0x5608c4132710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:05.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 4 client.16362 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:05.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608c401bc30 con 0x5608c41302f0 2024-04-21T22:38:05.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.892+0000 7fea4ea00640 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c41302f0 0x5608c4132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:05.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea4ea00640 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c41302f0 0x5608c4132710 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73346a799fa4b209 server_cookie=dac600158f4a779c in_seq=0 out_seq=0 2024-04-21T22:38:05.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea38c00640 10 client.16362 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:05.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea38c00640 1 -- 172.21.15.18:0/4128488327 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608c401bc30 con 0x5608c41302f0 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea38c00640 10 client.16362 handle_command_reply: tid=0 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 client.16362 shutdown 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 msgr2=0x5608c40c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40c1b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00a010 tx=0x7fea3c005670 comp rx=0 tx=0).stop 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 shutdown_connections 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x5608c41302f0 0x5608c4132710 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5608c40b9470 0x5608c40b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5608c40b0890 0x5608c40c1b70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 --2- 172.21.15.18:0/4128488327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5608c40aff70 0x5608c40c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea38c00640 0 client.16362 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 >> 172.21.15.18:0/4128488327 conn(0x5608c40aa6a0 msgr2=0x5608c40a8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 shutdown_connections 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.893+0000 7fea58a7c740 1 -- 172.21.15.18:0/4128488327 wait complete. 2024-04-21T22:38:05.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea58a7c740 20 client.16362 trim_cache size 0 max 16384 2024-04-21T22:38:05.906 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:05.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 msgr2=0x7fea340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 0x7fea340a51c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5608c40ab830 tx=0x7fea3c015040 comp rx=0 tx=0).stop 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 msgr2=0x7fea5019e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea5019e910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea48037040 tx=0x7fea48032460 comp rx=0 tx=0).stop 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 shutdown_connections 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fea340a2d00 0x7fea340a51c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50109770 0x7fea5019e910 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea50104120 0x7fea5019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 --2- 172.21.15.18:0/3074626667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea50103760 0x7fea5019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 >> 172.21.15.18:0/3074626667 conn(0x7fea500ff230 msgr2=0x7fea500ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.894+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 shutdown_connections 2024-04-21T22:38:05.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:05.895+0000 7fea4fe00640 1 -- 172.21.15.18:0/3074626667 wait complete. 2024-04-21T22:38:05.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:38:06.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 -- 172.21.15.18:0/4237736180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 msgr2=0x7f25a010d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 --2- 172.21.15.18:0/4237736180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a010d840 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f258c009900 tx=0x7f258c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 -- 172.21.15.18:0/4237736180 shutdown_connections 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 --2- 172.21.15.18:0/4237736180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a010dd80 0x7f25a01101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 --2- 172.21.15.18:0/4237736180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a010d840 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 --2- 172.21.15.18:0/4237736180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0073b70 0x7f25a0073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 -- 172.21.15.18:0/4237736180 >> 172.21.15.18:0/4237736180 conn(0x7f25a00fd090 msgr2=0x7f25a00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 -- 172.21.15.18:0/4237736180 shutdown_connections 2024-04-21T22:38:06.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.123+0000 7f25a5800640 1 -- 172.21.15.18:0/4237736180 wait complete. 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 Processor -- start 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 -- start start 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0073b70 0x7f25a019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a010dd80 0x7f25a019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0113b70 con 0x7f25a0074490 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01139f0 con 0x7f25a0073b70 2024-04-21T22:38:06.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.124+0000 7f25a5800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0113cf0 con 0x7f25a010dd80 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44324/0 (socket says 172.21.15.18:44324) 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 -- 172.21.15.18:0/511232498 learned_addr learned my addr 172.21.15.18:0/511232498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f25a4e00640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a010dd80 0x7f25a019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259fe00640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0073b70 0x7f25a019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 -- 172.21.15.18:0/511232498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a010dd80 msgr2=0x7f25a019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a010dd80 0x7f25a019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 -- 172.21.15.18:0/511232498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0073b70 msgr2=0x7f25a019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0073b70 0x7f25a019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 -- 172.21.15.18:0/511232498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a019f0a0 con 0x7f25a0074490 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.125+0000 7f259f400640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f258c000c00 tx=0x7f258c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.126+0000 7f259cc00640 1 -- 172.21.15.18:0/511232498 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c042020 con 0x7f25a0074490 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.126+0000 7f259cc00640 1 -- 172.21.15.18:0/511232498 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c005000 con 0x7f25a0074490 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.126+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a019f330 con 0x7f25a0074490 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.126+0000 7f259cc00640 1 -- 172.21.15.18:0/511232498 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c003b20 con 0x7f25a0074490 2024-04-21T22:38:06.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.126+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01a6c20 con 0x7f25a0074490 2024-04-21T22:38:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.131+0000 7f25a9a37740 1 Processor -- start 2024-04-21T22:38:06.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 -- start start 2024-04-21T22:38:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dad940e3a0 con 0x55dad94a9f70 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dad93b6930 con 0x55dad94aa890 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a9a37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dad940a360 con 0x55dad94b3470 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f259cc00640 1 -- 172.21.15.18:0/511232498 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f258c045020 con 0x7f25a0074490 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44326/0 (socket says 172.21.15.18:44326) 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 -- 172.21.15.18:0/889650376 learned_addr learned my addr 172.21.15.18:0/889650376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f259fe00640 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 -- 172.21.15.18:0/889650376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 msgr2=0x55dad94b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 -- 172.21.15.18:0/889650376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 msgr2=0x55dad94b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 -- 172.21.15.18:0/889650376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad91223f0 con 0x55dad94a9f70 2024-04-21T22:38:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f25a4e00640 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2598009f50 tx=0x7f25980118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e7de9331ec283c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.132+0000 7f2595600640 1 -- 172.21.15.18:0/889650376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598004d20 con 0x55dad94a9f70 2024-04-21T22:38:06.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f2595600640 1 -- 172.21.15.18:0/889650376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2598004050 con 0x55dad94a9f70 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f2595600640 1 -- 172.21.15.18:0/889650376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598005280 con 0x55dad94a9f70 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f259cc00640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 0x7f25840a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 -- 172.21.15.18:0/889650376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 msgr2=0x55dad94aa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2598009f50 tx=0x7f25980118d0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f259cc00640 1 -- 172.21.15.18:0/511232498 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f258c0f0f00 con 0x7f25a0074490 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 -- 172.21.15.18:0/889650376 shutdown_connections 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 --2- 172.21.15.18:0/889650376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a9f70 0x55dad94aa350 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f25a9a37740 1 -- 172.21.15.18:0/889650376 >> 172.21.15.18:0/889650376 conn(0x55dad94a46a0 msgr2=0x55dad94a4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.133+0000 7f259fe00640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 0x7f25840a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.134+0000 7f25a9a37740 1 -- 172.21.15.18:0/889650376 shutdown_connections 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.134+0000 7f25a9a37740 1 -- 172.21.15.18:0/889650376 wait complete. 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.134+0000 7f25a9a37740 1 -- start start 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.134+0000 7f25a9a37740 1 Processor -- start 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.134+0000 7f259fe00640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 0x7f25840a51c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55dad94a9a40 tx=0x7f2590005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94b3470 0x55dad94b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dad94b6260 con 0x55dad94b3470 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dad93c9d80 con 0x55dad94aa890 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dad94b63e0 con 0x55dad94a9f70 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a9a37740 10 client.0 _ll_register_callbacks cb 0x55dad94062b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f259fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f259fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54128/0 (socket says 172.21.15.18:54128) 2024-04-21T22:38:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f259fe00640 1 -- 172.21.15.18:0/376976302 learned_addr learned my addr 172.21.15.18:0/376976302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f259f400640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.135+0000 7f25a4e00640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94b3470 0x55dad94b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 -- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 msgr2=0x55dad94b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 -- 172.21.15.18:0/376976302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94b3470 msgr2=0x55dad94b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94b3470 0x55dad94b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 -- 172.21.15.18:0/376976302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad91ec7d0 con 0x55dad94a9f70 2024-04-21T22:38:06.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259f400640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f259fe00640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2590005f60 tx=0x7f2590004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6f555e5ae16c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f258a000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590029440 con 0x55dad94a9f70 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f259001f430 con 0x55dad94a9f70 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.136+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2598004050 con 0x55dad94a9f70 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f259001f630 con 0x55dad94a9f70 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 10 client.26497 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dad94c25f0 con 0x55dad94a9f70 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2598004050 con 0x55dad94a9f70 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f2590027070 con 0x55dad94a9f70 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 10 client.26497 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 10 client.26497 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 20 client.26497 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad94c3ab0 0x55dad94c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 4 client.26497 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.137+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad941b8e0 con 0x55dad94c3ab0 2024-04-21T22:38:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.138+0000 7f259f400640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad94c3ab0 0x55dad94c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.138+0000 7f259f400640 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad94c3ab0 0x55dad94c5ee0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81484f9e5fa72dd3 server_cookie=fbc92f103b40e0ad in_seq=0 out_seq=0 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.138+0000 7f258a000640 10 client.26497 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f258a000640 1 -- 172.21.15.18:0/376976302 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dad941b8e0 con 0x55dad94c3ab0 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f258a000640 10 client.26497 handle_command_reply: tid=0 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 client.26497 shutdown 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 msgr2=0x55dad94b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2590005f60 tx=0x7f2590004730 comp rx=0 tx=0).stop 2024-04-21T22:38:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 shutdown_connections 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad94c3ab0 0x55dad94c5ee0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94b3470 0x55dad94b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 --2- 172.21.15.18:0/376976302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a9f70 0x55dad94b0510 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f258a000640 0 client.26497 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 >> 172.21.15.18:0/376976302 conn(0x55dad94a46a0 msgr2=0x55dad94a63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 shutdown_connections 2024-04-21T22:38:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.139+0000 7f25a9a37740 1 -- 172.21.15.18:0/376976302 wait complete. 2024-04-21T22:38:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.140+0000 7f25a9a37740 20 client.26497 trim_cache size 0 max 16384 2024-04-21T22:38:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.155+0000 7f25a9a37740 1 Processor -- start 2024-04-21T22:38:06.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.155+0000 7f25a9a37740 1 -- start start 2024-04-21T22:38:06.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.155+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94aa890 0x55dad94bf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.155+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 0x55dad94cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a9a37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01af670 con 0x55dad94aa890 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a9a37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b1240 con 0x55dad94b3470 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a9a37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01afda0 con 0x55dad94a6200 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 0x55dad94cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53518/0 (socket says 172.21.15.18:53518) 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 -- 172.21.15.18:0/3433762401 learned_addr learned my addr 172.21.15.18:0/3433762401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 0x55dad94cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54132/0 (socket says 172.21.15.18:54132) 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259fe00640 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94aa890 0x55dad94bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 -- 172.21.15.18:0/3433762401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 msgr2=0x55dad94cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 0x55dad94cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 -- 172.21.15.18:0/3433762401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94aa890 msgr2=0x55dad94bf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94aa890 0x55dad94bf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 -- 172.21.15.18:0/3433762401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad94a4fe0 con 0x55dad94b3470 2024-04-21T22:38:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f259f400640 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f258c0bd4c0 tx=0x7f258c0a8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38657af2bb40a064 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f2594c00640 1 -- 172.21.15.18:0/3433762401 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0a2e60 con 0x55dad94b3470 2024-04-21T22:38:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f2594c00640 1 -- 172.21.15.18:0/3433762401 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c0bd530 con 0x55dad94b3470 2024-04-21T22:38:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.157+0000 7f2594c00640 1 -- 172.21.15.18:0/3433762401 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0dd040 con 0x55dad94b3470 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- 172.21.15.18:0/3433762401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 msgr2=0x55dad94b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f258c0bd4c0 tx=0x7f258c0a8040 comp rx=0 tx=0).stop 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- 172.21.15.18:0/3433762401 shutdown_connections 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94a6200 0x55dad94cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94b3470 0x55dad94b0de0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 --2- 172.21.15.18:0/3433762401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94aa890 0x55dad94bf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- 172.21.15.18:0/3433762401 >> 172.21.15.18:0/3433762401 conn(0x55dad94a46a0 msgr2=0x55dad94a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- 172.21.15.18:0/3433762401 shutdown_connections 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- 172.21.15.18:0/3433762401 wait complete. 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 -- start start 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.158+0000 7f25a9a37740 1 Processor -- start 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a6200 0x55dad94ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b0b40 con 0x55dad94a6200 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b0470 con 0x55dad94aa890 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01ad650 con 0x55dad94b3470 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a9a37740 10 client.0 _ll_register_callbacks cb 0x7f2590009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f259fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a6200 0x55dad94ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53530/0 (socket says 172.21.15.18:53530) 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f259f400640 1 -- 172.21.15.18:0/2227235480 learned_addr learned my addr 172.21.15.18:0/2227235480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.159+0000 7f25a4e00640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 -- 172.21.15.18:0/2227235480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 msgr2=0x55dad94adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 -- 172.21.15.18:0/2227235480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a6200 msgr2=0x55dad94ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a6200 0x55dad94ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 -- 172.21.15.18:0/2227235480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad9529050 con 0x55dad94aa890 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259f400640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f258c0bd230 tx=0x7f258c004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=980d0ea722485a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c0d5070 con 0x55dad94aa890 2024-04-21T22:38:06.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f258c0b9ba0 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f258c0bd530 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f258c0a2e60 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 10 client.26465 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dad952a330 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f258c0bd530 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f258c0d62a0 con 0x55dad94aa890 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 10 client.26465 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 10 client.26465 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 20 client.26465 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad952a960 0x55dad952cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 4 client.26465 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dad9415c30 con 0x55dad952a960 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.161+0000 7f259fe00640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad952a960 0x55dad952cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f259fe00640 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad952a960 0x55dad952cd80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d01cbbfcdca9218 server_cookie=5244b9c8f2f37aa in_seq=0 out_seq=0 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f258a000640 10 client.26465 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:06.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f258a000640 1 -- 172.21.15.18:0/2227235480 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dad9415c30 con 0x55dad952a960 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f258a000640 10 client.26465 handle_command_reply: tid=0 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 client.26465 shutdown 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 msgr2=0x55dad94ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f258c0bd230 tx=0x7f258c004610 comp rx=0 tx=0).stop 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 shutdown_connections 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55dad952a960 0x55dad952cd80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dad94b3470 0x55dad94adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dad94aa890 0x55dad94ad720 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 --2- 172.21.15.18:0/2227235480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad94a6200 0x55dad94ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f258a000640 0 client.26465 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 >> 172.21.15.18:0/2227235480 conn(0x55dad94a46a0 msgr2=0x55dad94a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 shutdown_connections 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.162+0000 7f25a9a37740 1 -- 172.21.15.18:0/2227235480 wait complete. 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a9a37740 20 client.26465 trim_cache size 0 max 16384 2024-04-21T22:38:06.171 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:06.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 msgr2=0x7f25840a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 0x7f25840a51c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55dad94a9a40 tx=0x7f2590005f90 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 msgr2=0x7f25a019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f258c000c00 tx=0x7f258c004360 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 shutdown_connections 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f25840a2d00 0x7f25840a51c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a010dd80 0x7f25a019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a0074490 0x7f25a019a5f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 --2- 172.21.15.18:0/511232498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0073b70 0x7f25a019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 >> 172.21.15.18:0/511232498 conn(0x7f25a00fd090 msgr2=0x7f25a00fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.163+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 shutdown_connections 2024-04-21T22:38:06.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.164+0000 7f25a5800640 1 -- 172.21.15.18:0/511232498 wait complete. 2024-04-21T22:38:06.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:38:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 -- 172.21.15.18:0/1917853236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41029b0 msgr2=0x7f06c4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 --2- 172.21.15.18:0/1917853236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41029b0 0x7f06c4102d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009ca0 tx=0x7f06b402c190 comp rx=0 tx=0).stop 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 -- 172.21.15.18:0/1917853236 shutdown_connections 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 --2- 172.21.15.18:0/1917853236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c410bcf0 0x7f06c410e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 --2- 172.21.15.18:0/1917853236 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c41032d0 0x7f06c410b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 --2- 172.21.15.18:0/1917853236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41029b0 0x7f06c4102d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 -- 172.21.15.18:0/1917853236 >> 172.21.15.18:0/1917853236 conn(0x7f06c40777f0 msgr2=0x7f06c4077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 -- 172.21.15.18:0/1917853236 shutdown_connections 2024-04-21T22:38:06.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.401+0000 7f06cb600640 1 -- 172.21.15.18:0/1917853236 wait complete. 2024-04-21T22:38:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 Processor -- start 2024-04-21T22:38:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 -- start start 2024-04-21T22:38:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41032d0 0x7f06c419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c410bcf0 0x7f06c419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06c4111af0 con 0x7f06c41029b0 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06c4111970 con 0x7f06c410bcf0 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.403+0000 7f06cb600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06c4111c70 con 0x7f06c41032d0 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44362/0 (socket says 172.21.15.18:44362) 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 -- 172.21.15.18:0/1572156873 learned_addr learned my addr 172.21.15.18:0/1572156873 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06bbe00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41032d0 0x7f06c419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c9600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c410bcf0 0x7f06c419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 -- 172.21.15.18:0/1572156873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41032d0 msgr2=0x7f06c419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41032d0 0x7f06c419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 -- 172.21.15.18:0/1572156873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c410bcf0 msgr2=0x7f06c419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c410bcf0 0x7f06c419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.404+0000 7f06c8c00640 1 -- 172.21.15.18:0/1572156873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c419f220 con 0x7f06c41029b0 2024-04-21T22:38:06.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06c8c00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06b4005e30 tx=0x7f06b4035d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06c2000640 1 -- 172.21.15.18:0/1572156873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4039040 con 0x7f06c41029b0 2024-04-21T22:38:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06c2000640 1 -- 172.21.15.18:0/1572156873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b4044070 con 0x7f06c41029b0 2024-04-21T22:38:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c419f4b0 con 0x7f06c41029b0 2024-04-21T22:38:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06c2000640 1 -- 172.21.15.18:0/1572156873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b40328d0 con 0x7f06c41029b0 2024-04-21T22:38:06.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.405+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c41a6da0 con 0x7f06c41029b0 2024-04-21T22:38:06.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.408+0000 7f06ce3bd740 1 Processor -- start 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06c2000640 1 -- 172.21.15.18:0/1572156873 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f06b4032a70 con 0x7f06c41029b0 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 -- start start 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492b26a0 0x55e4492bad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 0x55e4492bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e4492163a0 con 0x55e4492bb280 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4491be930 con 0x55e4492b26a0 2024-04-21T22:38:06.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e449212360 con 0x55e4492b1d80 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 0x55e4492bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06c9600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06c9600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54176/0 (socket says 172.21.15.18:54176) 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.409+0000 7f06c9600640 1 -- 172.21.15.18:0/2659560857 learned_addr learned my addr 172.21.15.18:0/2659560857 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c8c00640 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492b26a0 0x55e4492bad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 -- 172.21.15.18:0/2659560857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492b26a0 msgr2=0x55e4492bad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492b26a0 0x55e4492bad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 -- 172.21.15.18:0/2659560857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 msgr2=0x55e4492bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 0x55e4492bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 -- 172.21.15.18:0/2659560857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e448f2a3f0 con 0x55e4492b1d80 2024-04-21T22:38:06.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 0x55e4492bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.410+0000 7f06c9600640 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b680 tx=0x7f06bc004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b54a2d685cb060db server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06c2000640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 0x7f06a80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06b9c00640 1 -- 172.21.15.18:0/2659560857 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc003af0 con 0x55e4492b1d80 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06b9c00640 1 -- 172.21.15.18:0/2659560857 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06bc015070 con 0x55e4492b1d80 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06b9c00640 1 -- 172.21.15.18:0/2659560857 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc004d40 con 0x55e4492b1d80 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06c2000640 1 -- 172.21.15.18:0/1572156873 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06b40f1530 con 0x7f06c41029b0 2024-04-21T22:38:06.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.411+0000 7f06c8c00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 0x7f06a80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2659560857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 msgr2=0x55e4492b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b680 tx=0x7f06bc004610 comp rx=0 tx=0).stop 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06c8c00640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 0x7f06a80a51c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06b40eee40 tx=0x7f06b40f70e0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2659560857 shutdown_connections 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492bb280 0x55e4492bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492b26a0 0x55e4492bad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2659560857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492b2160 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2659560857 >> 172.21.15.18:0/2659560857 conn(0x55e4492ac4b0 msgr2=0x55e4492ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2659560857 shutdown_connections 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2659560857 wait complete. 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.412+0000 7f06ce3bd740 1 -- start start 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 Processor -- start 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e4492be070 con 0x55e4492b1d80 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e4491d1d80 con 0x55e4492bb280 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e4492be1f0 con 0x55e4492b26a0 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06ce3bd740 10 client.0 _ll_register_callbacks cb 0x55e44920e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06c9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06c9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44378/0 (socket says 172.21.15.18:44378) 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.413+0000 7f06c9600640 1 -- 172.21.15.18:0/2064905249 learned_addr learned my addr 172.21.15.18:0/2064905249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06c9600640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 -- 172.21.15.18:0/2064905249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 msgr2=0x55e4492b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 -- 172.21.15.18:0/2064905249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 msgr2=0x55e4492b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 -- 172.21.15.18:0/2064905249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e448ff47d0 con 0x55e4492b26a0 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06c9600640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492b88b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f06c410b730 tx=0x7f06ac012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6bc1c8315218d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06b2000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:06.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac004030 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06bc015070 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.414+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06ac0041d0 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f06ac0043d0 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 10 client.26515 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e4492ca480 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06bc015070 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f06ac003bc0 con 0x55e4492b26a0 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 10 client.26515 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 10 client.26515 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 20 client.26515 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e4492cb8e0 0x55e4492cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 4 client.26515 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.415+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4492238e0 con 0x55e4492cb8e0 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.416+0000 7f06c9600640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e4492cb8e0 0x55e4492cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.416+0000 7f06c9600640 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e4492cb8e0 0x55e4492cdd10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b529d868c7eb03d server_cookie=cee76f8f3cffd10e in_seq=0 out_seq=0 2024-04-21T22:38:06.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.416+0000 7f06b2000640 10 client.26515 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.417+0000 7f06b2000640 1 -- 172.21.15.18:0/2064905249 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e4492238e0 con 0x55e4492cb8e0 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.417+0000 7f06b2000640 10 client.26515 handle_command_reply: tid=0 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.417+0000 7f06ce3bd740 1 client.26515 shutdown 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.417+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 msgr2=0x55e4492b88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.417+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492b88b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f06c410b730 tx=0x7f06ac012b60 comp rx=0 tx=0).stop 2024-04-21T22:38:06.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 shutdown_connections 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e4492cb8e0 0x55e4492cdd10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492b88b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2064905249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 >> 172.21.15.18:0/2064905249 conn(0x55e4492ac4b0 msgr2=0x55e4492ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06b2000640 0 client.26515 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 shutdown_connections 2024-04-21T22:38:06.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2064905249 wait complete. 2024-04-21T22:38:06.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.418+0000 7f06ce3bd740 20 client.26515 trim_cache size 0 max 16384 2024-04-21T22:38:06.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 Processor -- start 2024-04-21T22:38:06.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 -- start start 2024-04-21T22:38:06.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41af740 con 0x55e4492b1d80 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41b1310 con 0x55e4492bb280 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.433+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41afe70 con 0x55e4492b26a0 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54190/0 (socket says 172.21.15.18:54190) 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06c9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 -- 172.21.15.18:0/1516218698 learned_addr learned my addr 172.21.15.18:0/1516218698 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 -- 172.21.15.18:0/1516218698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 msgr2=0x55e4492ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 -- 172.21.15.18:0/1516218698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 msgr2=0x55e4492baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492baaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 -- 172.21.15.18:0/1516218698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4492abfe0 con 0x55e4492b26a0 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.434+0000 7f06bbe00640 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06ac012420 tx=0x7f06ac005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369596c6d36625d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06b9200640 1 -- 172.21.15.18:0/1516218698 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac029070 con 0x55e4492b26a0 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06b9200640 1 -- 172.21.15.18:0/1516218698 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06ac00fe00 con 0x55e4492b26a0 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06b9200640 1 -- 172.21.15.18:0/1516218698 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac003be0 con 0x55e4492b26a0 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 -- 172.21.15.18:0/1516218698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 msgr2=0x55e4492c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06ac012420 tx=0x7f06ac005880 comp rx=0 tx=0).stop 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 -- 172.21.15.18:0/1516218698 shutdown_connections 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b26a0 0x55e4492c6f30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/1516218698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b1d80 0x55e4492baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 -- 172.21.15.18:0/1516218698 >> 172.21.15.18:0/1516218698 conn(0x55e4492ac4b0 msgr2=0x55e4492aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 -- 172.21.15.18:0/1516218698 shutdown_connections 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.435+0000 7f06ce3bd740 1 -- 172.21.15.18:0/1516218698 wait complete. 2024-04-21T22:38:06.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 -- start start 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 Processor -- start 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41b0c10 con 0x55e4492b26a0 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41b0540 con 0x55e4492bb280 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06c41ad720 con 0x55e4492b1d80 2024-04-21T22:38:06.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.436+0000 7f06ce3bd740 10 client.0 _ll_register_callbacks cb 0x7f06ac009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44382/0 (socket says 172.21.15.18:44382) 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 -- 172.21.15.18:0/2546263844 learned_addr learned my addr 172.21.15.18:0/2546263844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06c9600640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06c9600640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 -- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 msgr2=0x55e4492c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 -- 172.21.15.18:0/2546263844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 msgr2=0x55e4492c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 -- 172.21.15.18:0/2546263844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4492c0ad0 con 0x55e4492b26a0 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06c9600640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06bbe00640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06ac010520 tx=0x7f06ac00fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be7c18969080efe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.437+0000 7f06b2000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac032070 con 0x55e4492b26a0 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f06ac003a70 con 0x55e4492b26a0 2024-04-21T22:38:06.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06ac00fe00 con 0x55e4492b26a0 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f06ac03e050 con 0x55e4492b26a0 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06ce3bd740 10 client.16398 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e44933b030 con 0x55e4492b26a0 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06ac00fe00 con 0x55e4492b26a0 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.438+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f06ac02e460 con 0x55e4492b26a0 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 10 client.16398 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 10 client.16398 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 20 client.16398 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e44933b6f0 0x55e44933db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 4 client.16398 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e44921dc30 con 0x55e44933b6f0 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06c9600640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e44933b6f0 0x55e44933db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06c9600640 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e44933b6f0 0x55e44933db10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2626ab2cd0ee2da server_cookie=40477e692a5b8de2 in_seq=0 out_seq=0 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.439+0000 7f06b2000640 10 client.16398 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06b2000640 1 -- 172.21.15.18:0/2546263844 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e44921dc30 con 0x55e44933b6f0 2024-04-21T22:38:06.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06b2000640 10 client.16398 handle_command_reply: tid=0 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 client.16398 shutdown 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 msgr2=0x55e4492c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06ac010520 tx=0x7f06ac00fb50 comp rx=0 tx=0).stop 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 shutdown_connections 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e44933b6f0 0x55e44933db10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e4492bb280 0x55e4492c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e4492b26a0 0x55e4492c3980 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 --2- 172.21.15.18:0/2546263844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4492b1d80 0x55e4492c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 >> 172.21.15.18:0/2546263844 conn(0x55e4492ac4b0 msgr2=0x55e4492ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06b2000640 0 client.16398 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 shutdown_connections 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 1 -- 172.21.15.18:0/2546263844 wait complete. 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.440+0000 7f06ce3bd740 20 client.16398 trim_cache size 0 max 16384 2024-04-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 msgr2=0x7f06a80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 0x7f06a80a51c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06b40eee40 tx=0x7f06b40f70e0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 msgr2=0x7f06c419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f06b4005e30 tx=0x7f06b4035d70 comp rx=0 tx=0).stop 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 shutdown_connections 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f06a80a2d00 0x7f06a80a51c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c410bcf0 0x7f06c419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c41032d0 0x7f06c419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 --2- 172.21.15.18:0/1572156873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06c41029b0 0x7f06c419a230 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 >> 172.21.15.18:0/1572156873 conn(0x7f06c40777f0 msgr2=0x7f06c4107c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 shutdown_connections 2024-04-21T22:38:06.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.441+0000 7f06cb600640 1 -- 172.21.15.18:0/1572156873 wait complete. 2024-04-21T22:38:06.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:38:06.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 -- 172.21.15.18:0/3351975972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5010dc00 msgr2=0x7efc5010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 --2- 172.21.15.18:0/3351975972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5010dc00 0x7efc5010dfe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc40009890 tx=0x7efc4002bb70 comp rx=0 tx=0).stop 2024-04-21T22:38:06.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 -- 172.21.15.18:0/3351975972 shutdown_connections 2024-04-21T22:38:06.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 --2- 172.21.15.18:0/3351975972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc50108640 0x7efc501149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 --2- 172.21.15.18:0/3351975972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc50108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 --2- 172.21.15.18:0/3351975972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5010dc00 0x7efc5010dfe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 -- 172.21.15.18:0/3351975972 >> 172.21.15.18:0/3351975972 conn(0x7efc50077550 msgr2=0x7efc50106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 -- 172.21.15.18:0/3351975972 shutdown_connections 2024-04-21T22:38:06.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.672+0000 7efc54a00640 1 -- 172.21.15.18:0/3351975972 wait complete. 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.673+0000 7efc54a00640 1 Processor -- start 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.673+0000 7efc54a00640 1 -- start start 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50108640 0x7efc5019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc5010dc00 0x7efc501a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc50117f00 con 0x7efc50107c80 2024-04-21T22:38:06.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc50117d80 con 0x7efc5010dc00 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc54a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc50118080 con 0x7efc50108640 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc4f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc4f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44396/0 (socket says 172.21.15.18:44396) 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc4f400640 1 -- 172.21.15.18:0/624162672 learned_addr learned my addr 172.21.15.18:0/624162672 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc4fe00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc5010dc00 0x7efc501a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.674+0000 7efc4ea00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50108640 0x7efc5019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 -- 172.21.15.18:0/624162672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50108640 msgr2=0x7efc5019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50108640 0x7efc5019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 -- 172.21.15.18:0/624162672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc5010dc00 msgr2=0x7efc501a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc5010dc00 0x7efc501a2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 -- 172.21.15.18:0/624162672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501a33f0 con 0x7efc50107c80 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc4f400640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc400042f0 tx=0x7efc40004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc47e00640 1 -- 172.21.15.18:0/624162672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40041020 con 0x7efc50107c80 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501a3680 con 0x7efc50107c80 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc47e00640 1 -- 172.21.15.18:0/624162672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc4002c9f0 con 0x7efc50107c80 2024-04-21T22:38:06.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc47e00640 1 -- 172.21.15.18:0/624162672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40039040 con 0x7efc50107c80 2024-04-21T22:38:06.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.675+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501aaf70 con 0x7efc50107c80 2024-04-21T22:38:06.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 Processor -- start 2024-04-21T22:38:06.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 -- start start 2024-04-21T22:38:06.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc47e00640 1 -- 172.21.15.18:0/624162672 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efc40044020 con 0x7efc50107c80 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f64f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 0x5585b6f67860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5585b6ec03a0 con 0x5585b6f65470 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5585b6e68930 con 0x5585b6f5c890 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.680+0000 7efc58daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585b6ebc360 con 0x5585b6f5bf70 2024-04-21T22:38:06.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54228/0 (socket says 172.21.15.18:54228) 2024-04-21T22:38:06.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 -- 172.21.15.18:0/3106226484 learned_addr learned my addr 172.21.15.18:0/3106226484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4ea00640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 0x5585b6f67860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4f400640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f64f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 -- 172.21.15.18:0/3106226484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 msgr2=0x5585b6f64f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f64f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 -- 172.21.15.18:0/3106226484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 msgr2=0x5585b6f67860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 0x5585b6f67860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 -- 172.21.15.18:0/3106226484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585b6bd43f0 con 0x5585b6f5bf70 2024-04-21T22:38:06.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4ea00640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 0x5585b6f67860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:06.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.681+0000 7efc4fe00640 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc48011440 tx=0x7efc48011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dbbec578244e102 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc3be00640 1 -- 172.21.15.18:0/3106226484 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48003c30 con 0x5585b6f5bf70 2024-04-21T22:38:06.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc3be00640 1 -- 172.21.15.18:0/3106226484 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc48003dd0 con 0x5585b6f5bf70 2024-04-21T22:38:06.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc3be00640 1 -- 172.21.15.18:0/3106226484 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800fae0 con 0x5585b6f5bf70 2024-04-21T22:38:06.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc47e00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 0x7efc340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc47e00640 1 -- 172.21.15.18:0/624162672 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efc400f0c70 con 0x7efc50107c80 2024-04-21T22:38:06.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.682+0000 7efc4f400640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 0x7efc340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- 172.21.15.18:0/3106226484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 msgr2=0x5585b6f5c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc48011440 tx=0x7efc48011900 comp rx=0 tx=0).stop 2024-04-21T22:38:06.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- 172.21.15.18:0/3106226484 shutdown_connections 2024-04-21T22:38:06.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f65470 0x5585b6f67860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f64f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 --2- 172.21.15.18:0/3106226484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f5c350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- 172.21.15.18:0/3106226484 >> 172.21.15.18:0/3106226484 conn(0x5585b6f566a0 msgr2=0x5585b6f56a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- 172.21.15.18:0/3106226484 shutdown_connections 2024-04-21T22:38:06.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- 172.21.15.18:0/3106226484 wait complete. 2024-04-21T22:38:06.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc4f400640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 0x7efc340a51c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5585b6f5ba40 tx=0x7efc400dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.683+0000 7efc58daa740 1 -- start start 2024-04-21T22:38:06.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 Processor -- start 2024-04-21T22:38:06.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f62550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f62fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5585b6f68260 con 0x5585b6f5c890 2024-04-21T22:38:06.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5585b6e7bd80 con 0x5585b6f65470 2024-04-21T22:38:06.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585b6f683e0 con 0x5585b6f5bf70 2024-04-21T22:38:06.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc58daa740 10 client.0 _ll_register_callbacks cb 0x5585b6eb82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f62550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.684+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44410/0 (socket says 172.21.15.18:44410) 2024-04-21T22:38:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4ea00640 1 -- 172.21.15.18:0/2547562768 learned_addr learned my addr 172.21.15.18:0/2547562768 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f62fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 -- 172.21.15.18:0/2547562768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 msgr2=0x5585b6f62fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f62fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 -- 172.21.15.18:0/2547562768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 msgr2=0x5585b6f62a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 -- 172.21.15.18:0/2547562768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585b6c9e7d0 con 0x5585b6f5bf70 2024-04-21T22:38:06.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc4fe00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f62550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc4800f780 tx=0x7efc4800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac6f9c92f565398f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.685+0000 7efc38c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:06.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48004250 con 0x5585b6f5bf70 2024-04-21T22:38:06.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efc480043f0 con 0x5585b6f5bf70 2024-04-21T22:38:06.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc48003dd0 con 0x5585b6f5bf70 2024-04-21T22:38:06.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efc48036050 con 0x5585b6f5bf70 2024-04-21T22:38:06.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc58daa740 10 client.26533 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.686+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5585b6f745f0 con 0x5585b6f5bf70 2024-04-21T22:38:06.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc48003dd0 con 0x5585b6f5bf70 2024-04-21T22:38:06.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7efc48028ca0 con 0x5585b6f5bf70 2024-04-21T22:38:06.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 10 client.26533 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 10 client.26533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:38:06.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 20 client.26533 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6f75940 0x5585b6f77d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 4 client.26533 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:06.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585b6ecd8e0 con 0x5585b6f75940 2024-04-21T22:38:06.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.687+0000 7efc4ea00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6f75940 0x5585b6f77d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.688+0000 7efc4ea00640 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6f75940 0x5585b6f77d30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c2c79caa72fdd4c server_cookie=63b655b3a0914ee9 in_seq=0 out_seq=0 2024-04-21T22:38:06.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.688+0000 7efc38c00640 10 client.26533 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:06.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc38c00640 1 -- 172.21.15.18:0/2547562768 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5585b6ecd8e0 con 0x5585b6f75940 2024-04-21T22:38:06.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc38c00640 10 client.26533 handle_command_reply: tid=0 2024-04-21T22:38:06.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 client.26533 shutdown 2024-04-21T22:38:06.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 msgr2=0x5585b6f62550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f62550 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc4800f780 tx=0x7efc4800f680 comp rx=0 tx=0).stop 2024-04-21T22:38:06.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 shutdown_connections 2024-04-21T22:38:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6f75940 0x5585b6f77d30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f62fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 --2- 172.21.15.18:0/2547562768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f62550 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 >> 172.21.15.18:0/2547562768 conn(0x5585b6f566a0 msgr2=0x5585b6f583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc38c00640 0 client.26533 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:06.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 shutdown_connections 2024-04-21T22:38:06.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.689+0000 7efc58daa740 1 -- 172.21.15.18:0/2547562768 wait complete. 2024-04-21T22:38:06.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.690+0000 7efc58daa740 20 client.26533 trim_cache size 0 max 16384 2024-04-21T22:38:06.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.704+0000 7efc58daa740 1 Processor -- start 2024-04-21T22:38:06.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.704+0000 7efc58daa740 1 -- start start 2024-04-21T22:38:06.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f71150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f581e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b3930 con 0x5585b6f5c890 2024-04-21T22:38:06.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b5500 con 0x5585b6f65470 2024-04-21T22:38:06.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc58daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b4060 con 0x5585b6f5bf70 2024-04-21T22:38:06.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44416/0 (socket says 172.21.15.18:44416) 2024-04-21T22:38:06.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 -- 172.21.15.18:0/1846609846 learned_addr learned my addr 172.21.15.18:0/1846609846 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4fe00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f71150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4fe00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 -- 172.21.15.18:0/1846609846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 msgr2=0x5585b6f71150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f71150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 -- 172.21.15.18:0/1846609846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 msgr2=0x5585b6f581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4ea00640 1 -- 172.21.15.18:0/1846609846 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585b6f60ae0 con 0x5585b6f5c890 2024-04-21T22:38:06.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.705+0000 7efc4fe00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.706+0000 7efc4ea00640 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5585b6f78430 tx=0x7efc3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688a67870b334e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.706+0000 7efc3b400640 1 -- 172.21.15.18:0/1846609846 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c026070 con 0x5585b6f5c890 2024-04-21T22:38:06.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.706+0000 7efc3b400640 1 -- 172.21.15.18:0/1846609846 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc3c020690 con 0x5585b6f5c890 2024-04-21T22:38:06.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.706+0000 7efc3b400640 1 -- 172.21.15.18:0/1846609846 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c010bf0 con 0x5585b6f5c890 2024-04-21T22:38:06.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- 172.21.15.18:0/1846609846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 msgr2=0x5585b6f62df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x5585b6f78430 tx=0x7efc3c009260 comp rx=0 tx=0).stop 2024-04-21T22:38:06.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- 172.21.15.18:0/1846609846 shutdown_connections 2024-04-21T22:38:06.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f65470 0x5585b6f581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5c890 0x5585b6f62df0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 --2- 172.21.15.18:0/1846609846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f5bf70 0x5585b6f71150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- 172.21.15.18:0/1846609846 >> 172.21.15.18:0/1846609846 conn(0x5585b6f566a0 msgr2=0x5585b6f57ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- 172.21.15.18:0/1846609846 shutdown_connections 2024-04-21T22:38:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- 172.21.15.18:0/1846609846 wait complete. 2024-04-21T22:38:06.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 -- start start 2024-04-21T22:38:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.707+0000 7efc58daa740 1 Processor -- start 2024-04-21T22:38:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 0x5585b6f6d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f65470 0x5585b6f5f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b4e00 con 0x5585b6f5bf70 2024-04-21T22:38:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b4730 con 0x5585b6f5c890 2024-04-21T22:38:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b1910 con 0x5585b6f65470 2024-04-21T22:38:06.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc58daa740 10 client.0 _ll_register_callbacks cb 0x7efc48009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 0x5585b6f6d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53656/0 (socket says 172.21.15.18:53656) 2024-04-21T22:38:06.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc4ea00640 1 -- 172.21.15.18:0/309538395 learned_addr learned my addr 172.21.15.18:0/309538395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.708+0000 7efc4fe00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f65470 0x5585b6f5f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 -- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f65470 msgr2=0x5585b6f5f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f65470 0x5585b6f5f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 -- 172.21.15.18:0/309538395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 msgr2=0x5585b6f6d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 0x5585b6f6d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 -- 172.21.15.18:0/309538395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585b6f5fb40 con 0x5585b6f5c890 2024-04-21T22:38:06.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4fe00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 0x5585b6f6d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:06.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc4ea00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0107d0 tx=0x7efc3c004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873528ef49554a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc38c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:06.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c026040 con 0x5585b6f5c890 2024-04-21T22:38:06.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.709+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc3c020690 con 0x5585b6f5c890 2024-04-21T22:38:06.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efc3c010430 con 0x5585b6f5c890 2024-04-21T22:38:06.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efc3c003ce0 con 0x5585b6f5c890 2024-04-21T22:38:06.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 10 client.26498 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5585b6fdbc80 con 0x5585b6f5c890 2024-04-21T22:38:06.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc3c020690 con 0x5585b6f5c890 2024-04-21T22:38:06.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7efc3c010c50 con 0x5585b6f5c890 2024-04-21T22:38:06.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 10 client.26498 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 10 client.26498 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:38:06.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 20 client.26498 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6fdc360 0x5585b6fde780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 4 client.26498 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:06.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.710+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585b6ec7c30 con 0x5585b6fdc360 2024-04-21T22:38:06.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.711+0000 7efc4fe00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6fdc360 0x5585b6fde780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.711+0000 7efc4fe00640 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6fdc360 0x5585b6fde780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=316d4d48b8252674 server_cookie=1796c4e2f8556c77 in_seq=0 out_seq=0 2024-04-21T22:38:06.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.711+0000 7efc38c00640 10 client.26498 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:06.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc38c00640 1 -- 172.21.15.18:0/309538395 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585b6ec7c30 con 0x5585b6fdc360 2024-04-21T22:38:06.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc38c00640 10 client.26498 handle_command_reply: tid=0 2024-04-21T22:38:06.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 client.26498 shutdown 2024-04-21T22:38:06.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 msgr2=0x5585b6f5eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0107d0 tx=0x7efc3c004400 comp rx=0 tx=0).stop 2024-04-21T22:38:06.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 shutdown_connections 2024-04-21T22:38:06.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5585b6fdc360 0x5585b6fde780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5585b6f65470 0x5585b6f5f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5585b6f5c890 0x5585b6f5eec0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 --2- 172.21.15.18:0/309538395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5585b6f5bf70 0x5585b6f6d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 >> 172.21.15.18:0/309538395 conn(0x5585b6f566a0 msgr2=0x5585b6f55690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc38c00640 0 client.26498 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 shutdown_connections 2024-04-21T22:38:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 1 -- 172.21.15.18:0/309538395 wait complete. 2024-04-21T22:38:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.712+0000 7efc58daa740 20 client.26498 trim_cache size 0 max 16384 2024-04-21T22:38:06.745 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 msgr2=0x7efc340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 0x7efc340a51c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5585b6f5ba40 tx=0x7efc400dd040 comp rx=0 tx=0).stop 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 msgr2=0x7efc5019e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc400042f0 tx=0x7efc40004320 comp rx=0 tx=0).stop 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 shutdown_connections 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc340a2d00 0x7efc340a51c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc5010dc00 0x7efc501a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc50108640 0x7efc5019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 --2- 172.21.15.18:0/624162672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc50107c80 0x7efc5019e400 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 >> 172.21.15.18:0/624162672 conn(0x7efc50077550 msgr2=0x7efc500786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 shutdown_connections 2024-04-21T22:38:06.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.713+0000 7efc54a00640 1 -- 172.21.15.18:0/624162672 wait complete. 2024-04-21T22:38:06.747 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3065955750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:06.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:38:06.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3065955750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:06.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3065955750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:06.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 -- 172.21.15.18:0/4088708890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6510075c70 msgr2=0x7f6510076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 --2- 172.21.15.18:0/4088708890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6510075c70 0x7f6510076050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6500009ca0 tx=0x7f650002c180 comp rx=0 tx=0).stop 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 -- 172.21.15.18:0/4088708890 shutdown_connections 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 --2- 172.21.15.18:0/4088708890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65101123b0 0x7f65101147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 --2- 172.21.15.18:0/4088708890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510076590 0x7f6510111e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 --2- 172.21.15.18:0/4088708890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6510075c70 0x7f6510076050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 -- 172.21.15.18:0/4088708890 >> 172.21.15.18:0/4088708890 conn(0x7f65100ff220 msgr2=0x7f6510101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 -- 172.21.15.18:0/4088708890 shutdown_connections 2024-04-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.967+0000 7f650f200640 1 -- 172.21.15.18:0/4088708890 wait complete. 2024-04-21T22:38:06.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.968+0000 7f650f200640 1 Processor -- start 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 -- start start 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 0x7f651019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6510076590 0x7f651019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 0x7f65101a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6510117f10 con 0x7f6510075c70 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6510117d90 con 0x7f6510076590 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6510118090 con 0x7f65101123b0 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 0x7f651019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 0x7f65101a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 0x7f651019e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44446/0 (socket says 172.21.15.18:44446) 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f650de00640 1 -- 172.21.15.18:0/2507671163 learned_addr learned my addr 172.21.15.18:0/2507671163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.969+0000 7f6505400640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6510076590 0x7f651019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 -- 172.21.15.18:0/2507671163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6510076590 msgr2=0x7f651019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6510076590 0x7f651019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 -- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 msgr2=0x7f651019e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 0x7f651019e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 -- 172.21.15.18:0/2507671163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65101a3440 con 0x7f65101123b0 2024-04-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650e800640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 0x7f65101a2d10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f650800e970 tx=0x7f650800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f6507400640 1 -- 172.21.15.18:0/2507671163 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800ccc0 con 0x7f65101123b0 2024-04-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65101a3730 con 0x7f65101123b0 2024-04-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f6507400640 1 -- 172.21.15.18:0/2507671163 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6508005020 con 0x7f65101123b0 2024-04-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f6507400640 1 -- 172.21.15.18:0/2507671163 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508004a00 con 0x7f65101123b0 2024-04-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.970+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65101aafc0 con 0x7f65101123b0 2024-04-21T22:38:06.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 Processor -- start 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6507400640 1 -- 172.21.15.18:0/2507671163 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f65080051d0 con 0x7f65101123b0 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 -- start start 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e61860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641f4dba3a0 con 0x5641f4e56890 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641f4d62930 con 0x5641f4e5f470 2024-04-21T22:38:06.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.974+0000 7f6517c16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641f4db6360 con 0x5641f4e55f70 2024-04-21T22:38:06.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54268/0 (socket says 172.21.15.18:54268) 2024-04-21T22:38:06.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 -- 172.21.15.18:0/4196009459 learned_addr learned my addr 172.21.15.18:0/4196009459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f650de00640 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e61860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 -- 172.21.15.18:0/4196009459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 msgr2=0x5641f4e61860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e61860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 -- 172.21.15.18:0/4196009459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 msgr2=0x5641f4e5ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.975+0000 7f6505400640 1 -- 172.21.15.18:0/4196009459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f4ace3f0 con 0x5641f4e55f70 2024-04-21T22:38:06.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f6505400640 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f64f8012780 tx=0x7f64f80096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffda047a85541522 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f6507400640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 0x7f64f40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f6507400640 1 -- 172.21.15.18:0/2507671163 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f65080cf490 con 0x7f65101123b0 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f64ff400640 1 -- 172.21.15.18:0/4196009459 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8012d00 con 0x5641f4e55f70 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f650de00640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 0x7f64f40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f64ff400640 1 -- 172.21.15.18:0/4196009459 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64f8010cb0 con 0x5641f4e55f70 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.976+0000 7f64ff400640 1 -- 172.21.15.18:0/4196009459 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f800eb30 con 0x5641f4e55f70 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 -- 172.21.15.18:0/4196009459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 msgr2=0x5641f4e56350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f650de00640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 0x7f64f40a51c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5641f4e55a40 tx=0x7f6500005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f64f8012780 tx=0x7f64f80096e0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 -- 172.21.15.18:0/4196009459 shutdown_connections 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e61860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 --2- 172.21.15.18:0/4196009459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e56350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 -- 172.21.15.18:0/4196009459 >> 172.21.15.18:0/4196009459 conn(0x5641f4e506a0 msgr2=0x5641f4e50a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 -- 172.21.15.18:0/4196009459 shutdown_connections 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.977+0000 7f6517c16740 1 -- 172.21.15.18:0/4196009459 wait complete. 2024-04-21T22:38:06.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 -- start start 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 Processor -- start 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 0x5641f4e5c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641f4e62260 con 0x5641f4e56890 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641f4d75d80 con 0x5641f4e55f70 2024-04-21T22:38:06.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641f4e623e0 con 0x5641f4e5f470 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.978+0000 7f6517c16740 10 client.0 _ll_register_callbacks cb 0x5641f4db22b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f6505400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54274/0 (socket says 172.21.15.18:54274) 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 -- 172.21.15.18:0/383714046 learned_addr learned my addr 172.21.15.18:0/383714046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f6505400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44472/0 (socket says 172.21.15.18:44472) 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650de00640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 0x5641f4e5c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 -- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 msgr2=0x5641f4e5c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 0x5641f4e5c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 -- 172.21.15.18:0/383714046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 msgr2=0x5641f4e5ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 -- 172.21.15.18:0/383714046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f4b987d0 con 0x5641f4e5f470 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650de00640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 0x5641f4e5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f6505400640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f650e800640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f65080a4090 tx=0x7f650809c050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2f67c4b9cddf935 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.979+0000 7f64f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:06.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650801c040 con 0x5641f4e5f470 2024-04-21T22:38:06.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f65080a4330 con 0x5641f4e5f470 2024-04-21T22:38:06.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64f8010cb0 con 0x5641f4e5f470 2024-04-21T22:38:06.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f65080b9050 con 0x5641f4e5f470 2024-04-21T22:38:06.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 10 client.26551 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:06.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5641f4e6e620 con 0x5641f4e5f470 2024-04-21T22:38:06.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6508060e50 con 0x5641f4e5f470 2024-04-21T22:38:06.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f6508086070 con 0x5641f4e5f470 2024-04-21T22:38:06.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 10 client.26551 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:06.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 10 client.26551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:06.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.980+0000 7f6517c16740 20 client.26551 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:06.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4e6fa80 0x5641f4e71e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:06.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f6517c16740 4 client.26551 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:06.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641f4dc78e0 con 0x5641f4e6fa80 2024-04-21T22:38:06.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f650de00640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4e6fa80 0x5641f4e71e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:06.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f650de00640 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4e6fa80 0x5641f4e71e90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc70a1041b06cf3 server_cookie=c0f6abcc013a6364 in_seq=0 out_seq=0 2024-04-21T22:38:06.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.981+0000 7f64f3e00640 10 client.26551 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.982+0000 7f64f3e00640 1 -- 172.21.15.18:0/383714046 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5641f4dc78e0 con 0x5641f4e6fa80 2024-04-21T22:38:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.982+0000 7f64f3e00640 10 client.26551 handle_command_reply: tid=0 2024-04-21T22:38:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.982+0000 7f6517c16740 1 client.26551 shutdown 2024-04-21T22:38:06.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.982+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 msgr2=0x5641f4e5cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.982+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f65080a4090 tx=0x7f650809c050 comp rx=0 tx=0).stop 2024-04-21T22:38:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 shutdown_connections 2024-04-21T22:38:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4e6fa80 0x5641f4e71e90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e5f470 0x5641f4e5cfd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e5ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 --2- 172.21.15.18:0/383714046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e55f70 0x5641f4e5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:06.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 >> 172.21.15.18:0/383714046 conn(0x5641f4e506a0 msgr2=0x5641f4e523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:06.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f64f3e00640 0 client.26551 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 shutdown_connections 2024-04-21T22:38:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 1 -- 172.21.15.18:0/383714046 wait complete. 2024-04-21T22:38:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.983+0000 7f6517c16740 20 client.26551 trim_cache size 0 max 16384 2024-04-21T22:38:07.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 Processor -- start 2024-04-21T22:38:07.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 -- start start 2024-04-21T22:38:07.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 0x5641f4e6b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e5f470 0x5641f4e521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b38e0 con 0x5641f4e5f470 2024-04-21T22:38:07.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b54b0 con 0x5641f4e56890 2024-04-21T22:38:07.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.998+0000 7f6517c16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b4010 con 0x5641f4e55f70 2024-04-21T22:38:07.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54280/0 (socket says 172.21.15.18:54280) 2024-04-21T22:38:07.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 -- 172.21.15.18:0/2344566461 learned_addr learned my addr 172.21.15.18:0/2344566461 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:07.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e5f470 0x5641f4e521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f6505400640 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 0x5641f4e6b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 -- 172.21.15.18:0/2344566461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 msgr2=0x5641f4e6b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:07.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 0x5641f4e6b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 -- 172.21.15.18:0/2344566461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e5f470 msgr2=0x5641f4e521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:07.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e5f470 0x5641f4e521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 -- 172.21.15.18:0/2344566461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f4e72510 con 0x5641f4e55f70 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f6505400640 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 0x5641f4e6b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:06.999+0000 7f650de00640 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6500009a60 tx=0x7f6500041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b716cb1896870793 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f64fea00640 1 -- 172.21.15.18:0/2344566461 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500039040 con 0x5641f4e55f70 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f64fea00640 1 -- 172.21.15.18:0/2344566461 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6500032670 con 0x5641f4e55f70 2024-04-21T22:38:07.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f64fea00640 1 -- 172.21.15.18:0/2344566461 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000346a0 con 0x5641f4e55f70 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 -- 172.21.15.18:0/2344566461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 msgr2=0x5641f4e5ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6500009a60 tx=0x7f6500041000 comp rx=0 tx=0).stop 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 -- 172.21.15.18:0/2344566461 shutdown_connections 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e5f470 0x5641f4e521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e56890 0x5641f4e6b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 --2- 172.21.15.18:0/2344566461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e5ec80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 -- 172.21.15.18:0/2344566461 >> 172.21.15.18:0/2344566461 conn(0x5641f4e506a0 msgr2=0x5641f4e51ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:07.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 -- 172.21.15.18:0/2344566461 shutdown_connections 2024-04-21T22:38:07.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.000+0000 7f6517c16740 1 -- 172.21.15.18:0/2344566461 wait complete. 2024-04-21T22:38:07.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 -- start start 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 Processor -- start 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e5a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b4db0 con 0x5641f4e56890 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b46e0 con 0x5641f4e5f470 2024-04-21T22:38:07.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65101b18a0 con 0x5641f4e55f70 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.001+0000 7f6517c16740 10 client.0 _ll_register_callbacks cb 0x7f6508097bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44490/0 (socket says 172.21.15.18:44490) 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 -- 172.21.15.18:0/342723288 learned_addr learned my addr 172.21.15.18:0/342723288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f650de00640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f650e800640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 -- 172.21.15.18:0/342723288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 msgr2=0x5641f4e59560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:07.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e59560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 -- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 msgr2=0x5641f4e5a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e5a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 -- 172.21.15.18:0/342723288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f4ed52a0 con 0x5641f4e56890 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f650de00640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e59560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f6505400640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f64f800e750 tx=0x7f64f8005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba8d680e4946f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.002+0000 7f64f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f802d060 con 0x5641f4e56890 2024-04-21T22:38:07.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f64f80054c0 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6500032670 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f64f8009c50 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f6517c16740 10 client.16434 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5641f4ed65a0 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.003+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6500032670 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f64f8003680 con 0x5641f4e56890 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 10 client.16434 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:07.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 20 client.16434 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4ed6ab0 0x5641f4ed8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 4 client.16434 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641f4dc1c30 con 0x5641f4ed6ab0 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.004+0000 7f650de00640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4ed6ab0 0x5641f4ed8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f650de00640 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4ed6ab0 0x5641f4ed8ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b86bdb1280670c3 server_cookie=50bcf64088a3898f in_seq=0 out_seq=0 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f64f3e00640 10 client.16434 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:07.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f64f3e00640 1 -- 172.21.15.18:0/342723288 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641f4dc1c30 con 0x5641f4ed6ab0 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f64f3e00640 10 client.16434 handle_command_reply: tid=0 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 client.16434 shutdown 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 msgr2=0x5641f4e59aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f64f800e750 tx=0x7f64f8005a70 comp rx=0 tx=0).stop 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 shutdown_connections 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641f4e5f470 0x5641f4e5a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641f4e56890 0x5641f4e59aa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641f4ed6ab0 0x5641f4ed8ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 --2- 172.21.15.18:0/342723288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641f4e55f70 0x5641f4e59560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 >> 172.21.15.18:0/342723288 conn(0x5641f4e506a0 msgr2=0x5641f4e5cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f64f3e00640 0 client.16434 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 shutdown_connections 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 1 -- 172.21.15.18:0/342723288 wait complete. 2024-04-21T22:38:07.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.005+0000 7f6517c16740 20 client.16434 trim_cache size 0 max 16384 2024-04-21T22:38:07.022 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:07.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 msgr2=0x7f64f40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:07.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 0x7f64f40a51c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5641f4e55a40 tx=0x7f6500005d80 comp rx=0 tx=0).stop 2024-04-21T22:38:07.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 msgr2=0x7f65101a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:07.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 0x7f65101a2d10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f650800e970 tx=0x7f650800ee30 comp rx=0 tx=0).stop 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 shutdown_connections 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f64f40a2d00 0x7f64f40a51c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65101123b0 0x7f65101a2d10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6510076590 0x7f651019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 --2- 172.21.15.18:0/2507671163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6510075c70 0x7f651019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 >> 172.21.15.18:0/2507671163 conn(0x7f65100ff220 msgr2=0x7f6510113de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 shutdown_connections 2024-04-21T22:38:07.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:07.006+0000 7f650f200640 1 -- 172.21.15.18:0/2507671163 wait complete. 2024-04-21T22:38:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:07 smithi018 ceph-mon[26614]: pgmap v125: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-04-21T22:38:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:07 smithi081 ceph-mon[31692]: pgmap v125: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-04-21T22:38:07.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:07 smithi047 ceph-mon[31561]: pgmap v125: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-04-21T22:38:08.025 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:38:08.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:38:08.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.259+0000 7f860ea00640 1 -- 172.21.15.18:0/3744731394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 msgr2=0x7f86081079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.259+0000 7f860ea00640 1 --2- 172.21.15.18:0/3744731394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86081079d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009900 tx=0x7f85fc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 -- 172.21.15.18:0/3744731394 shutdown_connections 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 --2- 172.21.15.18:0/3744731394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 0x7f860810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 --2- 172.21.15.18:0/3744731394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f86081019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 --2- 172.21.15.18:0/3744731394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86081079d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 -- 172.21.15.18:0/3744731394 >> 172.21.15.18:0/3744731394 conn(0x7f86080fd020 msgr2=0x7f86080ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 -- 172.21.15.18:0/3744731394 shutdown_connections 2024-04-21T22:38:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.260+0000 7f860ea00640 1 -- 172.21.15.18:0/3744731394 wait complete. 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 Processor -- start 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 -- start start 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 0x7f8608073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86080744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8608111900 con 0x7f86081075f0 2024-04-21T22:38:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8608111780 con 0x7f8608101ef0 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.261+0000 7f860ea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8608111a80 con 0x7f8608101530 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54300/0 (socket says 172.21.15.18:54300) 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 -- 172.21.15.18:0/2117451688 learned_addr learned my addr 172.21.15.18:0/2117451688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860e000640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86080744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860cc00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 0x7f8608073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 -- 172.21.15.18:0/2117451688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 msgr2=0x7f8608073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 0x7f8608073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 -- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 msgr2=0x7f86080744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86080744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 -- 172.21.15.18:0/2117451688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081aa740 con 0x7f8608101530 2024-04-21T22:38:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.262+0000 7f860d600640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02efd0 tx=0x7f85fc0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.263+0000 7f8606000640 1 -- 172.21.15.18:0/2117451688 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc041070 con 0x7f8608101530 2024-04-21T22:38:08.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.263+0000 7f8606000640 1 -- 172.21.15.18:0/2117451688 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85fc02ccc0 con 0x7f8608101530 2024-04-21T22:38:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.263+0000 7f8606000640 1 -- 172.21.15.18:0/2117451688 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc003d10 con 0x7f8608101530 2024-04-21T22:38:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.263+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081aa910 con 0x7f8608101530 2024-04-21T22:38:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.263+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081aadb0 con 0x7f8608101530 2024-04-21T22:38:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.266+0000 7f8612d97740 1 Processor -- start 2024-04-21T22:38:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.266+0000 7f8612d97740 1 -- start start 2024-04-21T22:38:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8606000640 1 -- 172.21.15.18:0/2117451688 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f85fc044070 con 0x7f8608101530 2024-04-21T22:38:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe0266de0 0x55dbe02691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbe01bbdf0 con 0x55dbe0266de0 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dbe01c1040 con 0x55dbe025d8e0 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f8612d97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dbe01698c0 con 0x55dbe025e200 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53720/0 (socket says 172.21.15.18:53720) 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 -- 172.21.15.18:0/1202931113 learned_addr learned my addr 172.21.15.18:0/1202931113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860cc00640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe0266de0 0x55dbe02691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860d600640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 -- 172.21.15.18:0/1202931113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 msgr2=0x55dbe02668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 -- 172.21.15.18:0/1202931113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe0266de0 msgr2=0x55dbe02691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe0266de0 0x55dbe02691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860e000640 1 -- 172.21.15.18:0/1202931113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbdff9d7e0 con 0x55dbe025d8e0 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.267+0000 7f860d600640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:08.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.268+0000 7f860e000640 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8600009f50 tx=0x7f86000118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77aa6621c986aed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.268+0000 7f85fa600640 1 -- 172.21.15.18:0/1202931113 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600004d20 con 0x55dbe025d8e0 2024-04-21T22:38:08.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.268+0000 7f85fa600640 1 -- 172.21.15.18:0/1202931113 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8600004050 con 0x55dbe025d8e0 2024-04-21T22:38:08.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.268+0000 7f85fa600640 1 -- 172.21.15.18:0/1202931113 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600005280 con 0x55dbe025d8e0 2024-04-21T22:38:08.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.268+0000 7f8606000640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 0x7f85f00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8606000640 1 -- 172.21.15.18:0/2117451688 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f85fc0f0d30 con 0x7f8608101530 2024-04-21T22:38:08.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f860d600640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 0x7f85f00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 -- 172.21.15.18:0/1202931113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 msgr2=0x55dbe025dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8600009f50 tx=0x7f86000118d0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 -- 172.21.15.18:0/1202931113 shutdown_connections 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe0266de0 0x55dbe02691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 --2- 172.21.15.18:0/1202931113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe025dcc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 -- 172.21.15.18:0/1202931113 >> 172.21.15.18:0/1202931113 conn(0x55dbe0258010 msgr2=0x55dbe02583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.269+0000 7f8612d97740 1 -- 172.21.15.18:0/1202931113 shutdown_connections 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.270+0000 7f8612d97740 1 -- 172.21.15.18:0/1202931113 wait complete. 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.270+0000 7f860d600640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 0x7f85f00a5240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ee640 tx=0x7f85fc0dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.270+0000 7f8612d97740 1 -- start start 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.270+0000 7f8612d97740 1 Processor -- start 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0263e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe0266de0 0x55dbe02648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbe017cd20 con 0x55dbe025d8e0 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55dbe01bd000 con 0x55dbe0266de0 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55dbe0269bd0 con 0x55dbe025e200 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f8612d97740 10 client.0 _ll_register_callbacks cb 0x55dbe01b80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0263e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0263e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44514/0 (socket says 172.21.15.18:44514) 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860e000640 1 -- 172.21.15.18:0/4187547937 learned_addr learned my addr 172.21.15.18:0/4187547937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860e000640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe0266de0 0x55dbe02648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 -- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe0266de0 msgr2=0x55dbe02648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe0266de0 0x55dbe02648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 -- 172.21.15.18:0/4187547937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 msgr2=0x55dbe0263e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0263e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.271+0000 7f860cc00640 1 -- 172.21.15.18:0/4187547937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbdfffdf70 con 0x55dbe025e200 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f860cc00640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02643b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8608075200 tx=0x7f85f4012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b338fbea77649650 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f85eea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4004320 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f85f4011970 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8600004050 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f85f40044c0 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f8612d97740 10 client.26569 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.272+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dbdfe95170 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8600004050 con 0x55dbe025e200 2024-04-21T22:38:08.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f85f4025480 con 0x55dbe025e200 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 10 client.26569 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 20 client.26569 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe0276ff0 0x55dbe0279450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 4 client.26569 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.273+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbe01ce580 con 0x55dbe0276ff0 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.274+0000 7f860e000640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe0276ff0 0x55dbe0279450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.274+0000 7f860e000640 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe0276ff0 0x55dbe0279450 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab8bbd8518629499 server_cookie=9c2c803aea7dadcb in_seq=0 out_seq=0 2024-04-21T22:38:08.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.274+0000 7f85eea00640 10 client.26569 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f85eea00640 1 -- 172.21.15.18:0/4187547937 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dbe01ce580 con 0x55dbe0276ff0 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f85eea00640 10 client.26569 handle_command_reply: tid=0 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 client.26569 shutdown 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 msgr2=0x55dbe02643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02643b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8608075200 tx=0x7f85f4012b60 comp rx=0 tx=0).stop 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 shutdown_connections 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe0266de0 0x55dbe02648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe0276ff0 0x55dbe0279450 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe025e200 0x55dbe02643b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 --2- 172.21.15.18:0/4187547937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0263e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f85eea00640 0 client.26569 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 >> 172.21.15.18:0/4187547937 conn(0x55dbe0258010 msgr2=0x55dbe0259d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 shutdown_connections 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.275+0000 7f8612d97740 1 -- 172.21.15.18:0/4187547937 wait complete. 2024-04-21T22:38:08.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.276+0000 7f8612d97740 20 client.26569 trim_cache size 0 max 16384 2024-04-21T22:38:08.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.295+0000 7f8612d97740 1 Processor -- start 2024-04-21T22:38:08.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.295+0000 7f8612d97740 1 -- start start 2024-04-21T22:38:08.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025e200 0x55dbe027ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe027f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b39b0 con 0x55dbe025d8e0 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b5580 con 0x55dbe025e200 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f8612d97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b40e0 con 0x55dbe0266de0 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44530/0 (socket says 172.21.15.18:44530) 2024-04-21T22:38:08.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 -- 172.21.15.18:0/2264191970 learned_addr learned my addr 172.21.15.18:0/2264191970 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860cc00640 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025e200 0x55dbe027ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe027f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 -- 172.21.15.18:0/2264191970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 msgr2=0x55dbe027f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe027f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 -- 172.21.15.18:0/2264191970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025e200 msgr2=0x55dbe027ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025e200 0x55dbe027ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.296+0000 7f860e000640 1 -- 172.21.15.18:0/2264191970 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe0256490 con 0x55dbe025d8e0 2024-04-21T22:38:08.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.297+0000 7f860e000640 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8600011dd0 tx=0x7f8600009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e451b7a5509c4107 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.297+0000 7f85f9c00640 1 -- 172.21.15.18:0/2264191970 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600033070 con 0x55dbe025d8e0 2024-04-21T22:38:08.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.297+0000 7f85f9c00640 1 -- 172.21.15.18:0/2264191970 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8600003970 con 0x55dbe025d8e0 2024-04-21T22:38:08.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.297+0000 7f85f9c00640 1 -- 172.21.15.18:0/2264191970 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86000052a0 con 0x55dbe025d8e0 2024-04-21T22:38:08.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- 172.21.15.18:0/2264191970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 msgr2=0x55dbe0272910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8600011dd0 tx=0x7f8600009c60 comp rx=0 tx=0).stop 2024-04-21T22:38:08.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- 172.21.15.18:0/2264191970 shutdown_connections 2024-04-21T22:38:08.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe027f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025e200 0x55dbe027ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 --2- 172.21.15.18:0/2264191970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025d8e0 0x55dbe0272910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- 172.21.15.18:0/2264191970 >> 172.21.15.18:0/2264191970 conn(0x55dbe0258010 msgr2=0x55dbe0259ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- 172.21.15.18:0/2264191970 shutdown_connections 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- 172.21.15.18:0/2264191970 wait complete. 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.298+0000 7f8612d97740 1 -- start start 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 Processor -- start 2024-04-21T22:38:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe026c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025e200 0x55dbe026c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b4e80 con 0x55dbe025e200 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b47b0 con 0x55dbe025d8e0 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86081b1990 con 0x55dbe0266de0 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f8612d97740 10 client.0 _ll_register_callbacks cb 0x7f85f40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:08.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f860e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe026c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f860cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025e200 0x55dbe026c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f860e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f860e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54340/0 (socket says 172.21.15.18:54340) 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.299+0000 7f860e000640 1 -- 172.21.15.18:0/1056661524 learned_addr learned my addr 172.21.15.18:0/1056661524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 -- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 msgr2=0x55dbe026c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe026c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 -- 172.21.15.18:0/1056661524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025e200 msgr2=0x55dbe026c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025e200 0x55dbe026c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 -- 172.21.15.18:0/1056661524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe02d7b60 con 0x55dbe0266de0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f860e000640 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86000047c0 tx=0x7f86000118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0b8df3fafcaafd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f85eea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600040070 con 0x55dbe0266de0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8600003970 con 0x55dbe0266de0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.300+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8600003b20 con 0x55dbe0266de0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8600033070 con 0x55dbe0266de0 2024-04-21T22:38:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 10 client.26575 fetch_fsmap learned FSMap version 35 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dbe02def20 con 0x55dbe0266de0 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8600003970 con 0x55dbe0266de0 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f8600043030 con 0x55dbe0266de0 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 10 client.26575 fetch_fsmap finished waiting for FSMap version 35 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 10 client.26575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 20 client.26575 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe02df4b0 0x55dbe02e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 4 client.26575 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:38:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.301+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dbe01c88d0 con 0x55dbe02df4b0 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.302+0000 7f860cc00640 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe02df4b0 0x55dbe02e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.302+0000 7f860cc00640 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe02df4b0 0x55dbe02e18d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375c0919994369f4 server_cookie=1a91adad39fc598f in_seq=0 out_seq=0 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.302+0000 7f85eea00640 10 client.26575 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.303+0000 7f85eea00640 1 -- 172.21.15.18:0/1056661524 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dbe01c88d0 con 0x55dbe02df4b0 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.303+0000 7f85eea00640 10 client.26575 handle_command_reply: tid=0 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.303+0000 7f8612d97740 1 client.26575 shutdown 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.303+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 msgr2=0x55dbe02d7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.303+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86000047c0 tx=0x7f86000118d0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 shutdown_connections 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55dbe02df4b0 0x55dbe02e18d0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbe0266de0 0x55dbe02d7570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbe025e200 0x55dbe026c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f85eea00640 0 client.26575 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 --2- 172.21.15.18:0/1056661524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55dbe025d8e0 0x55dbe026c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 >> 172.21.15.18:0/1056661524 conn(0x55dbe0258010 msgr2=0x55dbe02592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 shutdown_connections 2024-04-21T22:38:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 1 -- 172.21.15.18:0/1056661524 wait complete. 2024-04-21T22:38:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.304+0000 7f8612d97740 20 client.26575 trim_cache size 0 max 16384 2024-04-21T22:38:08.312 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:08.312 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:38:08.312 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "c127ec11-d858-4198-bf80-95ddab625035", 2024-04-21T22:38:08.313 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:38:08.313 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 msgr2=0x7f85f00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 0x7f85f00a5240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ee640 tx=0x7f85fc0dd040 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 msgr2=0x7f8608073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f85fc02efd0 tx=0x7f85fc0042f0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 shutdown_connections 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f85f00a2d80 0x7f85f00a5240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86081075f0 0x7f86080744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8608101ef0 0x7f8608073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 --2- 172.21.15.18:0/2117451688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8608101530 0x7f8608073a40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 >> 172.21.15.18:0/2117451688 conn(0x7f86080fd020 msgr2=0x7f86080fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 shutdown_connections 2024-04-21T22:38:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.305+0000 7f860ea00640 1 -- 172.21.15.18:0/2117451688 wait complete. 2024-04-21T22:38:08.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:38:08.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:38:08.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 -- 172.21.15.18:0/607984525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458102760 msgr2=0x7fc458102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 --2- 172.21.15.18:0/607984525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458102760 0x7fc458102b40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009900 tx=0x7fc44c02bcd0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 -- 172.21.15.18:0/607984525 shutdown_connections 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 --2- 172.21.15.18:0/607984525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 0x7fc45810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 --2- 172.21.15.18:0/607984525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458103080 0x7fc45810b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 --2- 172.21.15.18:0/607984525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458102760 0x7fc458102b40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 -- 172.21.15.18:0/607984525 >> 172.21.15.18:0/607984525 conn(0x7fc4580771f0 msgr2=0x7fc4580fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 -- 172.21.15.18:0/607984525 shutdown_connections 2024-04-21T22:38:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.557+0000 7fc45e800640 1 -- 172.21.15.18:0/607984525 wait complete. 2024-04-21T22:38:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.558+0000 7fc45e800640 1 Processor -- start 2024-04-21T22:38:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 -- start start 2024-04-21T22:38:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 0x7fc45819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 0x7fc45819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc458111950 con 0x7fc45810bb30 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581117d0 con 0x7fc458102760 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc458111ad0 con 0x7fc458103080 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 0x7fc45819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:53750/0 (socket says 172.21.15.18:53750) 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 0x7fc45819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54352/0 (socket says 172.21.15.18:54352) 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.559+0000 7fc45d400640 1 -- 172.21.15.18:0/957622149 learned_addr learned my addr 172.21.15.18:0/957622149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45de00640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 0x7fc45819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 -- 172.21.15.18:0/957622149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 msgr2=0x7fc45819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 0x7fc45819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 -- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 msgr2=0x7fc45819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 0x7fc45819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 -- 172.21.15.18:0/957622149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45819f100 con 0x7fc458102760 2024-04-21T22:38:08.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.560+0000 7fc45d400640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000c00 tx=0x7fc44c0043c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.561+0000 7fc456000640 1 -- 172.21.15.18:0/957622149 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c042020 con 0x7fc458102760 2024-04-21T22:38:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.561+0000 7fc456000640 1 -- 172.21.15.18:0/957622149 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc44c0054e0 con 0x7fc458102760 2024-04-21T22:38:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.561+0000 7fc456000640 1 -- 172.21.15.18:0/957622149 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c003af0 con 0x7fc458102760 2024-04-21T22:38:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.561+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45819f390 con 0x7fc458102760 2024-04-21T22:38:08.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.561+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581a6c80 con 0x7fc458102760 2024-04-21T22:38:08.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.566+0000 7fc462a66740 1 Processor -- start 2024-04-21T22:38:08.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.566+0000 7fc456000640 1 -- 172.21.15.18:0/957622149 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc44c045020 con 0x7fc458102760 2024-04-21T22:38:08.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.566+0000 7fc462a66740 1 -- start start 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a34280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a36bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562b94986410 con 0x562b94a22e40 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b9492e7e0 con 0x562b94a347c0 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc462a66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b949823d0 con 0x562b94a22490 2024-04-21T22:38:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54368/0 (socket says 172.21.15.18:54368) 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc45de00640 1 -- 172.21.15.18:0/4214547042 learned_addr learned my addr 172.21.15.18:0/4214547042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc45ca00640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a36bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.567+0000 7fc45d400640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a34280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 -- 172.21.15.18:0/4214547042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 msgr2=0x562b94a36bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a36bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 -- 172.21.15.18:0/4214547042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 msgr2=0x562b94a34280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a34280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 -- 172.21.15.18:0/4214547042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b947647d0 con 0x562b94a22490 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45ca00640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a36bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45d400640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a34280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc45de00640 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc450009f20 tx=0x7fc45000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb4108ae687bd80 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc456000640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 0x7fc4400a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.568+0000 7fc44a600640 1 -- 172.21.15.18:0/4214547042 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450015070 con 0x562b94a22490 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc44a600640 1 -- 172.21.15.18:0/4214547042 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45001ab40 con 0x562b94a22490 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc44a600640 1 -- 172.21.15.18:0/4214547042 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450011c40 con 0x562b94a22490 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc456000640 1 -- 172.21.15.18:0/957622149 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc44c0f1100 con 0x7fc458102760 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc45d400640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 0x7fc4400a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc462a66740 1 -- 172.21.15.18:0/4214547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 msgr2=0x562b94a22870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc462a66740 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc450009f20 tx=0x7fc45000f7f0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.569+0000 7fc45d400640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 0x7fc4400a5240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0eea10 tx=0x7fc44c009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 -- 172.21.15.18:0/4214547042 shutdown_connections 2024-04-21T22:38:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a36bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a34280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 --2- 172.21.15.18:0/4214547042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a22870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 -- 172.21.15.18:0/4214547042 >> 172.21.15.18:0/4214547042 conn(0x562b94a1d1e0 msgr2=0x562b94a1d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 -- 172.21.15.18:0/4214547042 shutdown_connections 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 -- 172.21.15.18:0/4214547042 wait complete. 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.570+0000 7fc462a66740 1 -- start start 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 Processor -- start 2024-04-21T22:38:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a32290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562b94a37580 con 0x562b94a22e40 2024-04-21T22:38:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562b94941c40 con 0x562b94a347c0 2024-04-21T22:38:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.571+0000 7fc462a66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562b94a37700 con 0x562b94a22490 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc462a66740 10 client.0 _ll_register_callbacks cb 0x562b94941630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54374/0 (socket says 172.21.15.18:54374) 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 -- 172.21.15.18:0/2668150517 learned_addr learned my addr 172.21.15.18:0/2668150517 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a32290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45ca00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 -- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 msgr2=0x562b94a32290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a32290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 -- 172.21.15.18:0/2668150517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 msgr2=0x562b94a31d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a31d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 -- 172.21.15.18:0/2668150517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9469a3f0 con 0x562b94a22490 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc45de00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc450011980 tx=0x7fc450004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e4f8d387844232b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.572+0000 7fc43ea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45001e020 con 0x562b94a22490 2024-04-21T22:38:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc450003b70 con 0x562b94a22490 2024-04-21T22:38:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc45001ab40 con 0x562b94a22490 2024-04-21T22:38:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc450031050 con 0x562b94a22490 2024-04-21T22:38:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc462a66740 10 client.26587 fetch_fsmap learned FSMap version 36 2024-04-21T22:38:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.573+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562b9465a0f0 con 0x562b94a22490 2024-04-21T22:38:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45001ab40 con 0x562b94a22490 2024-04-21T22:38:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc450004210 con 0x562b94a22490 2024-04-21T22:38:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 10 client.26587 fetch_fsmap finished waiting for FSMap version 36 2024-04-21T22:38:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 10 client.26587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 20 client.26587 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94a44a00 0x562b94a46df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 4 client.26587 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.574+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b94999c40 con 0x562b94a44a00 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.575+0000 7fc45ca00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94a44a00 0x562b94a46df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.575+0000 7fc45ca00640 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94a44a00 0x562b94a46df0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac5ba68ab8e6a20 server_cookie=61a282e4e1f66ff1 in_seq=0 out_seq=0 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.575+0000 7fc43ea00640 10 client.26587 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.576+0000 7fc43ea00640 1 -- 172.21.15.18:0/2668150517 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562b94999c40 con 0x562b94a44a00 2024-04-21T22:38:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.576+0000 7fc43ea00640 10 client.26587 handle_command_reply: tid=0 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 client.26587 shutdown 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 msgr2=0x562b94a31810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc450011980 tx=0x7fc450004f70 comp rx=0 tx=0).stop 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 shutdown_connections 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a32290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22e40 0x562b94a31d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94a44a00 0x562b94a46df0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 --2- 172.21.15.18:0/2668150517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22490 0x562b94a31810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 >> 172.21.15.18:0/2668150517 conn(0x562b94a1d1e0 msgr2=0x562b94a1ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.577+0000 7fc43ea00640 0 client.26587 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.578+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 shutdown_connections 2024-04-21T22:38:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.578+0000 7fc462a66740 1 -- 172.21.15.18:0/2668150517 wait complete. 2024-04-21T22:38:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.578+0000 7fc462a66740 20 client.26587 trim_cache size 0 max 16384 2024-04-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.602+0000 7fc462a66740 1 Processor -- start 2024-04-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 -- start start 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 0x562b94a404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581ab180 con 0x562b94a22490 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581acd20 con 0x562b94a347c0 2024-04-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc462a66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581ab8b0 con 0x562b94a22e40 2024-04-21T22:38:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc45de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 0x562b94a404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54378/0 (socket says 172.21.15.18:54378) 2024-04-21T22:38:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc45ca00640 1 -- 172.21.15.18:0/3808330813 learned_addr learned my addr 172.21.15.18:0/3808330813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.603+0000 7fc45de00640 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 -- 172.21.15.18:0/3808330813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 msgr2=0x562b94a1bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 -- 172.21.15.18:0/3808330813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 msgr2=0x562b94a320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 -- 172.21.15.18:0/3808330813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b94a37710 con 0x562b94a22490 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45ca00640 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.604+0000 7fc45de00640 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 0x562b94a404b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc450002230 tx=0x7fc4500129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366f9a84d8557495 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.605+0000 7fc449c00640 1 -- 172.21.15.18:0/3808330813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45001e040 con 0x562b94a22490 2024-04-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.605+0000 7fc449c00640 1 -- 172.21.15.18:0/3808330813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450021070 con 0x562b94a22490 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.605+0000 7fc449c00640 1 -- 172.21.15.18:0/3808330813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450023070 con 0x562b94a22490 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- 172.21.15.18:0/3808330813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 msgr2=0x562b94a404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 0x562b94a404b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc450002230 tx=0x7fc4500129c0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- 172.21.15.18:0/3808330813 shutdown_connections 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a347c0 0x562b94a320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a1bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 --2- 172.21.15.18:0/3808330813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a22490 0x562b94a404b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- 172.21.15.18:0/3808330813 >> 172.21.15.18:0/3808330813 conn(0x562b94a1d1e0 msgr2=0x562b94a1eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- 172.21.15.18:0/3808330813 shutdown_connections 2024-04-21T22:38:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- 172.21.15.18:0/3808330813 wait complete. 2024-04-21T22:38:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.606+0000 7fc462a66740 1 -- start start 2024-04-21T22:38:08.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 Processor -- start 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a22490 0x562b94a3ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 0x562b94a2e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581ac650 con 0x562b94a347c0 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581abf80 con 0x562b94a22490 2024-04-21T22:38:08.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4581a91a0 con 0x562b94a22e40 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.607+0000 7fc462a66740 10 client.0 _ll_register_callbacks cb 0x7fc450004e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54382/0 (socket says 172.21.15.18:54382) 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 -- 172.21.15.18:0/1145061511 learned_addr learned my addr 172.21.15.18:0/1145061511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45de00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a22490 0x562b94a3ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45de00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 0x562b94a2e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 -- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a22490 msgr2=0x562b94a3ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a22490 0x562b94a3ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 -- 172.21.15.18:0/1145061511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 msgr2=0x562b94a2e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 0x562b94a2e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 -- 172.21.15.18:0/1145061511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b94a2edb0 con 0x562b94a22e40 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45de00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 0x562b94a2e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc45ca00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc4580fef60 tx=0x7fc4440044d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=820a2ab4cacd069b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.608+0000 7fc43ea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444003a00 con 0x562b94a22e40 2024-04-21T22:38:08.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc444003ba0 con 0x562b94a22e40 2024-04-21T22:38:08.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc450021070 con 0x562b94a22e40 2024-04-21T22:38:08.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc44402c050 con 0x562b94a22e40 2024-04-21T22:38:08.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc462a66740 10 client.26593 fetch_fsmap learned FSMap version 36 2024-04-21T22:38:08.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.609+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562b94aaac40 con 0x562b94a22e40 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450021070 con 0x562b94a22e40 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc444012450 con 0x562b94a22e40 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 10 client.26593 fetch_fsmap finished waiting for FSMap version 36 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 10 client.26593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 20 client.26593 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94aab410 0x562b94aad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:08.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 4 client.26593 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b94a1ca60 con 0x562b94aab410 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.610+0000 7fc45de00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94aab410 0x562b94aad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc45de00640 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94aab410 0x562b94aad830 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf57d486412713d7 server_cookie=af9b2626a7617bf2 in_seq=0 out_seq=0 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc43ea00640 10 client.26593 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc43ea00640 1 -- 172.21.15.18:0/1145061511 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562b94a1ca60 con 0x562b94aab410 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc43ea00640 10 client.26593 handle_command_reply: tid=0 2024-04-21T22:38:08.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 client.26593 shutdown 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 msgr2=0x562b94a2e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc4580fef60 tx=0x7fc4440044d0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 shutdown_connections 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562b94a347c0 0x562b94a2e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562b94aab410 0x562b94aad830 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b94a22e40 0x562b94a2e160 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 --2- 172.21.15.18:0/1145061511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562b94a22490 0x562b94a3ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc43ea00640 0 client.26593 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.611+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 >> 172.21.15.18:0/1145061511 conn(0x562b94a1d1e0 msgr2=0x562b94a1e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.612+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 shutdown_connections 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.612+0000 7fc462a66740 1 -- 172.21.15.18:0/1145061511 wait complete. 2024-04-21T22:38:08.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.612+0000 7fc462a66740 20 client.26593 trim_cache size 0 max 16384 2024-04-21T22:38:08.621 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:38:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:38:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "c127ec11-d858-4198-bf80-95ddab625035": { 2024-04-21T22:38:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:38:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "c127ec11-d858-4198-bf80-95ddab625035", 2024-04-21T22:38:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:38:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:38:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:38:08.623 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.613+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 msgr2=0x7fc4400a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.613+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 0x7fc4400a5240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0eea10 tx=0x7fc44c009260 comp rx=0 tx=0).stop 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.613+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 msgr2=0x7fc45819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.613+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000c00 tx=0x7fc44c0043c0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 shutdown_connections 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc4400a2d80 0x7fc4400a5240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810bb30 0x7fc45819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458103080 0x7fc45819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 --2- 172.21.15.18:0/957622149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458102760 0x7fc45819a110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 >> 172.21.15.18:0/957622149 conn(0x7fc4580771f0 msgr2=0x7fc4580fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 shutdown_connections 2024-04-21T22:38:08.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:08.614+0000 7fc45e800640 1 -- 172.21.15.18:0/957622149 wait complete. 2024-04-21T22:38:08.636 INFO:tasks.cephfs.filesystem:scrub status for tag:c127ec11-d858-4198-bf80-95ddab625035 - {'path': '/', 'tag': 'c127ec11-d858-4198-bf80-95ddab625035', 'options': 'recursive,force'} 2024-04-21T22:38:09.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: pgmap v126: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-04-21T22:38:09.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:38:09.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:09.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:09.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:09 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: pgmap v126: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:09.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:09 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: pgmap v126: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:09.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:09.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:09 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:11 smithi018 ceph-mon[26614]: pgmap v127: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:11 smithi081 ceph-mon[31692]: pgmap v127: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:11 smithi047 ceph-mon[31561]: pgmap v127: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:13 smithi018 ceph-mon[26614]: pgmap v128: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:13.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:13 smithi081 ceph-mon[31692]: pgmap v128: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:13.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:13 smithi047 ceph-mon[31561]: pgmap v128: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-21T22:38:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:15 smithi018 ceph-mon[26614]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-04-21T22:38:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:15 smithi081 ceph-mon[31692]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-04-21T22:38:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:15 smithi047 ceph-mon[31561]: pgmap v129: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-04-21T22:38:16.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:16 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:38:16.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:16 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:38:16.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:16 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:38:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:17 smithi018 ceph-mon[26614]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-21T22:38:17.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:17 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:38:17.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:17 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:38:17.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:17 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:38:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:17 smithi081 ceph-mon[31692]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-21T22:38:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:17 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:38:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:17 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:38:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:17 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:38:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:17 smithi047 ceph-mon[31561]: pgmap v130: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-04-21T22:38:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:17 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:38:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:17 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:38:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:17 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:38:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:19 smithi018 ceph-mon[26614]: pgmap v131: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-21T22:38:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:19 smithi081 ceph-mon[31692]: pgmap v131: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-21T22:38:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:19 smithi047 ceph-mon[31561]: pgmap v131: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-04-21T22:38:21.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:21 smithi018 ceph-mon[26614]: pgmap v132: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:21 smithi081 ceph-mon[31692]: pgmap v132: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:21.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:21 smithi047 ceph-mon[31561]: pgmap v132: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:23 smithi018 ceph-mon[26614]: pgmap v133: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:23 smithi081 ceph-mon[31692]: pgmap v133: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:23 smithi047 ceph-mon[31561]: pgmap v133: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-21T22:38:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:23.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:24.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:24 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:24.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:24 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:24.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:24 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:24.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:24 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:24 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:24 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:24 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:24 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:24 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:25.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:25 smithi018 ceph-mon[26614]: pgmap v134: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:38:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:25 smithi081 ceph-mon[31692]: pgmap v134: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:38:25.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:25 smithi047 ceph-mon[31561]: pgmap v134: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 170 B/s wr, 12 op/s 2024-04-21T22:38:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:27 smithi018 ceph-mon[26614]: pgmap v135: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:27 smithi081 ceph-mon[31692]: pgmap v135: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:27 smithi047 ceph-mon[31561]: pgmap v135: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:29 smithi018 ceph-mon[26614]: pgmap v136: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:29.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:29 smithi081 ceph-mon[31692]: pgmap v136: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:29 smithi047 ceph-mon[31561]: pgmap v136: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:31 smithi018 ceph-mon[26614]: pgmap v137: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:31 smithi081 ceph-mon[31692]: pgmap v137: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:31 smithi047 ceph-mon[31561]: pgmap v137: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:33.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:33 smithi018 ceph-mon[26614]: pgmap v138: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:33 smithi081 ceph-mon[31692]: pgmap v138: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:33 smithi047 ceph-mon[31561]: pgmap v138: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:35 smithi018 ceph-mon[26614]: pgmap v139: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:35 smithi081 ceph-mon[31692]: pgmap v139: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:35.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:35 smithi047 ceph-mon[31561]: pgmap v139: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:37 smithi018 ceph-mon[26614]: pgmap v140: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:37 smithi081 ceph-mon[31692]: pgmap v140: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:37.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:37 smithi047 ceph-mon[31561]: pgmap v140: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:38.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:38:38.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:38:38.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 -- 172.21.15.18:0/193682929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8103900 msgr2=0x7fc7c8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 --2- 172.21.15.18:0/193682929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8103900 0x7fc7c8103d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009930 tx=0x7fc7b002bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 -- 172.21.15.18:0/193682929 shutdown_connections 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 --2- 172.21.15.18:0/193682929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c81042c0 0x7fc7c81107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 --2- 172.21.15.18:0/193682929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c8103900 0x7fc7c8103d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 --2- 172.21.15.18:0/193682929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8109910 0x7fc7c8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 -- 172.21.15.18:0/193682929 >> 172.21.15.18:0/193682929 conn(0x7fc7c80ff3b0 msgr2=0x7fc7c81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 -- 172.21.15.18:0/193682929 shutdown_connections 2024-04-21T22:38:38.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.865+0000 7fc7ce400640 1 -- 172.21.15.18:0/193682929 wait complete. 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.866+0000 7fc7ce400640 1 Processor -- start 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 -- start start 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 0x7fc7c819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c81042c0 0x7fc7c819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 0x7fc7c819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8113cf0 con 0x7fc7c81042c0 2024-04-21T22:38:38.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8113b70 con 0x7fc7c8103900 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7ce400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8113e70 con 0x7fc7c8109910 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 0x7fc7c819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 0x7fc7c819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43704/0 (socket says 172.21.15.18:43704) 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7c7400640 1 -- 172.21.15.18:0/1607700073 learned_addr learned my addr 172.21.15.18:0/1607700073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 0x7fc7c819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.867+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c81042c0 0x7fc7c819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1607700073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 msgr2=0x7fc7c819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 0x7fc7c819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c81042c0 msgr2=0x7fc7c819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c81042c0 0x7fc7c819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1607700073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c819f240 con 0x7fc7c8109910 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 0x7fc7c819eb10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000ec50 tx=0x7fc7c000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.868+0000 7fc7bfe00640 1 -- 172.21.15.18:0/1607700073 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0003b70 con 0x7fc7c8109910 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.869+0000 7fc7bfe00640 1 -- 172.21.15.18:0/1607700073 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c0003d10 con 0x7fc7c8109910 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.869+0000 7fc7bfe00640 1 -- 172.21.15.18:0/1607700073 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0010890 con 0x7fc7c8109910 2024-04-21T22:38:38.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.869+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c819f530 con 0x7fc7c8109910 2024-04-21T22:38:38.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.869+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a6dc0 con 0x7fc7c8109910 2024-04-21T22:38:38.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.872+0000 7fc7bfe00640 1 -- 172.21.15.18:0/1607700073 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc7c0003fc0 con 0x7fc7c8109910 2024-04-21T22:38:38.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.872+0000 7fc7d11c3740 1 Processor -- start 2024-04-21T22:38:38.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.872+0000 7fc7d11c3740 1 -- start start 2024-04-21T22:38:38.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af411ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af41d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575af375410 con 0x5575af41adc0 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575af31d7e0 con 0x5575af4118c0 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5575af3713d0 con 0x5575af4121e0 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af411ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60658/0 (socket says 172.21.15.18:60658) 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 -- 172.21.15.18:0/1612793673 learned_addr learned my addr 172.21.15.18:0/1612793673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af41d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 -- 172.21.15.18:0/1612793673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 msgr2=0x5575af411ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af411ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 -- 172.21.15.18:0/1612793673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 msgr2=0x5575af41d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af41d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.873+0000 7fc7c7400640 1 -- 172.21.15.18:0/1612793673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575af1537d0 con 0x5575af4121e0 2024-04-21T22:38:38.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af411ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:38.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7bfe00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 0x7fc7ac0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7bfe00640 1 -- 172.21.15.18:0/1607700073 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc7c00cf9e0 con 0x7fc7c8109910 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d40 tx=0x7fc7b8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9e3ca35ec6e96c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 0x7fc7ac0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7bcc00640 1 -- 172.21.15.18:0/1612793673 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004220 con 0x5575af4121e0 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7bcc00640 1 -- 172.21.15.18:0/1612793673 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b80043c0 con 0x5575af4121e0 2024-04-21T22:38:38.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.874+0000 7fc7bcc00640 1 -- 172.21.15.18:0/1612793673 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80035f0 con 0x5575af4121e0 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1612793673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 msgr2=0x5575af41a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 0x7fc7ac0a5240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005ab0 tx=0x7fc7b0005fd0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009d40 tx=0x7fc7b8011810 comp rx=0 tx=0).stop 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1612793673 shutdown_connections 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af41d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41a880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1612793673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af411ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1612793673 >> 172.21.15.18:0/1612793673 conn(0x5575af40bff0 msgr2=0x5575af40c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1612793673 shutdown_connections 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.875+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1612793673 wait complete. 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 -- start start 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 Processor -- start 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af418360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af41adc0 0x5575af4188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575af41dbb0 con 0x5575af4118c0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5575af330c40 con 0x5575af41adc0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5575af41dd30 con 0x5575af4121e0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.876+0000 7fc7d11c3740 10 client.0 _ll_register_callbacks cb 0x5575af330630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af418360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45426/0 (socket says 172.21.15.18:45426) 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c7400640 1 -- 172.21.15.18:0/2931793736 learned_addr learned my addr 172.21.15.18:0/2931793736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af41adc0 0x5575af4188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 -- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af41adc0 msgr2=0x5575af4188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af41adc0 0x5575af4188a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 -- 172.21.15.18:0/2931793736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 msgr2=0x5575af417e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 -- 172.21.15.18:0/2931793736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575af0893f0 con 0x5575af4121e0 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af418360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7b002c170 tx=0x7fc7b0005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd44a2981516f37 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.877+0000 7fc7b5600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0004ad0 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b80043c0 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc7b0004c70 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc7b00044b0 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7d11c3740 10 client.26605 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5575af0490f0 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.878+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b80043c0 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7fc7b0051020 con 0x5575af4121e0 2024-04-21T22:38:38.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 10 client.26605 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 10 client.26605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 20 client.26605 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af42b050 0x5575af42d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 4 client.26605 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575af388c40 con 0x5575af42b050 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.879+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af42b050 0x5575af42d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.880+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af42b050 0x5575af42d4c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235caf06265b514e server_cookie=9539c19530c3da54 in_seq=0 out_seq=0 2024-04-21T22:38:38.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.880+0000 7fc7b5600640 10 client.26605 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7b5600640 1 -- 172.21.15.18:0/2931793736 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5575af388c40 con 0x5575af42b050 2024-04-21T22:38:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7b5600640 10 client.26605 handle_command_reply: tid=0 2024-04-21T22:38:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 client.26605 shutdown 2024-04-21T22:38:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 msgr2=0x5575af418360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af418360 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7b002c170 tx=0x7fc7b0005b50 comp rx=0 tx=0).stop 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 shutdown_connections 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af41adc0 0x5575af4188a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af42b050 0x5575af42d4c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af418360 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2931793736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af4118c0 0x5575af417e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7b5600640 0 client.26605 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 >> 172.21.15.18:0/2931793736 conn(0x5575af40bff0 msgr2=0x5575af40dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 shutdown_connections 2024-04-21T22:38:38.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2931793736 wait complete. 2024-04-21T22:38:38.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.881+0000 7fc7d11c3740 20 client.26605 trim_cache size 0 max 16384 2024-04-21T22:38:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 Processor -- start 2024-04-21T22:38:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 -- start start 2024-04-21T22:38:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4121e0 0x5575af426a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af432d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81af770 con 0x5575af41adc0 2024-04-21T22:38:38.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81b12e0 con 0x5575af4121e0 2024-04-21T22:38:38.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81afe70 con 0x5575af4118c0 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af432d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.901+0000 7fc7c6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4121e0 0x5575af426a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60674/0 (socket says 172.21.15.18:60674) 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 -- 172.21.15.18:0/2503064762 learned_addr learned my addr 172.21.15.18:0/2503064762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 -- 172.21.15.18:0/2503064762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4121e0 msgr2=0x5575af426a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4121e0 0x5575af426a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 -- 172.21.15.18:0/2503064762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 msgr2=0x5575af432d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af432d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 -- 172.21.15.18:0/2503064762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575af410c80 con 0x5575af4118c0 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af432d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7c7400640 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8000c00 tx=0x7fc7b8009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35cde855eb96843 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.902+0000 7fc7b7e00640 1 -- 172.21.15.18:0/2503064762 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8033070 con 0x5575af4118c0 2024-04-21T22:38:38.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7b7e00640 1 -- 172.21.15.18:0/2503064762 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b801e040 con 0x5575af4118c0 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7b7e00640 1 -- 172.21.15.18:0/2503064762 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b801d040 con 0x5575af4118c0 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2503064762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 msgr2=0x5575af41a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8000c00 tx=0x7fc7b8009fb0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2503064762 shutdown_connections 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af432d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4121e0 0x5575af426a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/2503064762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4118c0 0x5575af41a550 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2503064762 >> 172.21.15.18:0/2503064762 conn(0x5575af40bff0 msgr2=0x5575af4166f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2503064762 shutdown_connections 2024-04-21T22:38:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.903+0000 7fc7d11c3740 1 -- 172.21.15.18:0/2503064762 wait complete. 2024-04-21T22:38:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 -- start start 2024-04-21T22:38:38.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 Processor -- start 2024-04-21T22:38:38.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af41df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81b0c10 con 0x5575af41adc0 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81b0540 con 0x5575af4118c0 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.904+0000 7fc7d11c3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81ad750 con 0x5575af4121e0 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7d11c3740 10 client.0 _ll_register_callbacks cb 0x7fc7b0005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:38.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45448/0 (socket says 172.21.15.18:45448) 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1357133070 learned_addr learned my addr 172.21.15.18:0/1357133070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af41df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1357133070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 msgr2=0x5575af41e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 msgr2=0x5575af41df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af41df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 -- 172.21.15.18:0/1357133070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575af48fb30 con 0x5575af41adc0 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c6a00640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7c7e00640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0098870 tx=0x7fc7c0009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f1f9dac107025 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.905+0000 7fc7b5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00a4b10 con 0x5575af41adc0 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc7c00cd350 con 0x5575af41adc0 2024-04-21T22:38:38.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b801e040 con 0x5575af41adc0 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc7c00a4680 con 0x5575af41adc0 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 10 client.16488 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5575af490d00 con 0x5575af41adc0 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b801e040 con 0x5575af41adc0 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7fc7c0004c20 con 0x5575af41adc0 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 10 client.16488 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:38.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.906+0000 7fc7d11c3740 20 client.16488 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.907+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af491430 0x5575af493850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.907+0000 7fc7d11c3740 4 client.16488 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.907+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5575af382950 con 0x5575af491430 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.907+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af491430 0x5575af493850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7c7400640 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af491430 0x5575af493850 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a54140102af435 server_cookie=12859f97bb4f176 in_seq=0 out_seq=0 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7b5600640 10 client.16488 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7b5600640 1 -- 172.21.15.18:0/1357133070 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5575af382950 con 0x5575af491430 2024-04-21T22:38:38.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7b5600640 10 client.16488 handle_command_reply: tid=0 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 client.16488 shutdown 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 msgr2=0x5575af48f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0098870 tx=0x7fc7c0009960 comp rx=0 tx=0).stop 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 shutdown_connections 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575af41adc0 0x5575af48f5f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5575af491430 0x5575af493850 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575af4121e0 0x5575af41e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 --2- 172.21.15.18:0/1357133070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5575af4118c0 0x5575af41df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 >> 172.21.15.18:0/1357133070 conn(0x5575af40bff0 msgr2=0x5575af416b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7b5600640 0 client.16488 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:38.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 shutdown_connections 2024-04-21T22:38:38.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 1 -- 172.21.15.18:0/1357133070 wait complete. 2024-04-21T22:38:38.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.908+0000 7fc7d11c3740 20 client.16488 trim_cache size 0 max 16384 2024-04-21T22:38:38.918 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:38.918 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:38:38.918 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:38:38.918 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 msgr2=0x7fc7ac0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 0x7fc7ac0a5240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0005ab0 tx=0x7fc7b0005fd0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 msgr2=0x7fc7c819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 0x7fc7c819eb10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000ec50 tx=0x7fc7c000c6a0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 shutdown_connections 2024-04-21T22:38:38.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7ac0a2d80 0x7fc7ac0a5240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7c8109910 0x7fc7c819eb10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7c81042c0 0x7fc7c819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 --2- 172.21.15.18:0/1607700073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7c8103900 0x7fc7c819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 >> 172.21.15.18:0/1607700073 conn(0x7fc7c80ff3b0 msgr2=0x7fc7c80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 shutdown_connections 2024-04-21T22:38:38.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:38.909+0000 7fc7ce400640 1 -- 172.21.15.18:0/1607700073 wait complete. 2024-04-21T22:38:38.927 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:38:38.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.139+0000 7f23e9800640 1 -- 172.21.15.18:0/2601476164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 msgr2=0x7f23e4114880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.139+0000 7f23e9800640 1 --2- 172.21.15.18:0/2601476164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e4114880 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009cd0 tx=0x7f23dc02c0e0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 -- 172.21.15.18:0/2601476164 shutdown_connections 2024-04-21T22:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 --2- 172.21.15.18:0/2601476164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e4114880 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 --2- 172.21.15.18:0/2601476164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 0x7f23e4111f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 --2- 172.21.15.18:0/2601476164 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e4076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 -- 172.21.15.18:0/2601476164 >> 172.21.15.18:0/2601476164 conn(0x7f23e40ff300 msgr2=0x7f23e4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 -- 172.21.15.18:0/2601476164 shutdown_connections 2024-04-21T22:38:39.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.140+0000 7f23e9800640 1 -- 172.21.15.18:0/2601476164 wait complete. 2024-04-21T22:38:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.141+0000 7f23e9800640 1 Processor -- start 2024-04-21T22:38:39.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.141+0000 7f23e9800640 1 -- start start 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.141+0000 7f23e9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.141+0000 7f23e9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 0x7f23e419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.141+0000 7f23e9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e9800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4117ff0 con 0x7f23e4076590 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e9800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4117e70 con 0x7f23e4075c70 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e9800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4118170 con 0x7f23e4112490 2024-04-21T22:38:39.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60706/0 (socket says 172.21.15.18:60706) 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e8e00640 1 -- 172.21.15.18:0/3276772023 learned_addr learned my addr 172.21.15.18:0/3276772023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43764/0 (socket says 172.21.15.18:43764) 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3400640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 0x7f23e419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 -- 172.21.15.18:0/3276772023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 msgr2=0x7f23e41a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 -- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 msgr2=0x7f23e419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 0x7f23e419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e3e00640 1 -- 172.21.15.18:0/3276772023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e41a34b0 con 0x7f23e4075c70 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.142+0000 7f23e8e00640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e3e00640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23d400e9f0 tx=0x7f23d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d400ccc0 con 0x7f23e4075c70 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23d4010910 con 0x7f23e4075c70 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e41a37a0 con 0x7f23e4075c70 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4018960 con 0x7f23e4075c70 2024-04-21T22:38:39.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.143+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41ab030 con 0x7f23e4075c70 2024-04-21T22:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.144+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e404f570 con 0x7f23e4075c70 2024-04-21T22:38:39.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.147+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f23d4010ac0 con 0x7f23e4075c70 2024-04-21T22:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.148+0000 7f23e0c00640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 0x7f23c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.148+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f23d40cf820 con 0x7f23e4075c70 2024-04-21T22:38:39.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.149+0000 7f23e3400640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 0x7f23c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.149+0000 7f23e3400640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 0x7f23c80a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23e41017d0 tx=0x7f23d000b390 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.153+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f23d409bd90 con 0x7f23e4075c70 2024-04-21T22:38:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.396+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23e410d620 con 0x7f23e4075c70 2024-04-21T22:38:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.397+0000 7f23e0c00640 1 -- 172.21.15.18:0/3276772023 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11915 (secure 0 0 0) 0x7f23d40a0090 con 0x7f23e4075c70 2024-04-21T22:38:39.397 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:38:39.397 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:23.103987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24596,24568,24509,24496,24538]},"id":1}]} 2024-04-21T22:38:39.398 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 37 2024-04-21T22:38:39.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 msgr2=0x7f23c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 0x7f23c80a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23e41017d0 tx=0x7f23d000b390 comp rx=0 tx=0).stop 2024-04-21T22:38:39.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 msgr2=0x7f23e419e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23d400e9f0 tx=0x7f23d400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 shutdown_connections 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f23c80a2cf0 0x7f23c80a51b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e4112490 0x7f23e41a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23e4076590 0x7f23e419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 --2- 172.21.15.18:0/3276772023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f23e4075c70 0x7f23e419e510 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 >> 172.21.15.18:0/3276772023 conn(0x7f23e40ff300 msgr2=0x7f23e4113bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 shutdown_connections 2024-04-21T22:38:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.400+0000 7f23e9800640 1 -- 172.21.15.18:0/3276772023 wait complete. 2024-04-21T22:38:39.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:38:39.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 -- 172.21.15.18:0/1015492679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8030109930 msgr2=0x7f8030109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 --2- 172.21.15.18:0/1015492679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8030109930 0x7f8030109d10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8018009930 tx=0x7f801802bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:39.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 -- 172.21.15.18:0/1015492679 shutdown_connections 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 --2- 172.21.15.18:0/1015492679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80301042e0 0x7f80301107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 --2- 172.21.15.18:0/1015492679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030103920 0x7f8030103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 --2- 172.21.15.18:0/1015492679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8030109930 0x7f8030109d10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 -- 172.21.15.18:0/1015492679 >> 172.21.15.18:0/1015492679 conn(0x7f80300ff3b0 msgr2=0x7f80301017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 -- 172.21.15.18:0/1015492679 shutdown_connections 2024-04-21T22:38:39.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.645+0000 7f8035e00640 1 -- 172.21.15.18:0/1015492679 wait complete. 2024-04-21T22:38:39.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.646+0000 7f8035e00640 1 Processor -- start 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.646+0000 7f8035e00640 1 -- start start 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.646+0000 7f8035e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.646+0000 7f8035e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f8035e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030109930 0x7f803019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f8035e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8030113d90 con 0x7f80301042e0 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f8035e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8030113c10 con 0x7f8030103920 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f8035e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8030113f10 con 0x7f8030109930 2024-04-21T22:38:39.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45482/0 (socket says 172.21.15.18:45482) 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43780/0 (socket says 172.21.15.18:43780) 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802e000640 1 -- 172.21.15.18:0/2161462326 learned_addr learned my addr 172.21.15.18:0/2161462326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802f400640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030109930 0x7f803019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 -- 172.21.15.18:0/2161462326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030109930 msgr2=0x7f803019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030109930 0x7f803019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 -- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 msgr2=0x7f803019a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802ea00640 1 -- 172.21.15.18:0/2161462326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803019f300 con 0x7f8030103920 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.647+0000 7f802e000640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f802ea00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8018036040 tx=0x7f8018005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f8034a00640 1 -- 172.21.15.18:0/2161462326 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018043020 con 0x7f8030103920 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f8034a00640 1 -- 172.21.15.18:0/2161462326 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8018005000 con 0x7f8030103920 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f8034a00640 1 -- 172.21.15.18:0/2161462326 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018003a30 con 0x7f8030103920 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803019f590 con 0x7f8030103920 2024-04-21T22:38:39.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.648+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80301a6e80 con 0x7f8030103920 2024-04-21T22:38:39.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.651+0000 7f8034a00640 1 -- 172.21.15.18:0/2161462326 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8018046020 con 0x7f8030103920 2024-04-21T22:38:39.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 Processor -- start 2024-04-21T22:38:39.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 -- start start 2024-04-21T22:38:39.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ecfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc43e2b3a0 con 0x55cc43ec6d80 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cc43dd3930 con 0x55cc43ed0280 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.652+0000 7f8038ba7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc43e27360 con 0x55cc43ec76a0 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ecfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45494/0 (socket says 172.21.15.18:45494) 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802e000640 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802f400640 1 -- 172.21.15.18:0/3022694108 learned_addr learned my addr 172.21.15.18:0/3022694108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 -- 172.21.15.18:0/3022694108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 msgr2=0x55cc43ed2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 -- 172.21.15.18:0/3022694108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 msgr2=0x55cc43ec7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802ea00640 1 -- 172.21.15.18:0/3022694108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc43b3f3f0 con 0x55cc43ec76a0 2024-04-21T22:38:39.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.653+0000 7f802f400640 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f8034a00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 0x7f80140a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f802ea00640 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ecfd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f80180eea80 tx=0x7f80180f92f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e99d31d4f80e922 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f8034a00640 1 -- 172.21.15.18:0/2161462326 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f80180f1280 con 0x7f8030103920 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f801fe00640 1 -- 172.21.15.18:0/3022694108 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180b9af0 con 0x55cc43ec76a0 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f802f400640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 0x7f80140a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f801fe00640 1 -- 172.21.15.18:0/3022694108 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80180bdf50 con 0x55cc43ec76a0 2024-04-21T22:38:39.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.654+0000 7f801fe00640 1 -- 172.21.15.18:0/3022694108 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180bd1b0 con 0x55cc43ec76a0 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 -- 172.21.15.18:0/3022694108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 msgr2=0x55cc43ecfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ecfd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f80180eea80 tx=0x7f80180f92f0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f802f400640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 0x7f80140a51c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8028009fd0 tx=0x7f8028005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 -- 172.21.15.18:0/3022694108 shutdown_connections 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ecfd40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 --2- 172.21.15.18:0/3022694108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ec7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 -- 172.21.15.18:0/3022694108 >> 172.21.15.18:0/3022694108 conn(0x55cc43ec14b0 msgr2=0x55cc43ec1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 -- 172.21.15.18:0/3022694108 shutdown_connections 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.655+0000 7f8038ba7740 1 -- 172.21.15.18:0/3022694108 wait complete. 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 -- start start 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 Processor -- start 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec6d80 0x55cc43ecd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ecdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc43ed2e30 con 0x55cc43ec76a0 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cc43de6d80 con 0x55cc43ed0280 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.656+0000 7f8038ba7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cc43ed2fb0 con 0x55cc43ec6d80 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f8038ba7740 10 client.0 _ll_register_callbacks cb 0x55cc43e232b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45502/0 (socket says 172.21.15.18:45502) 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 -- 172.21.15.18:0/1704874497 learned_addr learned my addr 172.21.15.18:0/1704874497 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802ea00640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec6d80 0x55cc43ecd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802f400640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ecdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 -- 172.21.15.18:0/1704874497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec6d80 msgr2=0x55cc43ecd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec6d80 0x55cc43ecd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 -- 172.21.15.18:0/1704874497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 msgr2=0x55cc43ecdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ecdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 -- 172.21.15.18:0/1704874497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc43c097d0 con 0x55cc43ec76a0 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.657+0000 7f802e000640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8020012df0 tx=0x7f802000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c30f9d33629de9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f801cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020004b20 con 0x55cc43ec76a0 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8020004cc0 con 0x55cc43ec76a0 2024-04-21T22:38:39.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80180bdf50 con 0x55cc43ec76a0 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f802001c470 con 0x55cc43ec76a0 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f8038ba7740 10 client.16506 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cc43edf080 con 0x55cc43ec76a0 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.658+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80180bdf50 con 0x55cc43ec76a0 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f8020010700 con 0x55cc43ec76a0 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 10 client.16506 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:39.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 10 client.16506 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 20 client.16506 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43ee0540 0x55cc43ee29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 4 client.16506 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc43e388e0 con 0x55cc43ee0540 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.659+0000 7f802ea00640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43ee0540 0x55cc43ee29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.660+0000 7f802ea00640 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43ee0540 0x55cc43ee29c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f46e9ec1433ab54c server_cookie=e227d305c0828a34 in_seq=0 out_seq=0 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.660+0000 7f801cc00640 10 client.16506 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:39.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.660+0000 7f801cc00640 1 -- 172.21.15.18:0/1704874497 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cc43e388e0 con 0x55cc43ee0540 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.660+0000 7f801cc00640 10 client.16506 handle_command_reply: tid=0 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 client.16506 shutdown 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 msgr2=0x55cc43ecd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8020012df0 tx=0x7f802000f790 comp rx=0 tx=0).stop 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 shutdown_connections 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43ee0540 0x55cc43ee29c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ecdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec76a0 0x55cc43ecd7e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f801cc00640 0 client.16506 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 --2- 172.21.15.18:0/1704874497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec6d80 0x55cc43ecd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 >> 172.21.15.18:0/1704874497 conn(0x55cc43ec14b0 msgr2=0x55cc43ec3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 shutdown_connections 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 1 -- 172.21.15.18:0/1704874497 wait complete. 2024-04-21T22:38:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.661+0000 7f8038ba7740 20 client.16506 trim_cache size 0 max 16384 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 Processor -- start 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 -- start start 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 0x55cc43ecf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43edbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 0x55cc43ec0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80301af790 con 0x55cc43ed0280 2024-04-21T22:38:39.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80301b1300 con 0x55cc43ec6d80 2024-04-21T22:38:39.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f8038ba7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80301afe90 con 0x55cc43ec76a0 2024-04-21T22:38:39.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.677+0000 7f802f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 0x55cc43ec0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 0x55cc43ecf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 0x55cc43ec0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45516/0 (socket says 172.21.15.18:45516) 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802f400640 1 -- 172.21.15.18:0/2879698784 learned_addr learned my addr 172.21.15.18:0/2879698784 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802e000640 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43edbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 -- 172.21.15.18:0/2879698784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 msgr2=0x55cc43edbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43edbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 -- 172.21.15.18:0/2879698784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 msgr2=0x55cc43ec0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 0x55cc43ec0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 -- 172.21.15.18:0/2879698784 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc43ebbaa0 con 0x55cc43ec6d80 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f802ea00640 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 0x55cc43ecf9d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80180be100 tx=0x7f80180f9870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1493c16b8eeaba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.678+0000 7f801f400640 1 -- 172.21.15.18:0/2879698784 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180bd390 con 0x55cc43ec6d80 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f801f400640 1 -- 172.21.15.18:0/2879698784 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80180bdf50 con 0x55cc43ec6d80 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f801f400640 1 -- 172.21.15.18:0/2879698784 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180bd620 con 0x55cc43ec6d80 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 -- 172.21.15.18:0/2879698784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 msgr2=0x55cc43ecf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 0x55cc43ecf9d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80180be100 tx=0x7f80180f9870 comp rx=0 tx=0).stop 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 -- 172.21.15.18:0/2879698784 shutdown_connections 2024-04-21T22:38:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ed0280 0x55cc43ec0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43edbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2879698784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ec6d80 0x55cc43ecf9d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 -- 172.21.15.18:0/2879698784 >> 172.21.15.18:0/2879698784 conn(0x55cc43ec14b0 msgr2=0x55cc43ebfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 -- 172.21.15.18:0/2879698784 shutdown_connections 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.679+0000 7f8038ba7740 1 -- 172.21.15.18:0/2879698784 wait complete. 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.680+0000 7f8038ba7740 1 -- start start 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.680+0000 7f8038ba7740 1 Processor -- start 2024-04-21T22:38:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.680+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.680+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ed4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f8038ba7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f8038ba7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80301b0c30 con 0x55cc43ec6d80 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f8038ba7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f80301b0560 con 0x55cc43ed0280 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f8038ba7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80301ad770 con 0x55cc43ec76a0 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f8038ba7740 10 client.0 _ll_register_callbacks cb 0x7f8020012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ed4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45518/0 (socket says 172.21.15.18:45518) 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 -- 172.21.15.18:0/2142662026 learned_addr learned my addr 172.21.15.18:0/2142662026 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802f400640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 -- 172.21.15.18:0/2142662026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 msgr2=0x55cc43ed4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ed4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 -- 172.21.15.18:0/2142662026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 msgr2=0x55cc43ed48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.681+0000 7f802ea00640 1 -- 172.21.15.18:0/2142662026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc43f45e10 con 0x55cc43ec6d80 2024-04-21T22:38:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f802ea00640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f80180ba1d0 tx=0x7f80180b9b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be3bedc7a8155ae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f801cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180bd620 con 0x55cc43ec6d80 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f80180051b0 con 0x55cc43ec6d80 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80180bdf50 con 0x55cc43ec6d80 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f80180bd1b0 con 0x55cc43ec6d80 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f8038ba7740 10 client.16512 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cc43f47110 con 0x55cc43ec6d80 2024-04-21T22:38:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.682+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80180bdf50 con 0x55cc43ec6d80 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f80180bdab0 con 0x55cc43ec6d80 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 10 client.16512 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 10 client.16512 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 20 client.16512 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43f474a0 0x55cc43f49890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 4 client.16512 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc43e32c30 con 0x55cc43f474a0 2024-04-21T22:38:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f802e000640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43f474a0 0x55cc43f49890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f801cc00640 10 client.16512 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.683+0000 7f802e000640 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43f474a0 0x55cc43f49890 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3a7f6e949e6cf560 server_cookie=9d4cacec34a96ec2 in_seq=0 out_seq=0 2024-04-21T22:38:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f801cc00640 1 -- 172.21.15.18:0/2142662026 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc43e32c30 con 0x55cc43f474a0 2024-04-21T22:38:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f801cc00640 10 client.16512 handle_command_reply: tid=0 2024-04-21T22:38:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 client.16512 shutdown 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 msgr2=0x55cc43ed3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f80180ba1d0 tx=0x7f80180b9b70 comp rx=0 tx=0).stop 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 shutdown_connections 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cc43f474a0 0x55cc43f49890 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cc43ed0280 0x55cc43ed48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f801cc00640 0 client.16512 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cc43ec76a0 0x55cc43ed4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 --2- 172.21.15.18:0/2142662026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc43ec6d80 0x55cc43ed3e30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 >> 172.21.15.18:0/2142662026 conn(0x55cc43ec14b0 msgr2=0x55cc43ec0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 shutdown_connections 2024-04-21T22:38:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 1 -- 172.21.15.18:0/2142662026 wait complete. 2024-04-21T22:38:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.684+0000 7f8038ba7740 20 client.16512 trim_cache size 0 max 16384 2024-04-21T22:38:39.693 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 msgr2=0x7f80140a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 0x7f80140a51c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8028009fd0 tx=0x7f8028005f90 comp rx=0 tx=0).stop 2024-04-21T22:38:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 msgr2=0x7f803019a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8018036040 tx=0x7f8018005e80 comp rx=0 tx=0).stop 2024-04-21T22:38:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 shutdown_connections 2024-04-21T22:38:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f80140a2d00 0x7f80140a51c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8030109930 0x7f803019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80301042e0 0x7f803019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 --2- 172.21.15.18:0/2161462326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8030103920 0x7f803019a310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 >> 172.21.15.18:0/2161462326 conn(0x7f80300ff3b0 msgr2=0x7f80300ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 shutdown_connections 2024-04-21T22:38:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.685+0000 7f8035e00640 1 -- 172.21.15.18:0/2161462326 wait complete. 2024-04-21T22:38:39.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:39 smithi018 ceph-mon[26614]: pgmap v141: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:39.701 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:39 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3276772023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:39.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:38:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:39 smithi081 ceph-mon[31692]: pgmap v141: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:39 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3276772023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 -- 172.21.15.18:0/3187278448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 msgr2=0x7f3ac810e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 --2- 172.21.15.18:0/3187278448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac810e350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009ca0 tx=0x7f3ac002c100 comp rx=0 tx=0).stop 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 -- 172.21.15.18:0/3187278448 shutdown_connections 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 --2- 172.21.15.18:0/3187278448 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac810e350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 --2- 172.21.15.18:0/3187278448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac8103360 0x7f3ac810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 --2- 172.21.15.18:0/3187278448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac81029b0 0x7f3ac8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.920+0000 7f3acf800640 1 -- 172.21.15.18:0/3187278448 >> 172.21.15.18:0/3187278448 conn(0x7f3ac8077760 msgr2=0x7f3ac8077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.921+0000 7f3acf800640 1 -- 172.21.15.18:0/3187278448 shutdown_connections 2024-04-21T22:38:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.921+0000 7f3acf800640 1 -- 172.21.15.18:0/3187278448 wait complete. 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 Processor -- start 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 -- start start 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 0x7f3ac819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac819ec50 0x7f3ac819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8111cd0 con 0x7f3ac810bec0 2024-04-21T22:38:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8111b50 con 0x7f3ac81029b0 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3acf800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8111e50 con 0x7f3ac819ec50 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.922+0000 7f3abfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45546/0 (socket says 172.21.15.18:45546) 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3acce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 0x7f3ac819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 -- 172.21.15.18:0/199057833 learned_addr learned my addr 172.21.15.18:0/199057833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3acd800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac819ec50 0x7f3ac819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 -- 172.21.15.18:0/199057833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac819ec50 msgr2=0x7f3ac819f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac819ec50 0x7f3ac819f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 -- 172.21.15.18:0/199057833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 msgr2=0x7f3ac819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 0x7f3ac819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 -- 172.21.15.18:0/199057833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac819f740 con 0x7f3ac810bec0 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3acce00640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 0x7f3ac819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.923+0000 7f3abfe00640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000e9f0 tx=0x7f3ab000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.924+0000 7f3ac6000640 1 -- 172.21.15.18:0/199057833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000ccc0 con 0x7f3ac810bec0 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.924+0000 7f3ac6000640 1 -- 172.21.15.18:0/199057833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab0010910 con 0x7f3ac810bec0 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.924+0000 7f3ac6000640 1 -- 172.21.15.18:0/199057833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0018920 con 0x7f3ac810bec0 2024-04-21T22:38:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.924+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac819fa30 con 0x7f3ac810bec0 2024-04-21T22:38:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.924+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81a71d0 con 0x7f3ac810bec0 2024-04-21T22:38:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.927+0000 7f3ac6000640 1 -- 172.21.15.18:0/199057833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3ab0010ac0 con 0x7f3ac810bec0 2024-04-21T22:38:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.927+0000 7f3ad25dd740 1 Processor -- start 2024-04-21T22:38:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 -- start start 2024-04-21T22:38:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413eb3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558413e0f3a0 con 0x558413eaad80 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558413db7930 con 0x558413eb4280 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558413e0b360 con 0x558413eab6a0 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3acd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3acce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413eb3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3acd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45562/0 (socket says 172.21.15.18:45562) 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.928+0000 7f3acd800640 1 -- 172.21.15.18:0/2537155972 learned_addr learned my addr 172.21.15.18:0/2537155972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3abfe00640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 -- 172.21.15.18:0/2537155972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 msgr2=0x558413eb6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 -- 172.21.15.18:0/2537155972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 msgr2=0x558413eab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 -- 172.21.15.18:0/2537155972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558413b233f0 con 0x558413eab6a0 2024-04-21T22:38:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3abfe00640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acd800640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3ac6000640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 0x7f3aa80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3ac6000640 1 -- 172.21.15.18:0/199057833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3ab00cf670 con 0x7f3ac810bec0 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acce00640 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413eb3d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009fd0 tx=0x7f3ab80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=990289968726317f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.929+0000 7f3acd800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 0x7f3aa80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.930+0000 7f3abe000640 1 -- 172.21.15.18:0/2537155972 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004310 con 0x558413eab6a0 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.930+0000 7f3abe000640 1 -- 172.21.15.18:0/2537155972 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab80044b0 con 0x558413eab6a0 2024-04-21T22:38:39.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.930+0000 7f3abe000640 1 -- 172.21.15.18:0/2537155972 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab80035f0 con 0x558413eab6a0 2024-04-21T22:38:39.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2537155972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 msgr2=0x558413eb3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413eb3d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009fd0 tx=0x7f3ab80118d0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3acd800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 0x7f3aa80a51c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009a60 tx=0x7f3ac0005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2537155972 shutdown_connections 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413eb3d40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2537155972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413eab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2537155972 >> 172.21.15.18:0/2537155972 conn(0x558413ea54b0 msgr2=0x558413ea5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2537155972 shutdown_connections 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2537155972 wait complete. 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.931+0000 7f3ad25dd740 1 -- start start 2024-04-21T22:38:39.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 Processor -- start 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 0x558413eb12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413eb1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558413eb7070 con 0x558413eab6a0 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558413dcad80 con 0x558413eaad80 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558413eb71f0 con 0x558413eb4280 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3ad25dd740 10 client.0 _ll_register_callbacks cb 0x558413e072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:39.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3acd800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3abfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413eb1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3acce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 0x558413eb12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3acd800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60808/0 (socket says 172.21.15.18:60808) 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3acce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 0x558413eb12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43856/0 (socket says 172.21.15.18:43856) 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.932+0000 7f3acd800640 1 -- 172.21.15.18:0/2991177246 learned_addr learned my addr 172.21.15.18:0/2991177246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 -- 172.21.15.18:0/2991177246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 msgr2=0x558413eb1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 -- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 msgr2=0x558413eb12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 0x558413eb12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 -- 172.21.15.18:0/2991177246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558413bed7d0 con 0x558413eab6a0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3acd800640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3abfe00640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413eb1820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ccdc0 tx=0x7f3ab009bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683ed51c4944aec server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3ab6a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab009b290 con 0x558413eab6a0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3ab00cfb20 con 0x558413eab6a0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.933+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab80044b0 con 0x558413eab6a0 2024-04-21T22:38:39.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3ab009bc40 con 0x558413eab6a0 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 10 client.16524 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558413ec3390 con 0x558413eab6a0 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab80044b0 con 0x558413eab6a0 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f3ab0097b00 con 0x558413eab6a0 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 10 client.16524 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 10 client.16524 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 20 client.16524 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:39.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413ec48a0 0x558413ec6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 4 client.16524 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.934+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558413e1c8e0 con 0x558413ec48a0 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.935+0000 7f3acce00640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413ec48a0 0x558413ec6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.935+0000 7f3acce00640 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413ec48a0 0x558413ec6cd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6645640c92430243 server_cookie=6faf2d9cecfc4130 in_seq=0 out_seq=0 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.935+0000 7f3ab6a00640 10 client.16524 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.936+0000 7f3ab6a00640 1 -- 172.21.15.18:0/2991177246 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558413e1c8e0 con 0x558413ec48a0 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.936+0000 7f3ab6a00640 10 client.16524 handle_command_reply: tid=0 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.936+0000 7f3ad25dd740 1 client.16524 shutdown 2024-04-21T22:38:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 msgr2=0x558413eb1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413eb1820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ccdc0 tx=0x7f3ab009bb10 comp rx=0 tx=0).stop 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 shutdown_connections 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413ec48a0 0x558413ec6cd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eb4280 0x558413eb1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413eb1820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/2991177246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eaad80 0x558413eb12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ab6a00640 0 client.16524 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:39.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 >> 172.21.15.18:0/2991177246 conn(0x558413ea54b0 msgr2=0x558413ea7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 shutdown_connections 2024-04-21T22:38:39.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 1 -- 172.21.15.18:0/2991177246 wait complete. 2024-04-21T22:38:39.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.937+0000 7f3ad25dd740 20 client.16524 trim_cache size 0 max 16384 2024-04-21T22:38:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:39 smithi047 ceph-mon[31561]: pgmap v141: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:39 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3276772023' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:38:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 Processor -- start 2024-04-21T22:38:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 -- start start 2024-04-21T22:38:39.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413ebff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413ea4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81af6e0 con 0x558413eab6a0 2024-04-21T22:38:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81b1250 con 0x558413eb4280 2024-04-21T22:38:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.952+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81afde0 con 0x558413eaad80 2024-04-21T22:38:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3abfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413ebff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60820/0 (socket says 172.21.15.18:60820) 2024-04-21T22:38:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 -- 172.21.15.18:0/1468580047 learned_addr learned my addr 172.21.15.18:0/1468580047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acd800640 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413ea4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 -- 172.21.15.18:0/1468580047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 msgr2=0x558413ea4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413ea4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 -- 172.21.15.18:0/1468580047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 msgr2=0x558413ebff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413ebff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.953+0000 7f3acce00640 1 -- 172.21.15.18:0/1468580047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558413ec7350 con 0x558413eaad80 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3acce00640 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80042b0 tx=0x7f3ab8004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=902999a575a879c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3abd600640 1 -- 172.21.15.18:0/1468580047 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8033070 con 0x558413eaad80 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3abd600640 1 -- 172.21.15.18:0/1468580047 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab802edd0 con 0x558413eaad80 2024-04-21T22:38:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3abd600640 1 -- 172.21.15.18:0/1468580047 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab802e690 con 0x558413eaad80 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3ad25dd740 1 -- 172.21.15.18:0/1468580047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 msgr2=0x558413eb3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.954+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80042b0 tx=0x7f3ab8004c10 comp rx=0 tx=0).stop 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 -- 172.21.15.18:0/1468580047 shutdown_connections 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413ea4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eab6a0 0x558413ebff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/1468580047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eaad80 0x558413eb3a10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 -- 172.21.15.18:0/1468580047 >> 172.21.15.18:0/1468580047 conn(0x558413ea54b0 msgr2=0x558413ea3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 -- 172.21.15.18:0/1468580047 shutdown_connections 2024-04-21T22:38:39.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 -- 172.21.15.18:0/1468580047 wait complete. 2024-04-21T22:38:39.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 -- start start 2024-04-21T22:38:39.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.955+0000 7f3ad25dd740 1 Processor -- start 2024-04-21T22:38:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413ebc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81b0b80 con 0x558413eaad80 2024-04-21T22:38:39.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81b04b0 con 0x558413eb4280 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81ad6c0 con 0x558413eab6a0 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3ad25dd740 10 client.0 _ll_register_callbacks cb 0x7f3ab000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45586/0 (socket says 172.21.15.18:45586) 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 -- 172.21.15.18:0/153376289 learned_addr learned my addr 172.21.15.18:0/153376289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3abfe00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413ebc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acd800640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 -- 172.21.15.18:0/153376289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 msgr2=0x558413ebc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413ebc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 -- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 msgr2=0x558413eb7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.956+0000 7f3acce00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3acce00640 1 -- 172.21.15.18:0/153376289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558413eb8170 con 0x558413eaad80 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3acce00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8031040 tx=0x7f3ab8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ed42d17dc8dd0e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3ab6a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:39.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8033070 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3ab802e590 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab802edd0 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.957+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3ab8045050 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 10 client.16530 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558413f2aa20 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab802edd0 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f3ab8004da0 con 0x558413eaad80 2024-04-21T22:38:39.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 10 client.16530 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 10 client.16530 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 20 client.16530 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413f2af70 0x558413f2d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 4 client.16530 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558413e16c30 con 0x558413f2af70 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.958+0000 7f3abfe00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413f2af70 0x558413f2d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3abfe00640 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413f2af70 0x558413f2d390 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ea8fc1e55e1fe7 server_cookie=859a20e4fd6505c8 in_seq=0 out_seq=0 2024-04-21T22:38:39.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ab6a00640 10 client.16530 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ab6a00640 1 -- 172.21.15.18:0/153376289 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558413e16c30 con 0x558413f2af70 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ab6a00640 10 client.16530 handle_command_reply: tid=0 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 client.16530 shutdown 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 msgr2=0x558413ebc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8031040 tx=0x7f3ab8005fa0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 shutdown_connections 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x558413f2af70 0x558413f2d390 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558413eb4280 0x558413eb7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558413eab6a0 0x558413ebc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ab6a00640 0 client.16530 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 --2- 172.21.15.18:0/153376289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558413eaad80 0x558413ebc400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.959+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 >> 172.21.15.18:0/153376289 conn(0x558413ea54b0 msgr2=0x558413ea4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 shutdown_connections 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3ad25dd740 1 -- 172.21.15.18:0/153376289 wait complete. 2024-04-21T22:38:39.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3ad25dd740 20 client.16530 trim_cache size 0 max 16384 2024-04-21T22:38:39.968 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:39.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 msgr2=0x7f3aa80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 0x7f3aa80a51c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009a60 tx=0x7f3ac0005d80 comp rx=0 tx=0).stop 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 msgr2=0x7f3ac819a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000e9f0 tx=0x7f3ab000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 shutdown_connections 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3aa80a2d00 0x7f3aa80a51c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac819ec50 0x7f3ac819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac810bec0 0x7f3ac819a8d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 --2- 172.21.15.18:0/199057833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ac81029b0 0x7f3ac819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.960+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 >> 172.21.15.18:0/199057833 conn(0x7f3ac8077760 msgr2=0x7f3ac8107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.961+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 shutdown_connections 2024-04-21T22:38:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:39.961+0000 7f3acf800640 1 -- 172.21.15.18:0/199057833 wait complete. 2024-04-21T22:38:39.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:38:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 -- 172.21.15.18:0/4242031018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 msgr2=0x7ff628076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 --2- 172.21.15.18:0/4242031018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff628076050 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009930 tx=0x7ff61c02bc20 comp rx=0 tx=0).stop 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 -- 172.21.15.18:0/4242031018 shutdown_connections 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 --2- 172.21.15.18:0/4242031018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 0x7ff6281147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 --2- 172.21.15.18:0/4242031018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff628111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 --2- 172.21.15.18:0/4242031018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff628076050 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 -- 172.21.15.18:0/4242031018 >> 172.21.15.18:0/4242031018 conn(0x7ff6280ff210 msgr2=0x7ff628101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 -- 172.21.15.18:0/4242031018 shutdown_connections 2024-04-21T22:38:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.200+0000 7ff62e000640 1 -- 172.21.15.18:0/4242031018 wait complete. 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.201+0000 7ff62e000640 1 Processor -- start 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.201+0000 7ff62e000640 1 -- start start 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff62819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 0x7ff6281a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff628117f70 con 0x7ff628076590 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff628117df0 con 0x7ff6281123c0 2024-04-21T22:38:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281180f0 con 0x7ff628075c70 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff627e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff62819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60854/0 (socket says 172.21.15.18:60854) 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 -- 172.21.15.18:0/3973701240 learned_addr learned my addr 172.21.15.18:0/3973701240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62d600640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 0x7ff6281a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 -- 172.21.15.18:0/3973701240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 msgr2=0x7ff6281a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 0x7ff6281a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 -- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 msgr2=0x7ff62819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff62819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff62cc00640 1 -- 172.21.15.18:0/3973701240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6281a34a0 con 0x7ff628075c70 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.202+0000 7ff627e00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff62819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff62cc00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff61c005ab0 tx=0x7ff61c005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff625600640 1 -- 172.21.15.18:0/3973701240 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c043020 con 0x7ff628075c70 2024-04-21T22:38:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6281a3730 con 0x7ff628075c70 2024-04-21T22:38:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff625600640 1 -- 172.21.15.18:0/3973701240 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff61c005000 con 0x7ff628075c70 2024-04-21T22:38:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff625600640 1 -- 172.21.15.18:0/3973701240 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c003ab0 con 0x7ff628075c70 2024-04-21T22:38:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.203+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6281ab020 con 0x7ff628075c70 2024-04-21T22:38:40.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.206+0000 7ff63220d740 1 Processor -- start 2024-04-21T22:38:40.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 -- start start 2024-04-21T22:38:40.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff625600640 1 -- 172.21.15.18:0/3973701240 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff61c046020 con 0x7ff628075c70 2024-04-21T22:38:40.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960624f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x562960627860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5629605803a0 con 0x56296061c890 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562960528930 con 0x56296061bf70 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff63220d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56296057c360 con 0x562960625470 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff62cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960624f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff62d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff62d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43906/0 (socket says 172.21.15.18:43906) 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff627e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x562960627860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff62d600640 1 -- 172.21.15.18:0/3033499396 learned_addr learned my addr 172.21.15.18:0/3033499396 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.207+0000 7ff62cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960624f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45606/0 (socket says 172.21.15.18:45606) 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 -- 172.21.15.18:0/3033499396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 msgr2=0x562960627860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x562960627860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 -- 172.21.15.18:0/3033499396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 msgr2=0x562960624f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960624f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 -- 172.21.15.18:0/3033499396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629602943f0 con 0x56296061bf70 2024-04-21T22:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff62d600640 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff620009f30 tx=0x7ff6200118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f470118581602df5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.208+0000 7ff619c00640 1 -- 172.21.15.18:0/3033499396 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620004d20 con 0x56296061bf70 2024-04-21T22:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff619c00640 1 -- 172.21.15.18:0/3033499396 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff620004050 con 0x56296061bf70 2024-04-21T22:38:40.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff619c00640 1 -- 172.21.15.18:0/3033499396 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620005240 con 0x56296061bf70 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff625600640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 0x7ff6100a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff625600640 1 -- 172.21.15.18:0/3973701240 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff61c0f1260 con 0x7ff628075c70 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff62cc00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 0x7ff6100a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 -- 172.21.15.18:0/3033499396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 msgr2=0x56296061c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff620009f30 tx=0x7ff6200118d0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 -- 172.21.15.18:0/3033499396 shutdown_connections 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x562960627860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960624f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 --2- 172.21.15.18:0/3033499396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x56296061c350 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 -- 172.21.15.18:0/3033499396 >> 172.21.15.18:0/3033499396 conn(0x5629606166a0 msgr2=0x562960616a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 -- 172.21.15.18:0/3033499396 shutdown_connections 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.209+0000 7ff63220d740 1 -- 172.21.15.18:0/3033499396 wait complete. 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.210+0000 7ff62cc00640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 0x7ff6100a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0eeb70 tx=0x7ff61c0f4db0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.210+0000 7ff63220d740 1 -- start start 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.210+0000 7ff63220d740 1 Processor -- start 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 0x5629606223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 0x562960622e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562960628260 con 0x56296061bf70 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x56296053bd80 con 0x562960625470 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629606283e0 con 0x56296061c890 2024-04-21T22:38:40.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff63220d740 10 client.0 _ll_register_callbacks cb 0x5629605782b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff62d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 0x5629606223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60870/0 (socket says 172.21.15.18:60870) 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 -- 172.21.15.18:0/3061785176 learned_addr learned my addr 172.21.15.18:0/3061785176 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff62d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 0x5629606223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45622/0 (socket says 172.21.15.18:45622) 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff62d600640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 0x562960622e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 -- 172.21.15.18:0/3061785176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 msgr2=0x562960622e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 0x562960622e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 -- 172.21.15.18:0/3061785176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 msgr2=0x5629606223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 0x5629606223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff627e00640 1 -- 172.21.15.18:0/3061785176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296035e7d0 con 0x56296061c890 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.211+0000 7ff62d600640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 0x562960622e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff627e00640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff614012d00 tx=0x7ff61400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6650e78efa0e242 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff60e000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:40.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614009d90 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff614012110 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff620004050 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.212+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff614004050 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 10 client.26665 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562960634490 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff620004050 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7ff614010430 con 0x56296061c890 2024-04-21T22:38:40.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 10 client.26665 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 10 client.26665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 20 client.26665 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562960635950 0x562960637d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 4 client.26665 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.213+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56296058d8e0 con 0x562960635950 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.214+0000 7ff62d600640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562960635950 0x562960637d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.214+0000 7ff62d600640 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562960635950 0x562960637d60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4116fa4692b7b53e server_cookie=b498e881f3308204 in_seq=0 out_seq=0 2024-04-21T22:38:40.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.214+0000 7ff60e000640 10 client.26665 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff60e000640 1 -- 172.21.15.18:0/3061785176 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56296058d8e0 con 0x562960635950 2024-04-21T22:38:40.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff60e000640 10 client.26665 handle_command_reply: tid=0 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff63220d740 1 client.26665 shutdown 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 msgr2=0x562960622920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff614012d00 tx=0x7ff61400f790 comp rx=0 tx=0).stop 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 shutdown_connections 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.215+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562960635950 0x562960637d60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562960625470 0x562960622e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061c890 0x562960622920 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 --2- 172.21.15.18:0/3061785176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061bf70 0x5629606223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff60e000640 0 client.26665 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 >> 172.21.15.18:0/3061785176 conn(0x5629606166a0 msgr2=0x5629606183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 shutdown_connections 2024-04-21T22:38:40.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 1 -- 172.21.15.18:0/3061785176 wait complete. 2024-04-21T22:38:40.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.216+0000 7ff63220d740 20 client.26665 trim_cache size 0 max 16384 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 Processor -- start 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 -- start start 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x562960624b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x56296063d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b38f0 con 0x56296061c890 2024-04-21T22:38:40.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b5460 con 0x56296061bf70 2024-04-21T22:38:40.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.231+0000 7ff63220d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b3ff0 con 0x562960625470 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45634/0 (socket says 172.21.15.18:45634) 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 -- 172.21.15.18:0/3967268370 learned_addr learned my addr 172.21.15.18:0/3967268370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff62d600640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x562960624b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff62d600640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x56296063d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 -- 172.21.15.18:0/3967268370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 msgr2=0x56296063d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x56296063d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 -- 172.21.15.18:0/3967268370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 msgr2=0x562960624b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x562960624b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 -- 172.21.15.18:0/3967268370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296061d2e0 con 0x56296061c890 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff62d600640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x562960624b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.232+0000 7ff627e00640 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff614012cd0 tx=0x7ff614009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56a09c433aa2e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff619200640 1 -- 172.21.15.18:0/3967268370 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614032070 con 0x56296061c890 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff619200640 1 -- 172.21.15.18:0/3967268370 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff614012110 con 0x56296061c890 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff619200640 1 -- 172.21.15.18:0/3967268370 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614029070 con 0x56296061c890 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 -- 172.21.15.18:0/3967268370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 msgr2=0x562960631120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff614012cd0 tx=0x7ff614009fd0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 -- 172.21.15.18:0/3967268370 shutdown_connections 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562960625470 0x56296063d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56296061c890 0x562960631120 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 --2- 172.21.15.18:0/3967268370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061bf70 0x562960624b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 -- 172.21.15.18:0/3967268370 >> 172.21.15.18:0/3967268370 conn(0x5629606166a0 msgr2=0x562960620cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.233+0000 7ff63220d740 1 -- 172.21.15.18:0/3967268370 shutdown_connections 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 -- 172.21.15.18:0/3967268370 wait complete. 2024-04-21T22:38:40.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 -- start start 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 Processor -- start 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 0x56296062da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 0x56296061ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.234+0000 7ff63220d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 0x56296061f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff63220d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b4d90 con 0x562960625470 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff63220d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b46c0 con 0x56296061c890 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff63220d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281b18d0 con 0x56296061bf70 2024-04-21T22:38:40.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff63220d740 10 client.0 _ll_register_callbacks cb 0x7ff614009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff62d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 0x56296061f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff62d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 0x56296061f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45642/0 (socket says 172.21.15.18:45642) 2024-04-21T22:38:40.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 0x56296061ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff62d600640 1 -- 172.21.15.18:0/1414712918 learned_addr learned my addr 172.21.15.18:0/1414712918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff62d600640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 0x56296062da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 -- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 msgr2=0x56296062da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 0x56296062da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 -- 172.21.15.18:0/1414712918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 msgr2=0x56296061f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 0x56296061f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff627e00640 1 -- 172.21.15.18:0/1414712918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296061fbd0 con 0x56296061c890 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.235+0000 7ff62d600640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 0x56296062da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:40.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff627e00640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 0x56296061ee10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff614010820 tx=0x7ff614005520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdda31d90897854e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff60e000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614029070 con 0x56296061c890 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff614012110 con 0x56296061c890 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff614003800 con 0x56296061c890 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff614032070 con 0x56296061c890 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff63220d740 10 client.26621 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56296069bf30 con 0x56296061c890 2024-04-21T22:38:40.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.236+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff614012110 con 0x56296061c890 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7ff61402d780 con 0x56296061c890 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 10 client.26621 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 10 client.26621 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 20 client.26621 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x56296069c670 0x56296069ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 4 client.26621 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562960587c30 con 0x56296069c670 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.237+0000 7ff62d600640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x56296069c670 0x56296069ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff62d600640 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x56296069c670 0x56296069ea90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=508c8b7f3407401 server_cookie=1216f676fac2779b in_seq=0 out_seq=0 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff60e000640 10 client.26621 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff60e000640 1 -- 172.21.15.18:0/1414712918 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562960587c30 con 0x56296069c670 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff60e000640 10 client.26621 handle_command_reply: tid=0 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 client.26621 shutdown 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 msgr2=0x56296061ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 0x56296061ee10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff614010820 tx=0x7ff614005520 comp rx=0 tx=0).stop 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 shutdown_connections 2024-04-21T22:38:40.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x56296069c670 0x56296069ea90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562960625470 0x56296061f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56296061c890 0x56296061ee10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 --2- 172.21.15.18:0/1414712918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56296061bf70 0x56296062da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff60e000640 0 client.26621 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 >> 172.21.15.18:0/1414712918 conn(0x5629606166a0 msgr2=0x5629606223a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 shutdown_connections 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 1 -- 172.21.15.18:0/1414712918 wait complete. 2024-04-21T22:38:40.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.238+0000 7ff63220d740 20 client.26621 trim_cache size 0 max 16384 2024-04-21T22:38:40.247 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:40.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 msgr2=0x7ff6100a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 0x7ff6100a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0eeb70 tx=0x7ff61c0f4db0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 msgr2=0x7ff62819e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff61c005ab0 tx=0x7ff61c005e80 comp rx=0 tx=0).stop 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 shutdown_connections 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff6100a2d00 0x7ff6100a51c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6281123c0 0x7ff6281a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff628076590 0x7ff62819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 --2- 172.21.15.18:0/3973701240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff628075c70 0x7ff62819e4b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 >> 172.21.15.18:0/3973701240 conn(0x7ff6280ff210 msgr2=0x7ff628113ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 shutdown_connections 2024-04-21T22:38:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.239+0000 7ff62e000640 1 -- 172.21.15.18:0/3973701240 wait complete. 2024-04-21T22:38:40.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:38:40.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 -- 172.21.15.18:0/2459147230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 msgr2=0x7f77941101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 --2- 172.21.15.18:0/2459147230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f77941101c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f778c009ca0 tx=0x7f778c02c190 comp rx=0 tx=0).stop 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 -- 172.21.15.18:0/2459147230 shutdown_connections 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 --2- 172.21.15.18:0/2459147230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f77941101c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 --2- 172.21.15.18:0/2459147230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 --2- 172.21.15.18:0/2459147230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f7794073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 -- 172.21.15.18:0/2459147230 >> 172.21.15.18:0/2459147230 conn(0x7f77940fd020 msgr2=0x7f77940ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 -- 172.21.15.18:0/2459147230 shutdown_connections 2024-04-21T22:38:40.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.477+0000 7f7793e00640 1 -- 172.21.15.18:0/2459147230 wait complete. 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.478+0000 7f7793e00640 1 Processor -- start 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 -- start start 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f779419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113b10 con 0x7f7794073b10 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113990 con 0x7f7794074430 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7793e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113c90 con 0x7f779410ddb0 2024-04-21T22:38:40.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.479+0000 7f7792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45660/0 (socket says 172.21.15.18:45660) 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792a00640 1 -- 172.21.15.18:0/1058967697 learned_addr learned my addr 172.21.15.18:0/1058967697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7793400640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f779419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 -- 172.21.15.18:0/1058967697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 msgr2=0x7f779419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f779419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 -- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 msgr2=0x7f779419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 -- 172.21.15.18:0/1058967697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779419f050 con 0x7f7794074430 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792a00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.480+0000 7f7792000640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779419a5f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9f0 tx=0x7f778000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.481+0000 7f7798a00640 1 -- 172.21.15.18:0/1058967697 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778000ccc0 con 0x7f7794074430 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.481+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779419f340 con 0x7f7794074430 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.481+0000 7f7798a00640 1 -- 172.21.15.18:0/1058967697 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7780010910 con 0x7f7794074430 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.481+0000 7f7798a00640 1 -- 172.21.15.18:0/1058967697 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780018880 con 0x7f7794074430 2024-04-21T22:38:40.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.481+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941a6bd0 con 0x7f7794074430 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 Processor -- start 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 -- start start 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f7798a00640 1 -- 172.21.15.18:0/1058967697 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7780010ac0 con 0x7f7794074430 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcae7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaeff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcaf2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8dca4b3a0 con 0x55a8dcae7890 2024-04-21T22:38:40.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8dc9f3930 con 0x55a8dcae6f70 2024-04-21T22:38:40.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.485+0000 7f779ca0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8dca47360 con 0x55a8dcaf0470 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcaf2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7793400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcae7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaeff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7793400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcae7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43970/0 (socket says 172.21.15.18:43970) 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7793400640 1 -- 172.21.15.18:0/4241668094 learned_addr learned my addr 172.21.15.18:0/4241668094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 -- 172.21.15.18:0/4241668094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 msgr2=0x55a8dcae7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcae7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 -- 172.21.15.18:0/4241668094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 msgr2=0x55a8dcaeff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaeff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 -- 172.21.15.18:0/4241668094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dc75f3f0 con 0x55a8dcaf0470 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792a00640 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaeff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.486+0000 7f7792000640 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcaf2860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f77800cce20 tx=0x7f77800d7690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5d806481bb4abe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f777fe00640 1 -- 172.21.15.18:0/4241668094 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77800de070 con 0x55a8dcaf0470 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f777fe00640 1 -- 172.21.15.18:0/4241668094 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77800cfd80 con 0x55a8dcaf0470 2024-04-21T22:38:40.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f777fe00640 1 -- 172.21.15.18:0/4241668094 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77800da720 con 0x55a8dcaf0470 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f7798a00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 0x7f77780a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f7798a00640 1 -- 172.21.15.18:0/1058967697 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77800cf6d0 con 0x7f7794074430 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f7793400640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 0x7f77780a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f779ca0a740 1 -- 172.21.15.18:0/4241668094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 msgr2=0x55a8dcaf2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.487+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcaf2860 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f77800cce20 tx=0x7f77800d7690 comp rx=0 tx=0).stop 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 -- 172.21.15.18:0/4241668094 shutdown_connections 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcaf2860 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaeff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4241668094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcae7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 -- 172.21.15.18:0/4241668094 >> 172.21.15.18:0/4241668094 conn(0x55a8dcae16a0 msgr2=0x55a8dcae1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 -- 172.21.15.18:0/4241668094 shutdown_connections 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 -- 172.21.15.18:0/4241668094 wait complete. 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f7793400640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 0x7f77780a5240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f778c009a60 tx=0x7f778c005c50 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.488+0000 7f779ca0a740 1 -- start start 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 Processor -- start 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 0x55a8dcaed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaedab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcaf0470 0x55a8dcaedff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8dcaf3260 con 0x55a8dcae7890 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a8dca06d80 con 0x55a8dcaf0470 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a8dcaf33e0 con 0x55a8dcae6f70 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f779ca0a740 10 client.0 _ll_register_callbacks cb 0x55a8dca432b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f7792a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 0x55a8dcaed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f7792000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaedab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f7792a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 0x55a8dcaed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60954/0 (socket says 172.21.15.18:60954) 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.489+0000 7f7792a00640 1 -- 172.21.15.18:0/1597724877 learned_addr learned my addr 172.21.15.18:0/1597724877 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7793400640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcaf0470 0x55a8dcaedff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 -- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 msgr2=0x55a8dcaed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 0x55a8dcaed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 -- 172.21.15.18:0/1597724877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcaf0470 msgr2=0x55a8dcaedff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcaf0470 0x55a8dcaedff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 -- 172.21.15.18:0/1597724877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dc8297d0 con 0x55a8dcae7890 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f7792000640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaedab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f778009b9a0 tx=0x7f7780009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c360370cb8b039 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f777cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.490+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77800de070 con 0x55a8dcae7890 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77800cfd80 con 0x55a8dcae7890 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7780099fa0 con 0x55a8dcae7890 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f77800b2070 con 0x55a8dcae7890 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f779ca0a740 10 client.16560 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a8dcaff5e0 con 0x55a8dcae7890 2024-04-21T22:38:40.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77800cfd80 con 0x55a8dcae7890 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f7780098310 con 0x55a8dcae7890 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.491+0000 7f779ca0a740 10 client.16560 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f779ca0a740 10 client.16560 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f779ca0a740 20 client.16560 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb00930 0x55a8dcb02d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f779ca0a740 4 client.16560 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8dca588e0 con 0x55a8dcb00930 2024-04-21T22:38:40.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.492+0000 7f7792a00640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb00930 0x55a8dcb02d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.493+0000 7f7792a00640 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb00930 0x55a8dcb02d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35a237fa838a1839 server_cookie=eb892be3471f9c5a in_seq=0 out_seq=0 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.493+0000 7f777cc00640 10 client.16560 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f777cc00640 1 -- 172.21.15.18:0/1597724877 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8dca588e0 con 0x55a8dcb00930 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f777cc00640 10 client.16560 handle_command_reply: tid=0 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 client.16560 shutdown 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 msgr2=0x55a8dcaedab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaedab0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f778009b9a0 tx=0x7f7780009700 comp rx=0 tx=0).stop 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 shutdown_connections 2024-04-21T22:38:40.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb00930 0x55a8dcb02d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcaf0470 0x55a8dcaedff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae7890 0x55a8dcaedab0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 --2- 172.21.15.18:0/1597724877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae6f70 0x55a8dcaed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f777cc00640 0 client.16560 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 >> 172.21.15.18:0/1597724877 conn(0x55a8dcae16a0 msgr2=0x55a8dcae33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 shutdown_connections 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 1 -- 172.21.15.18:0/1597724877 wait complete. 2024-04-21T22:38:40.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.494+0000 7f779ca0a740 20 client.16560 trim_cache size 0 max 16384 2024-04-21T22:38:40.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.509+0000 7f779ca0a740 1 Processor -- start 2024-04-21T22:38:40.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 -- start start 2024-04-21T22:38:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcaefca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 0x55a8dcb05d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77941af5b0 con 0x55a8dcaf0470 2024-04-21T22:38:40.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77941b1120 con 0x55a8dcae6f70 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f779ca0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77941afcb0 con 0x55a8dcae7890 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f7793400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 0x55a8dcb05d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f7792000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f7792a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcaefca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f7792000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60958/0 (socket says 172.21.15.18:60958) 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.510+0000 7f7792000640 1 -- 172.21.15.18:0/4098583386 learned_addr learned my addr 172.21.15.18:0/4098583386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 -- 172.21.15.18:0/4098583386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 msgr2=0x55a8dcaefca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcaefca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 -- 172.21.15.18:0/4098583386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 msgr2=0x55a8dcb05d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 0x55a8dcb05d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 -- 172.21.15.18:0/4098583386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8dcaf3140 con 0x55a8dcae7890 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7793400640 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 0x55a8dcb05d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f7792000640 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9c0 tx=0x7f7780000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b234074e22de4e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f777f400640 1 -- 172.21.15.18:0/4098583386 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77800de070 con 0x55a8dcae7890 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f777f400640 1 -- 172.21.15.18:0/4098583386 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77800d7e90 con 0x55a8dcae7890 2024-04-21T22:38:40.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.511+0000 7f777f400640 1 -- 172.21.15.18:0/4098583386 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780005450 con 0x55a8dcae7890 2024-04-21T22:38:40.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 -- 172.21.15.18:0/4098583386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 msgr2=0x55a8dcaede10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9c0 tx=0x7f7780000bc0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 -- 172.21.15.18:0/4098583386 shutdown_connections 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcaf0470 0x55a8dcb05d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcae7890 0x55a8dcaede10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 --2- 172.21.15.18:0/4098583386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae6f70 0x55a8dcaefca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 -- 172.21.15.18:0/4098583386 >> 172.21.15.18:0/4098583386 conn(0x55a8dcae16a0 msgr2=0x55a8dcae3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 -- 172.21.15.18:0/4098583386 shutdown_connections 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.512+0000 7f779ca0a740 1 -- 172.21.15.18:0/4098583386 wait complete. 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 -- start start 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 Processor -- start 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae6f70 0x55a8dcb06270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcb03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77941b0a50 con 0x55a8dcae6f70 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77941b0380 con 0x55a8dcae7890 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ad590 con 0x55a8dcaf0470 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.513+0000 7f779ca0a740 10 client.0 _ll_register_callbacks cb 0x7f7784009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:43990/0 (socket says 172.21.15.18:43990) 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 -- 172.21.15.18:0/3982457691 learned_addr learned my addr 172.21.15.18:0/3982457691 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792a00640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae6f70 0x55a8dcb06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7793400640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcb03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 -- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 msgr2=0x55a8dcb03d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcb03d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 -- 172.21.15.18:0/3982457691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae6f70 msgr2=0x55a8dcb06270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae6f70 0x55a8dcb06270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.514+0000 7f7792000640 1 -- 172.21.15.18:0/3982457691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8dcb65b10 con 0x55a8dcae7890 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f7792000640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7780098100 tx=0x7f77800d7690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932e4a7abb80db12 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f777cc00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:40.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77800b8030 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7780099fa0 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77800d7e90 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f77800de070 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f779ca0a740 10 client.26639 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.515+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a8dcb65b10 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77800d7e90 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f77800a43d0 con 0x55a8dcae7890 2024-04-21T22:38:40.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 10 client.26639 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 10 client.26639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 20 client.26639 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb66f80 0x55a8dcb693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 4 client.26639 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8dca52c30 con 0x55a8dcb66f80 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.516+0000 7f7792a00640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb66f80 0x55a8dcb693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f7792a00640 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb66f80 0x55a8dcb693a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96e536aee93fc1e9 server_cookie=d5f2cb2a1628a416 in_seq=0 out_seq=0 2024-04-21T22:38:40.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f777cc00640 10 client.26639 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f777cc00640 1 -- 172.21.15.18:0/3982457691 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8dca52c30 con 0x55a8dcb66f80 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f777cc00640 10 client.26639 handle_command_reply: tid=0 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 client.26639 shutdown 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 msgr2=0x55a8dcb03600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7780098100 tx=0x7f77800d7690 comp rx=0 tx=0).stop 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 shutdown_connections 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55a8dcb66f80 0x55a8dcb693a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a8dcaf0470 0x55a8dcb03d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a8dcae7890 0x55a8dcb03600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 --2- 172.21.15.18:0/3982457691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8dcae6f70 0x55a8dcb06270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f777cc00640 0 client.26639 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 >> 172.21.15.18:0/3982457691 conn(0x55a8dcae16a0 msgr2=0x55a8dcadfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 shutdown_connections 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.517+0000 7f779ca0a740 1 -- 172.21.15.18:0/3982457691 wait complete. 2024-04-21T22:38:40.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f779ca0a740 20 client.26639 trim_cache size 0 max 16384 2024-04-21T22:38:40.526 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 msgr2=0x7f77780a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 0x7f77780a5240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f778c009a60 tx=0x7f778c005c50 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 msgr2=0x7f779419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779419a5f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f778000e9f0 tx=0x7f778000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 shutdown_connections 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f77780a2d80 0x7f77780a5240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779410ddb0 0x7f779419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7794074430 0x7f779419a5f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 --2- 172.21.15.18:0/1058967697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794073b10 0x7f779419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 >> 172.21.15.18:0/1058967697 conn(0x7f77940fd020 msgr2=0x7f77940fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.518+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 shutdown_connections 2024-04-21T22:38:40.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.519+0000 7f7793e00640 1 -- 172.21.15.18:0/1058967697 wait complete. 2024-04-21T22:38:40.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:38:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.741+0000 7f2a53e00640 1 -- 172.21.15.18:0/4097064311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 msgr2=0x7f2a54109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 --2- 172.21.15.18:0/4097064311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a54109b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a4402bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 -- 172.21.15.18:0/4097064311 shutdown_connections 2024-04-21T22:38:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 --2- 172.21.15.18:0/4097064311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54104120 0x7f2a54110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 --2- 172.21.15.18:0/4097064311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54103760 0x7f2a54103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 --2- 172.21.15.18:0/4097064311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a54109b50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 -- 172.21.15.18:0/4097064311 >> 172.21.15.18:0/4097064311 conn(0x7f2a540ff230 msgr2=0x7f2a54101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 -- 172.21.15.18:0/4097064311 shutdown_connections 2024-04-21T22:38:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.742+0000 7f2a53e00640 1 -- 172.21.15.18:0/4097064311 wait complete. 2024-04-21T22:38:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.743+0000 7f2a53e00640 1 Processor -- start 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.743+0000 7f2a53e00640 1 -- start start 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.743+0000 7f2a53e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a5419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54113b80 con 0x7f2a54104120 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54113a00 con 0x7f2a54109770 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54113d00 con 0x7f2a54103760 2024-04-21T22:38:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45716/0 (socket says 172.21.15.18:45716) 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 -- 172.21.15.18:0/1502514745 learned_addr learned my addr 172.21.15.18:0/1502514745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60986/0 (socket says 172.21.15.18:60986) 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53400640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a5419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 -- 172.21.15.18:0/1502514745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 msgr2=0x7f2a5419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 -- 172.21.15.18:0/1502514745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 msgr2=0x7f2a5419e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a5419e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52000640 1 -- 172.21.15.18:0/1502514745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5419f060 con 0x7f2a54104120 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a53400640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a5419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.744+0000 7f2a52a00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a52000640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000e9f0 tx=0x7f2a4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a4b400640 1 -- 172.21.15.18:0/1502514745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000cd80 con 0x7f2a54104120 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5419f350 con 0x7f2a54104120 2024-04-21T22:38:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a4b400640 1 -- 172.21.15.18:0/1502514745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a40010910 con 0x7f2a54104120 2024-04-21T22:38:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a4b400640 1 -- 172.21.15.18:0/1502514745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400188f0 con 0x7f2a54104120 2024-04-21T22:38:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.745+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a541a6be0 con 0x7f2a54104120 2024-04-21T22:38:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.748+0000 7f2a5c576740 1 Processor -- start 2024-04-21T22:38:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 -- start start 2024-04-21T22:38:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c0903ef860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c0903483a0 con 0x55c0903e4890 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c0902f0930 con 0x55c0903ed470 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a5c576740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c090344360 con 0x55c0903e3f70 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45728/0 (socket says 172.21.15.18:45728) 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.749+0000 7f2a52a00640 1 -- 172.21.15.18:0/2555131660 learned_addr learned my addr 172.21.15.18:0/2555131660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a53400640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a4b400640 1 -- 172.21.15.18:0/1502514745 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2a40010ac0 con 0x7f2a54104120 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52a00640 1 -- 172.21.15.18:0/2555131660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 msgr2=0x55c0903e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52a00640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52a00640 1 -- 172.21.15.18:0/2555131660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 msgr2=0x55c0903ef860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52000640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c0903ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52a00640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c0903ef860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52a00640 1 -- 172.21.15.18:0/2555131660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09005c3f0 con 0x55c0903e4890 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.750+0000 7f2a52000640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c0903ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.751+0000 7f2a52a00640 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a44005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92461427a4946b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.751+0000 7f2a3fe00640 1 -- 172.21.15.18:0/2555131660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44042070 con 0x55c0903e4890 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.751+0000 7f2a3fe00640 1 -- 172.21.15.18:0/2555131660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a44004a70 con 0x55c0903e4890 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.751+0000 7f2a3fe00640 1 -- 172.21.15.18:0/2555131660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44005220 con 0x55c0903e4890 2024-04-21T22:38:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.751+0000 7f2a4b400640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 -- 172.21.15.18:0/2555131660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 msgr2=0x55c0903ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009900 tx=0x7f2a44005e80 comp rx=0 tx=0).stop 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a4b400640 1 -- 172.21.15.18:0/1502514745 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a400cf910 con 0x7f2a54104120 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a53400640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 -- 172.21.15.18:0/2555131660 shutdown_connections 2024-04-21T22:38:40.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c0903ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903ecf30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 --2- 172.21.15.18:0/2555131660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 -- 172.21.15.18:0/2555131660 >> 172.21.15.18:0/2555131660 conn(0x55c0903de6a0 msgr2=0x55c0903dea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 -- 172.21.15.18:0/2555131660 shutdown_connections 2024-04-21T22:38:40.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.752+0000 7f2a5c576740 1 -- 172.21.15.18:0/2555131660 wait complete. 2024-04-21T22:38:40.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 -- start start 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a53400640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 0x7f2a380a51c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005fd0 tx=0x7f2a4c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 Processor -- start 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e4890 0x55c0903eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.753+0000 7f2a5c576740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c0903f0200 con 0x55c0903e3f70 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a5c576740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c090303d80 con 0x55c0903e4890 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a5c576740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c0903f0380 con 0x55c0903ed470 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a5c576740 10 client.0 _ll_register_callbacks cb 0x55c0903402b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45744/0 (socket says 172.21.15.18:45744) 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 -- 172.21.15.18:0/1441816576 learned_addr learned my addr 172.21.15.18:0/1441816576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a53400640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52000640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e4890 0x55c0903eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 -- 172.21.15.18:0/1441816576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 msgr2=0x55c0903eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 -- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e4890 msgr2=0x55c0903eaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e4890 0x55c0903eaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 -- 172.21.15.18:0/1441816576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0901267d0 con 0x55c0903e3f70 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.754+0000 7f2a52a00640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a4402cd50 tx=0x7f2a4402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a9525fa61b05d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4404b020 con 0x55c0903e3f70 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a44004440 con 0x55c0903e3f70 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a44004a70 con 0x55c0903e3f70 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2a44056050 con 0x55c0903e3f70 2024-04-21T22:38:40.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a5c576740 10 client.16578 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c0903fc430 con 0x55c0903e3f70 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.755+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a44004a70 con 0x55c0903e3f70 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f2a44047460 con 0x55c0903e3f70 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 10 client.16578 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 10 client.16578 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 20 client.16578 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0903fd780 0x55c0903ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 4 client.16578 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0903558e0 con 0x55c0903fd780 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.756+0000 7f2a52000640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0903fd780 0x55c0903ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.757+0000 7f2a52000640 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0903fd780 0x55c0903ffb70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a5aafb9263e125 server_cookie=6a3e29a305482757 in_seq=0 out_seq=0 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.757+0000 7f2a3cc00640 10 client.16578 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:40.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a3cc00640 1 -- 172.21.15.18:0/1441816576 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c0903558e0 con 0x55c0903fd780 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a3cc00640 10 client.16578 handle_command_reply: tid=0 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 client.16578 shutdown 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 msgr2=0x55c0903ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a4402cd50 tx=0x7f2a4402c650 comp rx=0 tx=0).stop 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 shutdown_connections 2024-04-21T22:38:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0903fd780 0x55c0903ffb70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e4890 0x55c0903eaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 --2- 172.21.15.18:0/1441816576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e3f70 0x55c0903ea4c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a3cc00640 0 client.16578 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 >> 172.21.15.18:0/1441816576 conn(0x55c0903de6a0 msgr2=0x55c0903e03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 shutdown_connections 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 1 -- 172.21.15.18:0/1441816576 wait complete. 2024-04-21T22:38:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.758+0000 7f2a5c576740 20 client.16578 trim_cache size 0 max 16384 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 Processor -- start 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 -- start start 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c090405650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541af470 con 0x55c0903e4890 2024-04-21T22:38:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541b0fe0 con 0x55c0903ed470 2024-04-21T22:38:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a5c576740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541afb70 con 0x55c0903e3f70 2024-04-21T22:38:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a53400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c090405650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45752/0 (socket says 172.21.15.18:45752) 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.774+0000 7f2a52000640 1 -- 172.21.15.18:0/4125289630 learned_addr learned my addr 172.21.15.18:0/4125289630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52a00640 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 -- 172.21.15.18:0/4125289630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 msgr2=0x55c0903f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 -- 172.21.15.18:0/4125289630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 msgr2=0x55c090405650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c090405650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 -- 172.21.15.18:0/4125289630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0903ffee0 con 0x55c0903e4890 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a52000640 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c6a0 tx=0x7f2a400d1dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f87a61fe7640d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a3f400640 1 -- 172.21.15.18:0/4125289630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40098440 con 0x55c0903e4890 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a3f400640 1 -- 172.21.15.18:0/4125289630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4009f070 con 0x55c0903e4890 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.775+0000 7f2a3f400640 1 -- 172.21.15.18:0/4125289630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40097b20 con 0x55c0903e4890 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 -- 172.21.15.18:0/4125289630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 msgr2=0x55c090405110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c6a0 tx=0x7f2a400d1dd0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 -- 172.21.15.18:0/4125289630 shutdown_connections 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903ed470 0x55c090405650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c090405110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 --2- 172.21.15.18:0/4125289630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903e3f70 0x55c0903f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 -- 172.21.15.18:0/4125289630 >> 172.21.15.18:0/4125289630 conn(0x55c0903de6a0 msgr2=0x55c0903dd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 -- 172.21.15.18:0/4125289630 shutdown_connections 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.776+0000 7f2a5c576740 1 -- 172.21.15.18:0/4125289630 wait complete. 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 -- start start 2024-04-21T22:38:40.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 Processor -- start 2024-04-21T22:38:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e3f70 0x55c0903f3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541b0910 con 0x55c0903e4890 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541b0240 con 0x55c0903e3f70 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541ad450 con 0x55c0903ed470 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.777+0000 7f2a5c576740 10 client.0 _ll_register_callbacks cb 0x7f2a4c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a52000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45756/0 (socket says 172.21.15.18:45756) 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a52000640 1 -- 172.21.15.18:0/3346044 learned_addr learned my addr 172.21.15.18:0/3346044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a52a00640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e3f70 0x55c0903f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 -- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e3f70 msgr2=0x55c0903f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e3f70 0x55c0903f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 -- 172.21.15.18:0/3346044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 msgr2=0x55c0903f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a53400640 1 -- 172.21.15.18:0/3346044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c090462990 con 0x55c0903ed470 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.778+0000 7f2a52000640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a53400640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903f3a80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009de0 tx=0x7f2a4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813f9a82e875c157 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c01e630 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a4009f070 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a4c01e7d0 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2a4c037050 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a5c576740 10 client.26707 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.779+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55c090463d20 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4009f070 con 0x55c0903ed470 2024-04-21T22:38:40.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f2a4c01dba0 con 0x55c0903ed470 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 10 client.26707 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 10 client.26707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 20 client.26707 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0904644d0 0x55c0904668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 4 client.26707 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c09034fc30 con 0x55c0904644d0 2024-04-21T22:38:40.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.780+0000 7f2a52a00640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0904644d0 0x55c0904668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a52a00640 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0904644d0 0x55c0904668f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3f2426e3c3272c server_cookie=784212da12c0c49d in_seq=0 out_seq=0 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a3cc00640 10 client.26707 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a3cc00640 1 -- 172.21.15.18:0/3346044 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c09034fc30 con 0x55c0904644d0 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a3cc00640 10 client.26707 handle_command_reply: tid=0 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 client.26707 shutdown 2024-04-21T22:38:40.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 msgr2=0x55c0903f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903f3a80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009de0 tx=0x7f2a4c004a40 comp rx=0 tx=0).stop 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 shutdown_connections 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c0904644d0 0x55c0904668f0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0903ed470 0x55c0903f3a80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c0903e4890 0x55c0903f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 --2- 172.21.15.18:0/3346044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c0903e3f70 0x55c0903f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a3cc00640 0 client.26707 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 >> 172.21.15.18:0/3346044 conn(0x55c0903de6a0 msgr2=0x55c0903df6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 shutdown_connections 2024-04-21T22:38:40.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.781+0000 7f2a5c576740 1 -- 172.21.15.18:0/3346044 wait complete. 2024-04-21T22:38:40.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a5c576740 20 client.26707 trim_cache size 0 max 16384 2024-04-21T22:38:40.789 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:38:40.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 msgr2=0x7f2a380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 0x7f2a380a51c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005fd0 tx=0x7f2a4c009500 comp rx=0 tx=0).stop 2024-04-21T22:38:40.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 msgr2=0x7f2a5419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:40.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000e9f0 tx=0x7f2a4000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 shutdown_connections 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a54109770 0x7f2a5419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a54104120 0x7f2a5419a600 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 --2- 172.21.15.18:0/1502514745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a54103760 0x7f2a5419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.782+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 >> 172.21.15.18:0/1502514745 conn(0x7f2a540ff230 msgr2=0x7f2a540ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.783+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 shutdown_connections 2024-04-21T22:38:40.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:40.783+0000 7f2a53e00640 1 -- 172.21.15.18:0/1502514745 wait complete. 2024-04-21T22:38:41.802 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:38:41.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:38:41.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:38:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:41 smithi018 ceph-mon[26614]: pgmap v142: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:41 smithi081 ceph-mon[31692]: pgmap v142: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:41.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:41 smithi047 ceph-mon[31561]: pgmap v142: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:42.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 -- 172.21.15.18:0/2726684724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 msgr2=0x7f7ee4107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 --2- 172.21.15.18:0/2726684724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee4107990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009930 tx=0x7f7ed802bc30 comp rx=0 tx=0).stop 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 -- 172.21.15.18:0/2726684724 shutdown_connections 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 --2- 172.21.15.18:0/2726684724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 0x7f7ee410e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 --2- 172.21.15.18:0/2726684724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee40ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 --2- 172.21.15.18:0/2726684724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee4107990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 -- 172.21.15.18:0/2726684724 >> 172.21.15.18:0/2726684724 conn(0x7f7ee4076980 msgr2=0x7f7ee40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 -- 172.21.15.18:0/2726684724 shutdown_connections 2024-04-21T22:38:42.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.034+0000 7f7eeae00640 1 -- 172.21.15.18:0/2726684724 wait complete. 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.035+0000 7f7eeae00640 1 Processor -- start 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 -- start start 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 0x7f7ee419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4111920 con 0x7f7ee41003f0 2024-04-21T22:38:42.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41117a0 con 0x7f7ee40ffa30 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7eeae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4111aa0 con 0x7f7ee41075b0 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.036+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 0x7f7ee419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44072/0 (socket says 172.21.15.18:44072) 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 -- 172.21.15.18:0/1520277864 learned_addr learned my addr 172.21.15.18:0/1520277864 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7eea400640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 -- 172.21.15.18:0/1520277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 msgr2=0x7f7ee419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 -- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 msgr2=0x7f7ee419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 0x7f7ee419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 -- 172.21.15.18:0/1520277864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee419f0d0 con 0x7f7ee40ffa30 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7eea400640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.037+0000 7f7ee9a00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009900 tx=0x7f7ed8004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.038+0000 7f7ee2000640 1 -- 172.21.15.18:0/1520277864 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8043020 con 0x7f7ee40ffa30 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.038+0000 7f7ee2000640 1 -- 172.21.15.18:0/1520277864 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed80054e0 con 0x7f7ee40ffa30 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.038+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee419f360 con 0x7f7ee40ffa30 2024-04-21T22:38:42.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.038+0000 7f7ee2000640 1 -- 172.21.15.18:0/1520277864 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003b80 con 0x7f7ee40ffa30 2024-04-21T22:38:42.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.038+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee41a6c50 con 0x7f7ee40ffa30 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.041+0000 7f7ee2000640 1 -- 172.21.15.18:0/1520277864 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7ed8046020 con 0x7f7ee40ffa30 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.041+0000 7f7eeefea740 1 Processor -- start 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.041+0000 7f7eeefea740 1 -- start start 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 0x55f0a8919cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a89228a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f0a8877df0 con 0x55f0a8922de0 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f0a887d040 con 0x55f0a891a200 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eeefea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f0a88258c0 con 0x55f0a89198e0 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a89228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45774/0 (socket says 172.21.15.18:45774) 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7ee9000640 1 -- 172.21.15.18:0/880168536 learned_addr learned my addr 172.21.15.18:0/880168536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 0x55f0a8919cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 -- 172.21.15.18:0/880168536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 msgr2=0x55f0a89228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a89228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 -- 172.21.15.18:0/880168536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 msgr2=0x55f0a89251d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.042+0000 7f7eea400640 1 -- 172.21.15.18:0/880168536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a86597e0 con 0x55f0a89198e0 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ee9000640 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7eea400640 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 0x55f0a8919cc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00bba0 tx=0x7f7edc00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8daddaa0ee316 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ee2000640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 0x7f7ecc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ed2a00640 1 -- 172.21.15.18:0/880168536 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc015070 con 0x55f0a89198e0 2024-04-21T22:38:42.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ed2a00640 1 -- 172.21.15.18:0/880168536 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc005500 con 0x55f0a89198e0 2024-04-21T22:38:42.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ed2a00640 1 -- 172.21.15.18:0/880168536 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004e60 con 0x55f0a89198e0 2024-04-21T22:38:42.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ee2000640 1 -- 172.21.15.18:0/1520277864 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7ed80f1400 con 0x7f7ee40ffa30 2024-04-21T22:38:42.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.043+0000 7f7ee9a00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 0x7f7ecc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 -- 172.21.15.18:0/880168536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 msgr2=0x55f0a8919cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 0x55f0a8919cc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00bba0 tx=0x7f7edc00f730 comp rx=0 tx=0).stop 2024-04-21T22:38:42.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7ee9a00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 0x7f7ecc0a5240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80eed10 tx=0x7f7ed80f4f50 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 -- 172.21.15.18:0/880168536 shutdown_connections 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a8922de0 0x55f0a89251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a89228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 --2- 172.21.15.18:0/880168536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a89198e0 0x55f0a8919cc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 -- 172.21.15.18:0/880168536 >> 172.21.15.18:0/880168536 conn(0x55f0a8914010 msgr2=0x55f0a89143f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 -- 172.21.15.18:0/880168536 shutdown_connections 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.044+0000 7f7eeefea740 1 -- 172.21.15.18:0/880168536 wait complete. 2024-04-21T22:38:42.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 -- start start 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 Processor -- start 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8920340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a8920880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f0a8838d20 con 0x55f0a89198e0 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f0a8879000 con 0x55f0a891a200 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.045+0000 7f7eeefea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f0a8925bd0 con 0x55f0a8922de0 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eeefea740 10 client.0 _ll_register_callbacks cb 0x55f0a88740a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:42.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45788/0 (socket says 172.21.15.18:45788) 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 -- 172.21.15.18:0/3166690949 learned_addr learned my addr 172.21.15.18:0/3166690949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7ee9000640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8920340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a8920880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 -- 172.21.15.18:0/3166690949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 msgr2=0x55f0a8920880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a8920880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 -- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 msgr2=0x55f0a8920340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8920340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 -- 172.21.15.18:0/3166690949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a86b9f70 con 0x55f0a89198e0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7eea400640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0048f0 tx=0x7f7edc00ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18c3ae314adf1ed server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.046+0000 7f7ec7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc015050 con 0x55f0a89198e0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7edc005080 con 0x55f0a89198e0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc005500 con 0x55f0a89198e0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7edc030050 con 0x55f0a89198e0 2024-04-21T22:38:42.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7eeefea740 10 client.16596 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f0a8551170 con 0x55f0a89198e0 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc005500 con 0x55f0a89198e0 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.047+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f7edc019410 con 0x55f0a89198e0 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 10 client.16596 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 10 client.16596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 20 client.16596 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a8932ee0 0x55f0a89352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 4 client.16596 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:42.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0a888a580 con 0x55f0a8932ee0 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.048+0000 7f7ee9000640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a8932ee0 0x55f0a89352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.049+0000 7f7ee9000640 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a8932ee0 0x55f0a89352d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0f7f88f4beaa1f server_cookie=1b2bc1e93ee0e785 in_seq=0 out_seq=0 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.049+0000 7f7ec7400640 10 client.16596 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7ec7400640 1 -- 172.21.15.18:0/3166690949 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f0a888a580 con 0x55f0a8932ee0 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7ec7400640 10 client.16596 handle_command_reply: tid=0 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 client.16596 shutdown 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 msgr2=0x55f0a891fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0048f0 tx=0x7f7edc00ff60 comp rx=0 tx=0).stop 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 shutdown_connections 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a8932ee0 0x55f0a89352d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a8920880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8920340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 --2- 172.21.15.18:0/3166690949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a891fe00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7ec7400640 0 client.16596 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 >> 172.21.15.18:0/3166690949 conn(0x55f0a8914010 msgr2=0x55f0a8915d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 shutdown_connections 2024-04-21T22:38:42.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 1 -- 172.21.15.18:0/3166690949 wait complete. 2024-04-21T22:38:42.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.050+0000 7f7eeefea740 20 client.16596 trim_cache size 0 max 16384 2024-04-21T22:38:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 Processor -- start 2024-04-21T22:38:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 -- start start 2024-04-21T22:38:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a892e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 0x55f0a893a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a8922de0 0x55f0a893ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41af5a0 con 0x55f0a89198e0 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b1110 con 0x55f0a8922de0 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.070+0000 7f7eeefea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41afca0 con 0x55f0a891a200 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7eea400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a892e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7eea400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a892e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45790/0 (socket says 172.21.15.18:45790) 2024-04-21T22:38:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7eea400640 1 -- 172.21.15.18:0/548010579 learned_addr learned my addr 172.21.15.18:0/548010579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 0x55f0a893a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7eea400640 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a8922de0 0x55f0a893ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 -- 172.21.15.18:0/548010579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a8922de0 msgr2=0x55f0a893ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a8922de0 0x55f0a893ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 -- 172.21.15.18:0/548010579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 msgr2=0x55f0a892e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a892e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.071+0000 7f7ee9000640 1 -- 172.21.15.18:0/548010579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a8912490 con 0x55f0a891a200 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.072+0000 7f7ee9000640 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 0x55f0a893a8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55f0a8935870 tx=0x7f7ed4009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d0f5709c01d8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.072+0000 7f7ed2000640 1 -- 172.21.15.18:0/548010579 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed401e270 con 0x55f0a891a200 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.072+0000 7f7ed2000640 1 -- 172.21.15.18:0/548010579 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed4024070 con 0x55f0a891a200 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.072+0000 7f7ed2000640 1 -- 172.21.15.18:0/548010579 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed401dd90 con 0x55f0a891a200 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- 172.21.15.18:0/548010579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 msgr2=0x55f0a893a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 0x55f0a893a8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55f0a8935870 tx=0x7f7ed4009500 comp rx=0 tx=0).stop 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- 172.21.15.18:0/548010579 shutdown_connections 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a8922de0 0x55f0a893ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a891a200 0x55f0a893a8d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 --2- 172.21.15.18:0/548010579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a892e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- 172.21.15.18:0/548010579 >> 172.21.15.18:0/548010579 conn(0x55f0a8914010 msgr2=0x55f0a89127f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- 172.21.15.18:0/548010579 shutdown_connections 2024-04-21T22:38:42.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- 172.21.15.18:0/548010579 wait complete. 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.073+0000 7f7eeefea740 1 -- start start 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 Processor -- start 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a8927e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a89288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b0a40 con 0x55f0a89198e0 2024-04-21T22:38:42.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b0370 con 0x55f0a891a200 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ad580 con 0x55f0a8922de0 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.074+0000 7f7eeefea740 10 client.0 _ll_register_callbacks cb 0x7f7ed4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a8927e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44110/0 (socket says 172.21.15.18:44110) 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7ee9000640 1 -- 172.21.15.18:0/764453478 learned_addr learned my addr 172.21.15.18:0/764453478 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a89288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 -- 172.21.15.18:0/764453478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 msgr2=0x55f0a89288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a89288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 -- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 msgr2=0x55f0a8928360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 -- 172.21.15.18:0/764453478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a8999150 con 0x55f0a89198e0 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7ee9000640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7eea400640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a8927e20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00f770 tx=0x7f7edc02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc6fe13238ae564 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.075+0000 7f7ec7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc015040 con 0x55f0a89198e0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7edc0195e0 con 0x55f0a89198e0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed4024070 con 0x55f0a89198e0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7edc045050 con 0x55f0a89198e0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7eeefea740 10 client.16602 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f0a899a390 con 0x55f0a89198e0 2024-04-21T22:38:42.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed4024070 con 0x55f0a89198e0 2024-04-21T22:38:42.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.076+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f7edc0116b0 con 0x55f0a89198e0 2024-04-21T22:38:42.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 10 client.16602 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:42.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:42.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 20 client.16602 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a899ab10 0x55f0a899cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 4 client.16602 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f0a88848d0 con 0x55f0a899ab10 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7ee9000640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a899ab10 0x55f0a899cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7ee9000640 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a899ab10 0x55f0a899cf30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a496ad18ae46e73 server_cookie=e81a8b85ad15654e in_seq=0 out_seq=0 2024-04-21T22:38:42.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.077+0000 7f7ec7400640 10 client.16602 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7ec7400640 1 -- 172.21.15.18:0/764453478 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f0a88848d0 con 0x55f0a899ab10 2024-04-21T22:38:42.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7ec7400640 10 client.16602 handle_command_reply: tid=0 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 client.16602 shutdown 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 msgr2=0x55f0a8927e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a8927e20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00f770 tx=0x7f7edc02b040 comp rx=0 tx=0).stop 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 shutdown_connections 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f0a899ab10 0x55f0a899cf30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f0a8922de0 0x55f0a89288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f0a891a200 0x55f0a8928360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 --2- 172.21.15.18:0/764453478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f0a89198e0 0x55f0a8927e20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 >> 172.21.15.18:0/764453478 conn(0x55f0a8914010 msgr2=0x55f0a8913080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7ec7400640 0 client.16602 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 shutdown_connections 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 1 -- 172.21.15.18:0/764453478 wait complete. 2024-04-21T22:38:42.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.079+0000 7f7eeefea740 20 client.16602 trim_cache size 0 max 16384 2024-04-21T22:38:42.090 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:42.090 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:38:42.090 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "b1142aaf-79cc-4595-808f-f77bb6124ef1", 2024-04-21T22:38:42.090 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:38:42.090 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:42.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 msgr2=0x7f7ecc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 0x7f7ecc0a5240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80eed10 tx=0x7f7ed80f4f50 comp rx=0 tx=0).stop 2024-04-21T22:38:42.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 msgr2=0x7f7ee419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009900 tx=0x7f7ed8004360 comp rx=0 tx=0).stop 2024-04-21T22:38:42.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 shutdown_connections 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7ecc0a2d80 0x7f7ecc0a5240 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee41075b0 0x7f7ee419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ee41003f0 0x7f7ee419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 --2- 172.21.15.18:0/1520277864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ee40ffa30 0x7f7ee419a0e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 >> 172.21.15.18:0/1520277864 conn(0x7f7ee4076980 msgr2=0x7f7ee40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 shutdown_connections 2024-04-21T22:38:42.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.080+0000 7f7eeae00640 1 -- 172.21.15.18:0/1520277864 wait complete. 2024-04-21T22:38:42.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:38:42.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:38:42.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 -- 172.21.15.18:0/3285500506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 msgr2=0x7f918810b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 --2- 172.21.15.18:0/3285500506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918810b540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9170009860 tx=0x7f917002bc00 comp rx=0 tx=0).stop 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 -- 172.21.15.18:0/3285500506 shutdown_connections 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 --2- 172.21.15.18:0/3285500506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 0x7f918810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 --2- 172.21.15.18:0/3285500506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918810b540 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 --2- 172.21.15.18:0/3285500506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 0x7f9188102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 -- 172.21.15.18:0/3285500506 >> 172.21.15.18:0/3285500506 conn(0x7f91880771f0 msgr2=0x7f91880fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 -- 172.21.15.18:0/3285500506 shutdown_connections 2024-04-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.379+0000 7f918cc00640 1 -- 172.21.15.18:0/3285500506 wait complete. 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 Processor -- start 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 -- start start 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 0x7f918819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 0x7f918819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91881118f0 con 0x7f918810bb10 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9188111770 con 0x7f9188102740 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.381+0000 7f918cc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9188111a70 con 0x7f9188103060 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:32850/0 (socket says 172.21.15.18:32850) 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 -- 172.21.15.18:0/3690762783 learned_addr learned my addr 172.21.15.18:0/3690762783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f9187400640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 0x7f918819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f9187e00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 0x7f918819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 -- 172.21.15.18:0/3690762783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 msgr2=0x7f918819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 0x7f918819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 -- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 msgr2=0x7f918819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 0x7f918819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.382+0000 7f917fe00640 1 -- 172.21.15.18:0/3690762783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918819f020 con 0x7f9188103060 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f917fe00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9170037040 tx=0x7f91700346f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f9184c00640 1 -- 172.21.15.18:0/3690762783 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170041020 con 0x7f9188103060 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f9184c00640 1 -- 172.21.15.18:0/3690762783 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91700044d0 con 0x7f9188103060 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f9184c00640 1 -- 172.21.15.18:0/3690762783 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170039040 con 0x7f9188103060 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918819f2b0 con 0x7f9188103060 2024-04-21T22:38:42.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.383+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881a6ba0 con 0x7f9188103060 2024-04-21T22:38:42.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.387+0000 7f9190fd2740 1 Processor -- start 2024-04-21T22:38:42.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.387+0000 7f9190fd2740 1 -- start start 2024-04-21T22:38:42.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c015a270 0x5569c016b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9184c00640 1 -- 172.21.15.18:0/3690762783 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f9170044020 con 0x7f9188103060 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5569c00bd410 con 0x5569c01598c0 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5569c00657e0 con 0x5569c016b7c0 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9190fd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5569c00b93d0 con 0x5569c015a270 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f917fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f9187400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c015a270 0x5569c016b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f917fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44136/0 (socket says 172.21.15.18:44136) 2024-04-21T22:38:42.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.388+0000 7f917fe00640 1 -- 172.21.15.18:0/84893267 learned_addr learned my addr 172.21.15.18:0/84893267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f9187e00640 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 -- 172.21.15.18:0/84893267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c015a270 msgr2=0x5569c016b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c015a270 0x5569c016b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 -- 172.21.15.18:0/84893267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 msgr2=0x5569c0159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 -- 172.21.15.18:0/84893267 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569bfe9b7d0 con 0x5569c016b7c0 2024-04-21T22:38:42.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f9187e00640 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.389+0000 7f917fe00640 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91700f4ba0 tx=0x7f91700f4c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c239324b6b2436 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.390+0000 7f9177e00640 1 -- 172.21.15.18:0/84893267 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170100020 con 0x5569c016b7c0 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.390+0000 7f9177e00640 1 -- 172.21.15.18:0/84893267 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91700f9ca0 con 0x5569c016b7c0 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.390+0000 7f9177e00640 1 -- 172.21.15.18:0/84893267 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700fb5f0 con 0x5569c016b7c0 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9184c00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 0x7f916c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9184c00640 1 -- 172.21.15.18:0/3690762783 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f91700f0b80 con 0x7f9188103060 2024-04-21T22:38:42.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9187e00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 0x7f916c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 -- 172.21.15.18:0/84893267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 msgr2=0x5569c016dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91700f4ba0 tx=0x7f91700f4c90 comp rx=0 tx=0).stop 2024-04-21T22:38:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 -- 172.21.15.18:0/84893267 shutdown_connections 2024-04-21T22:38:42.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c016dbb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c015a270 0x5569c016b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 --2- 172.21.15.18:0/84893267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.391+0000 7f9190fd2740 1 -- 172.21.15.18:0/84893267 >> 172.21.15.18:0/84893267 conn(0x5569c01541e0 msgr2=0x5569c01545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.392+0000 7f9190fd2740 1 -- 172.21.15.18:0/84893267 shutdown_connections 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.392+0000 7f9190fd2740 1 -- 172.21.15.18:0/84893267 wait complete. 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.392+0000 7f9187e00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 0x7f916c0a51c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9180007f10 tx=0x7f9180007520 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.393+0000 7f9190fd2740 1 -- start start 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.393+0000 7f9190fd2740 1 Processor -- start 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.393+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c01598c0 0x5569c01688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.393+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 0x5569c0168e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9190fd2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5569c016e340 con 0x5569c015a270 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9190fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5569c0078c40 con 0x5569c016b7c0 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9190fd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5569c016e4c0 con 0x5569c01598c0 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44142/0 (socket says 172.21.15.18:44142) 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 -- 172.21.15.18:0/1734459751 learned_addr learned my addr 172.21.15.18:0/1734459751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187400640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c01598c0 0x5569c01688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9190fd2740 10 client.0 _ll_register_callbacks cb 0x5569c0078630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f917fe00640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 0x5569c0168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 -- 172.21.15.18:0/1734459751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c01598c0 msgr2=0x5569c01688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c01598c0 0x5569c01688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 -- 172.21.15.18:0/1734459751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 msgr2=0x5569c0168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 0x5569c0168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f9187e00640 1 -- 172.21.15.18:0/1734459751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569bfdd13f0 con 0x5569c016b7c0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.394+0000 7f917fe00640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 0x5569c0168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.395+0000 7f9187e00640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f918000fe80 tx=0x7f9180004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=671cc85608d79cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.395+0000 7f9174c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.395+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180029060 con 0x5569c016b7c0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.395+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f918001a670 con 0x5569c016b7c0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.395+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91700f9ca0 con 0x5569c016b7c0 2024-04-21T22:38:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.396+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f918001ce10 con 0x5569c016b7c0 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.396+0000 7f9190fd2740 10 client.26684 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.396+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5569bfd910f0 con 0x5569c016b7c0 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.396+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91700f9ca0 con 0x5569c016b7c0 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.396+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f9180018040 con 0x5569c016b7c0 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 10 client.26684 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 10 client.26684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 20 client.26684 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c017b970 0x5569c017ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 4 client.26684 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:38:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c00d0c40 con 0x5569c017b970 2024-04-21T22:38:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.397+0000 7f9187400640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c017b970 0x5569c017ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.398+0000 7f9187400640 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c017b970 0x5569c017ddc0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30aabf5d7149a3c server_cookie=b47e7a9e655153a6 in_seq=0 out_seq=0 2024-04-21T22:38:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.398+0000 7f9174c00640 10 client.26684 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.398+0000 7f9174c00640 1 -- 172.21.15.18:0/1734459751 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5569c00d0c40 con 0x5569c017b970 2024-04-21T22:38:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.398+0000 7f9174c00640 10 client.26684 handle_command_reply: tid=0 2024-04-21T22:38:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.398+0000 7f9190fd2740 1 client.26684 shutdown 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 msgr2=0x5569c0169340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f918000fe80 tx=0x7f9180004a40 comp rx=0 tx=0).stop 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 shutdown_connections 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c016b7c0 0x5569c0169340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c015a270 0x5569c0168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c017b970 0x5569c017ddc0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 --2- 172.21.15.18:0/1734459751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c01598c0 0x5569c01688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9174c00640 0 client.26684 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 >> 172.21.15.18:0/1734459751 conn(0x5569c01541e0 msgr2=0x5569c0155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 shutdown_connections 2024-04-21T22:38:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 1 -- 172.21.15.18:0/1734459751 wait complete. 2024-04-21T22:38:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.399+0000 7f9190fd2740 20 client.26684 trim_cache size 0 max 16384 2024-04-21T22:38:42.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.425+0000 7f9190fd2740 1 Processor -- start 2024-04-21T22:38:42.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.425+0000 7f9190fd2740 1 -- start start 2024-04-21T22:38:42.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c016aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c0183bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ab060 con 0x5569c01598c0 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91881acbd0 con 0x5569c015a270 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9190fd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ab760 con 0x5569c016b7c0 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f917fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f917fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44152/0 (socket says 172.21.15.18:44152) 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f917fe00640 1 -- 172.21.15.18:0/3172824337 learned_addr learned my addr 172.21.15.18:0/3172824337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9187e00640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c0183bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.426+0000 7f9187400640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c016aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 -- 172.21.15.18:0/3172824337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 msgr2=0x5569c0183bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c0183bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 -- 172.21.15.18:0/3172824337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 msgr2=0x5569c016aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c016aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 -- 172.21.15.18:0/3172824337 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c016df20 con 0x5569c015a270 2024-04-21T22:38:42.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f9187e00640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c0183bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:38:42.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f917fe00640 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91700bd120 tx=0x7f917002bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa22c7661a1ae9d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f9177400640 1 -- 172.21.15.18:0/3172824337 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170100050 con 0x5569c015a270 2024-04-21T22:38:42.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f9177400640 1 -- 172.21.15.18:0/3172824337 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91700bd890 con 0x5569c015a270 2024-04-21T22:38:42.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.427+0000 7f9177400640 1 -- 172.21.15.18:0/3172824337 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700bd190 con 0x5569c015a270 2024-04-21T22:38:42.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 -- 172.21.15.18:0/3172824337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 msgr2=0x5569c0183690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91700bd120 tx=0x7f917002bc00 comp rx=0 tx=0).stop 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 -- 172.21.15.18:0/3172824337 shutdown_connections 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c0183bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c0183690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 --2- 172.21.15.18:0/3172824337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c016aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 -- 172.21.15.18:0/3172824337 >> 172.21.15.18:0/3172824337 conn(0x5569c01541e0 msgr2=0x5569c01545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 -- 172.21.15.18:0/3172824337 shutdown_connections 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.428+0000 7f9190fd2740 1 -- 172.21.15.18:0/3172824337 wait complete. 2024-04-21T22:38:42.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 -- start start 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 Processor -- start 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0173ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c016f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f91881ac500 con 0x5569c01598c0 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91881abe30 con 0x5569c015a270 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.429+0000 7f9190fd2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91881a9060 con 0x5569c016b7c0 2024-04-21T22:38:42.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9190fd2740 10 client.0 _ll_register_callbacks cb 0x7f918000fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9187e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c016f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9187e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c016f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:32896/0 (socket says 172.21.15.18:32896) 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9187e00640 1 -- 172.21.15.18:0/772801664 learned_addr learned my addr 172.21.15.18:0/772801664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44168/0 (socket says 172.21.15.18:44168) 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9187400640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0173ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 -- 172.21.15.18:0/772801664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 msgr2=0x5569c016f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c016f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 -- 172.21.15.18:0/772801664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 msgr2=0x5569c0173ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0173ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f917fe00640 1 -- 172.21.15.18:0/772801664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c016fb20 con 0x5569c015a270 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.430+0000 7f9187400640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0173ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f917fe00640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5569c014fe40 tx=0x7f91700f4c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c4ac529b0823d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9174c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170100070 con 0x5569c015a270 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f91700dd0b0 con 0x5569c015a270 2024-04-21T22:38:42.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91700bd890 con 0x5569c015a270 2024-04-21T22:38:42.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f91700bcf60 con 0x5569c015a270 2024-04-21T22:38:42.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9190fd2740 10 client.26690 fetch_fsmap learned FSMap version 37 2024-04-21T22:38:42.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5569c016fb20 con 0x5569c015a270 2024-04-21T22:38:42.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.431+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91700bd890 con 0x5569c015a270 2024-04-21T22:38:42.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f917003c030 con 0x5569c015a270 2024-04-21T22:38:42.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 10 client.26690 fetch_fsmap finished waiting for FSMap version 37 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 10 client.26690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 20 client.26690 populate_metadata read hostname 'smithi018' 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c01e1f90 0x5569c01e4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 4 client.26690 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5569c00ca950 con 0x5569c01e1f90 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.432+0000 7f9187400640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c01e1f90 0x5569c01e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9187400640 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c01e1f90 0x5569c01e4380 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eebb69d469581bf1 server_cookie=5c267e45d5bfb75b in_seq=0 out_seq=0 2024-04-21T22:38:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9174c00640 10 client.26690 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9174c00640 1 -- 172.21.15.18:0/772801664 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5569c00ca950 con 0x5569c01e1f90 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9174c00640 10 client.26690 handle_command_reply: tid=0 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 client.26690 shutdown 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 msgr2=0x5569c016ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5569c014fe40 tx=0x7f91700f4c90 comp rx=0 tx=0).stop 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 shutdown_connections 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5569c01e1f90 0x5569c01e4380 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569c016b7c0 0x5569c016f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5569c015a270 0x5569c016ede0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 --2- 172.21.15.18:0/772801664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5569c01598c0 0x5569c0173ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9174c00640 0 client.26690 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.433+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 >> 172.21.15.18:0/772801664 conn(0x5569c01541e0 msgr2=0x5569c0152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.434+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 shutdown_connections 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.434+0000 7f9190fd2740 1 -- 172.21.15.18:0/772801664 wait complete. 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.434+0000 7f9190fd2740 20 client.26690 trim_cache size 0 max 16384 2024-04-21T22:38:42.440 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "b1142aaf-79cc-4595-808f-f77bb6124ef1": { 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "b1142aaf-79cc-4595-808f-f77bb6124ef1", 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:38:42.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:38:42.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:38:42.442 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:38:42.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 msgr2=0x7f916c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 0x7f916c0a51c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9180007f10 tx=0x7f9180007520 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 msgr2=0x7f918819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9170037040 tx=0x7f91700346f0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 shutdown_connections 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f916c0a2d00 0x7f916c0a51c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f918810bb10 0x7f918819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9188103060 0x7f918819a570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 --2- 172.21.15.18:0/3690762783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9188102740 0x7f918819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 >> 172.21.15.18:0/3690762783 conn(0x7f91880771f0 msgr2=0x7f91880fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:38:42.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 shutdown_connections 2024-04-21T22:38:42.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:38:42.435+0000 7f918cc00640 1 -- 172.21.15.18:0/3690762783 wait complete. 2024-04-21T22:38:42.456 INFO:tasks.cephfs.filesystem:scrub status for tag:b1142aaf-79cc-4595-808f-f77bb6124ef1 - {'path': '/', 'tag': 'b1142aaf-79cc-4595-808f-f77bb6124ef1', 'options': 'recursive,force'} 2024-04-21T22:38:42.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:42 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:42.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:42 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:42.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:42 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:42.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:42 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:42.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:42 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:42.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:42 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:42.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:42 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:42.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:42 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:42.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:42 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:42.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:42 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:42.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:42 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:42.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:42 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:42.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:42 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:42.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:42 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:42.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:42 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: pgmap v143: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:38:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:43 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: pgmap v143: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:43.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:38:43.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:43.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:43 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: pgmap v143: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:44.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:38:44.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:43 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:38:44.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:44 smithi081 ceph-mon[31692]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:44.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:44 smithi081 ceph-mon[31692]: pgmap v144: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:44.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:44 smithi047 ceph-mon[31561]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:44.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:44 smithi047 ceph-mon[31561]: pgmap v144: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:44 smithi018 ceph-mon[26614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-21T22:38:45.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:44 smithi018 ceph-mon[26614]: pgmap v144: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:47.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:47 smithi018 ceph-mon[26614]: pgmap v145: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:47 smithi081 ceph-mon[31692]: pgmap v145: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:47 smithi047 ceph-mon[31561]: pgmap v145: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:49 smithi018 ceph-mon[26614]: pgmap v146: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:49 smithi081 ceph-mon[31692]: pgmap v146: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:49.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:49 smithi047 ceph-mon[31561]: pgmap v146: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:51.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:51 smithi018 ceph-mon[26614]: pgmap v147: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:51 smithi081 ceph-mon[31692]: pgmap v147: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:51 smithi047 ceph-mon[31561]: pgmap v147: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:53.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:53 smithi018 ceph-mon[26614]: pgmap v148: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:53.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:53.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:53.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:53 smithi081 ceph-mon[31692]: pgmap v148: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:53 smithi047 ceph-mon[31561]: pgmap v148: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:38:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:54.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:54 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:54.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:54 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:38:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:54 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:54 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:38:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:54 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:54 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:38:55.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:55 smithi018 ceph-mon[26614]: pgmap v149: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:55 smithi081 ceph-mon[31692]: pgmap v149: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:55 smithi047 ceph-mon[31561]: pgmap v149: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:38:57.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:57 smithi018 ceph-mon[26614]: pgmap v150: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:57 smithi081 ceph-mon[31692]: pgmap v150: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:57.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:57 smithi047 ceph-mon[31561]: pgmap v150: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:38:59.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:38:59 smithi018 ceph-mon[26614]: pgmap v151: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:38:59 smithi081 ceph-mon[31692]: pgmap v151: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:38:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:38:59 smithi047 ceph-mon[31561]: pgmap v151: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:01.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:01 smithi018 ceph-mon[26614]: pgmap v152: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:01 smithi081 ceph-mon[31692]: pgmap v152: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:01 smithi047 ceph-mon[31561]: pgmap v152: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:03.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:03 smithi018 ceph-mon[26614]: pgmap v153: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:03 smithi081 ceph-mon[31692]: pgmap v153: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:03 smithi047 ceph-mon[31561]: pgmap v153: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:05.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:05 smithi018 ceph-mon[26614]: pgmap v154: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:05 smithi081 ceph-mon[31692]: pgmap v154: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:05.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:05 smithi047 ceph-mon[31561]: pgmap v154: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:07.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:07 smithi018 ceph-mon[26614]: pgmap v155: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:07 smithi081 ceph-mon[31692]: pgmap v155: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:07 smithi047 ceph-mon[31561]: pgmap v155: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:09.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:09 smithi018 ceph-mon[26614]: pgmap v156: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:09 smithi081 ceph-mon[31692]: pgmap v156: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:09 smithi047 ceph-mon[31561]: pgmap v156: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:11.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:11 smithi018 ceph-mon[26614]: pgmap v157: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:11 smithi081 ceph-mon[31692]: pgmap v157: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:11 smithi047 ceph-mon[31561]: pgmap v157: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:12.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:39:12.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:39:12.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 -- 172.21.15.18:0/988073059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0074410 msgr2=0x7f4fd010da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 --2- 172.21.15.18:0/988073059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0074410 0x7f4fd010da70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009900 tx=0x7f4fb802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 -- 172.21.15.18:0/988073059 shutdown_connections 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 --2- 172.21.15.18:0/988073059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd01103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 --2- 172.21.15.18:0/988073059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0074410 0x7f4fd010da70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 --2- 172.21.15.18:0/988073059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0073af0 0x7f4fd0073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 -- 172.21.15.18:0/988073059 >> 172.21.15.18:0/988073059 conn(0x7f4fd00fd200 msgr2=0x7f4fd00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 -- 172.21.15.18:0/988073059 shutdown_connections 2024-04-21T22:39:12.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.682+0000 7f4fd5400640 1 -- 172.21.15.18:0/988073059 wait complete. 2024-04-21T22:39:12.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 Processor -- start 2024-04-21T22:39:12.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 -- start start 2024-04-21T22:39:12.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0073af0 0x7f4fd019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0113c90 con 0x7f4fd0074410 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0113b10 con 0x7f4fd0073af0 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.683+0000 7f4fd5400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd0113e10 con 0x7f4fd010dfb0 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57566/0 (socket says 172.21.15.18:57566) 2024-04-21T22:39:12.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fc5e00640 1 -- 172.21.15.18:0/1163665254 learned_addr learned my addr 172.21.15.18:0/1163665254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fce800640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0073af0 0x7f4fd019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 -- 172.21.15.18:0/1163665254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0073af0 msgr2=0x7f4fd019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0073af0 0x7f4fd019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 -- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 msgr2=0x7f4fd019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fcf200640 1 -- 172.21.15.18:0/1163665254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd019f1f0 con 0x7f4fd010dfb0 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.684+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fcf200640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd019eac0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d680 tx=0x7f4fc800db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fc7e00640 1 -- 172.21.15.18:0/1163665254 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8017070 con 0x7f4fd010dfb0 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fc7e00640 1 -- 172.21.15.18:0/1163665254 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc8009820 con 0x7f4fd010dfb0 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd019f4e0 con 0x7f4fd010dfb0 2024-04-21T22:39:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fc7e00640 1 -- 172.21.15.18:0/1163665254 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8004e00 con 0x7f4fd010dfb0 2024-04-21T22:39:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.685+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01a6d70 con 0x7f4fd010dfb0 2024-04-21T22:39:12.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.688+0000 7f4fd7ff1740 1 Processor -- start 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.688+0000 7f4fc7e00640 1 -- 172.21.15.18:0/1163665254 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4fc80099d0 con 0x7f4fd010dfb0 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 -- start start 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 0x555dc0a55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a55dc0 0x555dc0a581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555dc09b0410 con 0x555dc0a4c8c0 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555dc09587e0 con 0x555dc0a55dc0 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555dc09ac3d0 con 0x555dc0a4d1e0 2024-04-21T22:39:12.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57568/0 (socket says 172.21.15.18:57568) 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fc5e00640 1 -- 172.21.15.18:0/3041639704 learned_addr learned my addr 172.21.15.18:0/3041639704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.689+0000 7f4fce800640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 0x555dc0a55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a55dc0 0x555dc0a581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 -- 172.21.15.18:0/3041639704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a55dc0 msgr2=0x555dc0a581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a55dc0 0x555dc0a581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 -- 172.21.15.18:0/3041639704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 msgr2=0x555dc0a4cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 -- 172.21.15.18:0/3041639704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc078e7d0 con 0x555dc0a4d1e0 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fc7e00640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 0x7f4fb40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fce800640 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 0x555dc0a55880 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009fb0 tx=0x7f4fc0003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4994a1755396dce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fc7e00640 1 -- 172.21.15.18:0/1163665254 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4fc80cec20 con 0x7f4fd010dfb0 2024-04-21T22:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fbf400640 1 -- 172.21.15.18:0/3041639704 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004b20 con 0x555dc0a4d1e0 2024-04-21T22:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fbf400640 1 -- 172.21.15.18:0/3041639704 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc0004cc0 con 0x555dc0a4d1e0 2024-04-21T22:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fbf400640 1 -- 172.21.15.18:0/3041639704 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0012650 con 0x555dc0a4d1e0 2024-04-21T22:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.690+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 0x7f4fb40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/3041639704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 msgr2=0x555dc0a55880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 0x555dc0a55880 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009fb0 tx=0x7f4fc0003e00 comp rx=0 tx=0).stop 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 0x7f4fb40a51c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005ec0 tx=0x7f4fb8005d90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/3041639704 shutdown_connections 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a55dc0 0x555dc0a581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a4d1e0 0x555dc0a55880 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/3041639704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a4cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/3041639704 >> 172.21.15.18:0/3041639704 conn(0x555dc0a46ff0 msgr2=0x555dc0a473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/3041639704 shutdown_connections 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.691+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/3041639704 wait complete. 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.692+0000 7f4fd7ff1740 1 -- start start 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.692+0000 7f4fd7ff1740 1 Processor -- start 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 0x555dc0a52e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 0x555dc0a53340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555dc0a58bb0 con 0x555dc0a4d1e0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555dc096bc40 con 0x555dc0a4c8c0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555dc0a58d30 con 0x555dc0a55dc0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fd7ff1740 10 client.0 _ll_register_callbacks cb 0x555dc096b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 0x555dc0a53340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 0x555dc0a52e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a53880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39760/0 (socket says 172.21.15.18:39760) 2024-04-21T22:39:12.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 0x555dc0a53340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57570/0 (socket says 172.21.15.18:57570) 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fcf200640 1 -- 172.21.15.18:0/2690557014 learned_addr learned my addr 172.21.15.18:0/2690557014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 -- 172.21.15.18:0/2690557014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 msgr2=0x555dc0a53880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a53880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 -- 172.21.15.18:0/2690557014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 msgr2=0x555dc0a53340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 0x555dc0a53340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.693+0000 7f4fce800640 1 -- 172.21.15.18:0/2690557014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dc06c43f0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fce800640 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 0x555dc0a52e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004410 tx=0x7f4fc0009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a83ef04cd7313b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:12.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0005280 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc0004cc0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4fc0005420 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4fc0005620 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fd7ff1740 10 client.26702 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.694+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555dc06840f0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc0004cc0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4fc000f040 con 0x555dc0a4c8c0 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 10 client.26702 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:12.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 10 client.26702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 20 client.26702 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0a660a0 0x555dc0a68490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 4 client.26702 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dc09c3c40 con 0x555dc0a660a0 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.695+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0a660a0 0x555dc0a68490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.696+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0a660a0 0x555dc0a68490 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=345b260a46d1178a server_cookie=44928534cc85ab9c in_seq=0 out_seq=0 2024-04-21T22:39:12.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.696+0000 7f4fb3e00640 10 client.26702 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fb3e00640 1 -- 172.21.15.18:0/2690557014 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555dc09c3c40 con 0x555dc0a660a0 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fb3e00640 10 client.26702 handle_command_reply: tid=0 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 client.26702 shutdown 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 msgr2=0x555dc0a52e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 0x555dc0a52e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004410 tx=0x7f4fc0009c90 comp rx=0 tx=0).stop 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 shutdown_connections 2024-04-21T22:39:12.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0a660a0 0x555dc0a68490 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4d1e0 0x555dc0a53340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2690557014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4c8c0 0x555dc0a52e00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 >> 172.21.15.18:0/2690557014 conn(0x555dc0a46ff0 msgr2=0x555dc0a48d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fb3e00640 0 client.26702 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 shutdown_connections 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2690557014 wait complete. 2024-04-21T22:39:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.697+0000 7f4fd7ff1740 20 client.26702 trim_cache size 0 max 16384 2024-04-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 Processor -- start 2024-04-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 -- start start 2024-04-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a61a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01af6e0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01b1220 con 0x555dc0a4d1e0 2024-04-21T22:39:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.717+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01afdb0 con 0x555dc0a55dc0 2024-04-21T22:39:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57584/0 (socket says 172.21.15.18:57584) 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 -- 172.21.15.18:0/2487514651 learned_addr learned my addr 172.21.15.18:0/2487514651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fcf200640 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a61a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 -- 172.21.15.18:0/2487514651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 msgr2=0x555dc0a473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 -- 172.21.15.18:0/2487514651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 msgr2=0x555dc0a61a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a61a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 -- 172.21.15.18:0/2487514651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc0a4db90 con 0x555dc0a4c8c0 2024-04-21T22:39:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.718+0000 7f4fce800640 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4fc002d4e0 tx=0x7f4fc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981690e382acb3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fbea00640 1 -- 172.21.15.18:0/2487514651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0009680 con 0x555dc0a4c8c0 2024-04-21T22:39:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fbea00640 1 -- 172.21.15.18:0/2487514651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc0009aa0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fbea00640 1 -- 172.21.15.18:0/2487514651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00126b0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2487514651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 msgr2=0x555dc0a55530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4fc002d4e0 tx=0x7f4fc0009e30 comp rx=0 tx=0).stop 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2487514651 shutdown_connections 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a61a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/2487514651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a55530 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.719+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2487514651 >> 172.21.15.18:0/2487514651 conn(0x555dc0a46ff0 msgr2=0x555dc0a45800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.720+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2487514651 shutdown_connections 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.720+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/2487514651 wait complete. 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.720+0000 7f4fd7ff1740 1 -- start start 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.720+0000 7f4fd7ff1740 1 Processor -- start 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a5df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a4f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01b0b50 con 0x555dc0a4c8c0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01b0480 con 0x555dc0a4d1e0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01ad6c0 con 0x555dc0a55dc0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fd7ff1740 10 client.0 _ll_register_callbacks cb 0x7f4fc0003f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a5df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fc5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a5e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36124/0 (socket says 172.21.15.18:36124) 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fc5e00640 1 -- 172.21.15.18:0/47377986 learned_addr learned my addr 172.21.15.18:0/47377986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fcf200640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a4f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 -- 172.21.15.18:0/47377986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 msgr2=0x555dc0a4f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a4f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 -- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 msgr2=0x555dc0a5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.721+0000 7f4fce800640 1 -- 172.21.15.18:0/47377986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dc0a4f850 con 0x555dc0a4c8c0 2024-04-21T22:39:12.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fce800640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a5df80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4fc002ebd0 tx=0x7f4fc0009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bcff2ceb361fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fb3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc002d950 con 0x555dc0a4c8c0 2024-04-21T22:39:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4fc0005080 con 0x555dc0a4c8c0 2024-04-21T22:39:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc0009aa0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4fc00052a0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fd7ff1740 10 client.16635 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.722+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555dc0ad46f0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc0009aa0 con 0x555dc0a4c8c0 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4fc0036430 con 0x555dc0a4c8c0 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 10 client.16635 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 20 client.16635 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:12.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0ad4df0 0x555dc0ad7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 4 client.16635 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:39:12.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555dc09bd950 con 0x555dc0ad4df0 2024-04-21T22:39:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.723+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0ad4df0 0x555dc0ad7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fb3e00640 10 client.16635 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:12.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fc5e00640 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0ad4df0 0x555dc0ad7210 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ef224681aa0c393 server_cookie=2f79532dcea3494b in_seq=0 out_seq=0 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fb3e00640 1 -- 172.21.15.18:0/47377986 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555dc09bd950 con 0x555dc0ad4df0 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fb3e00640 10 client.16635 handle_command_reply: tid=0 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 client.16635 shutdown 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 msgr2=0x555dc0a5df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a5df80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4fc002ebd0 tx=0x7f4fc0009700 comp rx=0 tx=0).stop 2024-04-21T22:39:12.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 shutdown_connections 2024-04-21T22:39:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555dc0ad4df0 0x555dc0ad7210 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dc0a55dc0 0x555dc0a4f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555dc0a4d1e0 0x555dc0a5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 --2- 172.21.15.18:0/47377986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555dc0a4c8c0 0x555dc0a5df80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 >> 172.21.15.18:0/47377986 conn(0x555dc0a46ff0 msgr2=0x555dc0a46090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fb3e00640 0 client.16635 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.724+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 shutdown_connections 2024-04-21T22:39:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd7ff1740 1 -- 172.21.15.18:0/47377986 wait complete. 2024-04-21T22:39:12.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd7ff1740 20 client.16635 trim_cache size 0 max 16384 2024-04-21T22:39:12.738 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:39:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:39:12.738 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 msgr2=0x7f4fb40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 0x7f4fb40a51c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005ec0 tx=0x7f4fb8005d90 comp rx=0 tx=0).stop 2024-04-21T22:39:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 msgr2=0x7f4fd019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd019eac0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d680 tx=0x7f4fc800db40 comp rx=0 tx=0).stop 2024-04-21T22:39:12.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 shutdown_connections 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fb40a2d00 0x7f4fb40a51c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd010dfb0 0x7f4fd019eac0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fd0074410 0x7f4fd019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 --2- 172.21.15.18:0/1163665254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fd0073af0 0x7f4fd019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.725+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 >> 172.21.15.18:0/1163665254 conn(0x7f4fd00fd200 msgr2=0x7f4fd00feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.726+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 shutdown_connections 2024-04-21T22:39:12.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.726+0000 7f4fd5400640 1 -- 172.21.15.18:0/1163665254 wait complete. 2024-04-21T22:39:12.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:39:12.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:39:12.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 -- 172.21.15.18:0/2336881509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 msgr2=0x7f6eec102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 --2- 172.21.15.18:0/2336881509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec102bb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009900 tx=0x7f6ee002bcc0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 -- 172.21.15.18:0/2336881509 shutdown_connections 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 --2- 172.21.15.18:0/2336881509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 0x7f6eec10e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 --2- 172.21.15.18:0/2336881509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 0x7f6eec10b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 --2- 172.21.15.18:0/2336881509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec102bb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 -- 172.21.15.18:0/2336881509 >> 172.21.15.18:0/2336881509 conn(0x7f6eec0fbfd0 msgr2=0x7f6eec0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:12.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 -- 172.21.15.18:0/2336881509 shutdown_connections 2024-04-21T22:39:12.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.949+0000 7f6ef3000640 1 -- 172.21.15.18:0/2336881509 wait complete. 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.950+0000 7f6ef3000640 1 Processor -- start 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.950+0000 7f6ef3000640 1 -- start start 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 0x7f6eec19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 0x7f6eec19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec111a40 con 0x7f6eec1027d0 2024-04-21T22:39:12.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec1118c0 con 0x7f6eec10bbf0 2024-04-21T22:39:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef3000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec111bc0 con 0x7f6eec1030f0 2024-04-21T22:39:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57620/0 (socket says 172.21.15.18:57620) 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef1c00640 1 -- 172.21.15.18:0/4259549319 learned_addr learned my addr 172.21.15.18:0/4259549319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef1200640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 0x7f6eec19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.951+0000 7f6ef2600640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 0x7f6eec19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 -- 172.21.15.18:0/4259549319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 msgr2=0x7f6eec19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 0x7f6eec19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 -- 172.21.15.18:0/4259549319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 msgr2=0x7f6eec19ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 0x7f6eec19ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 -- 172.21.15.18:0/4259549319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec19f150 con 0x7f6eec1027d0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef1c00640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000c00 tx=0x7f6ee0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0042020 con 0x7f6eec1027d0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee0005000 con 0x7f6eec1027d0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec19f3e0 con 0x7f6eec1027d0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.952+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0003af0 con 0x7f6eec1027d0 2024-04-21T22:39:12.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.953+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec1a6cd0 con 0x7f6eec1027d0 2024-04-21T22:39:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.954+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec04f570 con 0x7f6eec1027d0 2024-04-21T22:39:12.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.956+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6ee0045020 con 0x7f6eec1027d0 2024-04-21T22:39:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.958+0000 7f6eea000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 0x7f6ed40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.958+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6ee00f0eb0 con 0x7f6eec1027d0 2024-04-21T22:39:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.958+0000 7f6ef1200640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 0x7f6ed40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.959+0000 7f6ef1200640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 0x7f6ed40a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6eec10d470 tx=0x7f6ed8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:12.963+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6ee004c020 con 0x7f6eec1027d0 2024-04-21T22:39:13.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.216+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eec1a6f60 con 0x7f6eec1027d0 2024-04-21T22:39:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.218+0000 7f6eea000640 1 -- 172.21.15.18:0/4259549319 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7f6ee00bdb80 con 0x7f6eec1027d0 2024-04-21T22:39:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:39:13.219 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:39:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:39:13.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 msgr2=0x7f6ed40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 0x7f6ed40a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6eec10d470 tx=0x7f6ed8005f90 comp rx=0 tx=0).stop 2024-04-21T22:39:13.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 msgr2=0x7f6eec19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000c00 tx=0x7f6ee0004360 comp rx=0 tx=0).stop 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 shutdown_connections 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6ed40a2d70 0x7f6ed40a5230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6eec10bbf0 0x7f6eec19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec1030f0 0x7f6eec19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 --2- 172.21.15.18:0/4259549319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eec1027d0 0x7f6eec19a160 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 >> 172.21.15.18:0/4259549319 conn(0x7f6eec0fbfd0 msgr2=0x7f6eec0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.221+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 shutdown_connections 2024-04-21T22:39:13.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.222+0000 7f6ef3000640 1 -- 172.21.15.18:0/4259549319 wait complete. 2024-04-21T22:39:13.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:39:13.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 -- 172.21.15.18:0/4257356983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 msgr2=0x7f4a80103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/4257356983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a80103be0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009860 tx=0x7f4a6802bb70 comp rx=0 tx=0).stop 2024-04-21T22:39:13.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 -- 172.21.15.18:0/4257356983 shutdown_connections 2024-04-21T22:39:13.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/4257356983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80104120 0x7f4a80110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/4257356983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a80103be0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/4257356983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80109770 0x7f4a80109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 -- 172.21.15.18:0/4257356983 >> 172.21.15.18:0/4257356983 conn(0x7f4a800ff230 msgr2=0x7f4a80101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 -- 172.21.15.18:0/4257356983 shutdown_connections 2024-04-21T22:39:13.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.457+0000 7f4a7fe00640 1 -- 172.21.15.18:0/4257356983 wait complete. 2024-04-21T22:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.458+0000 7f4a7fe00640 1 Processor -- start 2024-04-21T22:39:13.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 -- start start 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 0x7f4a8019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80109770 0x7f4a8019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a80113b40 con 0x7f4a80104120 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801139c0 con 0x7f4a80103760 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a80113cc0 con 0x7f4a80109770 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a76000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 0x7f4a8019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36170/0 (socket says 172.21.15.18:36170) 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7ea00640 1 -- 172.21.15.18:0/1084285464 learned_addr learned my addr 172.21.15.18:0/1084285464 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.459+0000 7f4a7f400640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80109770 0x7f4a8019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 -- 172.21.15.18:0/1084285464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80109770 msgr2=0x7f4a8019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80109770 0x7f4a8019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 -- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 msgr2=0x7f4a8019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 0x7f4a8019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 -- 172.21.15.18:0/1084285464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8019f070 con 0x7f4a80103760 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a76000640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 0x7f4a8019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000e9c0 tx=0x7f4a7000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a84a00640 1 -- 172.21.15.18:0/1084285464 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000cde0 con 0x7f4a80103760 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.460+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8019f360 con 0x7f4a80103760 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.461+0000 7f4a84a00640 1 -- 172.21.15.18:0/1084285464 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a700035f0 con 0x7f4a80103760 2024-04-21T22:39:13.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.461+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a801a6bf0 con 0x7f4a80103760 2024-04-21T22:39:13.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.461+0000 7f4a84a00640 1 -- 172.21.15.18:0/1084285464 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70010690 con 0x7f4a80103760 2024-04-21T22:39:13.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 Processor -- start 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a84a00640 1 -- 172.21.15.18:0/1084285464 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4a700037a0 con 0x7f4a80103760 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 -- start start 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dcd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1d263a0 con 0x55d1b1dc2890 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1cce930 con 0x55d1b1dcb470 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.464+0000 7f4a88b97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1d22360 con 0x55d1b1dc1f70 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39838/0 (socket says 172.21.15.18:39838) 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57642/0 (socket says 172.21.15.18:57642) 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 -- 172.21.15.18:0/68401085 learned_addr learned my addr 172.21.15.18:0/68401085 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a76000640 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dcd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 -- 172.21.15.18:0/68401085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 msgr2=0x55d1b1dcd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dcd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 -- 172.21.15.18:0/68401085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 msgr2=0x55d1b1dcaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7f400640 1 -- 172.21.15.18:0/68401085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1b1a3a3f0 con 0x55d1b1dc1f70 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.465+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:13.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a7f400640 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009fd0 tx=0x7f4a780118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f7f9f10c975561 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a84a00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 0x7f4a640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a6fe00640 1 -- 172.21.15.18:0/68401085 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78004d20 con 0x55d1b1dc1f70 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a6fe00640 1 -- 172.21.15.18:0/68401085 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a78004050 con 0x55d1b1dc1f70 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a6fe00640 1 -- 172.21.15.18:0/68401085 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78005280 con 0x55d1b1dc1f70 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a84a00640 1 -- 172.21.15.18:0/1084285464 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4a700cf700 con 0x7f4a80103760 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.466+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 0x7f4a640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- 172.21.15.18:0/68401085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 msgr2=0x55d1b1dc2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009fd0 tx=0x7f4a780118d0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a7ea00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 0x7f4a640a5240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55d1b1dc1a40 tx=0x7f4a700d5530 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- 172.21.15.18:0/68401085 shutdown_connections 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dcd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc2890 0x55d1b1dcaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 --2- 172.21.15.18:0/68401085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc2350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- 172.21.15.18:0/68401085 >> 172.21.15.18:0/68401085 conn(0x55d1b1dbc6a0 msgr2=0x55d1b1dbca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- 172.21.15.18:0/68401085 shutdown_connections 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- 172.21.15.18:0/68401085 wait complete. 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.467+0000 7f4a88b97740 1 -- start start 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 Processor -- start 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dcb470 0x55d1b1dc8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1dce260 con 0x55d1b1dc1f70 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1ce1d80 con 0x55d1b1dc2890 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d1b1dce3e0 con 0x55d1b1dcb470 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a88b97740 10 client.0 _ll_register_callbacks cb 0x55d1b1d1e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a76000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a76000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36184/0 (socket says 172.21.15.18:36184) 2024-04-21T22:39:13.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.468+0000 7f4a76000640 1 -- 172.21.15.18:0/2821496384 learned_addr learned my addr 172.21.15.18:0/2821496384 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a7f400640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dcb470 0x55d1b1dc8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 -- 172.21.15.18:0/2821496384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dcb470 msgr2=0x55d1b1dc8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dcb470 0x55d1b1dc8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 -- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 msgr2=0x55d1b1dc8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 -- 172.21.15.18:0/2821496384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1b1b047d0 con 0x55d1b1dc2890 2024-04-21T22:39:13.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a76000640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2df607a030fce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.469+0000 7f4a6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68039040 con 0x55d1b1dc2890 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a78004050 con 0x55d1b1dc2890 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4a68034640 con 0x55d1b1dc2890 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4a68050050 con 0x55d1b1dc2890 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a88b97740 10 client.26726 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:13.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d1b1dda560 con 0x55d1b1dc2890 2024-04-21T22:39:13.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.470+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a78004050 con 0x55d1b1dc2890 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4a68047070 con 0x55d1b1dc2890 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 10 client.26726 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 10 client.26726 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 20 client.26726 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1ddb970 0x55d1b1dddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 4 client.26726 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1b1d338e0 con 0x55d1b1ddb970 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.471+0000 7f4a7f400640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1ddb970 0x55d1b1dddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.472+0000 7f4a7f400640 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1ddb970 0x55d1b1dddda0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb13a2289fabae88 server_cookie=b09b1128669d718d in_seq=0 out_seq=0 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.472+0000 7f4a6cc00640 10 client.26726 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.472+0000 7f4a6cc00640 1 -- 172.21.15.18:0/2821496384 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d1b1d338e0 con 0x55d1b1ddb970 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.472+0000 7f4a6cc00640 10 client.26726 handle_command_reply: tid=0 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 client.26726 shutdown 2024-04-21T22:39:13.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 msgr2=0x55d1b1dc89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68004580 comp rx=0 tx=0).stop 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 shutdown_connections 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1ddb970 0x55d1b1dddda0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dcb470 0x55d1b1dc8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc2890 0x55d1b1dc89d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a6cc00640 0 client.26726 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 --2- 172.21.15.18:0/2821496384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dc8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 >> 172.21.15.18:0/2821496384 conn(0x55d1b1dbc6a0 msgr2=0x55d1b1dbe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 shutdown_connections 2024-04-21T22:39:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 1 -- 172.21.15.18:0/2821496384 wait complete. 2024-04-21T22:39:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.473+0000 7f4a88b97740 20 client.26726 trim_cache size 0 max 16384 2024-04-21T22:39:13.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.488+0000 7f4a88b97740 1 Processor -- start 2024-04-21T22:39:13.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.488+0000 7f4a88b97740 1 -- start start 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dcabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801af550 con 0x55d1b1dcb470 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801b1090 con 0x55d1b1dc1f70 2024-04-21T22:39:13.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a88b97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801afc20 con 0x55d1b1dc2890 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57670/0 (socket says 172.21.15.18:57670) 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 -- 172.21.15.18:0/1559001582 learned_addr learned my addr 172.21.15.18:0/1559001582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dcabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a76000640 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 -- 172.21.15.18:0/1559001582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 msgr2=0x55d1b1dd7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 -- 172.21.15.18:0/1559001582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc1f70 msgr2=0x55d1b1dcabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dcabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.489+0000 7f4a7f400640 1 -- 172.21.15.18:0/1559001582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1b1dc26c0 con 0x55d1b1dcb470 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.490+0000 7f4a7f400640 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a78004970 tx=0x7f4a78005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcbe623ffc2751 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.490+0000 7f4a6f400640 1 -- 172.21.15.18:0/1559001582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7802f3d0 con 0x55d1b1dcb470 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.490+0000 7f4a6f400640 1 -- 172.21.15.18:0/1559001582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a78009b50 con 0x55d1b1dcb470 2024-04-21T22:39:13.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.490+0000 7f4a6f400640 1 -- 172.21.15.18:0/1559001582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800fdb0 con 0x55d1b1dcb470 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- 172.21.15.18:0/1559001582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 msgr2=0x55d1b1de3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a78004970 tx=0x7f4a78005bd0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- 172.21.15.18:0/1559001582 shutdown_connections 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dcb470 0x55d1b1de3670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 --2- 172.21.15.18:0/1559001582 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dcabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- 172.21.15.18:0/1559001582 >> 172.21.15.18:0/1559001582 conn(0x55d1b1dbc6a0 msgr2=0x55d1b1dbb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- 172.21.15.18:0/1559001582 shutdown_connections 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- 172.21.15.18:0/1559001582 wait complete. 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 -- start start 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.491+0000 7f4a88b97740 1 Processor -- start 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dd0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801b09c0 con 0x55d1b1dc1f70 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801b02f0 con 0x55d1b1dcb470 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a801ad530 con 0x55d1b1dc2890 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a88b97740 10 client.0 _ll_register_callbacks cb 0x7f4a780093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a7f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57686/0 (socket says 172.21.15.18:57686) 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a7f400640 1 -- 172.21.15.18:0/865136446 learned_addr learned my addr 172.21.15.18:0/865136446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a76000640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.492+0000 7f4a7f400640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dd0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 -- 172.21.15.18:0/865136446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 msgr2=0x55d1b1dd3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 -- 172.21.15.18:0/865136446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 msgr2=0x55d1b1dd0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dd0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 -- 172.21.15.18:0/865136446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1b1dd0e00 con 0x55d1b1dc1f70 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a7f400640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4a7802ffd0 tx=0x7f4a78005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10679ed1c46dbfe server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800fa30 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4a7800fbd0 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.493+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a78009b50 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4a7800fdf0 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 10 client.16659 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d1b1e42930 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a78009b50 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4a78025040 con 0x55d1b1dc1f70 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 10 client.16659 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 10 client.16659 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 20 client.16659 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1e42d00 0x55d1b1e450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 4 client.16659 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1b1d2dc30 con 0x55d1b1e42d00 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.494+0000 7f4a76000640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1e42d00 0x55d1b1e450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a76000640 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1e42d00 0x55d1b1e450f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13d7ba4b20b090af server_cookie=9f3cadc41478372f in_seq=0 out_seq=0 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a6cc00640 10 client.16659 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:13.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a6cc00640 1 -- 172.21.15.18:0/865136446 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1b1d2dc30 con 0x55d1b1e42d00 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a6cc00640 10 client.16659 handle_command_reply: tid=0 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a88b97740 1 client.16659 shutdown 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 msgr2=0x55d1b1dd3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.495+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4a7802ffd0 tx=0x7f4a78005c40 comp rx=0 tx=0).stop 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 shutdown_connections 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d1b1e42d00 0x55d1b1e450f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d1b1dcb470 0x55d1b1dd0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d1b1dc2890 0x55d1b1dd3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a6cc00640 0 client.16659 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 --2- 172.21.15.18:0/865136446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1b1dc1f70 0x55d1b1dd3660 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 >> 172.21.15.18:0/865136446 conn(0x55d1b1dbc6a0 msgr2=0x55d1b1dbae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 shutdown_connections 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 1 -- 172.21.15.18:0/865136446 wait complete. 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.496+0000 7f4a88b97740 20 client.16659 trim_cache size 0 max 16384 2024-04-21T22:39:13.504 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:13.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 msgr2=0x7f4a640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 0x7f4a640a5240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55d1b1dc1a40 tx=0x7f4a700d5530 comp rx=0 tx=0).stop 2024-04-21T22:39:13.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 msgr2=0x7f4a8019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000e9c0 tx=0x7f4a7000ee80 comp rx=0 tx=0).stop 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 shutdown_connections 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4a640a2d80 0x7f4a640a5240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a80109770 0x7f4a8019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a80104120 0x7f4a8019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 --2- 172.21.15.18:0/1084285464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a80103760 0x7f4a8019a080 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 >> 172.21.15.18:0/1084285464 conn(0x7f4a800ff230 msgr2=0x7f4a800ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 shutdown_connections 2024-04-21T22:39:13.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.497+0000 7f4a7fe00640 1 -- 172.21.15.18:0/1084285464 wait complete. 2024-04-21T22:39:13.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:13 smithi018 ceph-mon[26614]: pgmap v158: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:13.513 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:13 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4259549319' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:13.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:39:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:13 smithi081 ceph-mon[31692]: pgmap v158: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:13.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:13 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4259549319' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:13 smithi047 ceph-mon[31561]: pgmap v158: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:39:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:13 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4259549319' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 -- 172.21.15.18:0/996454291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 msgr2=0x7f5da8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 --2- 172.21.15.18:0/996454291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da8109d10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009930 tx=0x7f5d9802bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 -- 172.21.15.18:0/996454291 shutdown_connections 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 --2- 172.21.15.18:0/996454291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da81107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 --2- 172.21.15.18:0/996454291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 0x7f5da8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 --2- 172.21.15.18:0/996454291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da8109d10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.721+0000 7f5daea00640 1 -- 172.21.15.18:0/996454291 >> 172.21.15.18:0/996454291 conn(0x7f5da80ff3b0 msgr2=0x7f5da81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.722+0000 7f5daea00640 1 -- 172.21.15.18:0/996454291 shutdown_connections 2024-04-21T22:39:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.722+0000 7f5daea00640 1 -- 172.21.15.18:0/996454291 wait complete. 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 Processor -- start 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 -- start start 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 0x7f5da819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8113d90 con 0x7f5da8109930 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8113c10 con 0x7f5da81042e0 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8113f10 con 0x7f5da8103920 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57690/0 (socket says 172.21.15.18:57690) 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5daca00640 1 -- 172.21.15.18:0/3775356314 learned_addr learned my addr 172.21.15.18:0/3775356314 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.723+0000 7f5da7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 0x7f5da819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5d9f400640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 -- 172.21.15.18:0/3775356314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 msgr2=0x7f5da819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 0x7f5da819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 -- 172.21.15.18:0/3775356314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 msgr2=0x7f5da819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 -- 172.21.15.18:0/3775356314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da819f300 con 0x7f5da8109930 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5d9f400640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.724+0000 7f5daca00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009fd0 tx=0x7f5da000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.725+0000 7f5da5600640 1 -- 172.21.15.18:0/3775356314 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0017070 con 0x7f5da8109930 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.725+0000 7f5da5600640 1 -- 172.21.15.18:0/3775356314 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5da0003e50 con 0x7f5da8109930 2024-04-21T22:39:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.725+0000 7f5da5600640 1 -- 172.21.15.18:0/3775356314 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da00106c0 con 0x7f5da8109930 2024-04-21T22:39:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.725+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da819f5f0 con 0x7f5da8109930 2024-04-21T22:39:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.725+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da81a6e80 con 0x7f5da8109930 2024-04-21T22:39:13.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.728+0000 7f5db17bf740 1 Processor -- start 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.728+0000 7f5da5600640 1 -- 172.21.15.18:0/3775356314 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5da0003970 con 0x7f5da8109930 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 -- start start 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280ba2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560280afb3a0 con 0x560280b96d80 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560280aa3930 con 0x560280b976a0 2024-04-21T22:39:13.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5db17bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560280af7360 con 0x560280ba0280 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5d9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.729+0000 7f5d9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57706/0 (socket says 172.21.15.18:57706) 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 -- 172.21.15.18:0/1032129397 learned_addr learned my addr 172.21.15.18:0/1032129397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5da7e00640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280ba2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 -- 172.21.15.18:0/1032129397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 msgr2=0x560280ba2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280ba2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 -- 172.21.15.18:0/1032129397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 msgr2=0x560280b9fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 -- 172.21.15.18:0/1032129397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028080f3f0 con 0x560280b96d80 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5da7e00640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5da5600640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 0x7f5d8c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.730+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d90013590 tx=0x7f5d900097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae29d9abc2943a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.731+0000 7f5da5600640 1 -- 172.21.15.18:0/3775356314 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5da00cf180 con 0x7f5da8109930 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.731+0000 7f5d9d200640 1 -- 172.21.15.18:0/1032129397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f520 con 0x560280b96d80 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.731+0000 7f5da7e00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 0x7f5d8c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.731+0000 7f5d9d200640 1 -- 172.21.15.18:0/1032129397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9000fba0 con 0x560280b96d80 2024-04-21T22:39:13.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.731+0000 7f5d9d200640 1 -- 172.21.15.18:0/1032129397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900119d0 con 0x560280b96d80 2024-04-21T22:39:13.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5da7e00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 0x7f5d8c0a51c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009900 tx=0x7f5d9802df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- 172.21.15.18:0/1032129397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 msgr2=0x560280b97160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d90013590 tx=0x7f5d900097d0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- 172.21.15.18:0/1032129397 shutdown_connections 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280ba2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1032129397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b97160 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- 172.21.15.18:0/1032129397 >> 172.21.15.18:0/1032129397 conn(0x560280b914b0 msgr2=0x560280b91890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- 172.21.15.18:0/1032129397 shutdown_connections 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- 172.21.15.18:0/1032129397 wait complete. 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.732+0000 7f5db17bf740 1 -- start start 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 Processor -- start 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280b9dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560280ba3070 con 0x560280b96d80 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560280ab6d80 con 0x560280b976a0 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560280ba31f0 con 0x560280ba0280 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5db17bf740 10 client.0 _ll_register_callbacks cb 0x560280af32b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5da7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5da7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57716/0 (socket says 172.21.15.18:57716) 2024-04-21T22:39:13.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5da7e00640 1 -- 172.21.15.18:0/2267613289 learned_addr learned my addr 172.21.15.18:0/2267613289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.733+0000 7f5daca00640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280b9dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 -- 172.21.15.18:0/2267613289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 msgr2=0x560280b9dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280b9dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 -- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 msgr2=0x560280b9d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 -- 172.21.15.18:0/2267613289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602808d97d0 con 0x560280b96d80 2024-04-21T22:39:13.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d980096c0 tx=0x7f5d98009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d60f7265cb88ca server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5d95600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.734+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98050070 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5d98004ee0 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d9000fba0 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5d98046070 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5db17bf740 10 client.16671 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560280baf390 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.735+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d9000fba0 con 0x560280b96d80 2024-04-21T22:39:13.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5d98003a30 con 0x560280b96d80 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 10 client.16671 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 10 client.16671 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 20 client.16671 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280bb07a0 0x560280bb2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 4 client.16671 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560280b088e0 con 0x560280bb07a0 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.736+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280bb07a0 0x560280bb2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.737+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280bb07a0 0x560280bb2b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd86c92b81eadccb server_cookie=68e8ea8503578d4d in_seq=0 out_seq=0 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.737+0000 7f5d95600640 10 client.16671 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5d95600640 1 -- 172.21.15.18:0/2267613289 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560280b088e0 con 0x560280bb07a0 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5d95600640 10 client.16671 handle_command_reply: tid=0 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 client.16671 shutdown 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 msgr2=0x560280b9d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d980096c0 tx=0x7f5d98009260 comp rx=0 tx=0).stop 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 shutdown_connections 2024-04-21T22:39:13.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280bb07a0 0x560280bb2b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280ba0280 0x560280b9dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280b976a0 0x560280b9d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5d95600640 0 client.16671 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2267613289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280b9d2c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 >> 172.21.15.18:0/2267613289 conn(0x560280b914b0 msgr2=0x560280b93200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 shutdown_connections 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 1 -- 172.21.15.18:0/2267613289 wait complete. 2024-04-21T22:39:13.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.738+0000 7f5db17bf740 20 client.16671 trim_cache size 0 max 16384 2024-04-21T22:39:13.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 Processor -- start 2024-04-21T22:39:13.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 -- start start 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 0x560280babf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280bb8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81af770 con 0x560280b976a0 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81b12b0 con 0x560280ba0280 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.754+0000 7f5db17bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81afe40 con 0x560280b96d80 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57718/0 (socket says 172.21.15.18:57718) 2024-04-21T22:39:13.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 -- 172.21.15.18:0/1104889278 learned_addr learned my addr 172.21.15.18:0/1104889278 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5da7e00640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 0x560280babf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5daca00640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280bb8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 -- 172.21.15.18:0/1104889278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 msgr2=0x560280babf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 0x560280babf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 -- 172.21.15.18:0/1104889278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 msgr2=0x560280bb8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280bb8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5d9f400640 1 -- 172.21.15.18:0/1104889278 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560280ba29e0 con 0x560280b976a0 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5da7e00640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 0x560280babf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.755+0000 7f5daca00640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280bb8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.756+0000 7f5d9f400640 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d90013ee0 tx=0x7f5d90013400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce44d3d5584ee049 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.756+0000 7f5d97e00640 1 -- 172.21.15.18:0/1104889278 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90005040 con 0x560280b976a0 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.756+0000 7f5d97e00640 1 -- 172.21.15.18:0/1104889278 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d90004660 con 0x560280b976a0 2024-04-21T22:39:13.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.756+0000 7f5d97e00640 1 -- 172.21.15.18:0/1104889278 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90011880 con 0x560280b976a0 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- 172.21.15.18:0/1104889278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 msgr2=0x560280b90510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d90013ee0 tx=0x7f5d90013400 comp rx=0 tx=0).stop 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- 172.21.15.18:0/1104889278 shutdown_connections 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280bb8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b976a0 0x560280b90510 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 --2- 172.21.15.18:0/1104889278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b96d80 0x560280babf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- 172.21.15.18:0/1104889278 >> 172.21.15.18:0/1104889278 conn(0x560280b914b0 msgr2=0x560280b8fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- 172.21.15.18:0/1104889278 shutdown_connections 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- 172.21.15.18:0/1104889278 wait complete. 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 -- start start 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.757+0000 7f5db17bf740 1 Processor -- start 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b976a0 0x560280ba89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280ba5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81b0be0 con 0x560280b96d80 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81b0510 con 0x560280ba0280 2024-04-21T22:39:13.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81ad750 con 0x560280b976a0 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5db17bf740 10 client.0 _ll_register_callbacks cb 0x7f5d98005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5da7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5da7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57720/0 (socket says 172.21.15.18:57720) 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5da7e00640 1 -- 172.21.15.18:0/2967429402 learned_addr learned my addr 172.21.15.18:0/2967429402 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b976a0 0x560280ba89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5daca00640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280ba5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.758+0000 7f5da7e00640 1 -- 172.21.15.18:0/2967429402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b976a0 msgr2=0x560280ba89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b976a0 0x560280ba89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5da7e00640 1 -- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 msgr2=0x560280ba5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280ba5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5da7e00640 1 -- 172.21.15.18:0/2967429402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560280ba5c10 con 0x560280b96d80 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5da7e00640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006010 tx=0x7f5d9805ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d4d407c2419c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5d95600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98050040 con 0x560280b96d80 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f5d98003fa0 con 0x560280b96d80 2024-04-21T22:39:13.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d90004660 con 0x560280b96d80 2024-04-21T22:39:13.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5d98004d10 con 0x560280b96d80 2024-04-21T22:39:13.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.759+0000 7f5db17bf740 10 client.16677 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:13.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560280c176f0 con 0x560280b96d80 2024-04-21T22:39:13.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d90004660 con 0x560280b96d80 2024-04-21T22:39:13.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5d98005450 con 0x560280b96d80 2024-04-21T22:39:13.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 10 client.16677 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:13.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 10 client.16677 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:39:13.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 20 client.16677 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280c17e20 0x560280c1a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 4 client.16677 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.760+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560280b02c30 con 0x560280c17e20 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.761+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280c17e20 0x560280c1a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.761+0000 7f5d9f400640 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280c17e20 0x560280c1a240 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=938b6dfaff98637 server_cookie=b123916667b23e05 in_seq=0 out_seq=0 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.761+0000 7f5d95600640 10 client.16677 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5d95600640 1 -- 172.21.15.18:0/2967429402 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560280b02c30 con 0x560280c17e20 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5d95600640 10 client.16677 handle_command_reply: tid=0 2024-04-21T22:39:13.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 client.16677 shutdown 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 msgr2=0x560280ba8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006010 tx=0x7f5d9805ec50 comp rx=0 tx=0).stop 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 shutdown_connections 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x560280c17e20 0x560280c1a240 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560280ba0280 0x560280ba5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560280b976a0 0x560280ba89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 --2- 172.21.15.18:0/2967429402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560280b96d80 0x560280ba8470 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5d95600640 0 client.16677 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:13.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 >> 172.21.15.18:0/2967429402 conn(0x560280b914b0 msgr2=0x560280b9d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 shutdown_connections 2024-04-21T22:39:13.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 1 -- 172.21.15.18:0/2967429402 wait complete. 2024-04-21T22:39:13.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.762+0000 7f5db17bf740 20 client.16677 trim_cache size 0 max 16384 2024-04-21T22:39:13.771 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 msgr2=0x7f5d8c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 0x7f5d8c0a51c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009900 tx=0x7f5d9802df90 comp rx=0 tx=0).stop 2024-04-21T22:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 msgr2=0x7f5da819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009fd0 tx=0x7f5da000b260 comp rx=0 tx=0).stop 2024-04-21T22:39:13.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 shutdown_connections 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5d8c0a2d00 0x7f5d8c0a51c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5da8109930 0x7f5da819ebd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81042e0 0x7f5da819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 --2- 172.21.15.18:0/3775356314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5da8103920 0x7f5da819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 >> 172.21.15.18:0/3775356314 conn(0x7f5da80ff3b0 msgr2=0x7f5da80ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 shutdown_connections 2024-04-21T22:39:13.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:13.763+0000 7f5daea00640 1 -- 172.21.15.18:0/3775356314 wait complete. 2024-04-21T22:39:13.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:39:14.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1532226619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 msgr2=0x7f1ecc109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1532226619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc109b50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009930 tx=0x7f1ebc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1532226619 shutdown_connections 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1532226619 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1532226619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1532226619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc109b50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.001+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1532226619 >> 172.21.15.18:0/1532226619 conn(0x7f1ecc0ff230 msgr2=0x7f1ecc101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.002+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1532226619 shutdown_connections 2024-04-21T22:39:14.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.002+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1532226619 wait complete. 2024-04-21T22:39:14.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.003+0000 7f1ed1a00640 1 Processor -- start 2024-04-21T22:39:14.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.003+0000 7f1ed1a00640 1 -- start start 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc113b40 con 0x7f1ecc109770 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1139c0 con 0x7f1ecc104120 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc113cc0 con 0x7f1ecc103760 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:39948/0 (socket says 172.21.15.18:39948) 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ecbe00640 1 -- 172.21.15.18:0/1779155585 learned_addr learned my addr 172.21.15.18:0/1779155585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ecb400640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.004+0000 7f1ecbe00640 1 -- 172.21.15.18:0/1779155585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 msgr2=0x7f1ecc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecbe00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecbe00640 1 -- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 msgr2=0x7f1ecc19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecbe00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecbe00640 1 -- 172.21.15.18:0/1779155585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc19f050 con 0x7f1ecc103760 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecb400640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:14.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ecbe00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009230 tx=0x7f1ebc02cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ec8c00640 1 -- 172.21.15.18:0/1779155585 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc041070 con 0x7f1ecc103760 2024-04-21T22:39:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc19f2e0 con 0x7f1ecc103760 2024-04-21T22:39:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ec8c00640 1 -- 172.21.15.18:0/1779155585 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc004450 con 0x7f1ecc103760 2024-04-21T22:39:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.005+0000 7f1ec8c00640 1 -- 172.21.15.18:0/1779155585 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003e50 con 0x7f1ecc103760 2024-04-21T22:39:14.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.006+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc1a6bd0 con 0x7f1ecc103760 2024-04-21T22:39:14.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 Processor -- start 2024-04-21T22:39:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 -- start start 2024-04-21T22:39:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b71f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b74860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562585acd3a0 con 0x562585b72470 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.010+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562585a75930 con 0x562585b68f70 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562585ac9360 con 0x562585b69890 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ec8c00640 1 -- 172.21.15.18:0/1779155585 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1ebc044070 con 0x7f1ecc103760 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ecb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b74860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ecbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b71f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ecb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b74860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57746/0 (socket says 172.21.15.18:57746) 2024-04-21T22:39:14.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ecb400640 1 -- 172.21.15.18:0/3682792182 learned_addr learned my addr 172.21.15.18:0/3682792182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36288/0 (socket says 172.21.15.18:36288) 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 -- 172.21.15.18:0/3682792182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 msgr2=0x562585b71f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b71f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 -- 172.21.15.18:0/3682792182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 msgr2=0x562585b74860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b74860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.011+0000 7f1ed1000640 1 -- 172.21.15.18:0/3682792182 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625857e13f0 con 0x562585b68f70 2024-04-21T22:39:14.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009f00 tx=0x7f1ec4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e6ad80977832d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ec1600640 1 -- 172.21.15.18:0/3682792182 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4004d20 con 0x562585b68f70 2024-04-21T22:39:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ec1600640 1 -- 172.21.15.18:0/3682792182 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4004050 con 0x562585b68f70 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ec1600640 1 -- 172.21.15.18:0/3682792182 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4005280 con 0x562585b68f70 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ec8c00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 0x7f1eb00a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.012+0000 7f1ec8c00640 1 -- 172.21.15.18:0/1779155585 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1ebc0f0c60 con 0x7f1ecc103760 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ecbe00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 0x7f1eb00a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3682792182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 msgr2=0x562585b69350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009f00 tx=0x7f1ec4011810 comp rx=0 tx=0).stop 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3682792182 shutdown_connections 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b74860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b71f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3682792182 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b69350 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3682792182 >> 172.21.15.18:0/3682792182 conn(0x562585b636a0 msgr2=0x562585b63a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3682792182 shutdown_connections 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3682792182 wait complete. 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.013+0000 7f1ecbe00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 0x7f1eb00a5360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0ee570 tx=0x7f1ebc0dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 -- start start 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 Processor -- start 2024-04-21T22:39:14.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b68f70 0x562585b6f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b6ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562585b75260 con 0x562585b72470 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562585a88d80 con 0x562585b69890 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562585b753e0 con 0x562585b68f70 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.014+0000 7f1ed5c22740 10 client.0 _ll_register_callbacks cb 0x562585ac52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b6ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b6ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57760/0 (socket says 172.21.15.18:57760) 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ed1000640 1 -- 172.21.15.18:0/2652224254 learned_addr learned my addr 172.21.15.18:0/2652224254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b68f70 0x562585b6f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 -- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b68f70 msgr2=0x562585b6f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b68f70 0x562585b6f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 -- 172.21.15.18:0/2652224254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 msgr2=0x562585b6ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b6ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 -- 172.21.15.18:0/2652224254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625858ab7d0 con 0x562585b69890 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.015+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6fa00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80126d0 tx=0x7f1eb8012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e4bb61540323f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1eb6000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8004320 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec4004050 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1eb80119a0 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1eb80044c0 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1ed5c22740 10 client.26762 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562585b815d0 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.016+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4004050 con 0x562585b69890 2024-04-21T22:39:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f1eb8025480 con 0x562585b69890 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 10 client.26762 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 10 client.26762 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 20 client.26762 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585b829e0 0x562585b84e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 4 client.26762 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562585ada8e0 con 0x562585b829e0 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.017+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585b829e0 0x562585b84e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.018+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585b829e0 0x562585b84e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8583345cbc171f server_cookie=ce5b4ed15fbd6138 in_seq=0 out_seq=0 2024-04-21T22:39:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.018+0000 7f1eb6000640 10 client.26762 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1eb6000640 1 -- 172.21.15.18:0/2652224254 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562585ada8e0 con 0x562585b829e0 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1eb6000640 10 client.26762 handle_command_reply: tid=0 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 client.26762 shutdown 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 msgr2=0x562585b6fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6fa00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80126d0 tx=0x7f1eb8012b90 comp rx=0 tx=0).stop 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 shutdown_connections 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585b829e0 0x562585b84e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b6ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6fa00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1eb6000640 0 client.26762 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2652224254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b68f70 0x562585b6f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 >> 172.21.15.18:0/2652224254 conn(0x562585b636a0 msgr2=0x562585b653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 shutdown_connections 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2652224254 wait complete. 2024-04-21T22:39:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.019+0000 7f1ed5c22740 20 client.26762 trim_cache size 0 max 16384 2024-04-21T22:39:14.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 Processor -- start 2024-04-21T22:39:14.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 -- start start 2024-04-21T22:39:14.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b7e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1af510 con 0x562585b72470 2024-04-21T22:39:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b1050 con 0x562585b68f70 2024-04-21T22:39:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.034+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1afbe0 con 0x562585b69890 2024-04-21T22:39:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57764/0 (socket says 172.21.15.18:57764) 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 -- 172.21.15.18:0/3672917901 learned_addr learned my addr 172.21.15.18:0/3672917901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ecb400640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b7e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 -- 172.21.15.18:0/3672917901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 msgr2=0x562585b6fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b6fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 -- 172.21.15.18:0/3672917901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 msgr2=0x562585b7e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b7e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ed1000640 1 -- 172.21.15.18:0/3672917901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562585b5dae0 con 0x562585b72470 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.035+0000 7f1ecb400640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.036+0000 7f1ed1000640 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009bb0 tx=0x7f1ec4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb22b3ab7cc8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.036+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3672917901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003ae0 con 0x562585b72470 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.036+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3672917901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4004530 con 0x562585b72470 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.036+0000 7f1ec0c00640 1 -- 172.21.15.18:0/3672917901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4028850 con 0x562585b72470 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3672917901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 msgr2=0x562585b8a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009bb0 tx=0x7f1ec4009500 comp rx=0 tx=0).stop 2024-04-21T22:39:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3672917901 shutdown_connections 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b72470 0x562585b8a6b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b69890 0x562585b6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/3672917901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b68f70 0x562585b7e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3672917901 >> 172.21.15.18:0/3672917901 conn(0x562585b636a0 msgr2=0x562585b62690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3672917901 shutdown_connections 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- 172.21.15.18:0/3672917901 wait complete. 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.037+0000 7f1ed5c22740 1 -- start start 2024-04-21T22:39:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 Processor -- start 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 0x562585b6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b72470 0x562585b6ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b0980 con 0x562585b68f70 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1b02b0 con 0x562585b69890 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1ad4f0 con 0x562585b72470 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed5c22740 10 client.0 _ll_register_callbacks cb 0x7f1eb8009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 0x562585b6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 0x562585b6bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57770/0 (socket says 172.21.15.18:57770) 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.038+0000 7f1ed1000640 1 -- 172.21.15.18:0/2058553918 learned_addr learned my addr 172.21.15.18:0/2058553918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b72470 0x562585b6ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 -- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b72470 msgr2=0x562585b6ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b72470 0x562585b6ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 -- 172.21.15.18:0/2058553918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 msgr2=0x562585b6bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 0x562585b6bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 -- 172.21.15.18:0/2058553918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562585be7f20 con 0x562585b69890 2024-04-21T22:39:14.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1ecb400640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6c510 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8025a10 tx=0x7f1eb80095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef9db1a2f5a01b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.039+0000 7f1eb6000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb802b070 con 0x562585b69890 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec4004530 con 0x562585b69890 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1eb8011bb0 con 0x562585b69890 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1eb803e050 con 0x562585b69890 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1ed5c22740 10 client.26768 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562585be90e0 con 0x562585b69890 2024-04-21T22:39:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec4004530 con 0x562585b69890 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.040+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f1eb8030440 con 0x562585b69890 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 10 client.26768 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 10 client.26768 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 20 client.26768 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585be97f0 0x562585bebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 4 client.26768 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562585ad4c30 con 0x562585be97f0 2024-04-21T22:39:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585be97f0 0x562585bebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1ed1000640 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585be97f0 0x562585bebc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52297238756f48b5 server_cookie=aba00a22817552b5 in_seq=0 out_seq=0 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.041+0000 7f1eb6000640 10 client.26768 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1eb6000640 1 -- 172.21.15.18:0/2058553918 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562585ad4c30 con 0x562585be97f0 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1eb6000640 10 client.26768 handle_command_reply: tid=0 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 client.26768 shutdown 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 msgr2=0x562585b6c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6c510 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8025a10 tx=0x7f1eb80095b0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 shutdown_connections 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x562585be97f0 0x562585bebc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562585b72470 0x562585b6ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x562585b69890 0x562585b6c510 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1eb6000640 0 client.26768 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 --2- 172.21.15.18:0/2058553918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562585b68f70 0x562585b6bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 >> 172.21.15.18:0/2058553918 conn(0x562585b636a0 msgr2=0x562585b64a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 shutdown_connections 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 1 -- 172.21.15.18:0/2058553918 wait complete. 2024-04-21T22:39:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.042+0000 7f1ed5c22740 20 client.26768 trim_cache size 0 max 16384 2024-04-21T22:39:14.052 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 msgr2=0x7f1eb00a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 0x7f1eb00a5360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0ee570 tx=0x7f1ebc0dd040 comp rx=0 tx=0).stop 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 msgr2=0x7f1ecc19a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009230 tx=0x7f1ebc02cb30 comp rx=0 tx=0).stop 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 shutdown_connections 2024-04-21T22:39:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1eb00a2ea0 0x7f1eb00a5360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ecc109770 0x7f1ecc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ecc104120 0x7f1ecc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 --2- 172.21.15.18:0/1779155585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ecc103760 0x7f1ecc19a060 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 >> 172.21.15.18:0/1779155585 conn(0x7f1ecc0ff230 msgr2=0x7f1ecc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 shutdown_connections 2024-04-21T22:39:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.043+0000 7f1ed1a00640 1 -- 172.21.15.18:0/1779155585 wait complete. 2024-04-21T22:39:14.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:39:14.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 -- 172.21.15.18:0/306905532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 msgr2=0x7fe5f010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 --2- 172.21.15.18:0/306905532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f010dfe0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009890 tx=0x7fe5e002bb70 comp rx=0 tx=0).stop 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 -- 172.21.15.18:0/306905532 shutdown_connections 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 --2- 172.21.15.18:0/306905532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0108640 0x7fe5f01149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 --2- 172.21.15.18:0/306905532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0107c80 0x7fe5f0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 --2- 172.21.15.18:0/306905532 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f010dfe0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 -- 172.21.15.18:0/306905532 >> 172.21.15.18:0/306905532 conn(0x7fe5f0077550 msgr2=0x7fe5f0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 -- 172.21.15.18:0/306905532 shutdown_connections 2024-04-21T22:39:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.277+0000 7fe5efe00640 1 -- 172.21.15.18:0/306905532 wait complete. 2024-04-21T22:39:14.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.278+0000 7fe5efe00640 1 Processor -- start 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.278+0000 7fe5efe00640 1 -- start start 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f01a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0117f40 con 0x7fe5f0108640 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0117dc0 con 0x7fe5f010dc00 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5efe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01180c0 con 0x7fe5f0107c80 2024-04-21T22:39:14.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5ee000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5eea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5ee000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57782/0 (socket says 172.21.15.18:57782) 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5eea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40016/0 (socket says 172.21.15.18:40016) 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5ee000640 1 -- 172.21.15.18:0/1743377854 learned_addr learned my addr 172.21.15.18:0/1743377854 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.279+0000 7fe5ef400640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f01a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 -- 172.21.15.18:0/1743377854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 msgr2=0x7fe5f01a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f01a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 -- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 msgr2=0x7fe5f019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 -- 172.21.15.18:0/1743377854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f01a33d0 con 0x7fe5f0107c80 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5ee000640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5eea00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00057c0 tx=0x7fe5e0004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5e7400640 1 -- 172.21.15.18:0/1743377854 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0041020 con 0x7fe5f0107c80 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5e7400640 1 -- 172.21.15.18:0/1743377854 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e002c9f0 con 0x7fe5f0107c80 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5e7400640 1 -- 172.21.15.18:0/1743377854 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0039040 con 0x7fe5f0107c80 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.280+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f01a3660 con 0x7fe5f0107c80 2024-04-21T22:39:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.281+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f01aaf50 con 0x7fe5f0107c80 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 Processor -- start 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5e7400640 1 -- 172.21.15.18:0/1743377854 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe5e0044020 con 0x7fe5f0107c80 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 -- start start 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5340860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55edc52993a0 con 0x55edc5335890 2024-04-21T22:39:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55edc5241930 con 0x55edc533e470 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5f857d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edc5295360 con 0x55edc5334f70 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.284+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40032/0 (socket says 172.21.15.18:40032) 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 -- 172.21.15.18:0/2133370291 learned_addr learned my addr 172.21.15.18:0/2133370291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ee000640 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5340860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 -- 172.21.15.18:0/2133370291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 msgr2=0x55edc5340860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5340860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 -- 172.21.15.18:0/2133370291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 msgr2=0x55edc533df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 -- 172.21.15.18:0/2133370291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc4fad3f0 con 0x55edc5334f70 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009fd0 tx=0x7fe5e80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5ae0293efa131eb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.285+0000 7fe5dbe00640 1 -- 172.21.15.18:0/2133370291 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8004d20 con 0x55edc5334f70 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5dbe00640 1 -- 172.21.15.18:0/2133370291 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e8004050 con 0x55edc5334f70 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5dbe00640 1 -- 172.21.15.18:0/2133370291 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8005260 con 0x55edc5334f70 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5e7400640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 0x7fe5d40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5e7400640 1 -- 172.21.15.18:0/1743377854 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5e00f0ad0 con 0x7fe5f0107c80 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5eea00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 0x7fe5d40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 -- 172.21.15.18:0/2133370291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 msgr2=0x55edc5335350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009fd0 tx=0x7fe5e80118d0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 -- 172.21.15.18:0/2133370291 shutdown_connections 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5340860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2133370291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5334f70 0x55edc5335350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 -- 172.21.15.18:0/2133370291 >> 172.21.15.18:0/2133370291 conn(0x55edc532f6a0 msgr2=0x55edc532fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 -- 172.21.15.18:0/2133370291 shutdown_connections 2024-04-21T22:39:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.286+0000 7fe5f857d740 1 -- 172.21.15.18:0/2133370291 wait complete. 2024-04-21T22:39:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.287+0000 7fe5eea00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 0x7fe5d40a51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00ee3e0 tx=0x7fe5e00dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.287+0000 7fe5f857d740 1 -- start start 2024-04-21T22:39:14.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.287+0000 7fe5f857d740 1 Processor -- start 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5335890 0x55edc533b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc533bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55edc5341260 con 0x55edc5334f70 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55edc5254d80 con 0x55edc5335890 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edc53413e0 con 0x55edc533e470 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5f857d740 10 client.0 _ll_register_callbacks cb 0x55edc52912b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57796/0 (socket says 172.21.15.18:57796) 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5ef400640 1 -- 172.21.15.18:0/1772856910 learned_addr learned my addr 172.21.15.18:0/1772856910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5ee000640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5335890 0x55edc533b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.288+0000 7fe5ef400640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc533bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 -- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 msgr2=0x55edc533bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc533bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 -- 172.21.15.18:0/1772856910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5335890 msgr2=0x55edc533b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5335890 0x55edc533b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 -- 172.21.15.18:0/1772856910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc50777d0 con 0x55edc5334f70 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5ef400640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8011dd0 tx=0x7fe5e8009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d3aa51c7662bd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8004610 con 0x55edc5334f70 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5e800f4e0 con 0x55edc5334f70 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.289+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5e8004050 con 0x55edc5334f70 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe5e8035050 con 0x55edc5334f70 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 10 client.16707 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55edc534d530 con 0x55edc5334f70 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5e8004050 con 0x55edc5334f70 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe5e8019810 con 0x55edc5334f70 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 10 client.16707 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 10 client.16707 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 20 client.16707 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc534e990 0x55edc5350d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 4 client.16707 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:14.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.290+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edc52a68e0 con 0x55edc534e990 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.291+0000 7fe5ee000640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc534e990 0x55edc5350d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.291+0000 7fe5ee000640 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc534e990 0x55edc5350d80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3b0088da5463a9e server_cookie=7b93e93f691eb1dc in_seq=0 out_seq=0 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.291+0000 7fe5d8c00640 10 client.16707 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5d8c00640 1 -- 172.21.15.18:0/1772856910 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55edc52a68e0 con 0x55edc534e990 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5d8c00640 10 client.16707 handle_command_reply: tid=0 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5f857d740 1 client.16707 shutdown 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 msgr2=0x55edc533b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8011dd0 tx=0x7fe5e8009c80 comp rx=0 tx=0).stop 2024-04-21T22:39:14.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.292+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 shutdown_connections 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc534e990 0x55edc5350d80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc533bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5335890 0x55edc533b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 --2- 172.21.15.18:0/1772856910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc533b4a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 >> 172.21.15.18:0/1772856910 conn(0x55edc532f6a0 msgr2=0x55edc53313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5d8c00640 0 client.16707 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 shutdown_connections 2024-04-21T22:39:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 1 -- 172.21.15.18:0/1772856910 wait complete. 2024-04-21T22:39:14.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.293+0000 7fe5f857d740 20 client.16707 trim_cache size 0 max 16384 2024-04-21T22:39:14.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 Processor -- start 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 -- start start 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 0x55edc534a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc532e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b38e0 con 0x55edc5335890 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b5420 con 0x55edc5334f70 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.308+0000 7fe5f857d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b3fb0 con 0x55edc533e470 2024-04-21T22:39:14.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 0x55edc534a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 0x55edc534a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36378/0 (socket says 172.21.15.18:36378) 2024-04-21T22:39:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ef400640 1 -- 172.21.15.18:0/852559103 learned_addr learned my addr 172.21.15.18:0/852559103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ef400640 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc532e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 -- 172.21.15.18:0/852559103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 msgr2=0x55edc532e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc532e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 -- 172.21.15.18:0/852559103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 msgr2=0x55edc534a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 0x55edc534a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 -- 172.21.15.18:0/852559103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc53356c0 con 0x55edc5335890 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.309+0000 7fe5ee000640 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533bd40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55edc5351490 tx=0x7fe5dc004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1b70071445bc5f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.310+0000 7fe5db400640 1 -- 172.21.15.18:0/852559103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0037f0 con 0x55edc5335890 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.310+0000 7fe5db400640 1 -- 172.21.15.18:0/852559103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5dc023070 con 0x55edc5335890 2024-04-21T22:39:14.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.310+0000 7fe5db400640 1 -- 172.21.15.18:0/852559103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc01e760 con 0x55edc5335890 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- 172.21.15.18:0/852559103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 msgr2=0x55edc533bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533bd40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55edc5351490 tx=0x7fe5dc004580 comp rx=0 tx=0).stop 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- 172.21.15.18:0/852559103 shutdown_connections 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc533e470 0x55edc532e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5335890 0x55edc533bd40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 --2- 172.21.15.18:0/852559103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc5334f70 0x55edc534a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- 172.21.15.18:0/852559103 >> 172.21.15.18:0/852559103 conn(0x55edc532f6a0 msgr2=0x55edc532de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- 172.21.15.18:0/852559103 shutdown_connections 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- 172.21.15.18:0/852559103 wait complete. 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 -- start start 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.311+0000 7fe5f857d740 1 Processor -- start 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 0x55edc5342580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5342ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b4d50 con 0x55edc5334f70 2024-04-21T22:39:14.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b4680 con 0x55edc533e470 2024-04-21T22:39:14.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b18c0 con 0x55edc5335890 2024-04-21T22:39:14.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5f857d740 10 client.0 _ll_register_callbacks cb 0x7fe5e00f44f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57812/0 (socket says 172.21.15.18:57812) 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5ef400640 1 -- 172.21.15.18:0/2055180939 learned_addr learned my addr 172.21.15.18:0/2055180939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5ee000640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 0x55edc5342580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.312+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5342ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 -- 172.21.15.18:0/2055180939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 msgr2=0x55edc5342ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5342ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 -- 172.21.15.18:0/2055180939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 msgr2=0x55edc5342040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 -- 172.21.15.18:0/2055180939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc53b3d60 con 0x55edc5335890 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5ee000640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 0x55edc5342580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55edc5330510 tx=0x7fe5dc009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=474ed1c6f222c844 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc02b070 con 0x55edc5335890 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe5dc005040 con 0x55edc5335890 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.313+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5dc023070 con 0x55edc5335890 2024-04-21T22:39:14.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe5dc037050 con 0x55edc5335890 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 10 client.26839 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55edc53b5010 con 0x55edc5335890 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5dc023070 con 0x55edc5335890 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe5dc0035f0 con 0x55edc5335890 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 10 client.26839 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 10 client.26839 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 20 client.26839 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc53b5650 0x55edc53b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 4 client.26839 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:14.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edc52a0c30 con 0x55edc53b5650 2024-04-21T22:39:14.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.314+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc53b5650 0x55edc53b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5ef400640 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc53b5650 0x55edc53b7a70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98d351d14ff6435d server_cookie=3ca7543a287909ed in_seq=0 out_seq=0 2024-04-21T22:39:14.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5d8c00640 10 client.26839 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:14.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5d8c00640 1 -- 172.21.15.18:0/2055180939 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edc52a0c30 con 0x55edc53b5650 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5d8c00640 10 client.26839 handle_command_reply: tid=0 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 client.26839 shutdown 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 msgr2=0x55edc5342580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 0x55edc5342580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55edc5330510 tx=0x7fe5dc009d80 comp rx=0 tx=0).stop 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 shutdown_connections 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55edc53b5650 0x55edc53b7a70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55edc533e470 0x55edc5342ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edc5335890 0x55edc5342580 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 --2- 172.21.15.18:0/2055180939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edc5334f70 0x55edc5342040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5d8c00640 0 client.26839 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.315+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 >> 172.21.15.18:0/2055180939 conn(0x55edc532f6a0 msgr2=0x55edc532e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 shutdown_connections 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5f857d740 1 -- 172.21.15.18:0/2055180939 wait complete. 2024-04-21T22:39:14.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5f857d740 20 client.26839 trim_cache size 0 max 16384 2024-04-21T22:39:14.327 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 msgr2=0x7fe5d40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 0x7fe5d40a51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00ee3e0 tx=0x7fe5e00dd040 comp rx=0 tx=0).stop 2024-04-21T22:39:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 msgr2=0x7fe5f019e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00057c0 tx=0x7fe5e0004360 comp rx=0 tx=0).stop 2024-04-21T22:39:14.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 shutdown_connections 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe5d40a2d00 0x7fe5d40a51c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5f010dc00 0x7fe5f01a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f0108640 0x7fe5f019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 --2- 172.21.15.18:0/1743377854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0107c80 0x7fe5f019e3e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.316+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 >> 172.21.15.18:0/1743377854 conn(0x7fe5f0077550 msgr2=0x7fe5f00785b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.317+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 shutdown_connections 2024-04-21T22:39:14.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.317+0000 7fe5efe00640 1 -- 172.21.15.18:0/1743377854 wait complete. 2024-04-21T22:39:14.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:39:14.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 -- 172.21.15.18:0/2487852444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f452010dc00 msgr2=0x7f452010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 --2- 172.21.15.18:0/2487852444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f452010dc00 0x7f452010dfe0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4514009900 tx=0x7f451402bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 -- 172.21.15.18:0/2487852444 shutdown_connections 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 --2- 172.21.15.18:0/2487852444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 0x7f45201149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 --2- 172.21.15.18:0/2487852444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4520107c80 0x7f4520108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 --2- 172.21.15.18:0/2487852444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f452010dc00 0x7f452010dfe0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 -- 172.21.15.18:0/2487852444 >> 172.21.15.18:0/2487852444 conn(0x7f4520077550 msgr2=0x7f4520106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 -- 172.21.15.18:0/2487852444 shutdown_connections 2024-04-21T22:39:14.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.531+0000 7f4526000640 1 -- 172.21.15.18:0/2487852444 wait complete. 2024-04-21T22:39:14.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.532+0000 7f4526000640 1 Processor -- start 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.532+0000 7f4526000640 1 -- start start 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 0x7f452019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f452010dc00 0x7f45201a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4520117f50 con 0x7f4520107c80 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4520117dd0 con 0x7f4520108640 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4526000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45201180d0 con 0x7f452010dc00 2024-04-21T22:39:14.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4524c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4524c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57830/0 (socket says 172.21.15.18:57830) 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4524c00640 1 -- 172.21.15.18:0/548692580 learned_addr learned my addr 172.21.15.18:0/548692580 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f4525600640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f452010dc00 0x7f45201a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.533+0000 7f451fe00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 0x7f452019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 -- 172.21.15.18:0/548692580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f452010dc00 msgr2=0x7f45201a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f452010dc00 0x7f45201a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 -- 172.21.15.18:0/548692580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 msgr2=0x7f452019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 0x7f452019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 -- 172.21.15.18:0/548692580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45201a3380 con 0x7f4520107c80 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4524c00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f451402efd0 tx=0x7f45140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f451d600640 1 -- 172.21.15.18:0/548692580 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514041070 con 0x7f4520107c80 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f451d600640 1 -- 172.21.15.18:0/548692580 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451402ccc0 con 0x7f4520107c80 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f451d600640 1 -- 172.21.15.18:0/548692580 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514003c60 con 0x7f4520107c80 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45201a3610 con 0x7f4520107c80 2024-04-21T22:39:14.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.534+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45201aaf00 con 0x7f4520107c80 2024-04-21T22:39:14.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 Processor -- start 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 -- start start 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f451d600640 1 -- 172.21.15.18:0/548692580 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4514044070 con 0x7f4520107c80 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a5890 0x55e6fe9adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe9093a0 con 0x55e6fe9a4f70 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe8b1930 con 0x55e6fe9a5890 2024-04-21T22:39:14.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.538+0000 7f452a377740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe905360 con 0x55e6fe9ae470 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57836/0 (socket says 172.21.15.18:57836) 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4524c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a5890 0x55e6fe9adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 -- 172.21.15.18:0/2018097896 learned_addr learned my addr 172.21.15.18:0/2018097896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f451fe00640 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 -- 172.21.15.18:0/2018097896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 msgr2=0x55e6fe9b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 -- 172.21.15.18:0/2018097896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a5890 msgr2=0x55e6fe9adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a5890 0x55e6fe9adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 -- 172.21.15.18:0/2018097896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6fe61d3f0 con 0x55e6fe9a4f70 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f451d600640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 0x7f45080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.539+0000 7f4525600640 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4518011440 tx=0x7f4518011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6884a0d314a42972 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.540+0000 7f451d600640 1 -- 172.21.15.18:0/548692580 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f45140f0c70 con 0x7f4520107c80 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.540+0000 7f4524c00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 0x7f45080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.540+0000 7f4511c00640 1 -- 172.21.15.18:0/2018097896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518003c30 con 0x55e6fe9a4f70 2024-04-21T22:39:14.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.540+0000 7f4511c00640 1 -- 172.21.15.18:0/2018097896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4518003dd0 con 0x55e6fe9a4f70 2024-04-21T22:39:14.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.540+0000 7f4511c00640 1 -- 172.21.15.18:0/2018097896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451800fb50 con 0x55e6fe9a4f70 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- 172.21.15.18:0/2018097896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 msgr2=0x55e6fe9a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4518011440 tx=0x7f4518011900 comp rx=0 tx=0).stop 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f4524c00640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 0x7f45080a5240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45140ee580 tx=0x7f45140dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- 172.21.15.18:0/2018097896 shutdown_connections 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a5890 0x55e6fe9adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 --2- 172.21.15.18:0/2018097896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9a5350 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- 172.21.15.18:0/2018097896 >> 172.21.15.18:0/2018097896 conn(0x55e6fe99f6a0 msgr2=0x55e6fe99fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- 172.21.15.18:0/2018097896 shutdown_connections 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- 172.21.15.18:0/2018097896 wait complete. 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 -- start start 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.541+0000 7f452a377740 1 Processor -- start 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9aba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe9b1260 con 0x55e6fe9a5890 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe8c4d80 con 0x55e6fe9a4f70 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e6fe9b13e0 con 0x55e6fe9ae470 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f452a377740 10 client.0 _ll_register_callbacks cb 0x55e6fe9012b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f451fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f4525600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f4525600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40090/0 (socket says 172.21.15.18:40090) 2024-04-21T22:39:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f4525600640 1 -- 172.21.15.18:0/3471493468 learned_addr learned my addr 172.21.15.18:0/3471493468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.542+0000 7f4525600640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 -- 172.21.15.18:0/3471493468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 msgr2=0x55e6fe9abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 -- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 msgr2=0x55e6fe9ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 -- 172.21.15.18:0/3471493468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6fe6e77d0 con 0x55e6fe9a5890 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f4525600640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f451fe00640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9aba80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4520077ca0 tx=0x7f450c012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176344e18ef1a753 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f4506000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c00f920 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f450c00fac0 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.543+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4518003dd0 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f450c00fcc0 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 10 client.16725 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e6fe9bd5f0 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4518003dd0 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f450c01c420 con 0x55e6fe9a5890 2024-04-21T22:39:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 10 client.16725 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 20 client.16725 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fe9beab0 0x55e6fe9c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 4 client.16725 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.544+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6fe9168e0 con 0x55e6fe9beab0 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.545+0000 7f4525600640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fe9beab0 0x55e6fe9c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.545+0000 7f4525600640 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fe9beab0 0x55e6fe9c0f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7711d51c8c7da7 server_cookie=fc3334c31ad11fd8 in_seq=0 out_seq=0 2024-04-21T22:39:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.545+0000 7f4506000640 10 client.16725 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f4506000640 1 -- 172.21.15.18:0/3471493468 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e6fe9168e0 con 0x55e6fe9beab0 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f4506000640 10 client.16725 handle_command_reply: tid=0 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 client.16725 shutdown 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 msgr2=0x55e6fe9aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9aba80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4520077ca0 tx=0x7f450c012b60 comp rx=0 tx=0).stop 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 shutdown_connections 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fe9beab0 0x55e6fe9c0f10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9aba80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 --2- 172.21.15.18:0/3471493468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f4506000640 0 client.16725 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.546+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 >> 172.21.15.18:0/3471493468 conn(0x55e6fe99f6a0 msgr2=0x55e6fe9a13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.547+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 shutdown_connections 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.547+0000 7f452a377740 1 -- 172.21.15.18:0/3471493468 wait complete. 2024-04-21T22:39:14.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.547+0000 7f452a377740 20 client.16725 trim_cache size 0 max 16384 2024-04-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 Processor -- start 2024-04-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 -- start start 2024-04-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b3900 con 0x55e6fe9a5890 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b5440 con 0x55e6fe9a4f70 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f452a377740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b3fd0 con 0x55e6fe9ae470 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f4525600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f451fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.562+0000 7f4525600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36428/0 (socket says 172.21.15.18:36428) 2024-04-21T22:39:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 -- 172.21.15.18:0/1782497440 learned_addr learned my addr 172.21.15.18:0/1782497440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 -- 172.21.15.18:0/1782497440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 msgr2=0x55e6fe9a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 -- 172.21.15.18:0/1782497440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 msgr2=0x55e6fe9ba120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9ba120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 -- 172.21.15.18:0/1782497440 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6fe9b0bd0 con 0x55e6fe9a4f70 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f451fe00640 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4525600640 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f451800f620 tx=0x7f4518009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5ba96d4e35c8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.563+0000 7f4511200640 1 -- 172.21.15.18:0/1782497440 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518003970 con 0x55e6fe9a4f70 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f4511200640 1 -- 172.21.15.18:0/1782497440 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451800f820 con 0x55e6fe9a4f70 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f4511200640 1 -- 172.21.15.18:0/1782497440 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518004240 con 0x55e6fe9a4f70 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 -- 172.21.15.18:0/1782497440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 msgr2=0x55e6fe9adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f451800f620 tx=0x7f4518009500 comp rx=0 tx=0).stop 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 -- 172.21.15.18:0/1782497440 shutdown_connections 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9ae470 0x55e6fe9a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a5890 0x55e6fe9ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 --2- 172.21.15.18:0/1782497440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9adc70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 -- 172.21.15.18:0/1782497440 >> 172.21.15.18:0/1782497440 conn(0x55e6fe99f6a0 msgr2=0x55e6fe9a0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 -- 172.21.15.18:0/1782497440 shutdown_connections 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.564+0000 7f452a377740 1 -- 172.21.15.18:0/1782497440 wait complete. 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 -- start start 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 Processor -- start 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b4d70 con 0x55e6fe9a4f70 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b46a0 con 0x55e6fe9ae470 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.565+0000 7f452a377740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45201b18e0 con 0x55e6fe9a5890 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f452a377740 10 client.0 _ll_register_callbacks cb 0x7f450c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:40102/0 (socket says 172.21.15.18:40102) 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f4525600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 -- 172.21.15.18:0/3168379096 learned_addr learned my addr 172.21.15.18:0/3168379096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f4525600640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 -- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9ae470 msgr2=0x55e6fe9b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 -- 172.21.15.18:0/3168379096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 msgr2=0x55e6fe9b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 -- 172.21.15.18:0/3168379096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6fea24050 con 0x55e6fe9a5890 2024-04-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f4525600640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f451fe00640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55e6fe9acb10 tx=0x7f450c01cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3b377bc2849588 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.566+0000 7f4506000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c00fe60 con 0x55e6fe9a5890 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f450c01c630 con 0x55e6fe9a5890 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f451800f820 con 0x55e6fe9a5890 2024-04-21T22:39:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f450c005c50 con 0x55e6fe9a5890 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f452a377740 10 client.26857 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e6fea251f0 con 0x55e6fe9a5890 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f451800f820 con 0x55e6fe9a5890 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.567+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f450c003bd0 con 0x55e6fe9a5890 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 10 client.26857 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 10 client.26857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 20 client.26857 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fea25940 0x55e6fea27d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 4 client.26857 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6fe910c30 con 0x55e6fea25940 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f4525600640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fea25940 0x55e6fea27d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f4525600640 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fea25940 0x55e6fea27d60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96dbae7985cb01e8 server_cookie=491e17bc88d9a396 in_seq=0 out_seq=0 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.568+0000 7f4506000640 10 client.26857 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f4506000640 1 -- 172.21.15.18:0/3168379096 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6fe910c30 con 0x55e6fea25940 2024-04-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f4506000640 10 client.26857 handle_command_reply: tid=0 2024-04-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 client.26857 shutdown 2024-04-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 msgr2=0x55e6fe9b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55e6fe9acb10 tx=0x7f450c01cd30 comp rx=0 tx=0).stop 2024-04-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 shutdown_connections 2024-04-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e6fe9ae470 0x55e6fe9b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e6fea25940 0x55e6fea27d60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e6fe9a5890 0x55e6fe9b1f00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 --2- 172.21.15.18:0/3168379096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e6fe9a4f70 0x55e6fe9b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f4506000640 0 client.26857 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 >> 172.21.15.18:0/3168379096 conn(0x55e6fe99f6a0 msgr2=0x55e6fe9a9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 shutdown_connections 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 1 -- 172.21.15.18:0/3168379096 wait complete. 2024-04-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.569+0000 7f452a377740 20 client.26857 trim_cache size 0 max 16384 2024-04-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 msgr2=0x7f45080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 0x7f45080a5240 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45140ee580 tx=0x7f45140dd040 comp rx=0 tx=0).stop 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 msgr2=0x7f452019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f451402efd0 tx=0x7f45140042f0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 shutdown_connections 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45080a2d80 0x7f45080a5240 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f452010dc00 0x7f45201a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4520108640 0x7f452019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 --2- 172.21.15.18:0/548692580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4520107c80 0x7f452019e390 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 >> 172.21.15.18:0/548692580 conn(0x7f4520077550 msgr2=0x7f45200784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 shutdown_connections 2024-04-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:14.570+0000 7f4526000640 1 -- 172.21.15.18:0/548692580 wait complete. 2024-04-21T22:39:15.590 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:39:15.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:39:15.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:39:15.600 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:15 smithi018 ceph-mon[26614]: pgmap v159: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:15 smithi081 ceph-mon[31692]: pgmap v159: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:15.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:15 smithi047 ceph-mon[31561]: pgmap v159: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:39:15.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 -- 172.21.15.18:0/2023801906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 msgr2=0x7fe97c076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 --2- 172.21.15.18:0/2023801906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c076050 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009ca0 tx=0x7fe96c02c100 comp rx=0 tx=0).stop 2024-04-21T22:39:15.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 -- 172.21.15.18:0/2023801906 shutdown_connections 2024-04-21T22:39:15.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 --2- 172.21.15.18:0/2023801906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c1125c0 0x7fe97c1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 --2- 172.21.15.18:0/2023801906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c076590 0x7fe97c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 --2- 172.21.15.18:0/2023801906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c076050 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.821+0000 7fe981200640 1 -- 172.21.15.18:0/2023801906 >> 172.21.15.18:0/2023801906 conn(0x7fe97c0ff3d0 msgr2=0x7fe97c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.822+0000 7fe981200640 1 -- 172.21.15.18:0/2023801906 shutdown_connections 2024-04-21T22:39:15.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.822+0000 7fe981200640 1 -- 172.21.15.18:0/2023801906 wait complete. 2024-04-21T22:39:15.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 Processor -- start 2024-04-21T22:39:15.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 -- start start 2024-04-21T22:39:15.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c076590 0x7fe97c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c1125c0 0x7fe97c1a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c118130 con 0x7fe97c075c70 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c117fb0 con 0x7fe97c076590 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe981200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1182b0 con 0x7fe97c1125c0 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.823+0000 7fe979e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52186/0 (socket says 172.21.15.18:52186) 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 -- 172.21.15.18:0/1998005483 learned_addr learned my addr 172.21.15.18:0/1998005483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979400640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c076590 0x7fe97c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe97a800640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c1125c0 0x7fe97c1a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 -- 172.21.15.18:0/1998005483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c1125c0 msgr2=0x7fe97c1a2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c1125c0 0x7fe97c1a2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 -- 172.21.15.18:0/1998005483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c076590 msgr2=0x7fe97c19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c076590 0x7fe97c19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 -- 172.21.15.18:0/1998005483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c1a3650 con 0x7fe97c075c70 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.824+0000 7fe979e00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005e30 tx=0x7fe96c0346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.825+0000 7fe972a00640 1 -- 172.21.15.18:0/1998005483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c039050 con 0x7fe97c075c70 2024-04-21T22:39:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.825+0000 7fe972a00640 1 -- 172.21.15.18:0/1998005483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96c045070 con 0x7fe97c075c70 2024-04-21T22:39:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.825+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c1a38e0 con 0x7fe97c075c70 2024-04-21T22:39:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.825+0000 7fe972a00640 1 -- 172.21.15.18:0/1998005483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0046c0 con 0x7fe97c075c70 2024-04-21T22:39:15.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.825+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c1ab1d0 con 0x7fe97c075c70 2024-04-21T22:39:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.828+0000 7fe983f8d740 1 Processor -- start 2024-04-21T22:39:15.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.828+0000 7fe972a00640 1 -- 172.21.15.18:0/1998005483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fe96c003970 con 0x7fe97c075c70 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.828+0000 7fe983f8d740 1 -- start start 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bdff24bdf0 con 0x55bdff2ee040 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bdff251040 con 0x55bdff2ed720 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe983f8d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bdff1f98c0 con 0x55bdff2f6c20 2024-04-21T22:39:15.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe97a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe979e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe97a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48802/0 (socket says 172.21.15.18:48802) 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe97a800640 1 -- 172.21.15.18:0/3063465985 learned_addr learned my addr 172.21.15.18:0/3063465985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.829+0000 7fe979400640 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 -- 172.21.15.18:0/3063465985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 msgr2=0x55bdff2f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 -- 172.21.15.18:0/3063465985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 msgr2=0x55bdff2f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 -- 172.21.15.18:0/3063465985 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdff02d7e0 con 0x55bdff2ed720 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe972a00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 0x7fe9600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe97a800640 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9740045e0 tx=0x7fe974004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e8327ed2f96209 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe972a00640 1 -- 172.21.15.18:0/1998005483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe96c0f1940 con 0x7fe97c075c70 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe979e00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 0x7fe9600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe96b400640 1 -- 172.21.15.18:0/3063465985 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974003af0 con 0x55bdff2ed720 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe96b400640 1 -- 172.21.15.18:0/3063465985 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe974015070 con 0x55bdff2ed720 2024-04-21T22:39:15.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.830+0000 7fe96b400640 1 -- 172.21.15.18:0/3063465985 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9740116a0 con 0x55bdff2ed720 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 -- 172.21.15.18:0/3063465985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 msgr2=0x55bdff2edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe979e00640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 0x7fe9600a5240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0ef250 tx=0x7fe96c0f74f0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9740045e0 tx=0x7fe974004610 comp rx=0 tx=0).stop 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 -- 172.21.15.18:0/3063465985 shutdown_connections 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3063465985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2edb00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.831+0000 7fe983f8d740 1 -- 172.21.15.18:0/3063465985 >> 172.21.15.18:0/3063465985 conn(0x55bdff2e7e50 msgr2=0x55bdff2e8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.832+0000 7fe983f8d740 1 -- 172.21.15.18:0/3063465985 shutdown_connections 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.832+0000 7fe983f8d740 1 -- 172.21.15.18:0/3063465985 wait complete. 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.832+0000 7fe983f8d740 1 -- start start 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.832+0000 7fe983f8d740 1 Processor -- start 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bdff20cd20 con 0x55bdff2ee040 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bdff24d000 con 0x55bdff2ed720 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bdff2f9a10 con 0x55bdff2f6c20 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe983f8d740 10 client.0 _ll_register_callbacks cb 0x55bdff2480a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52208/0 (socket says 172.21.15.18:52208) 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 -- 172.21.15.18:0/778750296 learned_addr learned my addr 172.21.15.18:0/778750296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe97a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe97a800640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 -- 172.21.15.18:0/778750296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 msgr2=0x55bdff2f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 -- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 msgr2=0x55bdff2f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe979400640 1 -- 172.21.15.18:0/778750296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdff08df70 con 0x55bdff2ee040 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.833+0000 7fe97a800640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe979400640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe964012710 tx=0x7fe964012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391543d4e1dc586c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe95fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:15.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f8c0 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe96400fa60 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe974015070 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe96400fc60 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe983f8d740 10 client.16743 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.834+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bdfef25170 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe974015070 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe96401c4b0 con 0x55bdff2ee040 2024-04-21T22:39:15.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 10 client.16743 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 20 client.16743 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff306ef0 0x55bdff309340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 4 client.16743 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.835+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdff25e580 con 0x55bdff306ef0 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.836+0000 7fe97a800640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff306ef0 0x55bdff309340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.836+0000 7fe97a800640 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff306ef0 0x55bdff309340 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c77d868ae8722c server_cookie=d2e31c05ad0052e5 in_seq=0 out_seq=0 2024-04-21T22:39:15.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.836+0000 7fe95fe00640 10 client.16743 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe95fe00640 1 -- 172.21.15.18:0/778750296 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bdff25e580 con 0x55bdff306ef0 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe95fe00640 10 client.16743 handle_command_reply: tid=0 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 client.16743 shutdown 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 msgr2=0x55bdff2f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe964012710 tx=0x7fe964012bd0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 shutdown_connections 2024-04-21T22:39:15.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff306ef0 0x55bdff309340 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2f4120 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 --2- 172.21.15.18:0/778750296 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ed720 0x55bdff2f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe95fe00640 0 client.16743 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 >> 172.21.15.18:0/778750296 conn(0x55bdff2e7e50 msgr2=0x55bdff2e9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 shutdown_connections 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.837+0000 7fe983f8d740 1 -- 172.21.15.18:0/778750296 wait complete. 2024-04-21T22:39:15.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.838+0000 7fe983f8d740 20 client.16743 trim_cache size 0 max 16384 2024-04-21T22:39:15.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.857+0000 7fe983f8d740 1 Processor -- start 2024-04-21T22:39:15.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 -- start start 2024-04-21T22:39:15.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 0x55bdff302780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b3ad0 con 0x55bdff2ed720 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b5610 con 0x55bdff2ee040 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe983f8d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b41a0 con 0x55bdff2f6c20 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe97a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe97a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52224/0 (socket says 172.21.15.18:52224) 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe97a800640 1 -- 172.21.15.18:0/3784949116 learned_addr learned my addr 172.21.15.18:0/3784949116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe979400640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 0x55bdff302780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.858+0000 7fe97a800640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 -- 172.21.15.18:0/3784949116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 msgr2=0x55bdff2f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 -- 172.21.15.18:0/3784949116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 msgr2=0x55bdff2f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 -- 172.21.15.18:0/3784949116 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdff2f9240 con 0x55bdff2ee040 2024-04-21T22:39:15.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe97a800640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:15.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe979400640 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 0x55bdff302780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55bdff2f3440 tx=0x7fe96400fe00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe4f0919f4b123b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe96aa00640 1 -- 172.21.15.18:0/3784949116 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f850 con 0x55bdff2ee040 2024-04-21T22:39:15.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe96aa00640 1 -- 172.21.15.18:0/3784949116 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96400f9f0 con 0x55bdff2ee040 2024-04-21T22:39:15.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.859+0000 7fe96aa00640 1 -- 172.21.15.18:0/3784949116 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9640048a0 con 0x55bdff2ee040 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- 172.21.15.18:0/3784949116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 msgr2=0x55bdff302780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 0x55bdff302780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55bdff2f3440 tx=0x7fe96400fe00 comp rx=0 tx=0).stop 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- 172.21.15.18:0/3784949116 shutdown_connections 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2f6c20 0x55bdff2f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2ee040 0x55bdff302780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 --2- 172.21.15.18:0/3784949116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ed720 0x55bdff2f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- 172.21.15.18:0/3784949116 >> 172.21.15.18:0/3784949116 conn(0x55bdff2e7e50 msgr2=0x55bdff2f3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- 172.21.15.18:0/3784949116 shutdown_connections 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- 172.21.15.18:0/3784949116 wait complete. 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.860+0000 7fe983f8d740 1 -- start start 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 Processor -- start 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 0x55bdff2fec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2f6c20 0x55bdff2fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b4f40 con 0x55bdff2ee040 2024-04-21T22:39:15.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b4870 con 0x55bdff2f6c20 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1b1ab0 con 0x55bdff2ed720 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe983f8d740 10 client.0 _ll_register_callbacks cb 0x7fe964009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe979400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe97a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 0x55bdff2fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe979400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52230/0 (socket says 172.21.15.18:52230) 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe979400640 1 -- 172.21.15.18:0/894453593 learned_addr learned my addr 172.21.15.18:0/894453593 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.861+0000 7fe97a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 0x55bdff2fec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41692/0 (socket says 172.21.15.18:41692) 2024-04-21T22:39:15.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe97a800640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2f6c20 0x55bdff2fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 -- 172.21.15.18:0/894453593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 msgr2=0x55bdff2fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 0x55bdff2fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 -- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2f6c20 msgr2=0x55bdff2fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2f6c20 0x55bdff2fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 -- 172.21.15.18:0/894453593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdff2fc370 con 0x55bdff2ee040 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe979400640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe964012c10 tx=0x7fe96401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95440c85781653be server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe95fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:15.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f850 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fe9640052e0 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.862+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96400f9f0 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe96403c050 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 10 client.16749 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bdff36df10 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96400f9f0 con 0x55bdff2ee040 2024-04-21T22:39:15.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fe964010430 con 0x55bdff2ee040 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 10 client.16749 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 20 client.16749 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff36e570 0x55bdff370990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 4 client.16749 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.863+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bdff2588d0 con 0x55bdff36e570 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.864+0000 7fe97a800640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff36e570 0x55bdff370990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.864+0000 7fe97a800640 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff36e570 0x55bdff370990 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb0d8fe0628f3ba3 server_cookie=f4344560d6a07dab in_seq=0 out_seq=0 2024-04-21T22:39:15.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.864+0000 7fe95fe00640 10 client.16749 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe95fe00640 1 -- 172.21.15.18:0/894453593 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bdff2588d0 con 0x55bdff36e570 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe95fe00640 10 client.16749 handle_command_reply: tid=0 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 client.16749 shutdown 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 msgr2=0x55bdff2ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe964012c10 tx=0x7fe96401c650 comp rx=0 tx=0).stop 2024-04-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 shutdown_connections 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bdff2f6c20 0x55bdff2fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bdff2ee040 0x55bdff2ff1d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55bdff36e570 0x55bdff370990 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 --2- 172.21.15.18:0/894453593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bdff2ed720 0x55bdff2fec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 >> 172.21.15.18:0/894453593 conn(0x55bdff2e7e50 msgr2=0x55bdff2e99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.866+0000 7fe95fe00640 0 client.16749 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 shutdown_connections 2024-04-21T22:39:15.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe983f8d740 1 -- 172.21.15.18:0/894453593 wait complete. 2024-04-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe983f8d740 20 client.16749 trim_cache size 0 max 16384 2024-04-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "ac7e851a-2158-4175-921b-e3888361100b", 2024-04-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 msgr2=0x7fe9600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 0x7fe9600a5240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0ef250 tx=0x7fe96c0f74f0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 msgr2=0x7fe97c19e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005e30 tx=0x7fe96c0346f0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 shutdown_connections 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fe9600a2d80 0x7fe9600a5240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c1125c0 0x7fe97c1a2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe97c076590 0x7fe97c19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 --2- 172.21.15.18:0/1998005483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe97c075c70 0x7fe97c19e6b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.867+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 >> 172.21.15.18:0/1998005483 conn(0x7fe97c0ff3d0 msgr2=0x7fe97c113d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.868+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 shutdown_connections 2024-04-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:15.868+0000 7fe981200640 1 -- 172.21.15.18:0/1998005483 wait complete. 2024-04-21T22:39:15.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:39:15.890 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:39:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 -- 172.21.15.18:0/908392184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401089b0 msgr2=0x7f4e40108d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 --2- 172.21.15.18:0/908392184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401089b0 0x7f4e40108d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009900 tx=0x7f4e3002bc50 comp rx=0 tx=0).stop 2024-04-21T22:39:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 -- 172.21.15.18:0/908392184 shutdown_connections 2024-04-21T22:39:16.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 --2- 172.21.15.18:0/908392184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401165c0 0x7f4e40118a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 --2- 172.21.15.18:0/908392184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40109360 0x7f4e40115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 --2- 172.21.15.18:0/908392184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401089b0 0x7f4e40108d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 -- 172.21.15.18:0/908392184 >> 172.21.15.18:0/908392184 conn(0x7f4e4006caa0 msgr2=0x7f4e4006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 -- 172.21.15.18:0/908392184 shutdown_connections 2024-04-21T22:39:16.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.129+0000 7f4e46400640 1 -- 172.21.15.18:0/908392184 wait complete. 2024-04-21T22:39:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.130+0000 7f4e46400640 1 Processor -- start 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 -- start start 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 0x7f4e401a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 0x7f4e401a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e401a27e0 0x7f4e401a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011c3e0 con 0x7f4e401a27e0 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011c260 con 0x7f4e401089b0 2024-04-21T22:39:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e46400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4011c560 con 0x7f4e401165c0 2024-04-21T22:39:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 0x7f4e401a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e45000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 0x7f4e401a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 0x7f4e401a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41700/0 (socket says 172.21.15.18:41700) 2024-04-21T22:39:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e401a27e0 0x7f4e401a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.131+0000 7f4e37e00640 1 -- 172.21.15.18:0/2490830825 learned_addr learned my addr 172.21.15.18:0/2490830825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 -- 172.21.15.18:0/2490830825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 msgr2=0x7f4e401a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 0x7f4e401a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 -- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e401a27e0 msgr2=0x7f4e401a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e401a27e0 0x7f4e401a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 -- 172.21.15.18:0/2490830825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e401a3370 con 0x7f4e401089b0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.132+0000 7f4e45000640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 0x7f4e401a8670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4e3002c190 tx=0x7f4e300042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.133+0000 7f4e3e000640 1 -- 172.21.15.18:0/2490830825 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30041070 con 0x7f4e401089b0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.133+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e401a3600 con 0x7f4e401089b0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.133+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401af830 con 0x7f4e401089b0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.133+0000 7f4e3e000640 1 -- 172.21.15.18:0/2490830825 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e3002ccb0 con 0x7f4e401089b0 2024-04-21T22:39:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.133+0000 7f4e3e000640 1 -- 172.21.15.18:0/2490830825 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30003d30 con 0x7f4e401089b0 2024-04-21T22:39:16.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.136+0000 7f4e3e000640 1 -- 172.21.15.18:0/2490830825 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4e30044070 con 0x7f4e401089b0 2024-04-21T22:39:16.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.137+0000 7f4e4a790740 1 Processor -- start 2024-04-21T22:39:16.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.137+0000 7f4e4a790740 1 -- start start 2024-04-21T22:39:16.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 0x55e71d0d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e71d023410 con 0x55e71d0bf8c0 2024-04-21T22:39:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e71cfcb7e0 con 0x55e71d0d17c0 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e4a790740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e71d01f3d0 con 0x55e71d0c0270 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0bfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52246/0 (socket says 172.21.15.18:52246) 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 0x55e71d0d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e45a00640 1 -- 172.21.15.18:0/2155595312 learned_addr learned my addr 172.21.15.18:0/2155595312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e45000640 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e37e00640 1 -- 172.21.15.18:0/2155595312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 msgr2=0x55e71d0d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e37e00640 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.138+0000 7f4e37e00640 1 -- 172.21.15.18:0/2155595312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 msgr2=0x55e71d0bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e37e00640 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e37e00640 1 -- 172.21.15.18:0/2155595312 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71ce017d0 con 0x55e71d0d17c0 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e3e000640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 0x7f4e240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e37e00640 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 0x55e71d0d3bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800bc60 tx=0x7f4e280107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c57bab1b5fedfd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e3e000640 1 -- 172.21.15.18:0/2490830825 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4e300f0dc0 con 0x7f4e401089b0 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e36000640 1 -- 172.21.15.18:0/2155595312 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28004230 con 0x55e71d0d17c0 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.139+0000 7f4e45a00640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 0x7f4e240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.140+0000 7f4e36000640 1 -- 172.21.15.18:0/2155595312 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e2800be10 con 0x55e71d0d17c0 2024-04-21T22:39:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.140+0000 7f4e36000640 1 -- 172.21.15.18:0/2155595312 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280117c0 con 0x55e71d0d17c0 2024-04-21T22:39:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.140+0000 7f4e4a790740 1 -- 172.21.15.18:0/2155595312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 msgr2=0x55e71d0d3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.140+0000 7f4e4a790740 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 0x55e71d0d3bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800bc60 tx=0x7f4e280107a0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.140+0000 7f4e45a00640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 0x7f4e240a5240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e38011630 tx=0x7f4e38009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 -- 172.21.15.18:0/2155595312 shutdown_connections 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0d17c0 0x55e71d0d3bb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 --2- 172.21.15.18:0/2155595312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 -- 172.21.15.18:0/2155595312 >> 172.21.15.18:0/2155595312 conn(0x55e71d0ba1e0 msgr2=0x55e71d0ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 -- 172.21.15.18:0/2155595312 shutdown_connections 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 -- 172.21.15.18:0/2155595312 wait complete. 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.141+0000 7f4e4a790740 1 -- start start 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 Processor -- start 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e71d0d4580 con 0x55e71d0d17c0 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e71cfdec40 con 0x55e71d0bf8c0 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e71d0d4700 con 0x55e71d0c0270 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.142+0000 7f4e4a790740 10 client.0 _ll_register_callbacks cb 0x55e71cfde630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48864/0 (socket says 172.21.15.18:48864) 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 -- 172.21.15.18:0/3204954802 learned_addr learned my addr 172.21.15.18:0/3204954802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45a00640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 -- 172.21.15.18:0/3204954802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 msgr2=0x55e71d0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 -- 172.21.15.18:0/3204954802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 msgr2=0x55e71d0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45000640 1 -- 172.21.15.18:0/3204954802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71cd373f0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.143+0000 7f4e45a00640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e45000640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e300f4500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c1ee734716cf84 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3004b040 con 0x55e71d0bf8c0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4e300bd700 con 0x55e71d0bf8c0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e2800be10 con 0x55e71d0bf8c0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4e300b9740 con 0x55e71d0bf8c0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e4a790740 10 client.26834 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.144+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e71ccf70f0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e2800be10 con 0x55e71d0bf8c0 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4e300d61f0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 10 client.26834 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 10 client.26834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 20 client.26834 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d0e1ae0 0x55e71d0e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 4 client.26834 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71d036c40 con 0x55e71d0e1ae0 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.145+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d0e1ae0 0x55e71d0e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.146+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d0e1ae0 0x55e71d0e3fa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c26c08a97bb381f server_cookie=23bad26f6db04908 in_seq=0 out_seq=0 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.146+0000 7f4e2ea00640 10 client.26834 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.147+0000 7f4e2ea00640 1 -- 172.21.15.18:0/3204954802 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e71d036c40 con 0x55e71d0e1ae0 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.147+0000 7f4e2ea00640 10 client.26834 handle_command_reply: tid=0 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.147+0000 7f4e4a790740 1 client.26834 shutdown 2024-04-21T22:39:16.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.147+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 msgr2=0x55e71d0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.147+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e300f4500 comp rx=0 tx=0).stop 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 shutdown_connections 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d0e1ae0 0x55e71d0e3fa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0c0270 0x55e71d0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3204954802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0bf8c0 0x55e71d0ce7f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e2ea00640 0 client.26834 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 >> 172.21.15.18:0/3204954802 conn(0x55e71d0ba1e0 msgr2=0x55e71d0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 shutdown_connections 2024-04-21T22:39:16.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 1 -- 172.21.15.18:0/3204954802 wait complete. 2024-04-21T22:39:16.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.148+0000 7f4e4a790740 20 client.26834 trim_cache size 0 max 16384 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 Processor -- start 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 -- start start 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 0x55e71d0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c00e7d0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c010310 con 0x55e71d0c0270 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.174+0000 7f4e4a790740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c00eea0 con 0x55e71d0d17c0 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 0x55e71d0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48876/0 (socket says 172.21.15.18:48876) 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 -- 172.21.15.18:0/3642226256 learned_addr learned my addr 172.21.15.18:0/3642226256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e45a00640 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 0x55e71d0d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41738/0 (socket says 172.21.15.18:41738) 2024-04-21T22:39:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e45000640 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 -- 172.21.15.18:0/3642226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 msgr2=0x55e71d0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 0x55e71d0d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 -- 172.21.15.18:0/3642226256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 msgr2=0x55e71d0dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 -- 172.21.15.18:0/3642226256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71d0d4460 con 0x55e71d0c0270 2024-04-21T22:39:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.175+0000 7f4e37e00640 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800ba20 tx=0x7f4e2800bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2d0f5ddde5e787 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.176+0000 7f4e35600640 1 -- 172.21.15.18:0/3642226256 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2802f070 con 0x55e71d0c0270 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.176+0000 7f4e35600640 1 -- 172.21.15.18:0/3642226256 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e28005520 con 0x55e71d0c0270 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.176+0000 7f4e35600640 1 -- 172.21.15.18:0/3642226256 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2802a4f0 con 0x55e71d0c0270 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 -- 172.21.15.18:0/3642226256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 msgr2=0x55e71d0cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800ba20 tx=0x7f4e2800bee0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 -- 172.21.15.18:0/3642226256 shutdown_connections 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0d17c0 0x55e71d0d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cd970 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 --2- 172.21.15.18:0/3642226256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0bf8c0 0x55e71d0dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 -- 172.21.15.18:0/3642226256 >> 172.21.15.18:0/3642226256 conn(0x55e71d0ba1e0 msgr2=0x55e71d0bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 -- 172.21.15.18:0/3642226256 shutdown_connections 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.177+0000 7f4e4a790740 1 -- 172.21.15.18:0/3642226256 wait complete. 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.178+0000 7f4e4a790740 1 -- start start 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.178+0000 7f4e4a790740 1 Processor -- start 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.178+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 0x55e71d0d9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c00fc40 con 0x55e71d0d17c0 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c00f570 con 0x55e71d0c0270 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c00c7b0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e4a790740 10 client.0 _ll_register_callbacks cb 0x7f4e30005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 0x55e71d0d9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52264/0 (socket says 172.21.15.18:52264) 2024-04-21T22:39:16.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45a00640 1 -- 172.21.15.18:0/802415333 learned_addr learned my addr 172.21.15.18:0/802415333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e37e00640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 -- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 msgr2=0x55e71d0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 -- 172.21.15.18:0/802415333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 msgr2=0x55e71d0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.179+0000 7f4e45000640 1 -- 172.21.15.18:0/802415333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71d1470e0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e37e00640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:39:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e45000640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 0x55e71d0d9f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4e300b9e70 tx=0x7f4e30003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d915d5686c8798df server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3004b040 con 0x55e71d0bf8c0 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4e300bcb00 con 0x55e71d0bf8c0 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.180+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e28005520 con 0x55e71d0bf8c0 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4e300044e0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e4a790740 10 client.26893 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e71d1470e0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e28005520 con 0x55e71d0bf8c0 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4e300f4ac0 con 0x55e71d0bf8c0 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e4a790740 10 client.26893 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e4a790740 10 client.26893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.181+0000 7f4e4a790740 20 client.26893 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.182+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d148650 0x55e71d14aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.182+0000 7f4e4a790740 4 client.26893 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.182+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e71d030950 con 0x55e71d148650 2024-04-21T22:39:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.182+0000 7f4e37e00640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d148650 0x55e71d14aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e37e00640 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d148650 0x55e71d14aa40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae66c3a4fffb341 server_cookie=97cf0417d0f1de33 in_seq=0 out_seq=0 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e2ea00640 10 client.26893 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e2ea00640 1 -- 172.21.15.18:0/802415333 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e71d030950 con 0x55e71d148650 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e2ea00640 10 client.26893 handle_command_reply: tid=0 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e4a790740 1 client.26893 shutdown 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 msgr2=0x55e71d0d9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.183+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 0x55e71d0d9f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4e300b9e70 tx=0x7f4e30003f90 comp rx=0 tx=0).stop 2024-04-21T22:39:16.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 shutdown_connections 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e71d0d17c0 0x55e71d0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e71d0c0270 0x55e71d0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55e71d148650 0x55e71d14aa40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 --2- 172.21.15.18:0/802415333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e71d0bf8c0 0x55e71d0d9f30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 >> 172.21.15.18:0/802415333 conn(0x55e71d0ba1e0 msgr2=0x55e71d0cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e2ea00640 0 client.26893 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 shutdown_connections 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.184+0000 7f4e4a790740 1 -- 172.21.15.18:0/802415333 wait complete. 2024-04-21T22:39:16.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e4a790740 20 client.26893 trim_cache size 0 max 16384 2024-04-21T22:39:16.191 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:39:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:39:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ac7e851a-2158-4175-921b-e3888361100b": { 2024-04-21T22:39:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:39:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "ac7e851a-2158-4175-921b-e3888361100b", 2024-04-21T22:39:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:39:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:39:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:39:16.192 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 msgr2=0x7f4e240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 0x7f4e240a5240 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e38011630 tx=0x7f4e38009500 comp rx=0 tx=0).stop 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 msgr2=0x7f4e401a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 0x7f4e401a8670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4e3002c190 tx=0x7f4e300042f0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 shutdown_connections 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4e240a2d80 0x7f4e240a5240 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e401a27e0 0x7f4e401a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e401165c0 0x7f4e401a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 --2- 172.21.15.18:0/2490830825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e401089b0 0x7f4e401a8670 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.185+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 >> 172.21.15.18:0/2490830825 conn(0x7f4e4006caa0 msgr2=0x7f4e40116cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.186+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 shutdown_connections 2024-04-21T22:39:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:16.186+0000 7f4e46400640 1 -- 172.21.15.18:0/2490830825 wait complete. 2024-04-21T22:39:16.207 INFO:tasks.cephfs.filesystem:scrub status for tag:ac7e851a-2158-4175-921b-e3888361100b - {'path': '/', 'tag': 'ac7e851a-2158-4175-921b-e3888361100b', 'options': 'recursive,force'} 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:16.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:16.597 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:16 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:39:16.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:16.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:16.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:16.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:16.641 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:16 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:16.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:16.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:16 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: pgmap v160: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:39:17.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:17 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:17.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:17.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: pgmap v160: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:39:17.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:17 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: pgmap v160: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:39:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:17 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:18.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:18 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:39:18.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:18 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:39:18.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:18 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:39:19.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:19 smithi018 ceph-mon[26614]: pgmap v161: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:39:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:19 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:39:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:19 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:39:19.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:19 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:39:19.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:19 smithi081 ceph-mon[31692]: pgmap v161: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:39:19.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:19 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:39:19.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:19 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:39:19.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:19 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:39:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:19 smithi047 ceph-mon[31561]: pgmap v161: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:39:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:19 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:39:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:19 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:39:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:19 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:39:21.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:21 smithi018 ceph-mon[26614]: pgmap v162: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:21.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:21 smithi081 ceph-mon[31692]: pgmap v162: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:21 smithi047 ceph-mon[31561]: pgmap v162: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:23.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:23 smithi018 ceph-mon[26614]: pgmap v163: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:23.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:23 smithi081 ceph-mon[31692]: pgmap v163: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:23 smithi047 ceph-mon[31561]: pgmap v163: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-04-21T22:39:25.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:25 smithi018 ceph-mon[26614]: pgmap v164: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:39:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:25 smithi081 ceph-mon[31692]: pgmap v164: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:39:25.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:25 smithi047 ceph-mon[31561]: pgmap v164: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2024-04-21T22:39:27.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:27 smithi018 ceph-mon[26614]: pgmap v165: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:27.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:27 smithi081 ceph-mon[31692]: pgmap v165: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:27 smithi047 ceph-mon[31561]: pgmap v165: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:28.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:28 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:39:28.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:28 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:39:28.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:28 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:39:28.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:28 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:39:28.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:28 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:39:28.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:28 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:39:28.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:28 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:39:28.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:28 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:39:28.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:28 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:39:29.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:29 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:39:29.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:29 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:39:29.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:29 smithi081 ceph-mon[31692]: pgmap v166: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:29.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:29 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:39:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:29 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:39:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:29 smithi047 ceph-mon[31561]: pgmap v166: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:29 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:39:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:29 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:39:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:29 smithi018 ceph-mon[26614]: pgmap v166: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:31.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:31 smithi081 ceph-mon[31692]: pgmap v167: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:31.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:31 smithi047 ceph-mon[31561]: pgmap v167: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:31 smithi018 ceph-mon[26614]: pgmap v167: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:33.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:33 smithi081 ceph-mon[31692]: pgmap v168: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:33 smithi047 ceph-mon[31561]: pgmap v168: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:33.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:33 smithi018 ceph-mon[26614]: pgmap v168: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:35.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:35 smithi081 ceph-mon[31692]: pgmap v169: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:35.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:35 smithi047 ceph-mon[31561]: pgmap v169: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:35 smithi018 ceph-mon[26614]: pgmap v169: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:37 smithi081 ceph-mon[31692]: pgmap v170: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:37.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:37 smithi047 ceph-mon[31561]: pgmap v170: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:37 smithi018 ceph-mon[26614]: pgmap v170: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:39 smithi081 ceph-mon[31692]: pgmap v171: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:39 smithi047 ceph-mon[31561]: pgmap v171: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:39 smithi018 ceph-mon[26614]: pgmap v171: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:41.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:41 smithi081 ceph-mon[31692]: pgmap v172: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:41 smithi047 ceph-mon[31561]: pgmap v172: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:41 smithi018 ceph-mon[26614]: pgmap v172: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:43 smithi081 ceph-mon[31692]: pgmap v173: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:43 smithi047 ceph-mon[31561]: pgmap v173: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:43.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:43 smithi018 ceph-mon[26614]: pgmap v173: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:45 smithi047 ceph-mon[31561]: pgmap v174: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:45 smithi018 ceph-mon[26614]: pgmap v174: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:45 smithi081 ceph-mon[31692]: pgmap v174: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:46.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:39:46.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:39:46.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.436+0000 7fc7ac200640 1 -- 172.21.15.18:0/1316835697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a41125b0 msgr2=0x7fc7a41149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.436+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1316835697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a41125b0 0x7fc7a41149a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009ca0 tx=0x7fc79c02c100 comp rx=0 tx=0).stop 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 -- 172.21.15.18:0/1316835697 shutdown_connections 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1316835697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a41125b0 0x7fc7a41149a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1316835697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 0x7fc7a4112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1316835697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a4075c70 0x7fc7a4076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 -- 172.21.15.18:0/1316835697 >> 172.21.15.18:0/1316835697 conn(0x7fc7a40ff400 msgr2=0x7fc7a4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 -- 172.21.15.18:0/1316835697 shutdown_connections 2024-04-21T22:39:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.437+0000 7fc7ac200640 1 -- 172.21.15.18:0/1316835697 wait complete. 2024-04-21T22:39:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 Processor -- start 2024-04-21T22:39:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 -- start start 2024-04-21T22:39:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 0x7fc7a419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a41125b0 0x7fc7a41a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41180f0 con 0x7fc7a4075c70 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a4117f70 con 0x7fc7a4076590 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7ac200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a4118270 con 0x7fc7a41125b0 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.438+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39958/0 (socket says 172.21.15.18:39958) 2024-04-21T22:39:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 -- 172.21.15.18:0/1665430084 learned_addr learned my addr 172.21.15.18:0/1665430084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7aa200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a41125b0 0x7fc7a41a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 0x7fc7a419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 -- 172.21.15.18:0/1665430084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a41125b0 msgr2=0x7fc7a41a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a41125b0 0x7fc7a41a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 -- 172.21.15.18:0/1665430084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 msgr2=0x7fc7a419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 0x7fc7a419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 -- 172.21.15.18:0/1665430084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a41a3600 con 0x7fc7a4075c70 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.439+0000 7fc7a9800640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e9f0 tx=0x7fc79800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.440+0000 7fc7a2000640 1 -- 172.21.15.18:0/1665430084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79800cd80 con 0x7fc7a4075c70 2024-04-21T22:39:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.440+0000 7fc7a2000640 1 -- 172.21.15.18:0/1665430084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc798005500 con 0x7fc7a4075c70 2024-04-21T22:39:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.440+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a41a38f0 con 0x7fc7a4075c70 2024-04-21T22:39:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.440+0000 7fc7a2000640 1 -- 172.21.15.18:0/1665430084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798010690 con 0x7fc7a4075c70 2024-04-21T22:39:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.440+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a41ab180 con 0x7fc7a4075c70 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.443+0000 7fc7aefa7740 1 Processor -- start 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 -- start start 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7a2000640 1 -- 172.21.15.18:0/1665430084 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc7980046c0 con 0x7fc7a4075c70 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a9067aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067b1e0 0x556a90683880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a905de410 con 0x556a90683dc0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a905867e0 con 0x556a9067b1e0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556a905da3d0 con 0x556a9067a8c0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067b1e0 0x556a90683880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39968/0 (socket says 172.21.15.18:39968) 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7a8e00640 1 -- 172.21.15.18:0/2223497843 learned_addr learned my addr 172.21.15.18:0/2223497843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.444+0000 7fc7aa200640 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a9067aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 -- 172.21.15.18:0/2223497843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 msgr2=0x556a9067aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a9067aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 -- 172.21.15.18:0/2223497843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067b1e0 msgr2=0x556a90683880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067b1e0 0x556a90683880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 -- 172.21.15.18:0/2223497843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a903bc7d0 con 0x556a90683dc0 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc790009c10 tx=0x7fc790011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b071614f08723e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc796a00640 1 -- 172.21.15.18:0/2223497843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790004230 con 0x556a90683dc0 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a2000640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 0x7fc78c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc796a00640 1 -- 172.21.15.18:0/2223497843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7900043d0 con 0x556a90683dc0 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc796a00640 1 -- 172.21.15.18:0/2223497843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790004e60 con 0x556a90683dc0 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.445+0000 7fc7a2000640 1 -- 172.21.15.18:0/1665430084 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc7980cf8d0 con 0x7fc7a4075c70 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aa200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 0x7fc78c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 -- 172.21.15.18:0/2223497843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 msgr2=0x556a906861b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc790009c10 tx=0x7fc790011810 comp rx=0 tx=0).stop 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 -- 172.21.15.18:0/2223497843 shutdown_connections 2024-04-21T22:39:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a906861b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067b1e0 0x556a90683880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/2223497843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a9067aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 -- 172.21.15.18:0/2223497843 >> 172.21.15.18:0/2223497843 conn(0x556a90674ff0 msgr2=0x556a906753d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aefa7740 1 -- 172.21.15.18:0/2223497843 shutdown_connections 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.446+0000 7fc7aa200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 0x7fc78c0a51c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc79c02c640 tx=0x7fc79c005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.447+0000 7fc7aefa7740 1 -- 172.21.15.18:0/2223497843 wait complete. 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.447+0000 7fc7aefa7740 1 -- start start 2024-04-21T22:39:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.447+0000 7fc7aefa7740 1 Processor -- start 2024-04-21T22:39:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90680df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 0x556a90681330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556a90686bb0 con 0x556a90683dc0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556a90599c40 con 0x556a9067a8c0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556a90686d30 con 0x556a9067b1e0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aefa7740 10 client.0 _ll_register_callbacks cb 0x556a90599630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39980/0 (socket says 172.21.15.18:39980) 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 -- 172.21.15.18:0/3850782735 learned_addr learned my addr 172.21.15.18:0/3850782735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 0x556a90681330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90680df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 -- 172.21.15.18:0/3850782735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 msgr2=0x556a90681330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 0x556a90681330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 -- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 msgr2=0x556a90680df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.448+0000 7fc7aa200640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90680df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7aa200640 1 -- 172.21.15.18:0/3850782735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a902f23f0 con 0x556a90683dc0 2024-04-21T22:39:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 0x556a90681330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90680df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7aa200640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc79c032830 tx=0x7fc79c02c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ac0e118eefbfe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc78b400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c051020 con 0x556a90683dc0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc79c0041b0 con 0x556a90683dc0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7900043d0 con 0x556a90683dc0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc79c039040 con 0x556a90683dc0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7aefa7740 10 client.16779 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.449+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556a902b20f0 con 0x556a90683dc0 2024-04-21T22:39:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7900043d0 con 0x556a90683dc0 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fc79c03f040 con 0x556a90683dc0 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 10 client.16779 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 20 client.16779 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a90694140 0x556a90696530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 4 client.16779 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.450+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a905f1c40 con 0x556a90694140 2024-04-21T22:39:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.451+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a90694140 0x556a90696530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.451+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a90694140 0x556a90696530 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44caf95bc07fe07 server_cookie=379a8f5aaa09bda4 in_seq=0 out_seq=0 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.451+0000 7fc78b400640 10 client.16779 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc78b400640 1 -- 172.21.15.18:0/3850782735 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556a905f1c40 con 0x556a90694140 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc78b400640 10 client.16779 handle_command_reply: tid=0 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 client.16779 shutdown 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 msgr2=0x556a90681870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc79c032830 tx=0x7fc79c02c100 comp rx=0 tx=0).stop 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 shutdown_connections 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a90683dc0 0x556a90681870 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a90694140 0x556a90696530 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067b1e0 0x556a90681330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3850782735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90680df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 >> 172.21.15.18:0/3850782735 conn(0x556a90674ff0 msgr2=0x556a90676d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc78b400640 0 client.16779 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:46.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.452+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 shutdown_connections 2024-04-21T22:39:46.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.453+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3850782735 wait complete. 2024-04-21T22:39:46.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.453+0000 7fc7aefa7740 20 client.16779 trim_cache size 0 max 16384 2024-04-21T22:39:46.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.472+0000 7fc7aefa7740 1 Processor -- start 2024-04-21T22:39:46.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 -- start start 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a9068fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 0x556a9069bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b3b90 con 0x556a9067b1e0 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b56d0 con 0x556a9067a8c0 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b4260 con 0x556a90683dc0 2024-04-21T22:39:46.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aa200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 0x556a9069bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48830/0 (socket says 172.21.15.18:48830) 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7a9800640 1 -- 172.21.15.18:0/3455126721 learned_addr learned my addr 172.21.15.18:0/3455126721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.473+0000 7fc7aa200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 0x556a9069bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:41940/0 (socket says 172.21.15.18:41940) 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a9068fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 -- 172.21.15.18:0/3455126721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 msgr2=0x556a9069bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 0x556a9069bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 -- 172.21.15.18:0/3455126721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 msgr2=0x556a9068fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a9068fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 -- 172.21.15.18:0/3455126721 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a9066f4a0 con 0x556a9067a8c0 2024-04-21T22:39:46.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc7a9800640 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc798004c00 tx=0x7fc7980d5530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d122f505578904d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc796000640 1 -- 172.21.15.18:0/3455126721 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980d5020 con 0x556a9067a8c0 2024-04-21T22:39:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.474+0000 7fc796000640 1 -- 172.21.15.18:0/3455126721 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc79809c490 con 0x556a9067a8c0 2024-04-21T22:39:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc796000640 1 -- 172.21.15.18:0/3455126721 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980cd240 con 0x556a9067a8c0 2024-04-21T22:39:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3455126721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 msgr2=0x556a90683520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc798004c00 tx=0x7fc7980d5530 comp rx=0 tx=0).stop 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3455126721 shutdown_connections 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a90683dc0 0x556a9069bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a9068fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/3455126721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a9067a8c0 0x556a90683520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3455126721 >> 172.21.15.18:0/3455126721 conn(0x556a90674ff0 msgr2=0x556a9067f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.475+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3455126721 shutdown_connections 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.476+0000 7fc7aefa7740 1 -- 172.21.15.18:0/3455126721 wait complete. 2024-04-21T22:39:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.476+0000 7fc7aefa7740 1 -- start start 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.476+0000 7fc7aefa7740 1 Processor -- start 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a90686f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 0x556a906879c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b5000 con 0x556a9067b1e0 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b4930 con 0x556a90683dc0 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a41b1b70 con 0x556a9067a8c0 2024-04-21T22:39:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aefa7740 10 client.0 _ll_register_callbacks cb 0x7fc79c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7aa200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 0x556a906879c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7a9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a90686f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39990/0 (socket says 172.21.15.18:39990) 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7a8e00640 1 -- 172.21.15.18:0/420256450 learned_addr learned my addr 172.21.15.18:0/420256450 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.477+0000 7fc7a8e00640 1 -- 172.21.15.18:0/420256450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 msgr2=0x556a90686f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a90686f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a8e00640 1 -- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 msgr2=0x556a906879c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 0x556a906879c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a8e00640 1 -- 172.21.15.18:0/420256450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a906f8720 con 0x556a9067b1e0 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a9800640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a90686f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7aa200640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 0x556a906879c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7a8e00640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc790004990 tx=0x7fc790004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dff89ff6f910a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc78b400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790029070 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc790019700 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79809c490 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc790035050 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7aefa7740 10 client.16785 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.478+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556a906f9a30 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc79809c490 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fc790024040 con 0x556a9067b1e0 2024-04-21T22:39:46.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 10 client.16785 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 20 client.16785 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a906f9ff0 0x556a906fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 4 client.16785 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a905eb950 con 0x556a906f9ff0 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.479+0000 7fc7a9800640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a906f9ff0 0x556a906fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc7a9800640 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a906f9ff0 0x556a906fc410 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340c2a50452c2575 server_cookie=f73345bbb1852c0c in_seq=0 out_seq=0 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc78b400640 10 client.16785 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:46.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc78b400640 1 -- 172.21.15.18:0/420256450 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556a905eb950 con 0x556a906f9ff0 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc78b400640 10 client.16785 handle_command_reply: tid=0 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc7aefa7740 1 client.16785 shutdown 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 msgr2=0x556a90687480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.480+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc790004990 tx=0x7fc790004740 comp rx=0 tx=0).stop 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 shutdown_connections 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556a90683dc0 0x556a906879c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556a9067b1e0 0x556a90687480 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556a906f9ff0 0x556a906fc410 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 --2- 172.21.15.18:0/420256450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556a9067a8c0 0x556a90686f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 >> 172.21.15.18:0/420256450 conn(0x556a90674ff0 msgr2=0x556a90674090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc78b400640 0 client.16785 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 shutdown_connections 2024-04-21T22:39:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 1 -- 172.21.15.18:0/420256450 wait complete. 2024-04-21T22:39:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7aefa7740 20 client.16785 trim_cache size 0 max 16384 2024-04-21T22:39:46.490 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:39:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:39:46.490 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 msgr2=0x7fc78c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 0x7fc78c0a51c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc79c02c640 tx=0x7fc79c005d80 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 msgr2=0x7fc7a419e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.481+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc79800e9f0 tx=0x7fc79800edf0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 shutdown_connections 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc78c0a2d00 0x7fc78c0a51c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7a41125b0 0x7fc7a41a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7a4076590 0x7fc7a419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 --2- 172.21.15.18:0/1665430084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7a4075c70 0x7fc7a419e610 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 >> 172.21.15.18:0/1665430084 conn(0x7fc7a40ff400 msgr2=0x7fc7a41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 shutdown_connections 2024-04-21T22:39:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.482+0000 7fc7ac200640 1 -- 172.21.15.18:0/1665430084 wait complete. 2024-04-21T22:39:46.500 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:39:46.501 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:39:46.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 -- 172.21.15.18:0/2235784207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f375810dfa0 msgr2=0x7f37581103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 --2- 172.21.15.18:0/2235784207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f375810dfa0 0x7f37581103b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3750009900 tx=0x7f375002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 -- 172.21.15.18:0/2235784207 shutdown_connections 2024-04-21T22:39:46.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 --2- 172.21.15.18:0/2235784207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f375810dfa0 0x7f37581103b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 --2- 172.21.15.18:0/2235784207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3758074430 0x7f375810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 --2- 172.21.15.18:0/2235784207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f3758073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 -- 172.21.15.18:0/2235784207 >> 172.21.15.18:0/2235784207 conn(0x7f37580fd210 msgr2=0x7f37580ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 -- 172.21.15.18:0/2235784207 shutdown_connections 2024-04-21T22:39:46.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.711+0000 7f375d400640 1 -- 172.21.15.18:0/2235784207 wait complete. 2024-04-21T22:39:46.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.712+0000 7f375d400640 1 Processor -- start 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.712+0000 7f375d400640 1 -- start start 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3758074430 0x7f375819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375810dfa0 0x7f375819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3758113d50 con 0x7f3758074430 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3758113bd0 con 0x7f3758073b10 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f375d400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3758113ed0 con 0x7f375810dfa0 2024-04-21T22:39:46.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f3756800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f3756800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48866/0 (socket says 172.21.15.18:48866) 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f3747e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3758074430 0x7f375819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f3756800640 1 -- 172.21.15.18:0/1765201278 learned_addr learned my addr 172.21.15.18:0/1765201278 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.713+0000 7f3757200640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375810dfa0 0x7f375819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 -- 172.21.15.18:0/1765201278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375810dfa0 msgr2=0x7f375819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375810dfa0 0x7f375819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 -- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3758074430 msgr2=0x7f375819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3758074430 0x7f375819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 -- 172.21.15.18:0/1765201278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375819f220 con 0x7f3758073b10 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f3756800640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3748009d50 tx=0x7f374800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748003b70 con 0x7f3758073b10 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3748003d10 con 0x7f3758073b10 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748010a20 con 0x7f3758073b10 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375819f510 con 0x7f3758073b10 2024-04-21T22:39:46.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.714+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581a6da0 con 0x7f3758073b10 2024-04-21T22:39:46.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.716+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3758068a40 con 0x7f3758073b10 2024-04-21T22:39:46.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.718+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3748003ec0 con 0x7f3758073b10 2024-04-21T22:39:46.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.719+0000 7f374fe00640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 0x7f37380a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:46.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.719+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f37480cfae0 con 0x7f3758073b10 2024-04-21T22:39:46.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.719+0000 7f3747e00640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 0x7f37380a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:46.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.720+0000 7f3747e00640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 0x7f37380a5240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f37580ff830 tx=0x7f3740005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.723+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f374809c6a0 con 0x7f3758073b10 2024-04-21T22:39:46.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.973+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f375802d170 con 0x7f3758073b10 2024-04-21T22:39:46.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.974+0000 7f374fe00640 1 -- 172.21.15.18:0/1765201278 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7f374809bfa0 con 0x7f3758073b10 2024-04-21T22:39:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:39:46.975 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:39:46.975 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:39:46.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.977+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 msgr2=0x7f37380a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.977+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 0x7f37380a5240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f37580ff830 tx=0x7f3740005f90 comp rx=0 tx=0).stop 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.977+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 msgr2=0x7f375819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.977+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3748009d50 tx=0x7f374800c6a0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 shutdown_connections 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f37380a2d80 0x7f37380a5240 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375810dfa0 0x7f375819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3758074430 0x7f375819a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 --2- 172.21.15.18:0/1765201278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3758073b10 0x7f375819a230 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:46.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 >> 172.21.15.18:0/1765201278 conn(0x7f37580fd210 msgr2=0x7f37580fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:46.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 shutdown_connections 2024-04-21T22:39:46.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:46.978+0000 7f375d400640 1 -- 172.21.15.18:0/1765201278 wait complete. 2024-04-21T22:39:46.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:39:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 -- 172.21.15.18:0/2199232298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c075c70 msgr2=0x7f3b8c076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 --2- 172.21.15.18:0/2199232298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c075c70 0x7f3b8c076050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009930 tx=0x7f3b8002bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 -- 172.21.15.18:0/2199232298 shutdown_connections 2024-04-21T22:39:47.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 --2- 172.21.15.18:0/2199232298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 --2- 172.21.15.18:0/2199232298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c076590 0x7f3b8c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 --2- 172.21.15.18:0/2199232298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c075c70 0x7f3b8c076050 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 -- 172.21.15.18:0/2199232298 >> 172.21.15.18:0/2199232298 conn(0x7f3b8c0ff3b0 msgr2=0x7f3b8c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 -- 172.21.15.18:0/2199232298 shutdown_connections 2024-04-21T22:39:47.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.217+0000 7f3b94000640 1 -- 172.21.15.18:0/2199232298 wait complete. 2024-04-21T22:39:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.218+0000 7f3b94000640 1 Processor -- start 2024-04-21T22:39:47.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.218+0000 7f3b94000640 1 -- start start 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.218+0000 7f3b94000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c075c70 0x7f3b8c19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.218+0000 7f3b94000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.218+0000 7f3b94000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b94000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c118130 con 0x7f3b8c076590 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b94000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c117fb0 con 0x7f3b8c075c70 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b94000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1182b0 con 0x7f3b8c1125c0 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40014/0 (socket says 172.21.15.18:40014) 2024-04-21T22:39:47.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 -- 172.21.15.18:0/1145765895 learned_addr learned my addr 172.21.15.18:0/1145765895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b92000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b91600640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c075c70 0x7f3b8c19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 -- 172.21.15.18:0/1145765895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 msgr2=0x7f3b8c1a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1a2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 -- 172.21.15.18:0/1145765895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c075c70 msgr2=0x7f3b8c19e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c075c70 0x7f3b8c19e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b90c00640 1 -- 172.21.15.18:0/1145765895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c1a3680 con 0x7f3b8c076590 2024-04-21T22:39:47.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.219+0000 7f3b92000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b90c00640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800e9f0 tx=0x7f3b7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b8a000640 1 -- 172.21.15.18:0/1145765895 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800cd80 con 0x7f3b8c076590 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1a3970 con 0x7f3b8c076590 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b8a000640 1 -- 172.21.15.18:0/1145765895 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b78005500 con 0x7f3b8c076590 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b8a000640 1 -- 172.21.15.18:0/1145765895 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78010690 con 0x7f3b8c076590 2024-04-21T22:39:47.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.220+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1ab200 con 0x7f3b8c076590 2024-04-21T22:39:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.223+0000 7f3b96daa740 1 Processor -- start 2024-04-21T22:39:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.223+0000 7f3b8a000640 1 -- 172.21.15.18:0/1145765895 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3b780046c0 con 0x7f3b8c076590 2024-04-21T22:39:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 -- start start 2024-04-21T22:39:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c16160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 0x55cca3c21670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca3b7a3a0 con 0x55cca3c1f280 2024-04-21T22:39:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cca3b22930 con 0x55cca3c166a0 2024-04-21T22:39:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b96daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cca3b76360 con 0x55cca3c15d80 2024-04-21T22:39:47.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 0x55cca3c21670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b91600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 0x55cca3c21670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40020/0 (socket says 172.21.15.18:40020) 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b90c00640 1 -- 172.21.15.18:0/260907792 learned_addr learned my addr 172.21.15.18:0/260907792 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.224+0000 7f3b92000640 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c16160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 -- 172.21.15.18:0/260907792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 msgr2=0x55cca3c16160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c16160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 -- 172.21.15.18:0/260907792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 msgr2=0x55cca3c21670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 0x55cca3c21670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b8a000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 0x7f3b740a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 -- 172.21.15.18:0/260907792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca388e3f0 con 0x55cca3c166a0 2024-04-21T22:39:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b8a000640 1 -- 172.21.15.18:0/1145765895 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3b780cf8d0 con 0x7f3b8c076590 2024-04-21T22:39:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b92000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 0x7f3b740a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.225+0000 7f3b91600640 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1ed40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009230 tx=0x7f3b80005bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eda81ef1ba83391 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.226+0000 7f3b7e600640 1 -- 172.21.15.18:0/260907792 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80042070 con 0x55cca3c166a0 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.226+0000 7f3b7e600640 1 -- 172.21.15.18:0/260907792 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8002c690 con 0x55cca3c166a0 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.226+0000 7f3b7e600640 1 -- 172.21.15.18:0/260907792 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004d40 con 0x55cca3c166a0 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- 172.21.15.18:0/260907792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 msgr2=0x55cca3c1ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b92000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 0x7f3b740a51c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c06aab0 tx=0x7f3b84009600 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1ed40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009230 tx=0x7f3b80005bf0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- 172.21.15.18:0/260907792 shutdown_connections 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c1f280 0x55cca3c21670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1ed40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 --2- 172.21.15.18:0/260907792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c16160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- 172.21.15.18:0/260907792 >> 172.21.15.18:0/260907792 conn(0x55cca3c104b0 msgr2=0x55cca3c10890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- 172.21.15.18:0/260907792 shutdown_connections 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- 172.21.15.18:0/260907792 wait complete. 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 -- start start 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.227+0000 7f3b96daa740 1 Processor -- start 2024-04-21T22:39:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 0x55cca3c1c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 0x55cca3c1ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cca3c22010 con 0x55cca3c15d80 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cca3b35d80 con 0x55cca3c166a0 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cca3c22190 con 0x55cca3c1f280 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b96daa740 10 client.0 _ll_register_callbacks cb 0x55cca3b722b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b91600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 0x55cca3c1c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b92000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 0x55cca3c1ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b91600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 0x55cca3c1c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40030/0 (socket says 172.21.15.18:40030) 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.228+0000 7f3b91600640 1 -- 172.21.15.18:0/890100892 learned_addr learned my addr 172.21.15.18:0/890100892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 -- 172.21.15.18:0/890100892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 msgr2=0x55cca3c1c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 -- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 msgr2=0x55cca3c1c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 0x55cca3c1c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 -- 172.21.15.18:0/890100892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca39587d0 con 0x55cca3c1f280 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b92000640 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 0x55cca3c1ce00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005fd0 tx=0x7f3b84004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc33f7157e79418c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b72a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8402b060 con 0x55cca3c1f280 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.229+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3b8401c670 con 0x55cca3c1f280 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cca3b878e0 con 0x55cca3c1f280 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3b8401c870 con 0x55cca3c1f280 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b96daa740 10 client.26929 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cca3c2e420 con 0x55cca3c1f280 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cca3b878e0 con 0x55cca3c1f280 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3b8401a040 con 0x55cca3c1f280 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b96daa740 10 client.26929 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.230+0000 7f3b96daa740 10 client.26929 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b96daa740 20 client.26929 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c2f8e0 0x55cca3c31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b96daa740 4 client.26929 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca3b81c30 con 0x55cca3c2f8e0 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b91600640 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c2f8e0 0x55cca3c31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b91600640 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c2f8e0 0x55cca3c31d50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d37b4e79bad086af server_cookie=317bb0a599267665 in_seq=0 out_seq=0 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.231+0000 7f3b72a00640 10 client.26929 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.232+0000 7f3b72a00640 1 -- 172.21.15.18:0/890100892 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cca3b81c30 con 0x55cca3c2f8e0 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.232+0000 7f3b72a00640 10 client.26929 handle_command_reply: tid=0 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.232+0000 7f3b96daa740 1 client.26929 shutdown 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.232+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 msgr2=0x55cca3c1ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.232+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 0x55cca3c1ce00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005fd0 tx=0x7f3b84004a40 comp rx=0 tx=0).stop 2024-04-21T22:39:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 shutdown_connections 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c2f8e0 0x55cca3c31d50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c1f280 0x55cca3c1ce00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c166a0 0x55cca3c1c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 --2- 172.21.15.18:0/890100892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c15d80 0x55cca3c1c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b72a00640 0 client.26929 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 >> 172.21.15.18:0/890100892 conn(0x55cca3c104b0 msgr2=0x55cca3c12200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 shutdown_connections 2024-04-21T22:39:47.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 1 -- 172.21.15.18:0/890100892 wait complete. 2024-04-21T22:39:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.233+0000 7f3b96daa740 20 client.26929 trim_cache size 0 max 16384 2024-04-21T22:39:47.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.248+0000 7f3b96daa740 1 Processor -- start 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.248+0000 7f3b96daa740 1 -- start start 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.248+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.248+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c2af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.248+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c37620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b96daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b3ad0 con 0x55cca3c166a0 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b96daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b5610 con 0x55cca3c1f280 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b96daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b41a0 con 0x55cca3c15d80 2024-04-21T22:39:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c37620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42030/0 (socket says 172.21.15.18:42030) 2024-04-21T22:39:47.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 -- 172.21.15.18:0/4287470904 learned_addr learned my addr 172.21.15.18:0/4287470904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 -- 172.21.15.18:0/4287470904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 msgr2=0x55cca3c37620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c37620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 -- 172.21.15.18:0/4287470904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 msgr2=0x55cca3c2af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c2af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.249+0000 7f3b91600640 1 -- 172.21.15.18:0/4287470904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca3c219a0 con 0x55cca3c15d80 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.250+0000 7f3b91600640 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3b8002c150 tx=0x7f3b8002bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b469cd884ae8ae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.250+0000 7f3b7dc00640 1 -- 172.21.15.18:0/4287470904 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80054070 con 0x55cca3c15d80 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.250+0000 7f3b7dc00640 1 -- 172.21.15.18:0/4287470904 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8004fbc0 con 0x55cca3c15d80 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.250+0000 7f3b7dc00640 1 -- 172.21.15.18:0/4287470904 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80042040 con 0x55cca3c15d80 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- 172.21.15.18:0/4287470904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 msgr2=0x55cca3c1eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3b8002c150 tx=0x7f3b8002bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- 172.21.15.18:0/4287470904 shutdown_connections 2024-04-21T22:39:47.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c37620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c2af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 --2- 172.21.15.18:0/4287470904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c1eab0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- 172.21.15.18:0/4287470904 >> 172.21.15.18:0/4287470904 conn(0x55cca3c104b0 msgr2=0x55cca3c10890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- 172.21.15.18:0/4287470904 shutdown_connections 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- 172.21.15.18:0/4287470904 wait complete. 2024-04-21T22:39:47.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 -- start start 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.251+0000 7f3b96daa740 1 Processor -- start 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c18e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b4f40 con 0x55cca3c166a0 2024-04-21T22:39:47.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b4870 con 0x55cca3c1f280 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c1b1ab0 con 0x55cca3c15d80 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b96daa740 10 client.0 _ll_register_callbacks cb 0x7f3b84011500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b90c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c18e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b91600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42034/0 (socket says 172.21.15.18:42034) 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b91600640 1 -- 172.21.15.18:0/2748274693 learned_addr learned my addr 172.21.15.18:0/2748274693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.252+0000 7f3b92000640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 -- 172.21.15.18:0/2748274693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 msgr2=0x55cca3c19570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c19570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 -- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 msgr2=0x55cca3c18e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c18e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 -- 172.21.15.18:0/2748274693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca3c94e90 con 0x55cca3c15d80 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b90c00640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c18e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b91600640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005e50 tx=0x7f3b80005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fe5a6e21cca4279 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b72a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:47.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80054070 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b8004fbc0 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.253+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3b8002ca80 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3b80042070 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 10 client.26935 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cca3c95fc0 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8004fbc0 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3b8004f7e0 con 0x55cca3c15d80 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 10 client.26935 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 10 client.26935 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:39:47.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 20 client.26935 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c962f0 0x55cca3c986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 4 client.26935 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:47.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cca3aff5a0 con 0x55cca3c962f0 2024-04-21T22:39:47.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.254+0000 7f3b90c00640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c962f0 0x55cca3c986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.255+0000 7f3b90c00640 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c962f0 0x55cca3c986e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=491dcaffe17eff99 server_cookie=b052282b02505f7b in_seq=0 out_seq=0 2024-04-21T22:39:47.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.255+0000 7f3b72a00640 10 client.26935 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.255+0000 7f3b72a00640 1 -- 172.21.15.18:0/2748274693 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cca3aff5a0 con 0x55cca3c962f0 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.255+0000 7f3b72a00640 10 client.26935 handle_command_reply: tid=0 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.255+0000 7f3b96daa740 1 client.26935 shutdown 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 msgr2=0x55cca3c27910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005e50 tx=0x7f3b80005b50 comp rx=0 tx=0).stop 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 shutdown_connections 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55cca3c962f0 0x55cca3c986e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca3c1f280 0x55cca3c19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b72a00640 0 client.26935 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cca3c166a0 0x55cca3c18e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 --2- 172.21.15.18:0/2748274693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cca3c15d80 0x55cca3c27910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 >> 172.21.15.18:0/2748274693 conn(0x55cca3c104b0 msgr2=0x55cca3c0ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 shutdown_connections 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 1 -- 172.21.15.18:0/2748274693 wait complete. 2024-04-21T22:39:47.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.256+0000 7f3b96daa740 20 client.26935 trim_cache size 0 max 16384 2024-04-21T22:39:47.266 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:47.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 msgr2=0x7f3b740a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 0x7f3b740a51c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c06aab0 tx=0x7f3b84009600 comp rx=0 tx=0).stop 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 msgr2=0x7f3b8c19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800e9f0 tx=0x7f3b7800edf0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 shutdown_connections 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3b740a2d00 0x7f3b740a51c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c1125c0 0x7f3b8c1a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b8c076590 0x7f3b8c19ebd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 --2- 172.21.15.18:0/1145765895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b8c075c70 0x7f3b8c19e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 >> 172.21.15.18:0/1145765895 conn(0x7f3b8c0ff3b0 msgr2=0x7f3b8c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 shutdown_connections 2024-04-21T22:39:47.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.257+0000 7f3b94000640 1 -- 172.21.15.18:0/1145765895 wait complete. 2024-04-21T22:39:47.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:39:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 -- 172.21.15.18:0/2551590794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 msgr2=0x7f3934103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 --2- 172.21.15.18:0/2551590794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f3934103be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f391c009860 tx=0x7f391c02bb70 comp rx=0 tx=0).stop 2024-04-21T22:39:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 -- 172.21.15.18:0/2551590794 shutdown_connections 2024-04-21T22:39:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 --2- 172.21.15.18:0/2551590794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f3934110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 --2- 172.21.15.18:0/2551590794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f3934103be0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 --2- 172.21.15.18:0/2551590794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 0x7f3934109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 -- 172.21.15.18:0/2551590794 >> 172.21.15.18:0/2551590794 conn(0x7f39340ff230 msgr2=0x7f3934101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 -- 172.21.15.18:0/2551590794 shutdown_connections 2024-04-21T22:39:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.496+0000 7f3938e00640 1 -- 172.21.15.18:0/2551590794 wait complete. 2024-04-21T22:39:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.497+0000 7f3938e00640 1 Processor -- start 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 -- start start 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f393419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 0x7f393419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113b80 con 0x7f3934104120 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113a00 con 0x7f3934103760 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f3938e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3934113d00 con 0x7f3934109770 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.498+0000 7f392be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40066/0 (socket says 172.21.15.18:40066) 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 -- 172.21.15.18:0/3219103934 learned_addr learned my addr 172.21.15.18:0/3219103934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f3933400640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f393419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f3933e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 0x7f393419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 -- 172.21.15.18:0/3219103934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 msgr2=0x7f393419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 0x7f393419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 -- 172.21.15.18:0/3219103934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 msgr2=0x7f393419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f393419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 -- 172.21.15.18:0/3219103934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393419f090 con 0x7f3934104120 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.499+0000 7f392be00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f391c037040 tx=0x7f391c004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.500+0000 7f3930c00640 1 -- 172.21.15.18:0/3219103934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c041020 con 0x7f3934104120 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.500+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393419f320 con 0x7f3934104120 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.500+0000 7f3930c00640 1 -- 172.21.15.18:0/3219103934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f391c02c9f0 con 0x7f3934104120 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.500+0000 7f3930c00640 1 -- 172.21.15.18:0/3219103934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c039040 con 0x7f3934104120 2024-04-21T22:39:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.500+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39341a6c10 con 0x7f3934104120 2024-04-21T22:39:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.504+0000 7f393d20d740 1 Processor -- start 2024-04-21T22:39:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.504+0000 7f393d20d740 1 -- start start 2024-04-21T22:39:47.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f3930c00640 1 -- 172.21.15.18:0/3219103934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f391c044020 con 0x7f3934104120 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350dc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a350353a0 con 0x557a350d0f70 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a34fdd930 con 0x557a350da470 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f393d20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a35031360 con 0x557a350d1890 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f3933400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f3933400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42060/0 (socket says 172.21.15.18:42060) 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f3933400640 1 -- 172.21.15.18:0/149321290 learned_addr learned my addr 172.21.15.18:0/149321290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f3933e00640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.505+0000 7f392be00640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350dc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 -- 172.21.15.18:0/149321290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 msgr2=0x557a350dc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350dc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 -- 172.21.15.18:0/149321290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 msgr2=0x557a350d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 -- 172.21.15.18:0/149321290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a34d493f0 con 0x557a350d1890 2024-04-21T22:39:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f392be00640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350dc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3933400640 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3924009ca0 tx=0x7f3924011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b873d052953df2b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3928c00640 1 -- 172.21.15.18:0/149321290 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392401e070 con 0x557a350d1890 2024-04-21T22:39:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3928c00640 1 -- 172.21.15.18:0/149321290 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3924019b10 con 0x557a350d1890 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3928c00640 1 -- 172.21.15.18:0/149321290 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392400eae0 con 0x557a350d1890 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.506+0000 7f3930c00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 0x7f39180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f3930c00640 1 -- 172.21.15.18:0/3219103934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f391c0f0ba0 con 0x7f3934104120 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f3933e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 0x7f39180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 -- 172.21.15.18:0/149321290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 msgr2=0x557a350d9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3924009ca0 tx=0x7f3924011810 comp rx=0 tx=0).stop 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 -- 172.21.15.18:0/149321290 shutdown_connections 2024-04-21T22:39:47.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350dc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d9f30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 --2- 172.21.15.18:0/149321290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.507+0000 7f393d20d740 1 -- 172.21.15.18:0/149321290 >> 172.21.15.18:0/149321290 conn(0x557a350cb6a0 msgr2=0x557a350cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.508+0000 7f393d20d740 1 -- 172.21.15.18:0/149321290 shutdown_connections 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.508+0000 7f3933e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 0x7f39180a5240 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c011040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.508+0000 7f393d20d740 1 -- 172.21.15.18:0/149321290 wait complete. 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.508+0000 7f393d20d740 1 -- start start 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.508+0000 7f393d20d740 1 Processor -- start 2024-04-21T22:39:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350d7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a350dd260 con 0x557a350d0f70 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a34ff0d80 con 0x557a350da470 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a350dd3e0 con 0x557a350d1890 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f393d20d740 10 client.0 _ll_register_callbacks cb 0x557a3502d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f3933400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f3933400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40076/0 (socket says 172.21.15.18:40076) 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f392be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f3933e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350d7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.509+0000 7f3933400640 1 -- 172.21.15.18:0/1996767553 learned_addr learned my addr 172.21.15.18:0/1996767553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 -- 172.21.15.18:0/1996767553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 msgr2=0x557a350d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 -- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 msgr2=0x557a350d7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350d7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 -- 172.21.15.18:0/1996767553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a34e137d0 con 0x557a350d0f70 2024-04-21T22:39:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3933400640 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3924009c70 tx=0x7f3924009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f6090167bdceff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3921600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924026030 con 0x557a350d0f70 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3924019640 con 0x557a350d0f70 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.510+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3924019b10 con 0x557a350d0f70 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3924030050 con 0x557a350d0f70 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 10 client.16821 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557a350e9530 con 0x557a350d0f70 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3924019b10 con 0x557a350d0f70 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f392400e970 con 0x557a350d0f70 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 10 client.16821 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 10 client.16821 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 20 client.16821 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a350ea990 0x557a350ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 4 client.16821 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:47.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.511+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a350428e0 con 0x557a350ea990 2024-04-21T22:39:47.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.512+0000 7f392be00640 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a350ea990 0x557a350ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.512+0000 7f392be00640 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a350ea990 0x557a350ecd80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5903561df009a093 server_cookie=b5d42e6023134f73 in_seq=0 out_seq=0 2024-04-21T22:39:47.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.512+0000 7f3921600640 10 client.16821 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:47.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.513+0000 7f3921600640 1 -- 172.21.15.18:0/1996767553 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a350428e0 con 0x557a350ea990 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.513+0000 7f3921600640 10 client.16821 handle_command_reply: tid=0 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.513+0000 7f393d20d740 1 client.16821 shutdown 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.513+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 msgr2=0x557a350d74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.513+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3924009c70 tx=0x7f3924009980 comp rx=0 tx=0).stop 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 shutdown_connections 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a350ea990 0x557a350ecd80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350da470 0x557a350d7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 --2- 172.21.15.18:0/1996767553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d0f70 0x557a350d74d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f3921600640 0 client.16821 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 >> 172.21.15.18:0/1996767553 conn(0x557a350cb6a0 msgr2=0x557a350cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 shutdown_connections 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 1 -- 172.21.15.18:0/1996767553 wait complete. 2024-04-21T22:39:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.514+0000 7f393d20d740 20 client.16821 trim_cache size 0 max 16384 2024-04-21T22:39:47.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 Processor -- start 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 -- start start 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350da470 0x557a350cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39341af540 con 0x557a350d1890 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39341b1080 con 0x557a350d0f70 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f393d20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39341afc10 con 0x557a350da470 2024-04-21T22:39:47.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f392be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f392be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40078/0 (socket says 172.21.15.18:40078) 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.529+0000 7f392be00640 1 -- 172.21.15.18:0/3697843249 learned_addr learned my addr 172.21.15.18:0/3697843249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f3933e00640 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350da470 0x557a350cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f3933400640 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 -- 172.21.15.18:0/3697843249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350da470 msgr2=0x557a350cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350da470 0x557a350cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 -- 172.21.15.18:0/3697843249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 msgr2=0x557a350e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 -- 172.21.15.18:0/3697843249 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a350d16c0 con 0x557a350d1890 2024-04-21T22:39:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f392be00640 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f391c02c180 tx=0x7f391c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a300822660cc075 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f3923e00640 1 -- 172.21.15.18:0/3697843249 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c0bcd10 con 0x557a350d1890 2024-04-21T22:39:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f3923e00640 1 -- 172.21.15.18:0/3697843249 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f391c034640 con 0x557a350d1890 2024-04-21T22:39:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.530+0000 7f3923e00640 1 -- 172.21.15.18:0/3697843249 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c0bcb30 con 0x557a350d1890 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 -- 172.21.15.18:0/3697843249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 msgr2=0x557a350d7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f391c02c180 tx=0x7f391c0327b0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 -- 172.21.15.18:0/3697843249 shutdown_connections 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350da470 0x557a350cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350d1890 0x557a350d7d70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 --2- 172.21.15.18:0/3697843249 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 -- 172.21.15.18:0/3697843249 >> 172.21.15.18:0/3697843249 conn(0x557a350cb6a0 msgr2=0x557a350cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 -- 172.21.15.18:0/3697843249 shutdown_connections 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.531+0000 7f393d20d740 1 -- 172.21.15.18:0/3697843249 wait complete. 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 -- start start 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 Processor -- start 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39341b09b0 con 0x557a350da470 2024-04-21T22:39:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39341b02e0 con 0x557a350d0f70 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39341ad520 con 0x557a350d1890 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.532+0000 7f393d20d740 10 client.0 _ll_register_callbacks cb 0x7f392401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40094/0 (socket says 172.21.15.18:40094) 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 -- 172.21.15.18:0/2691427615 learned_addr learned my addr 172.21.15.18:0/2691427615 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933400640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f392be00640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 -- 172.21.15.18:0/2691427615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 msgr2=0x557a350ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 -- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 msgr2=0x557a350e28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 -- 172.21.15.18:0/2691427615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a350de850 con 0x557a350da470 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933400640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3933e00640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f392c019f90 tx=0x7f392c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be34ac8befc1c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.533+0000 7f3921600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c02c030 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a3503cc30 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f392c004b20 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f392c038050 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f393d20d740 10 client.16827 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557a35150cc0 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557a3503cc30 con 0x557a350da470 2024-04-21T22:39:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.534+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f392c00b040 con 0x557a350da470 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 10 client.16827 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 10 client.16827 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 20 client.16827 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a35151470 0x557a35153890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 4 client.16827 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a34fba5a0 con 0x557a35151470 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f3933400640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a35151470 0x557a35153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f3933400640 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a35151470 0x557a35153890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2caa205ef7bea993 server_cookie=a2e6906e9290ffba in_seq=0 out_seq=0 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.535+0000 7f3921600640 10 client.16827 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f3921600640 1 -- 172.21.15.18:0/2691427615 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a34fba5a0 con 0x557a35151470 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f3921600640 10 client.16827 handle_command_reply: tid=0 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 client.16827 shutdown 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 msgr2=0x557a350de1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f392c019f90 tx=0x7f392c004ab0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 shutdown_connections 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x557a35151470 0x557a35153890 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a350da470 0x557a350de1b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a350d1890 0x557a350ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 --2- 172.21.15.18:0/2691427615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a350d0f70 0x557a350e28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f3921600640 0 client.16827 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 >> 172.21.15.18:0/2691427615 conn(0x557a350cb6a0 msgr2=0x557a350cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 shutdown_connections 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 1 -- 172.21.15.18:0/2691427615 wait complete. 2024-04-21T22:39:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.536+0000 7f393d20d740 20 client.16827 trim_cache size 0 max 16384 2024-04-21T22:39:47.545 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:47.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 msgr2=0x7f39180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 0x7f39180a5240 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f392c005fd0 tx=0x7f392c011040 comp rx=0 tx=0).stop 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 msgr2=0x7f393419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f391c037040 tx=0x7f391c004590 comp rx=0 tx=0).stop 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 shutdown_connections 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f39180a2d80 0x7f39180a5240 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3934109770 0x7f393419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3934104120 0x7f393419a5e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 --2- 172.21.15.18:0/3219103934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3934103760 0x7f393419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 >> 172.21.15.18:0/3219103934 conn(0x7f39340ff230 msgr2=0x7f39340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 shutdown_connections 2024-04-21T22:39:47.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.537+0000 7f3938e00640 1 -- 172.21.15.18:0/3219103934 wait complete. 2024-04-21T22:39:47.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:47 smithi018 ceph-mon[26614]: pgmap v175: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:47.553 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:47 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1765201278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:47.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:39:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:47 smithi047 ceph-mon[31561]: pgmap v175: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:47.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:47 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1765201278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 -- 172.21.15.18:0/1343044063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41181042e0 msgr2=0x7f41181107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 --2- 172.21.15.18:0/1343044063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41181042e0 0x7f41181107f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4110009930 tx=0x7f411002bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 -- 172.21.15.18:0/1343044063 shutdown_connections 2024-04-21T22:39:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 --2- 172.21.15.18:0/1343044063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41181042e0 0x7f41181107f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 --2- 172.21.15.18:0/1343044063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118103920 0x7f4118103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 --2- 172.21.15.18:0/1343044063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4118109930 0x7f4118109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 -- 172.21.15.18:0/1343044063 >> 172.21.15.18:0/1343044063 conn(0x7f41180ff3b0 msgr2=0x7f41181017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 -- 172.21.15.18:0/1343044063 shutdown_connections 2024-04-21T22:39:47.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.755+0000 7f411e400640 1 -- 172.21.15.18:0/1343044063 wait complete. 2024-04-21T22:39:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.756+0000 7f411e400640 1 Processor -- start 2024-04-21T22:39:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.756+0000 7f411e400640 1 -- start start 2024-04-21T22:39:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41181042e0 0x7f411819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118109930 0x7f411819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113d90 con 0x7f4118109930 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113c10 con 0x7f41181042e0 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f411e400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113f10 con 0x7f4118103920 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42100/0 (socket says 172.21.15.18:42100) 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 -- 172.21.15.18:0/835775485 learned_addr learned my addr 172.21.15.18:0/835775485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4116a00640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41181042e0 0x7f411819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117e00640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118109930 0x7f411819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 -- 172.21.15.18:0/835775485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41181042e0 msgr2=0x7f411819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41181042e0 0x7f411819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 -- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118109930 msgr2=0x7f411819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118109930 0x7f411819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.757+0000 7f4117400640 1 -- 172.21.15.18:0/835775485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411819f1e0 con 0x7f4118103920 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f4117400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f410800eb90 tx=0x7f410800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f410fe00640 1 -- 172.21.15.18:0/835775485 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108004d20 con 0x7f4118103920 2024-04-21T22:39:47.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f410fe00640 1 -- 172.21.15.18:0/835775485 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f410800ee90 con 0x7f4118103920 2024-04-21T22:39:47.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f410fe00640 1 -- 172.21.15.18:0/835775485 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108010830 con 0x7f4118103920 2024-04-21T22:39:47.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411819f4d0 con 0x7f4118103920 2024-04-21T22:39:47.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.758+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41181a6d60 con 0x7f4118103920 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.761+0000 7f4121062740 1 Processor -- start 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f410fe00640 1 -- 172.21.15.18:0/835775485 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4108005020 con 0x7f4118103920 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 -- start start 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fc6a0 0x5637b0804d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b0807670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5637b07603a0 con 0x5637b07fc6a0 2024-04-21T22:39:47.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5637b0708930 con 0x5637b07fbd80 2024-04-21T22:39:47.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4121062740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b075c360 con 0x5637b0805280 2024-04-21T22:39:47.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4117400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fc6a0 0x5637b0804d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4117e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4116a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b0807670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4117e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49016/0 (socket says 172.21.15.18:49016) 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.762+0000 7f4117e00640 1 -- 172.21.15.18:0/2272078900 learned_addr learned my addr 172.21.15.18:0/2272078900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 -- 172.21.15.18:0/2272078900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 msgr2=0x5637b0807670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b0807670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 -- 172.21.15.18:0/2272078900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fc6a0 msgr2=0x5637b0804d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fc6a0 0x5637b0804d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 -- 172.21.15.18:0/2272078900 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b04743f0 con 0x5637b07fbd80 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f4117e00640 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4110009930 tx=0x7f4110009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e6a1d53b7ed382 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f410fe00640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 0x7f40fc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.763+0000 7f410cc00640 1 -- 172.21.15.18:0/2272078900 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110045070 con 0x5637b07fbd80 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f410cc00640 1 -- 172.21.15.18:0/2272078900 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f411002c5d0 con 0x5637b07fbd80 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f410cc00640 1 -- 172.21.15.18:0/2272078900 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110004ac0 con 0x5637b07fbd80 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f4117400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 0x7f40fc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f410fe00640 1 -- 172.21.15.18:0/835775485 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f41080cf990 con 0x7f4118103920 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f4121062740 1 -- 172.21.15.18:0/2272078900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 msgr2=0x5637b07fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f4117400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 0x7f40fc0a5240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41080cd190 tx=0x7f41080d3430 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.764+0000 7f4121062740 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4110009930 tx=0x7f4110009560 comp rx=0 tx=0).stop 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 -- 172.21.15.18:0/2272078900 shutdown_connections 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b0807670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fc6a0 0x5637b0804d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 --2- 172.21.15.18:0/2272078900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b07fc160 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 -- 172.21.15.18:0/2272078900 >> 172.21.15.18:0/2272078900 conn(0x5637b07f64b0 msgr2=0x5637b07f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 -- 172.21.15.18:0/2272078900 shutdown_connections 2024-04-21T22:39:47.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 -- 172.21.15.18:0/2272078900 wait complete. 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.765+0000 7f4121062740 1 -- start start 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 Processor -- start 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 0x5637b0802360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b0802de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5637b0808010 con 0x5637b0805280 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5637b071bd80 con 0x5637b07fc6a0 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b0808190 con 0x5637b07fbd80 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4121062740 10 client.0 _ll_register_callbacks cb 0x5637b07582b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4116a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4116a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49020/0 (socket says 172.21.15.18:49020) 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.766+0000 7f4116a00640 1 -- 172.21.15.18:0/1542747870 learned_addr learned my addr 172.21.15.18:0/1542747870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4117e00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 0x5637b0802360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 -- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 msgr2=0x5637b0802360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 0x5637b0802360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 -- 172.21.15.18:0/1542747870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 msgr2=0x5637b0802de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b0802de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 -- 172.21.15.18:0/1542747870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b053e7d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4117e00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 0x5637b0802360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4116a00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4104012700 tx=0x7f4104012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=825ea84d1f7e5e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4101600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410400f8c0 con 0x5637b07fc6a0 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f410400fa60 con 0x5637b07fc6a0 2024-04-21T22:39:47.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.767+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f411002c5d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f410400fc60 con 0x5637b07fc6a0 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 10 client.26909 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5637b08143d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f411002c5d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f410401c420 con 0x5637b07fc6a0 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 10 client.26909 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 10 client.26909 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:39:47.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 20 client.26909 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b0815930 0x5637b0817d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 4 client.26909 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.768+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637b076d8e0 con 0x5637b0815930 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.769+0000 7f4117e00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b0815930 0x5637b0817d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.769+0000 7f4117e00640 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b0815930 0x5637b0817d70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2554ddc4b80451e4 server_cookie=74ae46cd689d5fd5 in_seq=0 out_seq=0 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.769+0000 7f4101600640 10 client.26909 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4101600640 1 -- 172.21.15.18:0/1542747870 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5637b076d8e0 con 0x5637b0815930 2024-04-21T22:39:47.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4101600640 10 client.26909 handle_command_reply: tid=0 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4121062740 1 client.26909 shutdown 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 msgr2=0x5637b08028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4104012700 tx=0x7f4104012bc0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.770+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 shutdown_connections 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b0815930 0x5637b0817d70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b0802de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b08028a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 --2- 172.21.15.18:0/1542747870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fbd80 0x5637b0802360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4101600640 0 client.26909 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:47.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 >> 172.21.15.18:0/1542747870 conn(0x5637b07f64b0 msgr2=0x5637b07f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 shutdown_connections 2024-04-21T22:39:47.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 1 -- 172.21.15.18:0/1542747870 wait complete. 2024-04-21T22:39:47.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.771+0000 7f4121062740 20 client.26909 trim_cache size 0 max 16384 2024-04-21T22:39:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 Processor -- start 2024-04-21T22:39:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 -- start start 2024-04-21T22:39:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b0810ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b07f5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f41181af600 con 0x5637b07fbd80 2024-04-21T22:39:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41181b1140 con 0x5637b07fc6a0 2024-04-21T22:39:47.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.786+0000 7f4121062740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41181afcd0 con 0x5637b0805280 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40164/0 (socket says 172.21.15.18:40164) 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 -- 172.21.15.18:0/2239764035 learned_addr learned my addr 172.21.15.18:0/2239764035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4116a00640 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b0810ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b07f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 -- 172.21.15.18:0/2239764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 msgr2=0x5637b07f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b07f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 -- 172.21.15.18:0/2239764035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 msgr2=0x5637b0810ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b0810ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 -- 172.21.15.18:0/2239764035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b08183f0 con 0x5637b07fbd80 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.787+0000 7f4117e00640 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4110006010 tx=0x7f4110004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f5019404a383ae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4103e00640 1 -- 172.21.15.18:0/2239764035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110045040 con 0x5637b07fbd80 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4103e00640 1 -- 172.21.15.18:0/2239764035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41100047d0 con 0x5637b07fbd80 2024-04-21T22:39:47.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4103e00640 1 -- 172.21.15.18:0/2239764035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100052c0 con 0x5637b07fbd80 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 -- 172.21.15.18:0/2239764035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 msgr2=0x5637b0804a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4110006010 tx=0x7f4110004760 comp rx=0 tx=0).stop 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 -- 172.21.15.18:0/2239764035 shutdown_connections 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b0805280 0x5637b07f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fc6a0 0x5637b0810ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 --2- 172.21.15.18:0/2239764035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b07fbd80 0x5637b0804a90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.788+0000 7f4121062740 1 -- 172.21.15.18:0/2239764035 >> 172.21.15.18:0/2239764035 conn(0x5637b07f64b0 msgr2=0x5637b07f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.789+0000 7f4121062740 1 -- 172.21.15.18:0/2239764035 shutdown_connections 2024-04-21T22:39:47.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.789+0000 7f4121062740 1 -- 172.21.15.18:0/2239764035 wait complete. 2024-04-21T22:39:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.789+0000 7f4121062740 1 -- start start 2024-04-21T22:39:47.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.789+0000 7f4121062740 1 Processor -- start 2024-04-21T22:39:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b080d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b080a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f41181b0a70 con 0x5637b0805280 2024-04-21T22:39:47.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41181b03a0 con 0x5637b07fbd80 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41181ad5e0 con 0x5637b07fc6a0 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4121062740 10 client.0 _ll_register_callbacks cb 0x7f4104009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4117e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b080a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42160/0 (socket says 172.21.15.18:42160) 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4117e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b080d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 -- 172.21.15.18:0/2233826913 learned_addr learned my addr 172.21.15.18:0/2233826913 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 -- 172.21.15.18:0/2233826913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 msgr2=0x5637b080d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b080d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 -- 172.21.15.18:0/2233826913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 msgr2=0x5637b080a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b080a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.790+0000 7f4116a00640 1 -- 172.21.15.18:0/2233826913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b080a920 con 0x5637b07fc6a0 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4116a00640 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5637b0801bc0 tx=0x7f410400f9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2d6412cb5502ff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4101600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410400fe70 con 0x5637b07fc6a0 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f410401cd10 con 0x5637b07fc6a0 2024-04-21T22:39:47.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41100047d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4104034050 con 0x5637b07fc6a0 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4121062740 10 client.26968 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.791+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5637b087c750 con 0x5637b07fc6a0 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41100047d0 con 0x5637b07fc6a0 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4104003a00 con 0x5637b07fc6a0 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 10 client.26968 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 10 client.26968 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 20 client.26968 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:47.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b087cea0 0x5637b087f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:47.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 4 client.26968 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637b0767c30 con 0x5637b087cea0 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.792+0000 7f4117e00640 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b087cea0 0x5637b087f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4117e00640 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b087cea0 0x5637b087f2c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e78afbf50d1ef376 server_cookie=7627ea22945b16ea in_seq=0 out_seq=0 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4101600640 10 client.26968 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4101600640 1 -- 172.21.15.18:0/2233826913 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637b0767c30 con 0x5637b087cea0 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4101600640 10 client.26968 handle_command_reply: tid=0 2024-04-21T22:39:47.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 client.26968 shutdown 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 msgr2=0x5637b080d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5637b0801bc0 tx=0x7f410400f9a0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 shutdown_connections 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5637b087cea0 0x5637b087f2c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5637b0805280 0x5637b080a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4101600640 0 client.26968 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b07fc6a0 0x5637b080d920 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 --2- 172.21.15.18:0/2233826913 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5637b07fbd80 0x5637b080d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 >> 172.21.15.18:0/2233826913 conn(0x5637b07f64b0 msgr2=0x5637b07f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 shutdown_connections 2024-04-21T22:39:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 1 -- 172.21.15.18:0/2233826913 wait complete. 2024-04-21T22:39:47.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.793+0000 7f4121062740 20 client.26968 trim_cache size 0 max 16384 2024-04-21T22:39:47.804 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 msgr2=0x7f40fc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 0x7f40fc0a5240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41080cd190 tx=0x7f41080d3430 comp rx=0 tx=0).stop 2024-04-21T22:39:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 msgr2=0x7f411819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f410800eb90 tx=0x7f410800c6a0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 shutdown_connections 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40fc0a2d80 0x7f40fc0a5240 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4118109930 0x7f411819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41181042e0 0x7f411819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 --2- 172.21.15.18:0/835775485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4118103920 0x7f411819a1f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 >> 172.21.15.18:0/835775485 conn(0x7f41180ff3b0 msgr2=0x7f41180ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 shutdown_connections 2024-04-21T22:39:47.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:47.794+0000 7f411e400640 1 -- 172.21.15.18:0/835775485 wait complete. 2024-04-21T22:39:47.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:39:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:47 smithi081 ceph-mon[31692]: pgmap v175: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:47 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1765201278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.029+0000 7f1242000640 1 -- 172.21.15.18:0/3915859781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 msgr2=0x7f123c10e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.029+0000 7f1242000640 1 --2- 172.21.15.18:0/3915859781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c10e3c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1234009cd0 tx=0x7f123402c0f0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 -- 172.21.15.18:0/3915859781 shutdown_connections 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 --2- 172.21.15.18:0/3915859781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c10e3c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 --2- 172.21.15.18:0/3915859781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c101540 0x7f123c1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 --2- 172.21.15.18:0/3915859781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c107600 0x7f123c1079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 -- 172.21.15.18:0/3915859781 >> 172.21.15.18:0/3915859781 conn(0x7f123c0fd010 msgr2=0x7f123c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 -- 172.21.15.18:0/3915859781 shutdown_connections 2024-04-21T22:39:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.030+0000 7f1242000640 1 -- 172.21.15.18:0/3915859781 wait complete. 2024-04-21T22:39:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.031+0000 7f1242000640 1 Processor -- start 2024-04-21T22:39:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.031+0000 7f1242000640 1 -- start start 2024-04-21T22:39:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.031+0000 7f1242000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 0x7f123c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1242000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1242000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1242000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1118f0 con 0x7f123c101540 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1242000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f123c111770 con 0x7f123c101f00 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1242000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f123c111a70 con 0x7f123c107600 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1240c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 0x7f123c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1240c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 0x7f123c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40180/0 (socket says 172.21.15.18:40180) 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42182/0 (socket says 172.21.15.18:42182) 2024-04-21T22:39:48.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1240c00640 1 -- 172.21.15.18:0/3061910945 learned_addr learned my addr 172.21.15.18:0/3061910945 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f123be00640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 -- 172.21.15.18:0/3061910945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 msgr2=0x7f123c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 -- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 msgr2=0x7f123c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 0x7f123c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.032+0000 7f1241600640 1 -- 172.21.15.18:0/3061910945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c19cda0 con 0x7f123c107600 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1241600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1234037040 tx=0x7f1234032ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1239600640 1 -- 172.21.15.18:0/3061910945 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234041020 con 0x7f123c107600 2024-04-21T22:39:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1239600640 1 -- 172.21.15.18:0/3061910945 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1234034cd0 con 0x7f123c107600 2024-04-21T22:39:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1239600640 1 -- 172.21.15.18:0/3061910945 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234039040 con 0x7f123c107600 2024-04-21T22:39:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c19d030 con 0x7f123c107600 2024-04-21T22:39:48.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.033+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c1a4920 con 0x7f123c107600 2024-04-21T22:39:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.038+0000 7f1246211740 1 Processor -- start 2024-04-21T22:39:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.038+0000 7f1239600640 1 -- 172.21.15.18:0/3061910945 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1234044020 con 0x7f123c107600 2024-04-21T22:39:48.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.038+0000 7f1246211740 1 -- start start 2024-04-21T22:39:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d015381f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015382470 0x55d015384860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0152dd3a0 con 0x55d015382470 2024-04-21T22:39:48.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d015285930 con 0x55d015378f70 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1246211740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d0152d9360 con 0x55d015379890 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f123be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f123be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49066/0 (socket says 172.21.15.18:49066) 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f123be00640 1 -- 172.21.15.18:0/282122668 learned_addr learned my addr 172.21.15.18:0/282122668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1240c00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d015381f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f123be00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015382470 0x55d015384860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.039+0000 7f1240c00640 1 -- 172.21.15.18:0/282122668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 msgr2=0x55d015379350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1240c00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1240c00640 1 -- 172.21.15.18:0/282122668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015382470 msgr2=0x55d015384860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1240c00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015382470 0x55d015384860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1239600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 0x7f12200a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1240c00640 1 -- 172.21.15.18:0/282122668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d014ff13f0 con 0x55d015379890 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f123be00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1239600640 1 -- 172.21.15.18:0/3061910945 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f12340f0e50 con 0x7f123c107600 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1241600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 0x7f12200a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1240c00640 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d015381f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1224009c80 tx=0x7f1224011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39729c7c4163138 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1231c00640 1 -- 172.21.15.18:0/282122668 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224004230 con 0x55d015379890 2024-04-21T22:39:48.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1231c00640 1 -- 172.21.15.18:0/282122668 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12240043d0 con 0x55d015379890 2024-04-21T22:39:48.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.040+0000 7f1231c00640 1 -- 172.21.15.18:0/282122668 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224004cd0 con 0x55d015379890 2024-04-21T22:39:48.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 -- 172.21.15.18:0/282122668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 msgr2=0x55d015381f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1241600640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 0x7f12200a5240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f12340bd120 tx=0x7f12340b7f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d015381f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1224009c80 tx=0x7f1224011810 comp rx=0 tx=0).stop 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 -- 172.21.15.18:0/282122668 shutdown_connections 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015382470 0x55d015384860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d015381f30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 --2- 172.21.15.18:0/282122668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d015379350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 -- 172.21.15.18:0/282122668 >> 172.21.15.18:0/282122668 conn(0x55d0153736a0 msgr2=0x55d015373a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 -- 172.21.15.18:0/282122668 shutdown_connections 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.041+0000 7f1246211740 1 -- 172.21.15.18:0/282122668 wait complete. 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 -- start start 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 Processor -- start 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d01537fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015382470 0x55d01537ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d015385260 con 0x55d015379890 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d015298d80 con 0x55d015378f70 2024-04-21T22:39:48.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.042+0000 7f1246211740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d0153853e0 con 0x55d015382470 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f1246211740 10 client.0 _ll_register_callbacks cb 0x55d0152d52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f1240c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d01537fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49072/0 (socket says 172.21.15.18:49072) 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 -- 172.21.15.18:0/1973602892 learned_addr learned my addr 172.21.15.18:0/1973602892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015382470 0x55d01537ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 -- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015382470 msgr2=0x55d01537ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015382470 0x55d01537ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 -- 172.21.15.18:0/1973602892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 msgr2=0x55d01537fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d01537fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.043+0000 7f123be00640 1 -- 172.21.15.18:0/1973602892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0150bb7d0 con 0x55d015378f70 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f123be00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f122c011d40 tx=0x7f122c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6298404be8eae5b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f122a000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c004220 con 0x55d015378f70 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f122c0043c0 con 0x55d015378f70 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12240043d0 con 0x55d015378f70 2024-04-21T22:39:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f122c029050 con 0x55d015378f70 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f1246211740 10 client.26927 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.044+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d015391590 con 0x55d015378f70 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12240043d0 con 0x55d015378f70 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f122c00e3e0 con 0x55d015378f70 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 10 client.26927 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 10 client.26927 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 20 client.26927 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0153929a0 0x55d015394dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 4 client.26927 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0152ea8e0 con 0x55d0153929a0 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.045+0000 7f1240c00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0153929a0 0x55d015394dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.046+0000 7f1240c00640 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0153929a0 0x55d015394dd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79cb0e8d1d266294 server_cookie=cacb68b83565cdb1 in_seq=0 out_seq=0 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.046+0000 7f122a000640 10 client.26927 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f122a000640 1 -- 172.21.15.18:0/1973602892 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0152ea8e0 con 0x55d0153929a0 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f122a000640 10 client.26927 handle_command_reply: tid=0 2024-04-21T22:39:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 client.26927 shutdown 2024-04-21T22:39:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 msgr2=0x55d01537f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f122c011d40 tx=0x7f122c004730 comp rx=0 tx=0).stop 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 shutdown_connections 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0153929a0 0x55d015394dd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015382470 0x55d01537ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d01537fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 --2- 172.21.15.18:0/1973602892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015378f70 0x55d01537f540 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f122a000640 0 client.26927 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 >> 172.21.15.18:0/1973602892 conn(0x55d0153736a0 msgr2=0x55d0153753f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 shutdown_connections 2024-04-21T22:39:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.047+0000 7f1246211740 1 -- 172.21.15.18:0/1973602892 wait complete. 2024-04-21T22:39:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.048+0000 7f1246211740 20 client.26927 trim_cache size 0 max 16384 2024-04-21T22:39:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.062+0000 7f1246211740 1 Processor -- start 2024-04-21T22:39:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.062+0000 7f1246211740 1 -- start start 2024-04-21T22:39:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d01537fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d01539a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1ad1b0 con 0x55d015378f70 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1aecf0 con 0x55d015382470 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1246211740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1ad880 con 0x55d015379890 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40198/0 (socket says 172.21.15.18:40198) 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 -- 172.21.15.18:0/3256089558 learned_addr learned my addr 172.21.15.18:0/3256089558 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f1240c00640 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d01537fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d01539a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 -- 172.21.15.18:0/3256089558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 msgr2=0x55d01537fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.063+0000 7f123be00640 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d01537fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f123be00640 1 -- 172.21.15.18:0/3256089558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 msgr2=0x55d01539a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f123be00640 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d01539a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f123be00640 1 -- 172.21.15.18:0/3256089558 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01536dae0 con 0x55d015378f70 2024-04-21T22:39:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f123be00640 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e920 tx=0x7f122c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ec71a0b27e96c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f1231200640 1 -- 172.21.15.18:0/3256089558 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c026030 con 0x55d015378f70 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f1231200640 1 -- 172.21.15.18:0/3256089558 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f122c011b40 con 0x55d015378f70 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.064+0000 7f1231200640 1 -- 172.21.15.18:0/3256089558 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c0052a0 con 0x55d015378f70 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- 172.21.15.18:0/3256089558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 msgr2=0x55d01538e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e920 tx=0x7f122c005f90 comp rx=0 tx=0).stop 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- 172.21.15.18:0/3256089558 shutdown_connections 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d01539a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015379890 0x55d01537fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 --2- 172.21.15.18:0/3256089558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015378f70 0x55d01538e120 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- 172.21.15.18:0/3256089558 >> 172.21.15.18:0/3256089558 conn(0x55d0153736a0 msgr2=0x55d015372690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- 172.21.15.18:0/3256089558 shutdown_connections 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- 172.21.15.18:0/3256089558 wait complete. 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 -- start start 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.065+0000 7f1246211740 1 Processor -- start 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 0x55d01538a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d0153f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d0153f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1ae620 con 0x55d015379890 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1adf50 con 0x55d015382470 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f123c1ab190 con 0x55d015378f70 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1246211740 10 client.0 _ll_register_callbacks cb 0x7f122c0115b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f123be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 0x55d01538a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f1240c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d0153f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f123be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 0x55d01538a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42218/0 (socket says 172.21.15.18:42218) 2024-04-21T22:39:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f123be00640 1 -- 172.21.15.18:0/647804267 learned_addr learned my addr 172.21.15.18:0/647804267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.066+0000 7f123be00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d0153f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 -- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 msgr2=0x55d01538a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 0x55d01538a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 -- 172.21.15.18:0/647804267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 msgr2=0x55d0153f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d0153f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 -- 172.21.15.18:0/647804267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0153f5090 con 0x55d015379890 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f123be00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d0153f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1240c00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d0153f4590 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204b612ae8837a35 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f122a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224031060 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1224004450 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.067+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122c011b40 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f122401e040 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 10 client.16860 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d015401bd0 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f122c011b40 con 0x55d015379890 2024-04-21T22:39:48.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f1224024040 con 0x55d015379890 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 10 client.16860 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 20 client.16860 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0154020a0 0x55d015404490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 4 client.16860 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0152e4c30 con 0x55d0154020a0 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.068+0000 7f123be00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0154020a0 0x55d015404490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.069+0000 7f123be00640 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0154020a0 0x55d015404490 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aaba5bb136ccd07a server_cookie=f621f39a857c48d in_seq=0 out_seq=0 2024-04-21T22:39:48.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.069+0000 7f122a000640 10 client.16860 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.069+0000 7f122a000640 1 -- 172.21.15.18:0/647804267 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0152e4c30 con 0x55d0154020a0 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.069+0000 7f122a000640 10 client.16860 handle_command_reply: tid=0 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.069+0000 7f1246211740 1 client.16860 shutdown 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 msgr2=0x55d0153f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d0153f4590 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224009790 comp rx=0 tx=0).stop 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 shutdown_connections 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55d0154020a0 0x55d015404490 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d015382470 0x55d0153f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d015379890 0x55d0153f4590 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 --2- 172.21.15.18:0/647804267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d015378f70 0x55d01538a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f122a000640 0 client.16860 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 >> 172.21.15.18:0/647804267 conn(0x55d0153736a0 msgr2=0x55d015374840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 shutdown_connections 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 1 -- 172.21.15.18:0/647804267 wait complete. 2024-04-21T22:39:48.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.070+0000 7f1246211740 20 client.16860 trim_cache size 0 max 16384 2024-04-21T22:39:48.078 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:48.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 msgr2=0x7f12200a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 0x7f12200a5240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f12340bd120 tx=0x7f12340b7f90 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 msgr2=0x7f123c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1234037040 tx=0x7f1234032ea0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 shutdown_connections 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f12200a2d80 0x7f12200a5240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f123c107600 0x7f123c19c670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f123c101f00 0x7f123c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 --2- 172.21.15.18:0/3061910945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c101540 0x7f123c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 >> 172.21.15.18:0/3061910945 conn(0x7f123c0fd010 msgr2=0x7f123c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 shutdown_connections 2024-04-21T22:39:48.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.071+0000 7f1242000640 1 -- 172.21.15.18:0/3061910945 wait complete. 2024-04-21T22:39:48.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:39:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 -- 172.21.15.18:0/838856720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81125c0 msgr2=0x7fbfb81149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 --2- 172.21.15.18:0/838856720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81125c0 0x7fbfb81149b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009ca0 tx=0x7fbfb002c100 comp rx=0 tx=0).stop 2024-04-21T22:39:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 -- 172.21.15.18:0/838856720 shutdown_connections 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 --2- 172.21.15.18:0/838856720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81125c0 0x7fbfb81149b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 --2- 172.21.15.18:0/838856720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb8076590 0x7fbfb8112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 --2- 172.21.15.18:0/838856720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb8076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 -- 172.21.15.18:0/838856720 >> 172.21.15.18:0/838856720 conn(0x7fbfb80ff3b0 msgr2=0x7fbfb81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 -- 172.21.15.18:0/838856720 shutdown_connections 2024-04-21T22:39:48.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.307+0000 7fbfc0200640 1 -- 172.21.15.18:0/838856720 wait complete. 2024-04-21T22:39:48.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.308+0000 7fbfc0200640 1 Processor -- start 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.308+0000 7fbfc0200640 1 -- start start 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb8076590 0x7fbfb819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb81125c0 0x7fbfb81a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81180e0 con 0x7fbfb8076590 2024-04-21T22:39:48.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8117f60 con 0x7fbfb8075c70 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfc0200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb8118260 con 0x7fbfb81125c0 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb8076590 0x7fbfb819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49106/0 (socket says 172.21.15.18:49106) 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 -- 172.21.15.18:0/2367450700 learned_addr learned my addr 172.21.15.18:0/2367450700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbe200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb81125c0 0x7fbfb81a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 -- 172.21.15.18:0/2367450700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb81125c0 msgr2=0x7fbfb81a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb81125c0 0x7fbfb81a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.309+0000 7fbfbd800640 1 -- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb8076590 msgr2=0x7fbfb819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfbd800640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb8076590 0x7fbfb819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfbd800640 1 -- 172.21.15.18:0/2367450700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb81a3600 con 0x7fbfb8075c70 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfbd800640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00ea60 tx=0x7fbfac00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfb6000640 1 -- 172.21.15.18:0/2367450700 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00cde0 con 0x7fbfb8075c70 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfb6000640 1 -- 172.21.15.18:0/2367450700 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfac0035f0 con 0x7fbfb8075c70 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb81a38f0 con 0x7fbfb8075c70 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfb6000640 1 -- 172.21.15.18:0/2367450700 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac010670 con 0x7fbfb8075c70 2024-04-21T22:39:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.310+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb81ab180 con 0x7fbfb8075c70 2024-04-21T22:39:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.313+0000 7fbfc2f65740 1 Processor -- start 2024-04-21T22:39:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 -- start start 2024-04-21T22:39:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfb6000640 1 -- 172.21.15.18:0/2367450700 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fbfac0037a0 con 0x7fbfb8075c70 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b960526a0 0x559b9605ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b9605b280 0x559b9605d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b95fb63a0 con 0x559b9605b280 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b95f5e930 con 0x559b96051d80 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b95fb2360 con 0x559b960526a0 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfbd800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b960526a0 0x559b9605ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49116/0 (socket says 172.21.15.18:49116) 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfbe200640 1 -- 172.21.15.18:0/3327863788 learned_addr learned my addr 172.21.15.18:0/3327863788 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.314+0000 7fbfbce00640 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b9605b280 0x559b9605d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 -- 172.21.15.18:0/3327863788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b960526a0 msgr2=0x559b9605ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b960526a0 0x559b9605ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 -- 172.21.15.18:0/3327863788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b9605b280 msgr2=0x559b9605d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b9605b280 0x559b9605d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 -- 172.21.15.18:0/3327863788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b95cca3f0 con 0x559b96051d80 2024-04-21T22:39:48.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfbe200640 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0004af0 tx=0x7fbfb0005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d022bb0fefd9a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfaaa00640 1 -- 172.21.15.18:0/3327863788 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0045020 con 0x559b96051d80 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfaaa00640 1 -- 172.21.15.18:0/3327863788 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb003a040 con 0x559b96051d80 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.315+0000 7fbfaaa00640 1 -- 172.21.15.18:0/3327863788 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0039040 con 0x559b96051d80 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfb6000640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 0x7fbfa00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3327863788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 msgr2=0x559b96052160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0004af0 tx=0x7fbfb0005f80 comp rx=0 tx=0).stop 2024-04-21T22:39:48.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfb6000640 1 -- 172.21.15.18:0/2367450700 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbfac0cf760 con 0x7fbfb8075c70 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfbd800640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 0x7fbfa00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3327863788 shutdown_connections 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b9605b280 0x559b9605d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b960526a0 0x559b9605ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3327863788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b96052160 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3327863788 >> 172.21.15.18:0/3327863788 conn(0x559b9604c4b0 msgr2=0x559b9604c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3327863788 shutdown_connections 2024-04-21T22:39:48.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.316+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3327863788 wait complete. 2024-04-21T22:39:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.317+0000 7fbfbd800640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 0x7fbfa00a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559b96051850 tx=0x7fbfac0d5530 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.317+0000 7fbfc2f65740 1 -- start start 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.317+0000 7fbfc2f65740 1 Processor -- start 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b960583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96058e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b9605e010 con 0x559b960526a0 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559b95f71d80 con 0x559b96051d80 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559b9605e190 con 0x559b9605b280 2024-04-21T22:39:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfc2f65740 10 client.0 _ll_register_callbacks cb 0x559b95fae2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b960583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40264/0 (socket says 172.21.15.18:40264) 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbce00640 1 -- 172.21.15.18:0/2916315998 learned_addr learned my addr 172.21.15.18:0/2916315998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbe200640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96058e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.318+0000 7fbfbce00640 1 -- 172.21.15.18:0/2916315998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 msgr2=0x559b96058e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfbce00640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96058e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfbce00640 1 -- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 msgr2=0x559b960583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfbce00640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b960583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfbce00640 1 -- 172.21.15.18:0/2916315998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b95d947d0 con 0x559b960526a0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfbce00640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4012700 tx=0x7fbfa4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d222596dd1b48bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbf9f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004020 con 0x559b960526a0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbfa40041c0 con 0x559b960526a0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb003a040 con 0x559b960526a0 2024-04-21T22:39:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.319+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbfa40043c0 con 0x559b960526a0 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 10 client.16872 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559b9606a400 con 0x559b960526a0 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb003a040 con 0x559b960526a0 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fbfa4003cb0 con 0x559b960526a0 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 10 client.16872 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 20 client.16872 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:48.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b9606b8c0 0x559b9606dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 4 client.16872 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.320+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b95fc38e0 con 0x559b9606b8c0 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.321+0000 7fbfbe200640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b9606b8c0 0x559b9606dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.321+0000 7fbfbe200640 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b9606b8c0 0x559b9606dcb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59ae76a933286c16 server_cookie=a56fd07089fe88e8 in_seq=0 out_seq=0 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.321+0000 7fbf9f400640 10 client.16872 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.322+0000 7fbf9f400640 1 -- 172.21.15.18:0/2916315998 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b95fc38e0 con 0x559b9606b8c0 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.322+0000 7fbf9f400640 10 client.16872 handle_command_reply: tid=0 2024-04-21T22:39:48.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.322+0000 7fbfc2f65740 1 client.16872 shutdown 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.322+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 msgr2=0x559b960588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.322+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4012700 tx=0x7fbfa4012bc0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 shutdown_connections 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b9606b8c0 0x559b9606dcb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96058e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b960526a0 0x559b960588e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/2916315998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b96051d80 0x559b960583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbf9f400640 0 client.16872 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:48.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 >> 172.21.15.18:0/2916315998 conn(0x559b9604c4b0 msgr2=0x559b9604e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 shutdown_connections 2024-04-21T22:39:48.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 1 -- 172.21.15.18:0/2916315998 wait complete. 2024-04-21T22:39:48.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.323+0000 7fbfc2f65740 20 client.16872 trim_cache size 0 max 16384 2024-04-21T22:39:48.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 Processor -- start 2024-04-21T22:39:48.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 -- start start 2024-04-21T22:39:48.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b9605aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b3b40 con 0x559b96051d80 2024-04-21T22:39:48.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b5680 con 0x559b960526a0 2024-04-21T22:39:48.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.338+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b4210 con 0x559b9605b280 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b9605aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49136/0 (socket says 172.21.15.18:49136) 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 -- 172.21.15.18:0/3678307424 learned_addr learned my addr 172.21.15.18:0/3678307424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbe200640 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 -- 172.21.15.18:0/3678307424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 msgr2=0x559b96073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 -- 172.21.15.18:0/3678307424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 msgr2=0x559b9605aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b9605aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 -- 172.21.15.18:0/3678307424 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b9606e020 con 0x559b960526a0 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.339+0000 7fbfbce00640 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbfa401c630 tx=0x7fbfa4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b6942c149bad6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfaa000640 1 -- 172.21.15.18:0/3678307424 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4029030 con 0x559b960526a0 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfaa000640 1 -- 172.21.15.18:0/3678307424 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfa4004020 con 0x559b960526a0 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfaa000640 1 -- 172.21.15.18:0/3678307424 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa401cae0 con 0x559b960526a0 2024-04-21T22:39:48.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3678307424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 msgr2=0x559b96066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbfa401c630 tx=0x7fbfa4005880 comp rx=0 tx=0).stop 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3678307424 shutdown_connections 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b96066ed0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/3678307424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b9605aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3678307424 >> 172.21.15.18:0/3678307424 conn(0x559b9604c4b0 msgr2=0x559b9604e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3678307424 shutdown_connections 2024-04-21T22:39:48.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.340+0000 7fbfc2f65740 1 -- 172.21.15.18:0/3678307424 wait complete. 2024-04-21T22:39:48.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.341+0000 7fbfc2f65740 1 -- start start 2024-04-21T22:39:48.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.341+0000 7fbfc2f65740 1 Processor -- start 2024-04-21T22:39:48.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b960556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96055be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b4fb0 con 0x559b96051d80 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b48e0 con 0x559b960526a0 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb81b1b20 con 0x559b9605b280 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfc2f65740 10 client.0 _ll_register_callbacks cb 0x7fbfa4005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40276/0 (socket says 172.21.15.18:40276) 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 -- 172.21.15.18:0/4149462725 learned_addr learned my addr 172.21.15.18:0/4149462725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:48.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbce00640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b960556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 -- 172.21.15.18:0/4149462725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 msgr2=0x559b96055be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96055be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 -- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 msgr2=0x559b960556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b960556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.342+0000 7fbfbe200640 1 -- 172.21.15.18:0/4149462725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b960d0dd0 con 0x559b96051d80 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbfbe200640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009bf0 tx=0x7fbfb0005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4385c4def895e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbf9f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:48.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0045070 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fbfb0032de0 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa4004020 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbfb0039040 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbfc2f65740 10 client.16878 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559b960d2070 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.343+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfa4004020 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fbfb0004000 con 0x559b96051d80 2024-04-21T22:39:48.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 10 client.16878 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 20 client.16878 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b960d2400 0x559b960d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 4 client.16878 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b95fbdc30 con 0x559b960d2400 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.344+0000 7fbfbce00640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b960d2400 0x559b960d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfbce00640 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b960d2400 0x559b960d47f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9385199dc0d364a server_cookie=cc1eba553a3ebd6f in_seq=0 out_seq=0 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbf9f400640 10 client.16878 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:48.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbf9f400640 1 -- 172.21.15.18:0/4149462725 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b95fbdc30 con 0x559b960d2400 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbf9f400640 10 client.16878 handle_command_reply: tid=0 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfc2f65740 1 client.16878 shutdown 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 msgr2=0x559b96055160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009bf0 tx=0x7fbfb0005d80 comp rx=0 tx=0).stop 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 shutdown_connections 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.345+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559b960d2400 0x559b960d47f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559b9605b280 0x559b96055be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559b960526a0 0x559b960556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbf9f400640 0 client.16878 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 --2- 172.21.15.18:0/4149462725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b96051d80 0x559b96055160 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 >> 172.21.15.18:0/4149462725 conn(0x559b9604c4b0 msgr2=0x559b9604ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 shutdown_connections 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 1 -- 172.21.15.18:0/4149462725 wait complete. 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc2f65740 20 client.16878 trim_cache size 0 max 16384 2024-04-21T22:39:48.353 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:39:48.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 msgr2=0x7fbfa00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 0x7fbfa00a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x559b96051850 tx=0x7fbfac0d5530 comp rx=0 tx=0).stop 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 msgr2=0x7fbfb819e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.346+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00ea60 tx=0x7fbfac00ef20 comp rx=0 tx=0).stop 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 shutdown_connections 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbfa00a2d00 0x7fbfa00a51c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb81125c0 0x7fbfb81a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb8076590 0x7fbfb819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 --2- 172.21.15.18:0/2367450700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbfb8075c70 0x7fbfb819e660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:48.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 >> 172.21.15.18:0/2367450700 conn(0x7fbfb80ff3b0 msgr2=0x7fbfb81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:48.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 shutdown_connections 2024-04-21T22:39:48.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:48.347+0000 7fbfc0200640 1 -- 172.21.15.18:0/2367450700 wait complete. 2024-04-21T22:39:49.366 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:39:49.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:39:49.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:39:49.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 -- 172.21.15.18:0/3290442948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff340075c70 msgr2=0x7ff340076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 --2- 172.21.15.18:0/3290442948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff340075c70 0x7ff340076050 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff330009930 tx=0x7ff33002bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 -- 172.21.15.18:0/3290442948 shutdown_connections 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 --2- 172.21.15.18:0/3290442948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3401123d0 0x7ff3401147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 --2- 172.21.15.18:0/3290442948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff340111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 --2- 172.21.15.18:0/3290442948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff340075c70 0x7ff340076050 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 -- 172.21.15.18:0/3290442948 >> 172.21.15.18:0/3290442948 conn(0x7ff3400ff1e0 msgr2=0x7ff340101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 -- 172.21.15.18:0/3290442948 shutdown_connections 2024-04-21T22:39:49.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.596+0000 7ff345400640 1 -- 172.21.15.18:0/3290442948 wait complete. 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 Processor -- start 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 -- start start 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff34019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3401123d0 0x7ff3401a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff340117f30 con 0x7ff340075c70 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff340117db0 con 0x7ff340076590 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff345400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401180b0 con 0x7ff3401123d0 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.598+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40290/0 (socket says 172.21.15.18:40290) 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 -- 172.21.15.18:0/3336835543 learned_addr learned my addr 172.21.15.18:0/3336835543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff344a00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3401123d0 0x7ff3401a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff337e00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff34019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 -- 172.21.15.18:0/3336835543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3401123d0 msgr2=0x7ff3401a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3401123d0 0x7ff3401a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 -- 172.21.15.18:0/3336835543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 msgr2=0x7ff34019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff34019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff33fe00640 1 -- 172.21.15.18:0/3336835543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3401a3490 con 0x7ff340075c70 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.599+0000 7ff337e00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff34019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff33fe00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff330009230 tx=0x7ff33002cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff33d600640 1 -- 172.21.15.18:0/3336835543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330041070 con 0x7ff340075c70 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff33d600640 1 -- 172.21.15.18:0/3336835543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff330004450 con 0x7ff340075c70 2024-04-21T22:39:49.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3401a3720 con 0x7ff340075c70 2024-04-21T22:39:49.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff33d600640 1 -- 172.21.15.18:0/3336835543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330034440 con 0x7ff340075c70 2024-04-21T22:39:49.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.600+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3401ab010 con 0x7ff340075c70 2024-04-21T22:39:49.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff33d600640 1 -- 172.21.15.18:0/3336835543 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff330044070 con 0x7ff340075c70 2024-04-21T22:39:49.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 Processor -- start 2024-04-21T22:39:49.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 -- start start 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c629a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c629d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593c61efdf0 con 0x5593c62918e0 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5593c61f5040 con 0x5593c629ade0 2024-04-21T22:39:49.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.604+0000 7ff34960d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5593c619d8c0 con 0x5593c6292200 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40302/0 (socket says 172.21.15.18:40302) 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 -- 172.21.15.18:0/1571321093 learned_addr learned my addr 172.21.15.18:0/1571321093 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff33fe00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c629a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff337e00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c629d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 -- 172.21.15.18:0/1571321093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 msgr2=0x5593c629a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c629a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 -- 172.21.15.18:0/1571321093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 msgr2=0x5593c629d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c629d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff344a00640 1 -- 172.21.15.18:0/1571321093 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c5fd17e0 con 0x5593c62918e0 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.605+0000 7ff33fe00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c629a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff344a00640 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff338009f30 tx=0x7ff3380118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc70bbfd68f0279 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff33d600640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 0x7ff3240a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff335200640 1 -- 172.21.15.18:0/1571321093 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338004d20 con 0x5593c62918e0 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff335200640 1 -- 172.21.15.18:0/1571321093 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff338004050 con 0x5593c62918e0 2024-04-21T22:39:49.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff335200640 1 -- 172.21.15.18:0/1571321093 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338005260 con 0x5593c62918e0 2024-04-21T22:39:49.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff33d600640 1 -- 172.21.15.18:0/3336835543 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff3300f0d80 con 0x7ff340075c70 2024-04-21T22:39:49.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.606+0000 7ff33fe00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 0x7ff3240a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- 172.21.15.18:0/1571321093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 msgr2=0x5593c6291cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff338009f30 tx=0x7ff3380118d0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff33fe00640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 0x7ff3240a51c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5593c62913b0 tx=0x7ff3300dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- 172.21.15.18:0/1571321093 shutdown_connections 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c629d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c629a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 --2- 172.21.15.18:0/1571321093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6291cc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- 172.21.15.18:0/1571321093 >> 172.21.15.18:0/1571321093 conn(0x5593c628c010 msgr2=0x5593c628c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- 172.21.15.18:0/1571321093 shutdown_connections 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- 172.21.15.18:0/1571321093 wait complete. 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.607+0000 7ff34960d740 1 -- start start 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 Processor -- start 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c6298320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c6298860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593c61b0d20 con 0x5593c62918e0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5593c61f1000 con 0x5593c629ade0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5593c629dbd0 con 0x5593c6292200 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff34960d740 10 client.0 _ll_register_callbacks cb 0x5593c61ec0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40308/0 (socket says 172.21.15.18:40308) 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.608+0000 7ff344a00640 1 -- 172.21.15.18:0/985436262 learned_addr learned my addr 172.21.15.18:0/985436262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff337e00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c6298320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c6298860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 -- 172.21.15.18:0/985436262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 msgr2=0x5593c6298320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c6298320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 -- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 msgr2=0x5593c6298860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c6298860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 -- 172.21.15.18:0/985436262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c6031f70 con 0x5593c62918e0 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff344a00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff338004810 tx=0x7ff338004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25cdf791537d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff32d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338004a40 con 0x5593c62918e0 2024-04-21T22:39:49.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff338004be0 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.609+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff338004050 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff338036050 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 10 client.16890 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5593c5ec9170 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff338004050 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff338028480 con 0x5593c62918e0 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 10 client.16890 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 20 client.16890 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c62aafd0 0x5593c62ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 4 client.16890 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.610+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593c6202580 con 0x5593c62aafd0 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.611+0000 7ff337e00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c62aafd0 0x5593c62ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.611+0000 7ff337e00640 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c62aafd0 0x5593c62ad3c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c7a64addcf313f server_cookie=bbd2619af2c555a7 in_seq=0 out_seq=0 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.611+0000 7ff32d600640 10 client.16890 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.612+0000 7ff32d600640 1 -- 172.21.15.18:0/985436262 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5593c6202580 con 0x5593c62aafd0 2024-04-21T22:39:49.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.612+0000 7ff32d600640 10 client.16890 handle_command_reply: tid=0 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.612+0000 7ff34960d740 1 client.16890 shutdown 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 msgr2=0x5593c6297de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff338004810 tx=0x7ff338004760 comp rx=0 tx=0).stop 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 shutdown_connections 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c629ade0 0x5593c6298860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c62aafd0 0x5593c62ad3c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c6298320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 --2- 172.21.15.18:0/985436262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c62918e0 0x5593c6297de0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 >> 172.21.15.18:0/985436262 conn(0x5593c628c010 msgr2=0x5593c628dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff32d600640 0 client.16890 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 shutdown_connections 2024-04-21T22:39:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 1 -- 172.21.15.18:0/985436262 wait complete. 2024-04-21T22:39:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.613+0000 7ff34960d740 20 client.16890 trim_cache size 0 max 16384 2024-04-21T22:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 Processor -- start 2024-04-21T22:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 -- start start 2024-04-21T22:39:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 0x5593c629a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c62a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c62b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b39c0 con 0x5593c629ade0 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b5500 con 0x5593c62918e0 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff34960d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b4090 con 0x5593c6292200 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.633+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c62b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff344a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 0x5593c629a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c62a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff344a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 0x5593c629a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49176/0 (socket says 172.21.15.18:49176) 2024-04-21T22:39:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff344a00640 1 -- 172.21.15.18:0/967938059 learned_addr learned my addr 172.21.15.18:0/967938059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 -- 172.21.15.18:0/967938059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 msgr2=0x5593c629a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 0x5593c629a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 -- 172.21.15.18:0/967938059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 msgr2=0x5593c62b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c62b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 -- 172.21.15.18:0/967938059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593c628a490 con 0x5593c6292200 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.634+0000 7ff337e00640 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c62a69a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5593c62adaf0 tx=0x7ff328005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0567d769b70cfa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff32fe00640 1 -- 172.21.15.18:0/967938059 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32801e050 con 0x5593c6292200 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff32fe00640 1 -- 172.21.15.18:0/967938059 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32801e6d0 con 0x5593c6292200 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff32fe00640 1 -- 172.21.15.18:0/967938059 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328012ac0 con 0x5593c6292200 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 -- 172.21.15.18:0/967938059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 msgr2=0x5593c62a69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c62a69a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5593c62adaf0 tx=0x7ff328005900 comp rx=0 tx=0).stop 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 -- 172.21.15.18:0/967938059 shutdown_connections 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c62b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c6292200 0x5593c62a69a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 --2- 172.21.15.18:0/967938059 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c62918e0 0x5593c629a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 -- 172.21.15.18:0/967938059 >> 172.21.15.18:0/967938059 conn(0x5593c628c010 msgr2=0x5593c628b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 -- 172.21.15.18:0/967938059 shutdown_connections 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.635+0000 7ff34960d740 1 -- 172.21.15.18:0/967938059 wait complete. 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 -- start start 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 Processor -- start 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c629f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b4e30 con 0x5593c629ade0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b4760 con 0x5593c6292200 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.636+0000 7ff34960d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401b19a0 con 0x5593c62918e0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff34960d740 10 client.0 _ll_register_callbacks cb 0x7ff328009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c629f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff337e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42310/0 (socket says 172.21.15.18:42310) 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff337e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49184/0 (socket says 172.21.15.18:49184) 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 -- 172.21.15.18:0/2322821572 learned_addr learned my addr 172.21.15.18:0/2322821572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 -- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 msgr2=0x5593c62a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 -- 172.21.15.18:0/2322821572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 msgr2=0x5593c629f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c629f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff344a00640 1 -- 172.21.15.18:0/2322821572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593c629fcd0 con 0x5593c62918e0 2024-04-21T22:39:49.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.637+0000 7ff337e00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff344a00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff3380048b0 tx=0x7ff338004990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cd5795792e8eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3380286b0 con 0x5593c62918e0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32801e6d0 con 0x5593c62918e0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff338028ac0 con 0x5593c62918e0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff338028cc0 con 0x5593c62918e0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff34960d740 10 client.27022 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5593c63120a0 con 0x5593c62918e0 2024-04-21T22:39:49.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32801e6d0 con 0x5593c62918e0 2024-04-21T22:39:49.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.638+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff3380458f0 con 0x5593c62918e0 2024-04-21T22:39:49.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 10 client.27022 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:49.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 10 client.27022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:49.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 20 client.27022 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c6312710 0x5593c6314b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 4 client.27022 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5593c61fc8d0 con 0x5593c6312710 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.639+0000 7ff337e00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c6312710 0x5593c6314b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.640+0000 7ff337e00640 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c6312710 0x5593c6314b00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d170d9ef4a30eec server_cookie=857fe163874f65be in_seq=0 out_seq=0 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.640+0000 7ff32d600640 10 client.27022 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff32d600640 1 -- 172.21.15.18:0/2322821572 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5593c61fc8d0 con 0x5593c6312710 2024-04-21T22:39:49.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff32d600640 10 client.27022 handle_command_reply: tid=0 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 client.27022 shutdown 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 msgr2=0x5593c62a2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff3380048b0 tx=0x7ff338004990 comp rx=0 tx=0).stop 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 shutdown_connections 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593c629ade0 0x5593c629f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5593c6292200 0x5593c62a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5593c6312710 0x5593c6314b00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 --2- 172.21.15.18:0/2322821572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593c62918e0 0x5593c62a2f00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 >> 172.21.15.18:0/2322821572 conn(0x5593c628c010 msgr2=0x5593c628a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff32d600640 0 client.27022 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 shutdown_connections 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.641+0000 7ff34960d740 1 -- 172.21.15.18:0/2322821572 wait complete. 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff34960d740 20 client.27022 trim_cache size 0 max 16384 2024-04-21T22:39:49.648 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:39:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "833805ff-04de-4a69-b87b-afb0715a035a", 2024-04-21T22:39:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:39:49.649 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 msgr2=0x7ff3240a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 0x7ff3240a51c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5593c62913b0 tx=0x7ff3300dd040 comp rx=0 tx=0).stop 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 msgr2=0x7ff34019e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff330009230 tx=0x7ff33002cba0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 shutdown_connections 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff3240a2d00 0x7ff3240a51c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3401123d0 0x7ff3401a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff340076590 0x7ff34019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 --2- 172.21.15.18:0/3336835543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff340075c70 0x7ff34019e4f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.642+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 >> 172.21.15.18:0/3336835543 conn(0x7ff3400ff1e0 msgr2=0x7ff340113b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.643+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 shutdown_connections 2024-04-21T22:39:49.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.643+0000 7ff345400640 1 -- 172.21.15.18:0/3336835543 wait complete. 2024-04-21T22:39:49.659 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:49 smithi018 ceph-mon[26614]: pgmap v176: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:49.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:39:49.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:39:49.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:49 smithi047 ceph-mon[31561]: pgmap v176: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:49 smithi081 ceph-mon[31692]: pgmap v176: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:39:49.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 -- 172.21.15.18:0/4281271805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8103910 msgr2=0x7f87d8103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 --2- 172.21.15.18:0/4281271805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8103910 0x7f87d8103d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009900 tx=0x7f87c802bc30 comp rx=0 tx=0).stop 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 -- 172.21.15.18:0/4281271805 shutdown_connections 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 --2- 172.21.15.18:0/4281271805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d81042d0 0x7f87d81107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 --2- 172.21.15.18:0/4281271805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8103910 0x7f87d8103d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 --2- 172.21.15.18:0/4281271805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d8109920 0x7f87d8109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.902+0000 7f87e0800640 1 -- 172.21.15.18:0/4281271805 >> 172.21.15.18:0/4281271805 conn(0x7f87d80ff3c0 msgr2=0x7f87d81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.903+0000 7f87e0800640 1 -- 172.21.15.18:0/4281271805 shutdown_connections 2024-04-21T22:39:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.903+0000 7f87e0800640 1 -- 172.21.15.18:0/4281271805 wait complete. 2024-04-21T22:39:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.904+0000 7f87e0800640 1 Processor -- start 2024-04-21T22:39:49.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.904+0000 7f87e0800640 1 -- start start 2024-04-21T22:39:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d8103910 0x7f87d819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 0x7f87d819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87d8113d80 con 0x7f87d8103910 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87d8113c00 con 0x7f87d8109920 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87e0800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87d8113f00 con 0x7f87d81042d0 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42338/0 (socket says 172.21.15.18:42338) 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87dd400640 1 -- 172.21.15.18:0/2764792070 learned_addr learned my addr 172.21.15.18:0/2764792070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87dde00640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d8103910 0x7f87d819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.905+0000 7f87de800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 0x7f87d819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 -- 172.21.15.18:0/2764792070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 msgr2=0x7f87d819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 0x7f87d819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 -- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d8103910 msgr2=0x7f87d819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d8103910 0x7f87d819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 -- 172.21.15.18:0/2764792070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d819f210 con 0x7f87d81042d0 2024-04-21T22:39:49.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87de800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 0x7f87d819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.906+0000 7f87dd400640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f87c802efd0 tx=0x7f87c8004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.907+0000 7f87d2a00640 1 -- 172.21.15.18:0/2764792070 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8041070 con 0x7f87d81042d0 2024-04-21T22:39:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.907+0000 7f87d2a00640 1 -- 172.21.15.18:0/2764792070 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87c80054e0 con 0x7f87d81042d0 2024-04-21T22:39:49.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.907+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d819f4a0 con 0x7f87d81042d0 2024-04-21T22:39:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.907+0000 7f87d2a00640 1 -- 172.21.15.18:0/2764792070 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8003d70 con 0x7f87d81042d0 2024-04-21T22:39:49.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.907+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d81a6d90 con 0x7f87d81042d0 2024-04-21T22:39:49.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 Processor -- start 2024-04-21T22:39:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87d2a00640 1 -- 172.21.15.18:0/2764792070 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f87c8044070 con 0x7f87d81042d0 2024-04-21T22:39:49.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 -- start start 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 0x555928571880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x5559285741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5559284cc410 con 0x555928571dc0 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5559284747e0 con 0x5559285691e0 2024-04-21T22:39:49.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.911+0000 7f87e33df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5559284c83d0 con 0x5559285688c0 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42340/0 (socket says 172.21.15.18:42340) 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87dde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 0x555928571880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 -- 172.21.15.18:0/259089639 learned_addr learned my addr 172.21.15.18:0/259089639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 -- 172.21.15.18:0/259089639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 msgr2=0x555928571880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 0x555928571880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 -- 172.21.15.18:0/259089639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 msgr2=0x5559285741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x5559285741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87de800640 1 -- 172.21.15.18:0/259089639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559282aa7d0 con 0x5559285688c0 2024-04-21T22:39:49.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.912+0000 7f87dde00640 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 0x555928571880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87de800640 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fb0 tx=0x7f87d4010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb44f3270a71160 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87d2a00640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 0x7f87c00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87d2a00640 1 -- 172.21.15.18:0/2764792070 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f87c80f0f40 con 0x7f87d81042d0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87c7000640 1 -- 172.21.15.18:0/259089639 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4016070 con 0x5559285688c0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87c7000640 1 -- 172.21.15.18:0/259089639 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d4012bf0 con 0x5559285688c0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87c7000640 1 -- 172.21.15.18:0/259089639 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d401bd20 con 0x5559285688c0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.913+0000 7f87dde00640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 0x7f87c00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 -- 172.21.15.18:0/259089639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 msgr2=0x555928568ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fb0 tx=0x7f87d4010800 comp rx=0 tx=0).stop 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 -- 172.21.15.18:0/259089639 shutdown_connections 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x5559285741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285691e0 0x555928571880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 --2- 172.21.15.18:0/259089639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285688c0 0x555928568ca0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 -- 172.21.15.18:0/259089639 >> 172.21.15.18:0/259089639 conn(0x555928562ff0 msgr2=0x5559285633d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 -- 172.21.15.18:0/259089639 shutdown_connections 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87dde00640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 0x7f87c00a5240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x555928568390 tx=0x7f87cc005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.914+0000 7f87e33df740 1 -- 172.21.15.18:0/259089639 wait complete. 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.915+0000 7f87e33df740 1 -- start start 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.915+0000 7f87e33df740 1 Processor -- start 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285688c0 0x55592856eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x55592856f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555928574bb0 con 0x555928571dc0 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555928487c40 con 0x5559285688c0 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555928574d30 con 0x5559285691e0 2024-04-21T22:39:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87e33df740 10 client.0 _ll_register_callbacks cb 0x555928487630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42342/0 (socket says 172.21.15.18:42342) 2024-04-21T22:39:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 -- 172.21.15.18:0/3003007910 learned_addr learned my addr 172.21.15.18:0/3003007910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87de800640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x55592856f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dde00640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285688c0 0x55592856eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 -- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285688c0 msgr2=0x55592856eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285688c0 0x55592856eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 -- 172.21.15.18:0/3003007910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 msgr2=0x55592856f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x55592856f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87dd400640 1 -- 172.21.15.18:0/3003007910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559281e03f0 con 0x5559285691e0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.916+0000 7f87de800640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x55592856f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87dd400640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f87c80bd210 tx=0x7f87c8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c71f35ff07aa7573 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87bb400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c804b040 con 0x5559285691e0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f87c80c5cf0 con 0x5559285691e0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d4012bf0 con 0x5559285691e0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f87c80bce70 con 0x5559285691e0 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87e33df740 10 client.27034 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.917+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5559281a00f0 con 0x5559285691e0 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d4012bf0 con 0x5559285691e0 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f87c80bc960 con 0x5559285691e0 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 10 client.27034 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 10 client.27034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 20 client.27034 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555928582200 0x555928584620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 4 client.27034 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:39:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559284dfc40 con 0x555928582200 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.918+0000 7f87dde00640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555928582200 0x555928584620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.919+0000 7f87dde00640 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555928582200 0x555928584620 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84704465bb76093b server_cookie=7a57be73c3d42f45 in_seq=0 out_seq=0 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.919+0000 7f87bb400640 10 client.27034 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87bb400640 1 -- 172.21.15.18:0/3003007910 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5559284dfc40 con 0x555928582200 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87bb400640 10 client.27034 handle_command_reply: tid=0 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87e33df740 1 client.27034 shutdown 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 msgr2=0x55592856f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f87c80bd210 tx=0x7f87c8005fd0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.920+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 shutdown_connections 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555928571dc0 0x55592856f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x555928582200 0x555928584620 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856f420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 --2- 172.21.15.18:0/3003007910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5559285688c0 0x55592856eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87bb400640 0 client.27034 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 >> 172.21.15.18:0/3003007910 conn(0x555928562ff0 msgr2=0x555928564d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 shutdown_connections 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 1 -- 172.21.15.18:0/3003007910 wait complete. 2024-04-21T22:39:49.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.921+0000 7f87e33df740 20 client.27034 trim_cache size 0 max 16384 2024-04-21T22:39:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 Processor -- start 2024-04-21T22:39:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 -- start start 2024-04-21T22:39:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x555928571610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592857da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x555928561f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81ab290 con 0x5559285688c0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81acdd0 con 0x555928571dc0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.945+0000 7f87e33df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81ab960 con 0x5559285691e0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87de800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x555928561f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592857da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87de800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x555928561f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49228/0 (socket says 172.21.15.18:49228) 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87de800640 1 -- 172.21.15.18:0/2840088955 learned_addr learned my addr 172.21.15.18:0/2840088955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dde00640 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x555928571610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 -- 172.21.15.18:0/2840088955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 msgr2=0x555928561f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x555928561f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 -- 172.21.15.18:0/2840088955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 msgr2=0x555928571610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x555928571610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.946+0000 7f87dd400640 1 -- 172.21.15.18:0/2840088955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559285633d0 con 0x5559285691e0 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.947+0000 7f87dd400640 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592857da70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87c80bd4a0 tx=0x7f87c8003840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9f01a50fce45a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.947+0000 7f87c6600640 1 -- 172.21.15.18:0/2840088955 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c804b050 con 0x5559285691e0 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.947+0000 7f87c6600640 1 -- 172.21.15.18:0/2840088955 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87c8004c80 con 0x5559285691e0 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.947+0000 7f87c6600640 1 -- 172.21.15.18:0/2840088955 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c80bd510 con 0x5559285691e0 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 -- 172.21.15.18:0/2840088955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 msgr2=0x55592857da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592857da70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87c80bd4a0 tx=0x7f87c8003840 comp rx=0 tx=0).stop 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 -- 172.21.15.18:0/2840088955 shutdown_connections 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x555928561f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592857da70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 --2- 172.21.15.18:0/2840088955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x555928571610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 -- 172.21.15.18:0/2840088955 >> 172.21.15.18:0/2840088955 conn(0x555928562ff0 msgr2=0x555928561800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 -- 172.21.15.18:0/2840088955 shutdown_connections 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.948+0000 7f87e33df740 1 -- 172.21.15.18:0/2840088955 wait complete. 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.949+0000 7f87e33df740 1 -- start start 2024-04-21T22:39:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.949+0000 7f87e33df740 1 Processor -- start 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.949+0000 7f87e33df740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x55592856bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.949+0000 7f87e33df740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87e33df740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x55592856c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87e33df740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81ac700 con 0x5559285688c0 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87e33df740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81ac030 con 0x555928571dc0 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87e33df740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87d81a9270 con 0x5559285691e0 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87e33df740 10 client.0 _ll_register_callbacks cb 0x7f87c802cd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42354/0 (socket says 172.21.15.18:42354) 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 -- 172.21.15.18:0/921475864 learned_addr learned my addr 172.21.15.18:0/921475864 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87de800640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x55592856c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dde00640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x55592856bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 -- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 msgr2=0x55592856c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x55592856c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 -- 172.21.15.18:0/921475864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 msgr2=0x55592856bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:39:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x55592856bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.950+0000 7f87dd400640 1 -- 172.21.15.18:0/921475864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559285e7740 con 0x5559285691e0 2024-04-21T22:39:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87de800640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x55592856c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87dde00640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x55592856bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:39:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87dd400640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b9e90 tx=0x7f87c80bba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d556d9bb1c8e2d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87bb400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c804b070 con 0x5559285691e0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f87c80b9460 con 0x5559285691e0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87c8004c80 con 0x5559285691e0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f87c80bd2e0 con 0x5559285691e0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87e33df740 10 client.27040 fetch_fsmap learned FSMap version 38 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.951+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5559285e7740 con 0x5559285691e0 2024-04-21T22:39:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87c8004c80 con 0x5559285691e0 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f87c8005080 con 0x5559285691e0 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 10 client.27040 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 10 client.27040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 20 client.27040 populate_metadata read hostname 'smithi018' 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5559285e8c70 0x5559285eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 4 client.27040 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5559284d9950 con 0x5559285e8c70 2024-04-21T22:39:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.952+0000 7f87dde00640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5559285e8c70 0x5559285eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87dde00640 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5559285e8c70 0x5559285eb060 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5933a74137bad18 server_cookie=c9920fd28254a999 in_seq=0 out_seq=0 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87bb400640 10 client.27040 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87bb400640 1 -- 172.21.15.18:0/921475864 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5559284d9950 con 0x5559285e8c70 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87bb400640 10 client.27040 handle_command_reply: tid=0 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87e33df740 1 client.27040 shutdown 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.953+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 msgr2=0x55592856c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b9e90 tx=0x7f87c80bba20 comp rx=0 tx=0).stop 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 shutdown_connections 2024-04-21T22:39:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555928571dc0 0x55592856c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5559285e8c70 0x5559285eb060 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5559285691e0 0x55592856c100 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 --2- 172.21.15.18:0/921475864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5559285688c0 0x55592856bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87bb400640 0 client.27040 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 >> 172.21.15.18:0/921475864 conn(0x555928562ff0 msgr2=0x55592856f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 shutdown_connections 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 1 -- 172.21.15.18:0/921475864 wait complete. 2024-04-21T22:39:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.954+0000 7f87e33df740 20 client.27040 trim_cache size 0 max 16384 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout: "833805ff-04de-4a69-b87b-afb0715a035a": { 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:39:49.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "833805ff-04de-4a69-b87b-afb0715a035a", 2024-04-21T22:39:49.962 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:39:49.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:39:49.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:39:49.962 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:39:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 msgr2=0x7f87c00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 0x7f87c00a5240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x555928568390 tx=0x7f87cc005f90 comp rx=0 tx=0).stop 2024-04-21T22:39:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 msgr2=0x7f87d819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:39:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f87c802efd0 tx=0x7f87c8004430 comp rx=0 tx=0).stop 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 shutdown_connections 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f87c00a2d80 0x7f87c00a5240 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87d8109920 0x7f87d819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d81042d0 0x7f87d819a760 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 --2- 172.21.15.18:0/2764792070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87d8103910 0x7f87d819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 >> 172.21.15.18:0/2764792070 conn(0x7f87d80ff3c0 msgr2=0x7f87d80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 shutdown_connections 2024-04-21T22:39:49.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:39:49.955+0000 7f87e0800640 1 -- 172.21.15.18:0/2764792070 wait complete. 2024-04-21T22:39:49.977 INFO:tasks.cephfs.filesystem:scrub status for tag:833805ff-04de-4a69-b87b-afb0715a035a - {'path': '/', 'tag': '833805ff-04de-4a69-b87b-afb0715a035a', 'options': 'recursive,force'} 2024-04-21T22:39:50.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:39:50.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:50.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:50 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:39:50.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:50.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:50 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:39:50.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:50.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:50.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:50 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:51.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:51 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:39:51.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:51 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:51.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:51 smithi047 ceph-mon[31561]: pgmap v177: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:51.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:51 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:39:51.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:51 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:51.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:51 smithi018 ceph-mon[26614]: pgmap v177: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:51.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:51 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:39:51.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:51 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:39:51.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:51 smithi081 ceph-mon[31692]: pgmap v177: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:53 smithi047 ceph-mon[31561]: pgmap v178: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:53 smithi018 ceph-mon[26614]: pgmap v178: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:53 smithi081 ceph-mon[31692]: pgmap v178: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:39:55.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:55 smithi047 ceph-mon[31561]: pgmap v179: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:55 smithi018 ceph-mon[26614]: pgmap v179: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:55 smithi081 ceph-mon[31692]: pgmap v179: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:57 smithi047 ceph-mon[31561]: pgmap v180: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:57 smithi018 ceph-mon[26614]: pgmap v180: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:57 smithi081 ceph-mon[31692]: pgmap v180: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:39:59.691 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:39:59 smithi081 ceph-mon[31692]: pgmap v181: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:39:59 smithi047 ceph-mon[31561]: pgmap v181: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:39:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:39:59 smithi018 ceph-mon[26614]: pgmap v181: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:00.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:00 smithi081 ceph-mon[31692]: overall HEALTH_OK 2024-04-21T22:40:00.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:00 smithi018 ceph-mon[26614]: overall HEALTH_OK 2024-04-21T22:40:00.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:00 smithi047 ceph-mon[31561]: overall HEALTH_OK 2024-04-21T22:40:01.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:01 smithi018 ceph-mon[26614]: pgmap v182: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:01 smithi081 ceph-mon[31692]: pgmap v182: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:01.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:01 smithi047 ceph-mon[31561]: pgmap v182: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:03 smithi018 ceph-mon[26614]: pgmap v183: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:03 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:03 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:03.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:03 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:03 smithi081 ceph-mon[31692]: pgmap v183: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:03 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:03.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:03 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:03.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:03 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:03.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:03 smithi047 ceph-mon[31561]: pgmap v183: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:03 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:03 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:03 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:04 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:04.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:04 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:04.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:04 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:04.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:04 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:04.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:04 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:04 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:05.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:05 smithi018 ceph-mon[26614]: pgmap v184: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:05.846 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:05 smithi047 ceph-mon[31561]: pgmap v184: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:05 smithi081 ceph-mon[31692]: pgmap v184: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:07 smithi018 ceph-mon[26614]: pgmap v185: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:07 smithi081 ceph-mon[31692]: pgmap v185: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:07.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:07 smithi047 ceph-mon[31561]: pgmap v185: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:09 smithi018 ceph-mon[26614]: pgmap v186: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:09 smithi081 ceph-mon[31692]: pgmap v186: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:09 smithi047 ceph-mon[31561]: pgmap v186: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:11 smithi018 ceph-mon[26614]: pgmap v187: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:11 smithi081 ceph-mon[31692]: pgmap v187: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:11 smithi047 ceph-mon[31561]: pgmap v187: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:13 smithi018 ceph-mon[26614]: pgmap v188: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:13 smithi081 ceph-mon[31692]: pgmap v188: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:13 smithi047 ceph-mon[31561]: pgmap v188: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-21T22:40:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:15 smithi018 ceph-mon[26614]: pgmap v189: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:15 smithi081 ceph-mon[31692]: pgmap v189: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:15 smithi047 ceph-mon[31561]: pgmap v189: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-21T22:40:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:17 smithi018 ceph-mon[26614]: pgmap v190: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:40:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:17 smithi081 ceph-mon[31692]: pgmap v190: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:40:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:17 smithi047 ceph-mon[31561]: pgmap v190: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-21T22:40:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:19 smithi018 ceph-mon[26614]: pgmap v191: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:40:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:19 smithi081 ceph-mon[31692]: pgmap v191: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:40:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:19 smithi047 ceph-mon[31561]: pgmap v191: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-21T22:40:19.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:40:19.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:40:20.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 -- 172.21.15.18:0/3973553383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740074490 msgr2=0x7fb74010d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 --2- 172.21.15.18:0/3973553383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740074490 0x7fb74010d860 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009900 tx=0x7fb72c02bcd0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 -- 172.21.15.18:0/3973553383 shutdown_connections 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 --2- 172.21.15.18:0/3973553383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 0x7fb7401101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 --2- 172.21.15.18:0/3973553383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740074490 0x7fb74010d860 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 --2- 172.21.15.18:0/3973553383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740073b70 0x7fb740073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 -- 172.21.15.18:0/3973553383 >> 172.21.15.18:0/3973553383 conn(0x7fb7400fd050 msgr2=0x7fb7400ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 -- 172.21.15.18:0/3973553383 shutdown_connections 2024-04-21T22:40:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.186+0000 7fb73f200640 1 -- 172.21.15.18:0/3973553383 wait complete. 2024-04-21T22:40:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.187+0000 7fb73f200640 1 Processor -- start 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.187+0000 7fb73f200640 1 -- start start 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740073b70 0x7fb74010d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 0x7fb74010b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb740113b90 con 0x7fb74010dda0 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb740113a10 con 0x7fb740073b70 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb740113d10 con 0x7fb740074490 2024-04-21T22:40:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59042/0 (socket says 172.21.15.18:59042) 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740073b70 0x7fb74010d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 -- 172.21.15.18:0/378035910 learned_addr learned my addr 172.21.15.18:0/378035910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73e800640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 0x7fb74010b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 -- 172.21.15.18:0/378035910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740073b70 msgr2=0x7fb74010d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740073b70 0x7fb74010d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 -- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 msgr2=0x7fb74010b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 0x7fb74010b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.188+0000 7fb73d400640 1 -- 172.21.15.18:0/378035910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7401aa8b0 con 0x7fb740074490 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb73d400640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000c00 tx=0x7fb72c0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb736a00640 1 -- 172.21.15.18:0/378035910 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c042020 con 0x7fb740074490 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb736a00640 1 -- 172.21.15.18:0/378035910 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb72c0054e0 con 0x7fb740074490 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb736a00640 1 -- 172.21.15.18:0/378035910 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c003b20 con 0x7fb740074490 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7401aaa80 con 0x7fb740074490 2024-04-21T22:40:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.189+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7401aaff0 con 0x7fb740074490 2024-04-21T22:40:20.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.192+0000 7fb736a00640 1 -- 172.21.15.18:0/378035910 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb72c045020 con 0x7fb740074490 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.193+0000 7fb7477cb740 1 Processor -- start 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.193+0000 7fb7477cb740 1 -- start start 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0cffde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d0093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd0cf61410 con 0x55fd0cffdab0 2024-04-21T22:40:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fd0cf097e0 con 0x55fd0d006fb0 2024-04-21T22:40:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb7477cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd0cf5d3d0 con 0x55fd0cffe3d0 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb73de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb73de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59054/0 (socket says 172.21.15.18:59054) 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb73de00640 1 -- 172.21.15.18:0/245972893 learned_addr learned my addr 172.21.15.18:0/245972893 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb73e800640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0cffde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.194+0000 7fb73d400640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d0093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 -- 172.21.15.18:0/245972893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 msgr2=0x55fd0d0093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d0093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 -- 172.21.15.18:0/245972893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 msgr2=0x55fd0cffde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0cffde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 -- 172.21.15.18:0/245972893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd0cd3f7d0 con 0x55fd0cffe3d0 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73d400640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d0093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb736a00640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 0x7fb7240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73de00640 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb730009d20 tx=0x7fb730011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f737b09cf81edf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb736a00640 1 -- 172.21.15.18:0/378035910 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb72c0f10e0 con 0x7fb740074490 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb72b000640 1 -- 172.21.15.18:0/245972893 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73001e070 con 0x55fd0cffe3d0 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb73e800640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 0x7fb7240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb72b000640 1 -- 172.21.15.18:0/245972893 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb730019b10 con 0x55fd0cffe3d0 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.195+0000 7fb72b000640 1 -- 172.21.15.18:0/245972893 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73000ebf0 con 0x55fd0cffe3d0 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 -- 172.21.15.18:0/245972893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 msgr2=0x55fd0d006a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb730009d20 tx=0x7fb730011810 comp rx=0 tx=0).stop 2024-04-21T22:40:20.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb73e800640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 0x7fb7240a5240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb738005fd0 tx=0x7fb738009760 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 -- 172.21.15.18:0/245972893 shutdown_connections 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d0093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d006a70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 --2- 172.21.15.18:0/245972893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0cffde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 -- 172.21.15.18:0/245972893 >> 172.21.15.18:0/245972893 conn(0x55fd0cff81e0 msgr2=0x55fd0cff85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.196+0000 7fb7477cb740 1 -- 172.21.15.18:0/245972893 shutdown_connections 2024-04-21T22:40:20.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.197+0000 7fb7477cb740 1 -- 172.21.15.18:0/245972893 wait complete. 2024-04-21T22:40:20.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.197+0000 7fb7477cb740 1 -- start start 2024-04-21T22:40:20.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 Processor -- start 2024-04-21T22:40:20.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d0044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 0x55fd0d0049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd0d009da0 con 0x55fd0d006fb0 2024-04-21T22:40:20.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55fd0cf1cc40 con 0x55fd0cffdab0 2024-04-21T22:40:20.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd0d009f20 con 0x55fd0cffe3d0 2024-04-21T22:40:20.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.198+0000 7fb7477cb740 10 client.0 _ll_register_callbacks cb 0x55fd0cf1c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:20.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56384/0 (socket says 172.21.15.18:56384) 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 -- 172.21.15.18:0/1192495079 learned_addr learned my addr 172.21.15.18:0/1192495079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73e800640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 0x55fd0d0049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73d400640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d0044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 -- 172.21.15.18:0/1192495079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 msgr2=0x55fd0d0044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d0044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 -- 172.21.15.18:0/1192495079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 msgr2=0x55fd0d0049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 0x55fd0d0049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 -- 172.21.15.18:0/1192495079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd0cc753f0 con 0x55fd0cffdab0 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73d400640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d0044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73e800640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 0x55fd0d0049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb73de00640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb73000e5c0 tx=0x7fb73000e5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67d084fdb687191 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.199+0000 7fb71f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:20.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730026020 con 0x55fd0cffdab0 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb730019840 con 0x55fd0cffdab0 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb730019b10 con 0x55fd0cffdab0 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb730031050 con 0x55fd0cffdab0 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb7477cb740 10 client.26996 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fd0cc350f0 con 0x55fd0cffdab0 2024-04-21T22:40:20.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb730019b10 con 0x55fd0cffdab0 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.200+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb7300054a0 con 0x55fd0cffdab0 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 10 client.26996 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 10 client.26996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 20 client.26996 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d017270 0x55fd0d019660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 4 client.26996 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd0cf74c40 con 0x55fd0d017270 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb73d400640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d017270 0x55fd0d019660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb73d400640 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d017270 0x55fd0d019660 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=973a464608d088e6 server_cookie=facf828b2fccf23b in_seq=0 out_seq=0 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.201+0000 7fb71f400640 10 client.26996 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.202+0000 7fb71f400640 1 -- 172.21.15.18:0/1192495079 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fd0cf74c40 con 0x55fd0d017270 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.202+0000 7fb71f400640 10 client.26996 handle_command_reply: tid=0 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 client.26996 shutdown 2024-04-21T22:40:20.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 msgr2=0x55fd0d003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb73000e5c0 tx=0x7fb73000e5f0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 shutdown_connections 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0d006fb0 0x55fd0d0049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d017270 0x55fd0d019660 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d0044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1192495079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0cffdab0 0x55fd0d003f70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb71f400640 0 client.26996 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:20.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 >> 172.21.15.18:0/1192495079 conn(0x55fd0cff81e0 msgr2=0x55fd0cff9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 shutdown_connections 2024-04-21T22:40:20.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 1 -- 172.21.15.18:0/1192495079 wait complete. 2024-04-21T22:40:20.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.203+0000 7fb7477cb740 20 client.26996 trim_cache size 0 max 16384 2024-04-21T22:40:20.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.223+0000 7fb7477cb740 1 Processor -- start 2024-04-21T22:40:20.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 -- start start 2024-04-21T22:40:20.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d0066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d012cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b38f0 con 0x55fd0cffdab0 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b5430 con 0x55fd0d006fb0 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb7477cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b3fc0 con 0x55fd0cffe3d0 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb73de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d0066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb73e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb73e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56388/0 (socket says 172.21.15.18:56388) 2024-04-21T22:40:20.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb73e800640 1 -- 172.21.15.18:0/154893838 learned_addr learned my addr 172.21.15.18:0/154893838 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.224+0000 7fb73d400640 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d012cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 -- 172.21.15.18:0/154893838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 msgr2=0x55fd0d012cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d012cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 -- 172.21.15.18:0/154893838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 msgr2=0x55fd0d0066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d0066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 -- 172.21.15.18:0/154893838 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd0cffce30 con 0x55fd0d006fb0 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb73e800640 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb738009ab0 tx=0x7fb738015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd9a4c0143b9740 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.225+0000 7fb72a600640 1 -- 172.21.15.18:0/154893838 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73802b070 con 0x55fd0d006fb0 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.226+0000 7fb72a600640 1 -- 172.21.15.18:0/154893838 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73801db20 con 0x55fd0d006fb0 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.226+0000 7fb72a600640 1 -- 172.21.15.18:0/154893838 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73801bdb0 con 0x55fd0d006fb0 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- 172.21.15.18:0/154893838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 msgr2=0x55fd0d01ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb738009ab0 tx=0x7fb738015000 comp rx=0 tx=0).stop 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- 172.21.15.18:0/154893838 shutdown_connections 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d01ee90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d012cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 --2- 172.21.15.18:0/154893838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d0066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- 172.21.15.18:0/154893838 >> 172.21.15.18:0/154893838 conn(0x55fd0cff81e0 msgr2=0x55fd0cff7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- 172.21.15.18:0/154893838 shutdown_connections 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- 172.21.15.18:0/154893838 wait complete. 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.227+0000 7fb7477cb740 1 -- start start 2024-04-21T22:40:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 Processor -- start 2024-04-21T22:40:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d00f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d00f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d000400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b4d60 con 0x55fd0cffdab0 2024-04-21T22:40:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b4690 con 0x55fd0d006fb0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401b18d0 con 0x55fd0cffe3d0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb7477cb740 10 client.0 _ll_register_callbacks cb 0x7fb72c0f4a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb73e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d000400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb73de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d00f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.228+0000 7fb73de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d00f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47898/0 (socket says 172.21.15.18:47898) 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d00f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73de00640 1 -- 172.21.15.18:0/1695525894 learned_addr learned my addr 172.21.15.18:0/1695525894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 -- 172.21.15.18:0/1695525894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 msgr2=0x55fd0d00f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d00f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 -- 172.21.15.18:0/1695525894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 msgr2=0x55fd0d00f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d00f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 -- 172.21.15.18:0/1695525894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd0d000c30 con 0x55fd0d006fb0 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73d400640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d00f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb73e800640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d000400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb738012cb0 tx=0x7fb73801eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a94ad2f43996915f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb71f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:20.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.229+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738034060 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb73801d640 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73801db20 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb73802b040 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 10 client.27002 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55fd0d07d230 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73801db20 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb738019040 con 0x55fd0d006fb0 2024-04-21T22:40:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 10 client.27002 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 10 client.27002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 20 client.27002 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d07d8a0 0x55fd0d07fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 4 client.27002 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.230+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd0cf6e950 con 0x55fd0d07d8a0 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb73de00640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d07d8a0 0x55fd0d07fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb73de00640 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d07d8a0 0x55fd0d07fcc0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94b4dd7989d98a4 server_cookie=38243675c256dcff in_seq=0 out_seq=0 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb71f400640 10 client.27002 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb71f400640 1 -- 172.21.15.18:0/1695525894 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fd0cf6e950 con 0x55fd0d07d8a0 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb71f400640 10 client.27002 handle_command_reply: tid=0 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.231+0000 7fb7477cb740 1 client.27002 shutdown 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 msgr2=0x55fd0d000400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d000400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb738012cb0 tx=0x7fb73801eef0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 shutdown_connections 2024-04-21T22:40:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55fd0d006fb0 0x55fd0d000400 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55fd0d07d8a0 0x55fd0d07fcc0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0cffe3d0 0x55fd0d00f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 --2- 172.21.15.18:0/1695525894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd0cffdab0 0x55fd0d00f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb71f400640 0 client.27002 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 >> 172.21.15.18:0/1695525894 conn(0x55fd0cff81e0 msgr2=0x55fd0d003f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 shutdown_connections 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 1 -- 172.21.15.18:0/1695525894 wait complete. 2024-04-21T22:40:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.232+0000 7fb7477cb740 20 client.27002 trim_cache size 0 max 16384 2024-04-21T22:40:20.240 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:20.240 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:40:20.240 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:40:20.240 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 msgr2=0x7fb7240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 0x7fb7240a5240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb738005fd0 tx=0x7fb738009760 comp rx=0 tx=0).stop 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 msgr2=0x7fb74010a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000c00 tx=0x7fb72c0043c0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 shutdown_connections 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb7240a2d80 0x7fb7240a5240 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb74010dda0 0x7fb74010b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb740074490 0x7fb74010a930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 --2- 172.21.15.18:0/378035910 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb740073b70 0x7fb74010d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 >> 172.21.15.18:0/378035910 conn(0x7fb7400fd050 msgr2=0x7fb7400fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 shutdown_connections 2024-04-21T22:40:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.233+0000 7fb73f200640 1 -- 172.21.15.18:0/378035910 wait complete. 2024-04-21T22:40:20.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:40:20.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:40:20.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.439+0000 7f4038e00640 1 -- 172.21.15.18:0/698653010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40341042d0 msgr2=0x7f40341107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.439+0000 7f4038e00640 1 --2- 172.21.15.18:0/698653010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40341042d0 0x7f40341107e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f402c009ca0 tx=0x7f402c02c100 comp rx=0 tx=0).stop 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 -- 172.21.15.18:0/698653010 shutdown_connections 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 --2- 172.21.15.18:0/698653010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40341042d0 0x7f40341107e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 --2- 172.21.15.18:0/698653010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034103910 0x7f4034103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 --2- 172.21.15.18:0/698653010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4034109920 0x7f4034109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 -- 172.21.15.18:0/698653010 >> 172.21.15.18:0/698653010 conn(0x7f40340ff420 msgr2=0x7f4034101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 -- 172.21.15.18:0/698653010 shutdown_connections 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.440+0000 7f4038e00640 1 -- 172.21.15.18:0/698653010 wait complete. 2024-04-21T22:40:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 Processor -- start 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 -- start start 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4034103910 0x7f403419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 0x7f403419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4034113d00 con 0x7f4034109920 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4034113b80 con 0x7f4034103910 2024-04-21T22:40:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.441+0000 7f4038e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4034113e80 con 0x7f40341042d0 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4032800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 0x7f403419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59096/0 (socket says 172.21.15.18:59096) 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 -- 172.21.15.18:0/2459094827 learned_addr learned my addr 172.21.15.18:0/2459094827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4034103910 0x7f403419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 -- 172.21.15.18:0/2459094827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4034103910 msgr2=0x7f403419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4034103910 0x7f403419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 -- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 msgr2=0x7f403419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 0x7f403419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4031400640 1 -- 172.21.15.18:0/2459094827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403419f0d0 con 0x7f40341042d0 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.442+0000 7f4032800640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 0x7f403419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f4031400640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f401c00ea60 tx=0x7f401c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c00cde0 con 0x7f40341042d0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f401c0035f0 con 0x7f40341042d0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c010690 con 0x7f40341042d0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403419f3c0 con 0x7f40341042d0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.443+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40341a6c50 con 0x7f40341042d0 2024-04-21T22:40:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.444+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4034068a40 con 0x7f40341042d0 2024-04-21T22:40:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.446+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f401c0037a0 con 0x7f40341042d0 2024-04-21T22:40:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.448+0000 7f402aa00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 0x7f40180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.448+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f401c0cf850 con 0x7f40341042d0 2024-04-21T22:40:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.448+0000 7f4031e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 0x7f40180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.450+0000 7f4031e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 0x7f40180a5240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f402400cac0 tx=0x7f402400c4a0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.452+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f401c09c410 con 0x7f40341042d0 2024-04-21T22:40:20.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:20 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:40:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.694+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40341a6f90 con 0x7f40341042d0 2024-04-21T22:40:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.695+0000 7f402aa00640 1 -- 172.21.15.18:0/2459094827 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7f401c09bd10 con 0x7f40341042d0 2024-04-21T22:40:20.696 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:40:20.696 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:40:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:40:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 msgr2=0x7f40180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 0x7f40180a5240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f402400cac0 tx=0x7f402400c4a0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 msgr2=0x7f403419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f401c00ea60 tx=0x7f401c00ef20 comp rx=0 tx=0).stop 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 shutdown_connections 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40180a2d80 0x7f40180a5240 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4034109920 0x7f403419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40341042d0 0x7f403419a620 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 --2- 172.21.15.18:0/2459094827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4034103910 0x7f403419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 >> 172.21.15.18:0/2459094827 conn(0x7f40340ff420 msgr2=0x7f40340ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 shutdown_connections 2024-04-21T22:40:20.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.698+0000 7f4038e00640 1 -- 172.21.15.18:0/2459094827 wait complete. 2024-04-21T22:40:20.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:40:20.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:20 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:40:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.915+0000 7f93ed000640 1 -- 172.21.15.18:0/3448358850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 msgr2=0x7f93e8105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.915+0000 7f93ed000640 1 --2- 172.21.15.18:0/3448358850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e8105d70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009cd0 tx=0x7f93e002c170 comp rx=0 tx=0).stop 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.915+0000 7f93ed000640 1 -- 172.21.15.18:0/3448358850 shutdown_connections 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 --2- 172.21.15.18:0/3448358850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e8105d70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 --2- 172.21.15.18:0/3448358850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 0x7f93e81052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 --2- 172.21.15.18:0/3448358850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e81008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 -- 172.21.15.18:0/3448358850 >> 172.21.15.18:0/3448358850 conn(0x7f93e80771f0 msgr2=0x7f93e80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 -- 172.21.15.18:0/3448358850 shutdown_connections 2024-04-21T22:40:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.916+0000 7f93ed000640 1 -- 172.21.15.18:0/3448358850 wait complete. 2024-04-21T22:40:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 Processor -- start 2024-04-21T22:40:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 -- start start 2024-04-21T22:40:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 0x7f93e819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93e8117f20 con 0x7f93e8105910 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93e8117da0 con 0x7f93e8100e30 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.917+0000 7f93ed000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81180a0 con 0x7f93e8100510 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47932/0 (socket says 172.21.15.18:47932) 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7e00640 1 -- 172.21.15.18:0/276587885 learned_addr learned my addr 172.21.15.18:0/276587885 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e6a00640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 0x7f93e819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 -- 172.21.15.18:0/276587885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 msgr2=0x7f93e819e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 0x7f93e819e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 -- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 msgr2=0x7f93e81a2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 -- 172.21.15.18:0/276587885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e81a3400 con 0x7f93e8100510 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7e00640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.918+0000 7f93e7400640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e819e460 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e9f0 tx=0x7f93d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.919+0000 7f93dfe00640 1 -- 172.21.15.18:0/276587885 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d800ccc0 con 0x7f93e8100510 2024-04-21T22:40:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.919+0000 7f93dfe00640 1 -- 172.21.15.18:0/276587885 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d8005020 con 0x7f93e8100510 2024-04-21T22:40:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.919+0000 7f93dfe00640 1 -- 172.21.15.18:0/276587885 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d80049e0 con 0x7f93e8100510 2024-04-21T22:40:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.919+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e81a36f0 con 0x7f93e8100510 2024-04-21T22:40:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.919+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e81aaf80 con 0x7f93e8100510 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.922+0000 7f93dfe00640 1 -- 172.21.15.18:0/276587885 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f93d8005560 con 0x7f93e8100510 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.922+0000 7f93f136d740 1 Processor -- start 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.922+0000 7f93f136d740 1 -- start start 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc8d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 0x55989bc95f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 0x55989bc98860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55989bbf13a0 con 0x55989bc96470 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55989bb99930 con 0x55989bc8cf70 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93f136d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55989bbed360 con 0x55989bc8d890 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 0x55989bc98860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc8d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 0x55989bc95f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc8d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56444/0 (socket says 172.21.15.18:56444) 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7e00640 1 -- 172.21.15.18:0/2524780250 learned_addr learned my addr 172.21.15.18:0/2524780250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 0x55989bc98860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47948/0 (socket says 172.21.15.18:47948) 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 -- 172.21.15.18:0/2524780250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 msgr2=0x55989bc8d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc8d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 -- 172.21.15.18:0/2524780250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 msgr2=0x55989bc98860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 0x55989bc98860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.923+0000 7f93e7400640 1 -- 172.21.15.18:0/2524780250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989b9053f0 con 0x55989bc8d890 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93dfe00640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 0x7f93cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93e7400640 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 0x55989bc95f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93d80ccab0 tx=0x7f93d80d7640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8501181a02ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93dfe00640 1 -- 172.21.15.18:0/276587885 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f93d80cf3c0 con 0x7f93e8100510 2024-04-21T22:40:20.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93dcc00640 1 -- 172.21.15.18:0/2524780250 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8097b20 con 0x55989bc8d890 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93e7e00640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 0x7f93cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93dcc00640 1 -- 172.21.15.18:0/2524780250 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d80d7e40 con 0x55989bc8d890 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.924+0000 7f93dcc00640 1 -- 172.21.15.18:0/2524780250 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d809b1e0 con 0x55989bc8d890 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- 172.21.15.18:0/2524780250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 msgr2=0x55989bc95f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 0x55989bc95f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93d80ccab0 tx=0x7f93d80d7640 comp rx=0 tx=0).stop 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93e7e00640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 0x7f93cc0a5240 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009a60 tx=0x7f93e0005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- 172.21.15.18:0/2524780250 shutdown_connections 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc96470 0x55989bc98860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8d890 0x55989bc95f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 --2- 172.21.15.18:0/2524780250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc8d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- 172.21.15.18:0/2524780250 >> 172.21.15.18:0/2524780250 conn(0x55989bc876a0 msgr2=0x55989bc87a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- 172.21.15.18:0/2524780250 shutdown_connections 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- 172.21.15.18:0/2524780250 wait complete. 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.925+0000 7f93f136d740 1 -- start start 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 Processor -- start 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc96470 0x55989bc93fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55989bc99260 con 0x55989bc8d890 2024-04-21T22:40:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55989bbacd80 con 0x55989bc96470 2024-04-21T22:40:20.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55989bc993e0 con 0x55989bc8cf70 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93f136d740 10 client.0 _ll_register_callbacks cb 0x55989bbe92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59130/0 (socket says 172.21.15.18:59130) 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47950/0 (socket says 172.21.15.18:47950) 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.926+0000 7f93e7400640 1 -- 172.21.15.18:0/2160563056 learned_addr learned my addr 172.21.15.18:0/2160563056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7e00640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc96470 0x55989bc93fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 -- 172.21.15.18:0/2160563056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc96470 msgr2=0x55989bc93fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc96470 0x55989bc93fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 -- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 msgr2=0x55989bc93a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 -- 172.21.15.18:0/2160563056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989b9cf7d0 con 0x55989bc8cf70 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93e7400640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f93d8098250 tx=0x7f93d80096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c6162170994c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93d5600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d801c030 con 0x55989bc8cf70 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f93d8086110 con 0x55989bc8cf70 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55989bbfe8e0 con 0x55989bc8cf70 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f93d809b3c0 con 0x55989bc8cf70 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93f136d740 10 client.27073 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:20.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.927+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55989bc99260 con 0x55989bc8cf70 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55989bbfe8e0 con 0x55989bc8cf70 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f93d8004be0 con 0x55989bc8cf70 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 10 client.27073 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 10 client.27073 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 20 client.27073 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bca6760 0x55989bca8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 4 client.27073 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55989bbf8c30 con 0x55989bca6760 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.928+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bca6760 0x55989bca8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.929+0000 7f93d5600640 10 client.27073 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.929+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bca6760 0x55989bca8b50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=add45c006a799924 server_cookie=cf61226d26b51fb7 in_seq=0 out_seq=0 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.929+0000 7f93d5600640 1 -- 172.21.15.18:0/2160563056 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55989bbf8c30 con 0x55989bca6760 2024-04-21T22:40:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.929+0000 7f93d5600640 10 client.27073 handle_command_reply: tid=0 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.929+0000 7f93f136d740 1 client.27073 shutdown 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 msgr2=0x55989bc93540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f93d8098250 tx=0x7f93d80096e0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 shutdown_connections 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bca6760 0x55989bca8b50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc96470 0x55989bc93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc93a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 --2- 172.21.15.18:0/2160563056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc8cf70 0x55989bc93540 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93d5600640 0 client.27073 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 >> 172.21.15.18:0/2160563056 conn(0x55989bc876a0 msgr2=0x55989bc893f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 shutdown_connections 2024-04-21T22:40:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 1 -- 172.21.15.18:0/2160563056 wait complete. 2024-04-21T22:40:20.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.930+0000 7f93f136d740 20 client.27073 trim_cache size 0 max 16384 2024-04-21T22:40:20.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:20 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:40:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 Processor -- start 2024-04-21T22:40:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 -- start start 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bca2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b39c0 con 0x55989bc8d890 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b5500 con 0x55989bc8cf70 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93f136d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b4090 con 0x55989bc96470 2024-04-21T22:40:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.945+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59136/0 (socket says 172.21.15.18:59136) 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 -- 172.21.15.18:0/3307887118 learned_addr learned my addr 172.21.15.18:0/3307887118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bca2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 -- 172.21.15.18:0/3307887118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 msgr2=0x55989bca2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bca2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 -- 172.21.15.18:0/3307887118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 msgr2=0x55989bc92480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc92480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 -- 172.21.15.18:0/3307887118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989bc871d0 con 0x55989bc96470 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e6a00640 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7400640 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bca2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93e7e00640 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f93e00325a0 tx=0x7f93e0041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3dafc904cc1e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.946+0000 7f93d7e00640 1 -- 172.21.15.18:0/3307887118 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0039040 con 0x55989bc96470 2024-04-21T22:40:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93d7e00640 1 -- 172.21.15.18:0/3307887118 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e0034c70 con 0x55989bc96470 2024-04-21T22:40:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93d7e00640 1 -- 172.21.15.18:0/3307887118 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0032a20 con 0x55989bc96470 2024-04-21T22:40:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 -- 172.21.15.18:0/3307887118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 msgr2=0x55989bc8ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f93e00325a0 tx=0x7f93e0041000 comp rx=0 tx=0).stop 2024-04-21T22:40:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 -- 172.21.15.18:0/3307887118 shutdown_connections 2024-04-21T22:40:20.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc8ec90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 --2- 172.21.15.18:0/3307887118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bca2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 -- 172.21.15.18:0/3307887118 >> 172.21.15.18:0/3307887118 conn(0x55989bc876a0 msgr2=0x55989bc86690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 -- 172.21.15.18:0/3307887118 shutdown_connections 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.947+0000 7f93f136d740 1 -- 172.21.15.18:0/3307887118 wait complete. 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 -- start start 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 Processor -- start 2024-04-21T22:40:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc9e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc99a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b4e30 con 0x55989bc8d890 2024-04-21T22:40:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b4760 con 0x55989bc8cf70 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93e81b19a0 con 0x55989bc96470 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.948+0000 7f93f136d740 10 client.0 _ll_register_callbacks cb 0x7f93d809f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47966/0 (socket says 172.21.15.18:47966) 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 -- 172.21.15.18:0/2822596525 learned_addr learned my addr 172.21.15.18:0/2822596525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc99a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e7400640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc9e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 -- 172.21.15.18:0/2822596525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 msgr2=0x55989bc99a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc99a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 -- 172.21.15.18:0/2822596525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 msgr2=0x55989bc9e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc9e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 -- 172.21.15.18:0/2822596525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989bc9a2c0 con 0x55989bc8d890 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93e6a00640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f93d0000c00 tx=0x7f93d000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1446499fd3fe7eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93d5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.949+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0005020 con 0x55989bc8d890 2024-04-21T22:40:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f93d00051c0 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93e0034c70 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f93d002f050 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 10 client.16953 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55989bd0c5e0 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e0034c70 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f93d00202a0 con 0x55989bc8d890 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 10 client.16953 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 10 client.16953 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:40:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 20 client.16953 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bd0cd90 0x55989bd0f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 4 client.16953 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.950+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55989bb765a0 con 0x55989bd0cd90 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93e7400640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bd0cd90 0x55989bd0f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93d5600640 10 client.16953 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93e7400640 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bd0cd90 0x55989bd0f1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ccbb3070f7e93628 server_cookie=8ab39619fdbc53a in_seq=0 out_seq=0 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93d5600640 1 -- 172.21.15.18:0/2822596525 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55989bb765a0 con 0x55989bd0cd90 2024-04-21T22:40:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93d5600640 10 client.16953 handle_command_reply: tid=0 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93f136d740 1 client.16953 shutdown 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 msgr2=0x55989bc9eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.951+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f93d0000c00 tx=0x7f93d000bd90 comp rx=0 tx=0).stop 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 shutdown_connections 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55989bd0cd90 0x55989bd0f1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55989bc96470 0x55989bc99a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55989bc8d890 0x55989bc9eae0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 --2- 172.21.15.18:0/2822596525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55989bc8cf70 0x55989bc9e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93d5600640 0 client.16953 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 >> 172.21.15.18:0/2822596525 conn(0x55989bc876a0 msgr2=0x55989bc88860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 shutdown_connections 2024-04-21T22:40:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 1 -- 172.21.15.18:0/2822596525 wait complete. 2024-04-21T22:40:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93f136d740 20 client.16953 trim_cache size 0 max 16384 2024-04-21T22:40:20.962 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:20.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 msgr2=0x7f93cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 0x7f93cc0a5240 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f93e0009a60 tx=0x7f93e0005d80 comp rx=0 tx=0).stop 2024-04-21T22:40:20.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 msgr2=0x7f93e819e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e819e460 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e9f0 tx=0x7f93d800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.952+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 shutdown_connections 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f93cc0a2d80 0x7f93cc0a5240 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93e8105910 0x7f93e81a2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93e8100e30 0x7f93e819e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 --2- 172.21.15.18:0/276587885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8100510 0x7f93e819e460 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 >> 172.21.15.18:0/276587885 conn(0x7f93e80771f0 msgr2=0x7f93e81032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 shutdown_connections 2024-04-21T22:40:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:20.953+0000 7f93ed000640 1 -- 172.21.15.18:0/276587885 wait complete. 2024-04-21T22:40:20.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:40:21.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 -- 172.21.15.18:0/2905531465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 msgr2=0x7feae81101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 --2- 172.21.15.18:0/2905531465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae81101e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feae0009ca0 tx=0x7feae002c190 comp rx=0 tx=0).stop 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 -- 172.21.15.18:0/2905531465 shutdown_connections 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 --2- 172.21.15.18:0/2905531465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae81101e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 --2- 172.21.15.18:0/2905531465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8074430 0x7feae810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 --2- 172.21.15.18:0/2905531465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8073b10 0x7feae8073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 -- 172.21.15.18:0/2905531465 >> 172.21.15.18:0/2905531465 conn(0x7feae80fd060 msgr2=0x7feae80ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 -- 172.21.15.18:0/2905531465 shutdown_connections 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.153+0000 7feaee800640 1 -- 172.21.15.18:0/2905531465 wait complete. 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.154+0000 7feaee800640 1 Processor -- start 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.154+0000 7feaee800640 1 -- start start 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.154+0000 7feaee800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 0x7feae819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.154+0000 7feaee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaee800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaee800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feae8113b30 con 0x7feae8074430 2024-04-21T22:40:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaee800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feae81139b0 con 0x7feae810ddd0 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaee800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feae8113cb0 con 0x7feae8073b10 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaeca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 0x7feae819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaeca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47982/0 (socket says 172.21.15.18:47982) 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaeca00640 1 -- 172.21.15.18:0/2346796306 learned_addr learned my addr 172.21.15.18:0/2346796306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaede00640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 -- 172.21.15.18:0/2346796306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 msgr2=0x7feae819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 -- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 msgr2=0x7feae819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaed400640 1 -- 172.21.15.18:0/2346796306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae819f020 con 0x7feae8073b10 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.155+0000 7feaeca00640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feaed400640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 0x7feae819a030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e9f0 tx=0x7feadc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feae6000640 1 -- 172.21.15.18:0/2346796306 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc00ccc0 con 0x7feae8073b10 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feae6000640 1 -- 172.21.15.18:0/2346796306 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc010910 con 0x7feae8073b10 2024-04-21T22:40:21.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feae6000640 1 -- 172.21.15.18:0/2346796306 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc018960 con 0x7feae8073b10 2024-04-21T22:40:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae819f310 con 0x7feae8073b10 2024-04-21T22:40:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.156+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81a6ba0 con 0x7feae8073b10 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.159+0000 7feae6000640 1 -- 172.21.15.18:0/2346796306 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7feadc010ac0 con 0x7feae8073b10 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feaf2c24740 1 Processor -- start 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feae6000640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 0x7fead00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feaf2c24740 1 -- start start 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feae6000640 1 -- 172.21.15.18:0/2346796306 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7feadc0cf7c0 con 0x7feae8073b10 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.160+0000 7feaede00640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 0x7fead00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f58f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaf2c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e554eb43a0 con 0x55e554f50890 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaf2c24740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e554e5c930 con 0x55e554f59470 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaf2c24740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e554eb0360 con 0x55e554f4ff70 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59156/0 (socket says 172.21.15.18:59156) 2024-04-21T22:40:21.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 -- 172.21.15.18:0/2366455088 learned_addr learned my addr 172.21.15.18:0/2366455088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaeca00640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f58f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaede00640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 -- 172.21.15.18:0/2366455088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 msgr2=0x55e554f5b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f5b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 -- 172.21.15.18:0/2366455088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 msgr2=0x55e554f58f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f58f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 -- 172.21.15.18:0/2366455088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e554bc83f0 con 0x55e554f4ff70 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaeca00640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:21.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaede00640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.161+0000 7feaed400640 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feadc0a43c0 tx=0x7feadc09bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f10bd970bf7a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaede00640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 0x7fead00a5240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feae0009bf0 tx=0x7feae0009a00 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feada600640 1 -- 172.21.15.18:0/2366455088 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0cd130 con 0x55e554f4ff70 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feada600640 1 -- 172.21.15.18:0/2366455088 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc0983a0 con 0x55e554f4ff70 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feada600640 1 -- 172.21.15.18:0/2366455088 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc018d60 con 0x55e554f4ff70 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 -- 172.21.15.18:0/2366455088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 msgr2=0x55e554f50350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feadc0a43c0 tx=0x7feadc09bd30 comp rx=0 tx=0).stop 2024-04-21T22:40:21.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 -- 172.21.15.18:0/2366455088 shutdown_connections 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2366455088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f50350 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.162+0000 7feaf2c24740 1 -- 172.21.15.18:0/2366455088 >> 172.21.15.18:0/2366455088 conn(0x55e554f4a6a0 msgr2=0x55e554f4aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.163+0000 7feaf2c24740 1 -- 172.21.15.18:0/2366455088 shutdown_connections 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.163+0000 7feaf2c24740 1 -- 172.21.15.18:0/2366455088 wait complete. 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.163+0000 7feaf2c24740 1 -- start start 2024-04-21T22:40:21.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.163+0000 7feaf2c24740 1 Processor -- start 2024-04-21T22:40:21.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f56590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e554f5c200 con 0x55e554f4ff70 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e554e6fd80 con 0x55e554f59470 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e554f5c380 con 0x55e554f50890 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaf2c24740 10 client.0 _ll_register_callbacks cb 0x55e554eac2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f56590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59170/0 (socket says 172.21.15.18:59170) 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 -- 172.21.15.18:0/204934578 learned_addr learned my addr 172.21.15.18:0/204934578 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaede00640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 -- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 msgr2=0x55e554f57010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f57010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 -- 172.21.15.18:0/204934578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 msgr2=0x55e554f56590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f56590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaeca00640 1 -- 172.21.15.18:0/204934578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e554c927d0 con 0x55e554f50890 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.164+0000 7feaed400640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f56590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feaeca00640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fead4012d00 tx=0x7fead400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9be86c8303827e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feacea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4009d00 con 0x55e554f50890 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feadc0983a0 con 0x55e554f50890 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fead40120d0 con 0x55e554f50890 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fead4010430 con 0x55e554f50890 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feaf2c24740 10 client.27091 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e554f685b0 con 0x55e554f50890 2024-04-21T22:40:21.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.165+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc0983a0 con 0x55e554f50890 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fead401c5b0 con 0x55e554f50890 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 10 client.27091 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 10 client.27091 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 20 client.27091 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554f69a70 0x55e554f6bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 4 client.27091 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e554ec18e0 con 0x55e554f69a70 2024-04-21T22:40:21.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaed400640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554f69a70 0x55e554f6bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feaed400640 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554f69a70 0x55e554f6bef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d965a754dc064d0e server_cookie=6b6d8cfe9cd2b381 in_seq=0 out_seq=0 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.166+0000 7feacea00640 10 client.27091 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.167+0000 7feacea00640 1 -- 172.21.15.18:0/204934578 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e554ec18e0 con 0x55e554f69a70 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.167+0000 7feacea00640 10 client.27091 handle_command_reply: tid=0 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.167+0000 7feaf2c24740 1 client.27091 shutdown 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.167+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 msgr2=0x55e554f56ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.167+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fead4012d00 tx=0x7fead400f790 comp rx=0 tx=0).stop 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 shutdown_connections 2024-04-21T22:40:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554f69a70 0x55e554f6bef0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feacea00640 0 client.27091 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f50890 0x55e554f56ad0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 --2- 172.21.15.18:0/204934578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f56590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 >> 172.21.15.18:0/204934578 conn(0x55e554f4a6a0 msgr2=0x55e554f4c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 shutdown_connections 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 1 -- 172.21.15.18:0/204934578 wait complete. 2024-04-21T22:40:21.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.168+0000 7feaf2c24740 20 client.27091 trim_cache size 0 max 16384 2024-04-21T22:40:21.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 Processor -- start 2024-04-21T22:40:21.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 -- start start 2024-04-21T22:40:21.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 0x55e554f650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f59470 0x55e554f4c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feae81af580 con 0x55e554f4ff70 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feae81b10c0 con 0x55e554f50890 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaf2c24740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feae81afc50 con 0x55e554f59470 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47998/0 (socket says 172.21.15.18:47998) 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaed400640 1 -- 172.21.15.18:0/2706084213 learned_addr learned my addr 172.21.15.18:0/2706084213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaede00640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f59470 0x55e554f4c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaed400640 1 -- 172.21.15.18:0/2706084213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f59470 msgr2=0x55e554f4c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaed400640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f59470 0x55e554f4c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.183+0000 7feaeca00640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 0x55e554f650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7feaed400640 1 -- 172.21.15.18:0/2706084213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 msgr2=0x55e554f650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7feaed400640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 0x55e554f650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7feaed400640 1 -- 172.21.15.18:0/2706084213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e554f4a1d0 con 0x55e554f4ff70 2024-04-21T22:40:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7feaeca00640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 0x55e554f650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7feaed400640 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feadc097a10 tx=0x7feadc0979a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67d1419c173e5e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7fead9c00640 1 -- 172.21.15.18:0/2706084213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0b9070 con 0x55e554f4ff70 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7fead9c00640 1 -- 172.21.15.18:0/2706084213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc09b380 con 0x55e554f4ff70 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.184+0000 7fead9c00640 1 -- 172.21.15.18:0/2706084213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc097d70 con 0x55e554f4ff70 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- 172.21.15.18:0/2706084213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 msgr2=0x55e554f58cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feadc097a10 tx=0x7feadc0979a0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- 172.21.15.18:0/2706084213 shutdown_connections 2024-04-21T22:40:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f59470 0x55e554f4c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f50890 0x55e554f650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 --2- 172.21.15.18:0/2706084213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f4ff70 0x55e554f58cc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- 172.21.15.18:0/2706084213 >> 172.21.15.18:0/2706084213 conn(0x55e554f4a6a0 msgr2=0x55e554f4bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- 172.21.15.18:0/2706084213 shutdown_connections 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- 172.21.15.18:0/2706084213 wait complete. 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.185+0000 7feaf2c24740 1 -- start start 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 Processor -- start 2024-04-21T22:40:21.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f53970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f53eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feae81b09f0 con 0x55e554f50890 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feae81b0320 con 0x55e554f59470 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ad560 con 0x55e554f4ff70 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaf2c24740 10 client.0 _ll_register_callbacks cb 0x7fead4009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59184/0 (socket says 172.21.15.18:59184) 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaed400640 1 -- 172.21.15.18:0/824509083 learned_addr learned my addr 172.21.15.18:0/824509083 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaeca00640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f53970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.186+0000 7feaede00640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f53eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 -- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 msgr2=0x55e554f53eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f53eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 -- 172.21.15.18:0/824509083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 msgr2=0x55e554f53970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f53970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 -- 172.21.15.18:0/824509083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e554fcf230 con 0x55e554f4ff70 2024-04-21T22:40:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaede00640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f53eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaed400640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feadc010f50 tx=0x7feadc009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d82659c81b13721 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feacea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0b9070 con 0x55e554f4ff70 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7feadc097d00 con 0x55e554f4ff70 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feadc09b380 con 0x55e554f4ff70 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7feadc0983a0 con 0x55e554f4ff70 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaf2c24740 10 client.27097 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e554fd0480 con 0x55e554f4ff70 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.187+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feadc09b380 con 0x55e554f4ff70 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7feadc0a4bb0 con 0x55e554f4ff70 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 10 client.27097 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 10 client.27097 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 20 client.27097 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554fd0710 0x55e554fd2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 4 client.27097 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e554ebbc30 con 0x55e554fd0710 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.188+0000 7feaeca00640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554fd0710 0x55e554fd2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaeca00640 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554fd0710 0x55e554fd2b00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c07403f97f952885 server_cookie=e77c8344212d7d3d in_seq=0 out_seq=0 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feacea00640 10 client.27097 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feacea00640 1 -- 172.21.15.18:0/824509083 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e554ebbc30 con 0x55e554fd0710 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feacea00640 10 client.27097 handle_command_reply: tid=0 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 client.27097 shutdown 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 msgr2=0x55e554f53430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feadc010f50 tx=0x7feadc009700 comp rx=0 tx=0).stop 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 shutdown_connections 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55e554fd0710 0x55e554fd2b00 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e554f59470 0x55e554f53eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e554f50890 0x55e554f53970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feacea00640 0 client.27097 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 --2- 172.21.15.18:0/824509083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e554f4ff70 0x55e554f53430 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 >> 172.21.15.18:0/824509083 conn(0x55e554f4a6a0 msgr2=0x55e554f56de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 shutdown_connections 2024-04-21T22:40:21.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 1 -- 172.21.15.18:0/824509083 wait complete. 2024-04-21T22:40:21.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.189+0000 7feaf2c24740 20 client.27097 trim_cache size 0 max 16384 2024-04-21T22:40:21.198 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:21.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 msgr2=0x7fead00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 0x7fead00a5240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feae0009bf0 tx=0x7feae0009a00 comp rx=0 tx=0).stop 2024-04-21T22:40:21.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 msgr2=0x7feae819a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 0x7feae819a030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e9f0 tx=0x7feadc00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 shutdown_connections 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fead00a2d80 0x7fead00a5240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feae810ddd0 0x7feae819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feae8074430 0x7feae819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 --2- 172.21.15.18:0/2346796306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8073b10 0x7feae819a030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 >> 172.21.15.18:0/2346796306 conn(0x7feae80fd060 msgr2=0x7feae80fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 shutdown_connections 2024-04-21T22:40:21.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.190+0000 7feaee800640 1 -- 172.21.15.18:0/2346796306 wait complete. 2024-04-21T22:40:21.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:40:21.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 -- 172.21.15.18:0/1879235192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414103760 msgr2=0x7f0414103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 --2- 172.21.15.18:0/1879235192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414103760 0x7f0414103be0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0400009900 tx=0x7f040002bc50 comp rx=0 tx=0).stop 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 -- 172.21.15.18:0/1879235192 shutdown_connections 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 --2- 172.21.15.18:0/1879235192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 0x7f0414110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 --2- 172.21.15.18:0/1879235192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414103760 0x7f0414103be0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 --2- 172.21.15.18:0/1879235192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414109770 0x7f0414109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 -- 172.21.15.18:0/1879235192 >> 172.21.15.18:0/1879235192 conn(0x7f04140ff230 msgr2=0x7f0414101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 -- 172.21.15.18:0/1879235192 shutdown_connections 2024-04-21T22:40:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.408+0000 7f0419e00640 1 -- 172.21.15.18:0/1879235192 wait complete. 2024-04-21T22:40:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 Processor -- start 2024-04-21T22:40:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 -- start start 2024-04-21T22:40:21.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 0x7f041419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414109770 0x7f041419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0414113b40 con 0x7f0414104120 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04141139c0 con 0x7f0414109770 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.410+0000 7f0419e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0414113cc0 con 0x7f0414103760 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59202/0 (socket says 172.21.15.18:59202) 2024-04-21T22:40:21.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0413e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 0x7f041419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 -- 172.21.15.18:0/853249587 learned_addr learned my addr 172.21.15.18:0/853249587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0419400640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414109770 0x7f041419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 -- 172.21.15.18:0/853249587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414109770 msgr2=0x7f041419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414109770 0x7f041419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 -- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 msgr2=0x7f041419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 0x7f041419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.411+0000 7f0418a00640 1 -- 172.21.15.18:0/853249587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041419f070 con 0x7f0414103760 2024-04-21T22:40:21.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0418a00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9f0 tx=0x7f040800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0411600640 1 -- 172.21.15.18:0/853249587 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800cd80 con 0x7f0414103760 2024-04-21T22:40:21.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041419f360 con 0x7f0414103760 2024-04-21T22:40:21.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0411600640 1 -- 172.21.15.18:0/853249587 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0408010910 con 0x7f0414103760 2024-04-21T22:40:21.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0411600640 1 -- 172.21.15.18:0/853249587 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04080188f0 con 0x7f0414103760 2024-04-21T22:40:21.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.412+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141a6bf0 con 0x7f0414103760 2024-04-21T22:40:21.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.415+0000 7f041e02e740 1 Processor -- start 2024-04-21T22:40:21.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.415+0000 7f041e02e740 1 -- start start 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.415+0000 7f0411600640 1 -- 172.21.15.18:0/853249587 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f0408010ac0 con 0x7f0414103760 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9ef70 0x5630c8b9f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8ba7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630c8b033a0 con 0x5630c8b9ef70 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5630c8aab930 con 0x5630c8b9f890 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f041e02e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5630c8aff360 con 0x5630c8ba8470 2024-04-21T22:40:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0418a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8ba7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0419400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9ef70 0x5630c8b9f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59208/0 (socket says 172.21.15.18:59208) 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 -- 172.21.15.18:0/2416114051 learned_addr learned my addr 172.21.15.18:0/2416114051 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 -- 172.21.15.18:0/2416114051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 msgr2=0x5630c8ba7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8ba7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 -- 172.21.15.18:0/2416114051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9ef70 msgr2=0x5630c8b9f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9ef70 0x5630c8b9f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.416+0000 7f0413e00640 1 -- 172.21.15.18:0/2416114051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c88173f0 con 0x5630c8ba8470 2024-04-21T22:40:21.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.417+0000 7f0413e00640 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f040002cfd0 tx=0x7f0400005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7becfccf97e14b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.417+0000 7f0405c00640 1 -- 172.21.15.18:0/2416114051 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400042070 con 0x5630c8ba8470 2024-04-21T22:40:21.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.417+0000 7f0405c00640 1 -- 172.21.15.18:0/2416114051 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0400004240 con 0x5630c8ba8470 2024-04-21T22:40:21.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.417+0000 7f0405c00640 1 -- 172.21.15.18:0/2416114051 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400004f00 con 0x5630c8ba8470 2024-04-21T22:40:21.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.417+0000 7f0411600640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 0x7f03fc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f0411600640 1 -- 172.21.15.18:0/853249587 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f04080cf7f0 con 0x7f0414103760 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- 172.21.15.18:0/2416114051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 msgr2=0x5630c8baa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f040002cfd0 tx=0x7f0400005c00 comp rx=0 tx=0).stop 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f0419400640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 0x7f03fc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- 172.21.15.18:0/2416114051 shutdown_connections 2024-04-21T22:40:21.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8baa860 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8ba7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 --2- 172.21.15.18:0/2416114051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9ef70 0x5630c8b9f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- 172.21.15.18:0/2416114051 >> 172.21.15.18:0/2416114051 conn(0x5630c8b996a0 msgr2=0x5630c8b99a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- 172.21.15.18:0/2416114051 shutdown_connections 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- 172.21.15.18:0/2416114051 wait complete. 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f041e02e740 1 -- start start 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.418+0000 7f0419400640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 0x7f03fc0a51c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f040c005fd0 tx=0x7f040c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 Processor -- start 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 0x5630c8ba5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8ba5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630c8bab200 con 0x5630c8b9f890 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5630c8abed80 con 0x5630c8b9ef70 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5630c8bab380 con 0x5630c8ba8470 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f041e02e740 10 client.0 _ll_register_callbacks cb 0x5630c8afb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f0418a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f0413e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 0x5630c8ba5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f0418a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56570/0 (socket says 172.21.15.18:56570) 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f0418a00640 1 -- 172.21.15.18:0/1404762262 learned_addr learned my addr 172.21.15.18:0/1404762262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.419+0000 7f0419400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8ba5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 -- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 msgr2=0x5630c8ba5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8ba5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 -- 172.21.15.18:0/1404762262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 msgr2=0x5630c8ba5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 -- 172.21.15.18:0/1404762262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c88e17d0 con 0x5630c8b9f890 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0418a00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f0413e00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 0x5630c8ba5960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0400036040 tx=0x7f040002c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee823fa8183d2559 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f03fa000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.420+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400042070 con 0x5630c8b9f890 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f040002cce0 con 0x5630c8b9f890 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0400004240 con 0x5630c8b9f890 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0400004ec0 con 0x5630c8b9f890 2024-04-21T22:40:21.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f041e02e740 10 client.16983 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5630c8bb7450 con 0x5630c8b9f890 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0400004240 con 0x5630c8b9f890 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f040004f030 con 0x5630c8b9f890 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f041e02e740 10 client.16983 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.421+0000 7f041e02e740 10 client.16983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f041e02e740 20 client.16983 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8bb87a0 0x5630c8bbab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f041e02e740 4 client.16983 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:21.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630c8b108e0 con 0x5630c8bb87a0 2024-04-21T22:40:21.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f0418a00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8bb87a0 0x5630c8bbab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f0418a00640 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8bb87a0 0x5630c8bbab90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da28497dad4428b0 server_cookie=92e0d193803d7157 in_seq=0 out_seq=0 2024-04-21T22:40:21.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.422+0000 7f03fa000640 10 client.16983 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f03fa000640 1 -- 172.21.15.18:0/1404762262 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5630c8b108e0 con 0x5630c8bb87a0 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f03fa000640 10 client.16983 handle_command_reply: tid=0 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 client.16983 shutdown 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 msgr2=0x5630c8ba5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 0x5630c8ba5960 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0400036040 tx=0x7f040002c7b0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 shutdown_connections 2024-04-21T22:40:21.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8bb87a0 0x5630c8bbab90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8ba8470 0x5630c8ba5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8b9f890 0x5630c8ba5960 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f03fa000640 0 client.16983 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 --2- 172.21.15.18:0/1404762262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 >> 172.21.15.18:0/1404762262 conn(0x5630c8b996a0 msgr2=0x5630c8b9b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.423+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 shutdown_connections 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.424+0000 7f041e02e740 1 -- 172.21.15.18:0/1404762262 wait complete. 2024-04-21T22:40:21.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.424+0000 7f041e02e740 20 client.16983 trim_cache size 0 max 16384 2024-04-21T22:40:21.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 Processor -- start 2024-04-21T22:40:21.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 -- start start 2024-04-21T22:40:21.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8bb40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8bc0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04141af480 con 0x5630c8ba8470 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b0fc0 con 0x5630c8b9f890 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f041e02e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04141afb50 con 0x5630c8b9ef70 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f0418a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f0418a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59226/0 (socket says 172.21.15.18:59226) 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f0418a00640 1 -- 172.21.15.18:0/2736485027 learned_addr learned my addr 172.21.15.18:0/2736485027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.439+0000 7f0419400640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8bc0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0413e00640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8bb40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 -- 172.21.15.18:0/2736485027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 msgr2=0x5630c8bb40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8bb40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 -- 172.21.15.18:0/2736485027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 msgr2=0x5630c8bc0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8bc0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 -- 172.21.15.18:0/2736485027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c8b93ae0 con 0x5630c8b9ef70 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0419400640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8bc0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0418a00640 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0408098730 tx=0x7f04080d5530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fae97b2a81882d4b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0405200640 1 -- 172.21.15.18:0/2736485027 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040809b6c0 con 0x5630c8b9ef70 2024-04-21T22:40:21.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0405200640 1 -- 172.21.15.18:0/2736485027 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040809bd60 con 0x5630c8b9ef70 2024-04-21T22:40:21.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.440+0000 7f0405200640 1 -- 172.21.15.18:0/2736485027 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040809a0f0 con 0x5630c8b9ef70 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- 172.21.15.18:0/2736485027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 msgr2=0x5630c8ba7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0408098730 tx=0x7f04080d5530 comp rx=0 tx=0).stop 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- 172.21.15.18:0/2736485027 shutdown_connections 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8bc0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9f890 0x5630c8bb40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 --2- 172.21.15.18:0/2736485027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9ef70 0x5630c8ba7b50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- 172.21.15.18:0/2736485027 >> 172.21.15.18:0/2736485027 conn(0x5630c8b996a0 msgr2=0x5630c8b98690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- 172.21.15.18:0/2736485027 shutdown_connections 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- 172.21.15.18:0/2736485027 wait complete. 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 -- start start 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.441+0000 7f041e02e740 1 Processor -- start 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 0x5630c8ba24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8ba2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b08f0 con 0x5630c8ba8470 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f04141b0220 con 0x5630c8b9ef70 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04141ad460 con 0x5630c8b9f890 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f041e02e740 10 client.0 _ll_register_callbacks cb 0x7f040c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f0418a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f0413e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 0x5630c8ba24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f0418a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56586/0 (socket says 172.21.15.18:56586) 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f0418a00640 1 -- 172.21.15.18:0/995093722 learned_addr learned my addr 172.21.15.18:0/995093722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.442+0000 7f0419400640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8ba2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 -- 172.21.15.18:0/995093722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 msgr2=0x5630c8ba1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 -- 172.21.15.18:0/995093722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 msgr2=0x5630c8ba2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8ba2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 -- 172.21.15.18:0/995093722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c8c1d9a0 con 0x5630c8b9f890 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f0413e00640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 0x5630c8ba24c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f04000479a0 tx=0x7f0400047dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c093431f094723 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f03fa000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040005d060 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f040809bd60 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f04000057f0 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0400042070 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f041e02e740 10 client.27115 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.443+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5630c8c1eae0 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f040809bd60 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f040004f040 con 0x5630c8b9f890 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 10 client.27115 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 10 client.27115 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 20 client.27115 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8c1f1d0 0x5630c8c215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 4 client.27115 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630c8b0ac30 con 0x5630c8c1f1d0 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.444+0000 7f0418a00640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8c1f1d0 0x5630c8c215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f03fa000640 10 client.27115 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f0418a00640 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8c1f1d0 0x5630c8c215f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2542c1b0ee6a39af server_cookie=ef4f7dec5a6e3379 in_seq=0 out_seq=0 2024-04-21T22:40:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f03fa000640 1 -- 172.21.15.18:0/995093722 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630c8b0ac30 con 0x5630c8c1f1d0 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f03fa000640 10 client.27115 handle_command_reply: tid=0 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 client.27115 shutdown 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 msgr2=0x5630c8ba24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 0x5630c8ba24c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f04000479a0 tx=0x7f0400047dc0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 shutdown_connections 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5630c8c1f1d0 0x5630c8c215f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630c8ba8470 0x5630c8ba2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630c8b9f890 0x5630c8ba24c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 --2- 172.21.15.18:0/995093722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5630c8b9ef70 0x5630c8ba1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 >> 172.21.15.18:0/995093722 conn(0x5630c8b996a0 msgr2=0x5630c8ba53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f03fa000640 0 client.27115 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 shutdown_connections 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 1 -- 172.21.15.18:0/995093722 wait complete. 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.445+0000 7f041e02e740 20 client.27115 trim_cache size 0 max 16384 2024-04-21T22:40:21.454 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 msgr2=0x7f03fc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 0x7f03fc0a51c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f040c005fd0 tx=0x7f040c009500 comp rx=0 tx=0).stop 2024-04-21T22:40:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 msgr2=0x7f041419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9f0 tx=0x7f040800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 shutdown_connections 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f03fc0a2d00 0x7f03fc0a51c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0414109770 0x7f041419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0414104120 0x7f041419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 --2- 172.21.15.18:0/853249587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0414103760 0x7f041419a080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 >> 172.21.15.18:0/853249587 conn(0x7f04140ff230 msgr2=0x7f04140ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 shutdown_connections 2024-04-21T22:40:21.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.446+0000 7f0419e00640 1 -- 172.21.15.18:0/853249587 wait complete. 2024-04-21T22:40:21.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:40:21.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:21 smithi018 ceph-mon[26614]: pgmap v192: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:21.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:21 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2459094827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:21.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:21 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:40:21.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:21 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:40:21.519 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:21 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:40:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 -- 172.21.15.18:0/134473278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 msgr2=0x7f1154076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 --2- 172.21.15.18:0/134473278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f1154076050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1144009930 tx=0x7f114402bc30 comp rx=0 tx=0).stop 2024-04-21T22:40:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 -- 172.21.15.18:0/134473278 shutdown_connections 2024-04-21T22:40:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 --2- 172.21.15.18:0/134473278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11541123c0 0x7f11541147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 --2- 172.21.15.18:0/134473278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1154076590 0x7f1154111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 --2- 172.21.15.18:0/134473278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f1154076050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.663+0000 7f1153e00640 1 -- 172.21.15.18:0/134473278 >> 172.21.15.18:0/134473278 conn(0x7f11540ff210 msgr2=0x7f1154101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.664+0000 7f1153e00640 1 -- 172.21.15.18:0/134473278 shutdown_connections 2024-04-21T22:40:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.664+0000 7f1153e00640 1 -- 172.21.15.18:0/134473278 wait complete. 2024-04-21T22:40:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.665+0000 7f1153e00640 1 Processor -- start 2024-04-21T22:40:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.665+0000 7f1153e00640 1 -- start start 2024-04-21T22:40:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f115419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541123c0 0x7f11541a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1154117f70 con 0x7f11541123c0 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1154117df0 con 0x7f1154075c70 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11541180f0 con 0x7f1154076590 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59260/0 (socket says 172.21.15.18:59260) 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 -- 172.21.15.18:0/2230380017 learned_addr learned my addr 172.21.15.18:0/2230380017 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152a00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f115419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1153400640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541123c0 0x7f11541a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 -- 172.21.15.18:0/2230380017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 msgr2=0x7f115419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f115419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 -- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541123c0 msgr2=0x7f11541a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.666+0000 7f1152000640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541123c0 0x7f11541a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1152000640 1 -- 172.21.15.18:0/2230380017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11541a34b0 con 0x7f1154076590 2024-04-21T22:40:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1152000640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1158a00640 1 -- 172.21.15.18:0/2230380017 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140017030 con 0x7f1154076590 2024-04-21T22:40:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1158a00640 1 -- 172.21.15.18:0/2230380017 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1140004020 con 0x7f1154076590 2024-04-21T22:40:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541a37a0 con 0x7f1154076590 2024-04-21T22:40:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1158a00640 1 -- 172.21.15.18:0/2230380017 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140005650 con 0x7f1154076590 2024-04-21T22:40:21.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.667+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11541ab030 con 0x7f1154076590 2024-04-21T22:40:21.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 Processor -- start 2024-04-21T22:40:21.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f1158a00640 1 -- 172.21.15.18:0/2230380017 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f11400041d0 con 0x7f1154076590 2024-04-21T22:40:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 -- start start 2024-04-21T22:40:21.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e06a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a1dfce3a0 con 0x557a1e069f70 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a1df76930 con 0x557a1e06a890 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f115cb6f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a1dfca360 con 0x557a1e073470 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f1152000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.671+0000 7f1153400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e06a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1153400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e06a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48086/0 (socket says 172.21.15.18:48086) 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1153400640 1 -- 172.21.15.18:0/3084458070 learned_addr learned my addr 172.21.15.18:0/3084458070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59262/0 (socket says 172.21.15.18:59262) 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152a00640 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 -- 172.21.15.18:0/3084458070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 msgr2=0x557a1e072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 -- 172.21.15.18:0/3084458070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 msgr2=0x557a1e06a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e06a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 -- 172.21.15.18:0/3084458070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a1dce23f0 con 0x557a1e073470 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f1152000640 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f11400cc480 tx=0x7f11400d57f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b36e03432c5d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.672+0000 7f113fe00640 1 -- 172.21.15.18:0/3084458070 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400d2df0 con 0x557a1e073470 2024-04-21T22:40:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f113fe00640 1 -- 172.21.15.18:0/3084458070 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11400d50d0 con 0x557a1e073470 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f113fe00640 1 -- 172.21.15.18:0/3084458070 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400df610 con 0x557a1e073470 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f1158a00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 0x7f11380a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f1158a00640 1 -- 172.21.15.18:0/2230380017 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f11400ced30 con 0x7f1154076590 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f1153400640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 0x7f11380a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 -- 172.21.15.18:0/3084458070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 msgr2=0x557a1e075860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f11400cc480 tx=0x7f11400d57f0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 -- 172.21.15.18:0/3084458070 shutdown_connections 2024-04-21T22:40:21.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e075860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3084458070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e06a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.673+0000 7f115cb6f740 1 -- 172.21.15.18:0/3084458070 >> 172.21.15.18:0/3084458070 conn(0x557a1e0646a0 msgr2=0x557a1e064a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.674+0000 7f115cb6f740 1 -- 172.21.15.18:0/3084458070 shutdown_connections 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.674+0000 7f115cb6f740 1 -- 172.21.15.18:0/3084458070 wait complete. 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.674+0000 7f1153400640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 0x7f11380a5240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f114c012640 tx=0x7f114c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.674+0000 7f115cb6f740 1 -- start start 2024-04-21T22:40:21.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.674+0000 7f115cb6f740 1 Processor -- start 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 0x557a1e070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a1e076260 con 0x557a1e073470 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x557a1df89d80 con 0x557a1e06a890 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557a1e0763e0 con 0x557a1e069f70 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f115cb6f740 10 client.0 _ll_register_callbacks cb 0x557a1dfc62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1152a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1153400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 0x557a1e070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1152a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59270/0 (socket says 172.21.15.18:59270) 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1152a00640 1 -- 172.21.15.18:0/3248293195 learned_addr learned my addr 172.21.15.18:0/3248293195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1153400640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 0x557a1e070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48088/0 (socket says 172.21.15.18:48088) 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.675+0000 7f1152000640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 -- 172.21.15.18:0/3248293195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 msgr2=0x557a1e0709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e0709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 -- 172.21.15.18:0/3248293195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 msgr2=0x557a1e070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 0x557a1e070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 -- 172.21.15.18:0/3248293195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a1ddac7d0 con 0x557a1e069f70 2024-04-21T22:40:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f1152a00640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f114402c240 tx=0x7f1144005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f0602642afe839 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f113cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114402cb10 con 0x557a1e069f70 2024-04-21T22:40:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f114402ccb0 con 0x557a1e069f70 2024-04-21T22:40:21.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.676+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11400d50d0 con 0x557a1e069f70 2024-04-21T22:40:21.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f11440046c0 con 0x557a1e069f70 2024-04-21T22:40:21.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 10 client.27127 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557a1e082500 con 0x557a1e069f70 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11400d50d0 con 0x557a1e069f70 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f11440035f0 con 0x557a1e069f70 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 10 client.27127 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 10 client.27127 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 20 client.27127 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0839c0 0x557a1e085df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 4 client.27127 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.677+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a1dfdb8e0 con 0x557a1e0839c0 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.678+0000 7f1152000640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0839c0 0x557a1e085df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.678+0000 7f1152000640 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0839c0 0x557a1e085df0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd6638758e748a2c server_cookie=d53d1a9d684bb53f in_seq=0 out_seq=0 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.678+0000 7f113cc00640 10 client.27127 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f113cc00640 1 -- 172.21.15.18:0/3248293195 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a1dfdb8e0 con 0x557a1e0839c0 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f113cc00640 10 client.27127 handle_command_reply: tid=0 2024-04-21T22:40:21.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 client.27127 shutdown 2024-04-21T22:40:21.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 msgr2=0x557a1e0704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f114402c240 tx=0x7f1144005e70 comp rx=0 tx=0).stop 2024-04-21T22:40:21.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 shutdown_connections 2024-04-21T22:40:21.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0839c0 0x557a1e085df0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e073470 0x557a1e070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f113cc00640 0 client.27127 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 --2- 172.21.15.18:0/3248293195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e069f70 0x557a1e0704a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 >> 172.21.15.18:0/3248293195 conn(0x557a1e0646a0 msgr2=0x557a1e0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 shutdown_connections 2024-04-21T22:40:21.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 1 -- 172.21.15.18:0/3248293195 wait complete. 2024-04-21T22:40:21.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.679+0000 7f115cb6f740 20 client.27127 trim_cache size 0 max 16384 2024-04-21T22:40:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 Processor -- start 2024-04-21T22:40:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 -- start start 2024-04-21T22:40:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e08b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e08bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b3990 con 0x557a1e069f70 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b54d0 con 0x557a1e06a890 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.694+0000 7f115cb6f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b4060 con 0x557a1e073470 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e08b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48092/0 (socket says 172.21.15.18:48092) 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 -- 172.21.15.18:0/743367291 learned_addr learned my addr 172.21.15.18:0/743367291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1153400640 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e08bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 -- 172.21.15.18:0/743367291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 msgr2=0x557a1e08bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e08bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 -- 172.21.15.18:0/743367291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 msgr2=0x557a1e08b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e08b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152a00640 1 -- 172.21.15.18:0/743367291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a1e06a6c0 con 0x557a1e069f70 2024-04-21T22:40:21.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.695+0000 7f1152000640 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e08b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.696+0000 7f1152a00640 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f114402c170 tx=0x7f1144003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162ee668e976adc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.696+0000 7f113f400640 1 -- 172.21.15.18:0/743367291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144057070 con 0x557a1e069f70 2024-04-21T22:40:21.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.696+0000 7f113f400640 1 -- 172.21.15.18:0/743367291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1144009520 con 0x557a1e069f70 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.696+0000 7f113f400640 1 -- 172.21.15.18:0/743367291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144005140 con 0x557a1e069f70 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- 172.21.15.18:0/743367291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 msgr2=0x557a1e07f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f114402c170 tx=0x7f1144003fd0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- 172.21.15.18:0/743367291 shutdown_connections 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e073470 0x557a1e08bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e06a890 0x557a1e08b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 --2- 172.21.15.18:0/743367291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e07f120 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- 172.21.15.18:0/743367291 >> 172.21.15.18:0/743367291 conn(0x557a1e0646a0 msgr2=0x557a1e063690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- 172.21.15.18:0/743367291 shutdown_connections 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- 172.21.15.18:0/743367291 wait complete. 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 -- start start 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.697+0000 7f115cb6f740 1 Processor -- start 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 0x557a1e0795d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 0x557a1e079b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b4e00 con 0x557a1e069f70 2024-04-21T22:40:21.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b4730 con 0x557a1e073470 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11541b1970 con 0x557a1e06a890 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f115cb6f740 10 client.0 _ll_register_callbacks cb 0x7f1144009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 0x557a1e0795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48096/0 (socket says 172.21.15.18:48096) 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 -- 172.21.15.18:0/2606471668 learned_addr learned my addr 172.21.15.18:0/2606471668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1153400640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 0x557a1e079b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 -- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 msgr2=0x557a1e0795d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 0x557a1e0795d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 -- 172.21.15.18:0/2606471668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 msgr2=0x557a1e079b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 0x557a1e079b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152a00640 1 -- 172.21.15.18:0/2606471668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a1e0e8f70 con 0x557a1e069f70 2024-04-21T22:40:21.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1153400640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 0x557a1e079b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:21.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.698+0000 7f1152000640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 0x557a1e0795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f1152a00640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f114402c240 tx=0x7f1144000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a286fac28d58b7a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f113cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144060060 con 0x557a1e069f70 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1144009520 con 0x557a1e069f70 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1144004a60 con 0x557a1e069f70 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1144057050 con 0x557a1e069f70 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f115cb6f740 10 client.17007 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.699+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557a1e0ea250 con 0x557a1e069f70 2024-04-21T22:40:21.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1144009520 con 0x557a1e069f70 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f114404a680 con 0x557a1e069f70 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 10 client.17007 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 10 client.17007 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 20 client.17007 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0ea880 0x557a1e0ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 4 client.17007 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a1dfd5c30 con 0x557a1e0ea880 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.700+0000 7f1152000640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0ea880 0x557a1e0ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f1152000640 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0ea880 0x557a1e0ecca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc7c105f38410cc2 server_cookie=a9fa13041a0746b3 in_seq=0 out_seq=0 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f113cc00640 10 client.17007 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f113cc00640 1 -- 172.21.15.18:0/2606471668 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a1dfd5c30 con 0x557a1e0ea880 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f113cc00640 10 client.17007 handle_command_reply: tid=0 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 client.17007 shutdown 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 msgr2=0x557a1e079090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f114402c240 tx=0x7f1144000bc0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 shutdown_connections 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x557a1e0ea880 0x557a1e0ecca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x557a1e073470 0x557a1e079b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a1e06a890 0x557a1e0795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f113cc00640 0 client.17007 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 --2- 172.21.15.18:0/2606471668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a1e069f70 0x557a1e079090 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 >> 172.21.15.18:0/2606471668 conn(0x557a1e0646a0 msgr2=0x557a1e065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.701+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 shutdown_connections 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f115cb6f740 1 -- 172.21.15.18:0/2606471668 wait complete. 2024-04-21T22:40:21.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f115cb6f740 20 client.17007 trim_cache size 0 max 16384 2024-04-21T22:40:21.711 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:21.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 msgr2=0x7f11380a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 0x7f11380a5240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f114c012640 tx=0x7f114c009500 comp rx=0 tx=0).stop 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 msgr2=0x7f115419ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000dd50 comp rx=0 tx=0).stop 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 shutdown_connections 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f11380a2d80 0x7f11380a5240 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11541123c0 0x7f11541a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1154076590 0x7f115419ea50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 --2- 172.21.15.18:0/2230380017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1154075c70 0x7f115419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.702+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 >> 172.21.15.18:0/2230380017 conn(0x7f11540ff210 msgr2=0x7f1154113b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.703+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 shutdown_connections 2024-04-21T22:40:21.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.703+0000 7f1153e00640 1 -- 172.21.15.18:0/2230380017 wait complete. 2024-04-21T22:40:21.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:40:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:21 smithi081 ceph-mon[31692]: pgmap v192: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:21 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2459094827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:21.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:21 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:40:21.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:21 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:40:21.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:21 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:40:21.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 -- 172.21.15.18:0/2888718308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 msgr2=0x7f3288101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 --2- 172.21.15.18:0/2888718308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f3288101b80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3274009900 tx=0x7f327402bc40 comp rx=0 tx=0).stop 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 -- 172.21.15.18:0/2888718308 shutdown_connections 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 --2- 172.21.15.18:0/2888718308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 --2- 172.21.15.18:0/2888718308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f3288101b80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 --2- 172.21.15.18:0/2888718308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f3288107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.934+0000 7f328cc00640 1 -- 172.21.15.18:0/2888718308 >> 172.21.15.18:0/2888718308 conn(0x7f32880fd1f0 msgr2=0x7f32880ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.935+0000 7f328cc00640 1 -- 172.21.15.18:0/2888718308 shutdown_connections 2024-04-21T22:40:21.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.935+0000 7f328cc00640 1 -- 172.21.15.18:0/2888718308 wait complete. 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.936+0000 7f328cc00640 1 Processor -- start 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.936+0000 7f328cc00640 1 -- start start 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f328819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f328819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3288111b70 con 0x7f32881020c0 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32881119f0 con 0x7f3288101700 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f328cc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3288111cf0 con 0x7f3288107710 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f3285400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f3285e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f328819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f3285400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48118/0 (socket says 172.21.15.18:48118) 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f3285400640 1 -- 172.21.15.18:0/3393486440 learned_addr learned my addr 172.21.15.18:0/3393486440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.937+0000 7f3286800640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f328819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 -- 172.21.15.18:0/3393486440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 msgr2=0x7f328819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f328819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 -- 172.21.15.18:0/3393486440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 msgr2=0x7f328819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f328819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 -- 172.21.15.18:0/3393486440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328819f260 con 0x7f32881020c0 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3286800640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f328819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.938+0000 7f3285400640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3274005ab0 tx=0x7f32740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.939+0000 7f327ea00640 1 -- 172.21.15.18:0/3393486440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274041070 con 0x7f32881020c0 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.939+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328819f4f0 con 0x7f32881020c0 2024-04-21T22:40:21.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.939+0000 7f327ea00640 1 -- 172.21.15.18:0/3393486440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f327402ccd0 con 0x7f32881020c0 2024-04-21T22:40:21.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.939+0000 7f327ea00640 1 -- 172.21.15.18:0/3393486440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274003d10 con 0x7f32881020c0 2024-04-21T22:40:21.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.939+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32881a6de0 con 0x7f32881020c0 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.942+0000 7f328f995740 1 Processor -- start 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.942+0000 7f328f995740 1 -- start start 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f327ea00640 1 -- 172.21.15.18:0/3393486440 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3274044070 con 0x7f32881020c0 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb45160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb4e280 0x5629edb50670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5629edaa93a0 con 0x5629edb456a0 2024-04-21T22:40:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5629eda51930 con 0x5629edb4e280 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f328f995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629edaa5360 con 0x5629edb44d80 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f3285e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f3285e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48126/0 (socket says 172.21.15.18:48126) 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f3285e00640 1 -- 172.21.15.18:0/819945078 learned_addr learned my addr 172.21.15.18:0/819945078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f3286800640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb45160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.943+0000 7f3285400640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb4e280 0x5629edb50670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:21 smithi047 ceph-mon[31561]: pgmap v192: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:21 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2459094827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:21 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:40:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:21 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:40:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:21 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:40:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 -- 172.21.15.18:0/819945078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb4e280 msgr2=0x5629edb50670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb4e280 0x5629edb50670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 -- 172.21.15.18:0/819945078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 msgr2=0x5629edb4dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 -- 172.21.15.18:0/819945078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ed7bd3f0 con 0x5629edb44d80 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3285e00640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3286800640 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb45160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3280010690 tx=0x7f3280010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d9d4bd48d4cf58 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3273000640 1 -- 172.21.15.18:0/819945078 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280004b20 con 0x5629edb44d80 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3273000640 1 -- 172.21.15.18:0/819945078 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328000edb0 con 0x5629edb44d80 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f3273000640 1 -- 172.21.15.18:0/819945078 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280005850 con 0x5629edb44d80 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.944+0000 7f327ea00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 0x7f326c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f327ea00640 1 -- 172.21.15.18:0/3393486440 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f32740f0d70 con 0x7f32881020c0 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f3285e00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 0x7f326c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 -- 172.21.15.18:0/819945078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 msgr2=0x5629edb45160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb45160 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3280010690 tx=0x7f3280010b50 comp rx=0 tx=0).stop 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 -- 172.21.15.18:0/819945078 shutdown_connections 2024-04-21T22:40:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb4e280 0x5629edb50670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb456a0 0x5629edb4dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 --2- 172.21.15.18:0/819945078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb45160 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 -- 172.21.15.18:0/819945078 >> 172.21.15.18:0/819945078 conn(0x5629edb3f4b0 msgr2=0x5629edb3f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 -- 172.21.15.18:0/819945078 shutdown_connections 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.945+0000 7f328f995740 1 -- 172.21.15.18:0/819945078 wait complete. 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.946+0000 7f3285e00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 0x7f326c0a51c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5629edb44850 tx=0x7f3278005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.946+0000 7f328f995740 1 -- start start 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.946+0000 7f328f995740 1 Processor -- start 2024-04-21T22:40:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.946+0000 7f328f995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.946+0000 7f328f995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb4b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f328f995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f328f995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5629edb51070 con 0x5629edb4e280 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f328f995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5629eda64d80 con 0x5629edb456a0 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f328f995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5629edb511f0 con 0x5629edb44d80 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f328f995740 10 client.0 _ll_register_callbacks cb 0x5629edaa12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3286800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59312/0 (socket says 172.21.15.18:59312) 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 -- 172.21.15.18:0/2814899493 learned_addr learned my addr 172.21.15.18:0/2814899493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285400640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb4b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 -- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 msgr2=0x5629edb4b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb4b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 -- 172.21.15.18:0/2814899493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 msgr2=0x5629edb4bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3285e00640 1 -- 172.21.15.18:0/2814899493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ed8877d0 con 0x5629edb44d80 2024-04-21T22:40:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.947+0000 7f3286800640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3285e00640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3278009e10 tx=0x7f3278004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed82d2409971b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3267400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278029440 con 0x5629edb44d80 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328000edb0 con 0x5629edb44d80 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f327800f480 con 0x5629edb44d80 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f327800f680 con 0x5629edb44d80 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f328f995740 10 client.27145 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5629edb5d4d0 con 0x5629edb44d80 2024-04-21T22:40:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.948+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328000edb0 con 0x5629edb44d80 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3278027070 con 0x5629edb44d80 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 10 client.27145 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 10 client.27145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 20 client.27145 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edb5e9e0 0x5629edb60e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 4 client.27145 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629edab68e0 con 0x5629edb5e9e0 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.949+0000 7f3285400640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edb5e9e0 0x5629edb60e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.950+0000 7f3285400640 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edb5e9e0 0x5629edb60e50 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44767567e853333d server_cookie=64c6d74b61a74c4b in_seq=0 out_seq=0 2024-04-21T22:40:21.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.950+0000 7f3267400640 10 client.27145 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.950+0000 7f3267400640 1 -- 172.21.15.18:0/2814899493 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5629edab68e0 con 0x5629edb5e9e0 2024-04-21T22:40:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.950+0000 7f3267400640 10 client.27145 handle_command_reply: tid=0 2024-04-21T22:40:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 client.27145 shutdown 2024-04-21T22:40:21.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 msgr2=0x5629edb4b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3278009e10 tx=0x7f3278004730 comp rx=0 tx=0).stop 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 shutdown_connections 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb4b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edb5e9e0 0x5629edb60e50 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 --2- 172.21.15.18:0/2814899493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb44d80 0x5629edb4b330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f3267400640 0 client.27145 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 >> 172.21.15.18:0/2814899493 conn(0x5629edb3f4b0 msgr2=0x5629edb41200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 shutdown_connections 2024-04-21T22:40:21.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 1 -- 172.21.15.18:0/2814899493 wait complete. 2024-04-21T22:40:21.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.951+0000 7f328f995740 20 client.27145 trim_cache size 0 max 16384 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 Processor -- start 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 -- start start 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb59f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32881af700 con 0x5629edb4e280 2024-04-21T22:40:21.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b1240 con 0x5629edb456a0 2024-04-21T22:40:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f328f995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32881afdd0 con 0x5629edb414c0 2024-04-21T22:40:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f3286800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f3286800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59320/0 (socket says 172.21.15.18:59320) 2024-04-21T22:40:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f3286800640 1 -- 172.21.15.18:0/2471438860 learned_addr learned my addr 172.21.15.18:0/2471438860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.966+0000 7f3285e00640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb59f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3285400640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 -- 172.21.15.18:0/2471438860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 msgr2=0x5629edb59f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb59f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 -- 172.21.15.18:0/2471438860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 msgr2=0x5629edb4bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 -- 172.21.15.18:0/2471438860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629edb3efe0 con 0x5629edb414c0 2024-04-21T22:40:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3285e00640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb59f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3285400640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3286800640 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3280010690 tx=0x7f32800103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9436e44aeeb3874 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3272600640 1 -- 172.21.15.18:0/2471438860 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328000ede0 con 0x5629edb414c0 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3272600640 1 -- 172.21.15.18:0/2471438860 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328002c070 con 0x5629edb414c0 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.967+0000 7f3272600640 1 -- 172.21.15.18:0/2471438860 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280005080 con 0x5629edb414c0 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 -- 172.21.15.18:0/2471438860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 msgr2=0x5629edb3e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3280010690 tx=0x7f32800103d0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 -- 172.21.15.18:0/2471438860 shutdown_connections 2024-04-21T22:40:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb414c0 0x5629edb3e510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb4e280 0x5629edb4bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 --2- 172.21.15.18:0/2471438860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb59f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 -- 172.21.15.18:0/2471438860 >> 172.21.15.18:0/2471438860 conn(0x5629edb3f4b0 msgr2=0x5629edb3de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 -- 172.21.15.18:0/2471438860 shutdown_connections 2024-04-21T22:40:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.968+0000 7f328f995740 1 -- 172.21.15.18:0/2471438860 wait complete. 2024-04-21T22:40:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 -- start start 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 Processor -- start 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb52740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 0x5629edbc3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b0b70 con 0x5629edb414c0 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32881b04a0 con 0x5629edb456a0 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32881ad6e0 con 0x5629edb4e280 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.969+0000 7f328f995740 10 client.0 _ll_register_callbacks cb 0x7f3278009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3285e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3285e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48166/0 (socket says 172.21.15.18:48166) 2024-04-21T22:40:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3285e00640 1 -- 172.21.15.18:0/3306206543 learned_addr learned my addr 172.21.15.18:0/3306206543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 0x5629edbc3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3285400640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb52740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 -- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 msgr2=0x5629edb52740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb52740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 -- 172.21.15.18:0/3306206543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 msgr2=0x5629edb52200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 -- 172.21.15.18:0/3306206543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629edb53040 con 0x5629edb4e280 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3285e00640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3286800640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 0x5629edbc3f90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x5629edb44280 tx=0x7f3280009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ddcdf39c848fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.970+0000 7f3267400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280005380 con 0x5629edb4e280 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328002c070 con 0x5629edb4e280 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3280005520 con 0x5629edb4e280 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3280005780 con 0x5629edb4e280 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 10 client.27151 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5629edbc5570 con 0x5629edb4e280 2024-04-21T22:40:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328002c070 con 0x5629edb4e280 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f328000f040 con 0x5629edb4e280 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 10 client.27151 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 10 client.27151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 20 client.27151 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edbc5a00 0x5629edbc7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 4 client.27151 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.971+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629edab0c30 con 0x5629edbc5a00 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f3285e00640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edbc5a00 0x5629edbc7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f3285e00640 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edbc5a00 0x5629edbc7e20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d91c872d5b6ecad8 server_cookie=9c0d0897c72efe7 in_seq=0 out_seq=0 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f3267400640 10 client.27151 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f3267400640 1 -- 172.21.15.18:0/3306206543 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629edab0c30 con 0x5629edbc5a00 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f3267400640 10 client.27151 handle_command_reply: tid=0 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.972+0000 7f328f995740 1 client.27151 shutdown 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 msgr2=0x5629edbc3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 0x5629edbc3f90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x5629edb44280 tx=0x7f3280009600 comp rx=0 tx=0).stop 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 shutdown_connections 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5629edbc5a00 0x5629edbc7e20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629edb4e280 0x5629edbc3f90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5629edb456a0 0x5629edb52740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f3267400640 0 client.27151 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 --2- 172.21.15.18:0/3306206543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629edb414c0 0x5629edb52200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 >> 172.21.15.18:0/3306206543 conn(0x5629edb3f4b0 msgr2=0x5629edb3e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 shutdown_connections 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 1 -- 172.21.15.18:0/3306206543 wait complete. 2024-04-21T22:40:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.973+0000 7f328f995740 20 client.27151 trim_cache size 0 max 16384 2024-04-21T22:40:21.983 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:21.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 msgr2=0x7f326c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 0x7f326c0a51c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5629edb44850 tx=0x7f3278005f90 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 msgr2=0x7f328819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3274005ab0 tx=0x7f32740042f0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 shutdown_connections 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f326c0a2d00 0x7f326c0a51c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3288107710 0x7f328819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32881020c0 0x7f328819a7b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 --2- 172.21.15.18:0/3393486440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3288101700 0x7f328819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 >> 172.21.15.18:0/3393486440 conn(0x7f32880fd1f0 msgr2=0x7f328810c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:21.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 shutdown_connections 2024-04-21T22:40:21.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:21.974+0000 7f328cc00640 1 -- 172.21.15.18:0/3393486440 wait complete. 2024-04-21T22:40:22.994 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:40:22.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:40:22.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.222+0000 7f5004e00640 1 -- 172.21.15.18:0/1159347754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 msgr2=0x7f50001105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.222+0000 7f5004e00640 1 --2- 172.21.15.18:0/1159347754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f50001105f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009cd0 tx=0x7f4ff802c0f0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 -- 172.21.15.18:0/1159347754 shutdown_connections 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 --2- 172.21.15.18:0/1159347754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f50001105f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 --2- 172.21.15.18:0/1159347754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000103720 0x7f5000103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 --2- 172.21.15.18:0/1159347754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000109730 0x7f5000109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 -- 172.21.15.18:0/1159347754 >> 172.21.15.18:0/1159347754 conn(0x7f50000ff210 msgr2=0x7f5000101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 -- 172.21.15.18:0/1159347754 shutdown_connections 2024-04-21T22:40:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.223+0000 7f5004e00640 1 -- 172.21.15.18:0/1159347754 wait complete. 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 Processor -- start 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 -- start start 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000103720 0x7f500019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000109730 0x7f500019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5000113b40 con 0x7f50001040e0 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50001139c0 con 0x7f5000109730 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.224+0000 7f5004e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5000113cc0 con 0x7f5000103720 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48182/0 (socket says 172.21.15.18:48182) 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 -- 172.21.15.18:0/4049294265 learned_addr learned my addr 172.21.15.18:0/4049294265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4fff400640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000103720 0x7f500019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4fffe00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000109730 0x7f500019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 -- 172.21.15.18:0/4049294265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000103720 msgr2=0x7f500019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000103720 0x7f500019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 -- 172.21.15.18:0/4049294265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000109730 msgr2=0x7f500019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000109730 0x7f500019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 -- 172.21.15.18:0/4049294265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500019f060 con 0x7f50001040e0 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.225+0000 7f4ffea00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9f0 tx=0x7f4fec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.226+0000 7f4ff7e00640 1 -- 172.21.15.18:0/4049294265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00cd80 con 0x7f50001040e0 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.226+0000 7f4ff7e00640 1 -- 172.21.15.18:0/4049294265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fec010910 con 0x7f50001040e0 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.226+0000 7f4ff7e00640 1 -- 172.21.15.18:0/4049294265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec018990 con 0x7f50001040e0 2024-04-21T22:40:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.226+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500019f350 con 0x7f50001040e0 2024-04-21T22:40:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.226+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50001a6be0 con 0x7f50001040e0 2024-04-21T22:40:23.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.230+0000 7f5008d22740 1 Processor -- start 2024-04-21T22:40:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.230+0000 7f5008d22740 1 -- start start 2024-04-21T22:40:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8bdd66df0 con 0x55c8bde088e0 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8bdd6c040 con 0x55c8bde11de0 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f5008d22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8bdd148c0 con 0x55c8bde09200 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f4fffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f4fff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f4fffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48190/0 (socket says 172.21.15.18:48190) 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f4fffe00640 1 -- 172.21.15.18:0/3013570984 learned_addr learned my addr 172.21.15.18:0/3013570984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.231+0000 7f4ff7e00640 1 -- 172.21.15.18:0/4049294265 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4fec010ac0 con 0x7f50001040e0 2024-04-21T22:40:23.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 -- 172.21.15.18:0/3013570984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 msgr2=0x55c8bde118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 -- 172.21.15.18:0/3013570984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 msgr2=0x55c8bde141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 -- 172.21.15.18:0/3013570984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8bdb487e0 con 0x55c8bde088e0 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fff400640 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.232+0000 7f4fffe00640 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8004af0 tx=0x7f4ff8005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73914c1a41f34df3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4ff4c00640 1 -- 172.21.15.18:0/3013570984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8043070 con 0x55c8bde088e0 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4ff4c00640 1 -- 172.21.15.18:0/3013570984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff802cca0 con 0x55c8bde088e0 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4ff4c00640 1 -- 172.21.15.18:0/3013570984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8039040 con 0x55c8bde088e0 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4ff7e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 0x7f4fe40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4ff7e00640 1 -- 172.21.15.18:0/4049294265 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4fec0cf720 con 0x7f50001040e0 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f4fff400640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 0x7f4fe40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f5008d22740 1 -- 172.21.15.18:0/3013570984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 msgr2=0x55c8bde08cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.233+0000 7f5008d22740 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8004af0 tx=0x7f4ff8005f80 comp rx=0 tx=0).stop 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 -- 172.21.15.18:0/3013570984 shutdown_connections 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 --2- 172.21.15.18:0/3013570984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde08cc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 -- 172.21.15.18:0/3013570984 >> 172.21.15.18:0/3013570984 conn(0x55c8bde03010 msgr2=0x55c8bde033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 -- 172.21.15.18:0/3013570984 shutdown_connections 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 -- 172.21.15.18:0/3013570984 wait complete. 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f4fff400640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 0x7f4fe40a5240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55c8bde083b0 tx=0x7f4ff0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.234+0000 7f5008d22740 1 -- start start 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 Processor -- start 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde0f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde0f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8bdd27d20 con 0x55c8bde088e0 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8bdd68000 con 0x55c8bde11de0 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8bde14b70 con 0x55c8bde09200 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f5008d22740 10 client.0 _ll_register_callbacks cb 0x55c8bdd630a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f4fff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f4fff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48200/0 (socket says 172.21.15.18:48200) 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f4fff400640 1 -- 172.21.15.18:0/500875163 learned_addr learned my addr 172.21.15.18:0/500875163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.235+0000 7f4ffea00640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde0f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fffe00640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde0f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 -- 172.21.15.18:0/500875163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 msgr2=0x55c8bde0f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde0f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 -- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 msgr2=0x55c8bde0f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde0f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 -- 172.21.15.18:0/500875163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8bdba8f70 con 0x55c8bde088e0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fff400640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00045f0 tx=0x7f4ff0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7306fc0bd33e07b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.236+0000 7f4fe9600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff002d060 con 0x55c8bde088e0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4ff0018030 con 0x55c8bde088e0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff802cca0 con 0x55c8bde088e0 2024-04-21T22:40:23.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4ff0020710 con 0x55c8bde088e0 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f5008d22740 10 client.17034 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8bda40170 con 0x55c8bde088e0 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff802cca0 con 0x55c8bde088e0 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.237+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4ff001da40 con 0x55c8bde088e0 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 10 client.17034 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 10 client.17034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 20 client.17034 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde22060 0x55c8bde244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 4 client.17034 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8bdd79580 con 0x55c8bde22060 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.238+0000 7f4ffea00640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde22060 0x55c8bde244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.239+0000 7f4ffea00640 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde22060 0x55c8bde244c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de4e898e732399a server_cookie=6a921834109f5097 in_seq=0 out_seq=0 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.239+0000 7f4fe9600640 10 client.17034 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.239+0000 7f4fe9600640 1 -- 172.21.15.18:0/500875163 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c8bdd79580 con 0x55c8bde22060 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.239+0000 7f4fe9600640 10 client.17034 handle_command_reply: tid=0 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.239+0000 7f5008d22740 1 client.17034 shutdown 2024-04-21T22:40:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 msgr2=0x55c8bde0ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00045f0 tx=0x7f4ff0004730 comp rx=0 tx=0).stop 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 shutdown_connections 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde0f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde22060 0x55c8bde244c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde0f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 --2- 172.21.15.18:0/500875163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde0ee60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f4fe9600640 0 client.17034 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 >> 172.21.15.18:0/500875163 conn(0x55c8bde03010 msgr2=0x55c8bde04d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 shutdown_connections 2024-04-21T22:40:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 1 -- 172.21.15.18:0/500875163 wait complete. 2024-04-21T22:40:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.240+0000 7f5008d22740 20 client.17034 trim_cache size 0 max 16384 2024-04-21T22:40:23.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.260+0000 7f5008d22740 1 Processor -- start 2024-04-21T22:40:23.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.260+0000 7f5008d22740 1 -- start start 2024-04-21T22:40:23.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde09200 0x55c8bde0dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde11de0 0x55c8bde1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50001af550 con 0x55c8bde09200 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50001b1090 con 0x55c8bde088e0 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f5008d22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50001afc20 con 0x55c8bde11de0 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56758/0 (socket says 172.21.15.18:56758) 2024-04-21T22:40:23.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 -- 172.21.15.18:0/204516901 learned_addr learned my addr 172.21.15.18:0/204516901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fffe00640 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde11de0 0x55c8bde1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4ffea00640 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde09200 0x55c8bde0dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 -- 172.21.15.18:0/204516901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde11de0 msgr2=0x55c8bde1d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde11de0 0x55c8bde1d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 -- 172.21.15.18:0/204516901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde09200 msgr2=0x55c8bde0dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde09200 0x55c8bde0dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.261+0000 7f4fff400640 1 -- 172.21.15.18:0/204516901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8bde01490 con 0x55c8bde088e0 2024-04-21T22:40:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.262+0000 7f4fff400640 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0004460 tx=0x7f4ff00044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27cd314c818b11bd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.262+0000 7f4febe00640 1 -- 172.21.15.18:0/204516901 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0020ab0 con 0x55c8bde088e0 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.262+0000 7f4febe00640 1 -- 172.21.15.18:0/204516901 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff0005500 con 0x55c8bde088e0 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.262+0000 7f4febe00640 1 -- 172.21.15.18:0/204516901 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0004da0 con 0x55c8bde088e0 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- 172.21.15.18:0/204516901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 msgr2=0x55c8bde11590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0004460 tx=0x7f4ff00044b0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- 172.21.15.18:0/204516901 shutdown_connections 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde11de0 0x55c8bde1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde09200 0x55c8bde0dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 --2- 172.21.15.18:0/204516901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde088e0 0x55c8bde11590 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- 172.21.15.18:0/204516901 >> 172.21.15.18:0/204516901 conn(0x55c8bde03010 msgr2=0x55c8bde02080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- 172.21.15.18:0/204516901 shutdown_connections 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- 172.21.15.18:0/204516901 wait complete. 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.263+0000 7f5008d22740 1 -- start start 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 Processor -- start 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde1a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde16e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50001b09c0 con 0x55c8bde088e0 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f50001b02f0 con 0x55c8bde11de0 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50001ad530 con 0x55c8bde09200 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f5008d22740 10 client.0 _ll_register_callbacks cb 0x7f4ff0009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.264+0000 7f4fff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48218/0 (socket says 172.21.15.18:48218) 2024-04-21T22:40:23.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 -- 172.21.15.18:0/1913680208 learned_addr learned my addr 172.21.15.18:0/1913680208 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4ffea00640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde1a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fffe00640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 -- 172.21.15.18:0/1913680208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 msgr2=0x55c8bde1a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde1a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 -- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 msgr2=0x55c8bde16e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde16e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 -- 172.21.15.18:0/1913680208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8bde176c0 con 0x55c8bde088e0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fff400640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0019040 tx=0x7f4ff00056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ab39b344095371 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.265+0000 7f4fe9600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff002d040 con 0x55c8bde088e0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4ff0004ae0 con 0x55c8bde088e0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff0005500 con 0x55c8bde088e0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4ff0004ce0 con 0x55c8bde088e0 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f5008d22740 10 client.17040 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:23.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8bde891f0 con 0x55c8bde088e0 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff0005500 con 0x55c8bde088e0 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4ff001da20 con 0x55c8bde088e0 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f5008d22740 10 client.17040 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.266+0000 7f5008d22740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f5008d22740 20 client.17040 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde89840 0x55c8bde8bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f5008d22740 4 client.17040 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:40:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c8bdd738d0 con 0x55c8bde89840 2024-04-21T22:40:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f4ffea00640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde89840 0x55c8bde8bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f4ffea00640 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde89840 0x55c8bde8bc30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2db4683e87ab2cf server_cookie=8d97231f44ab60bd in_seq=0 out_seq=0 2024-04-21T22:40:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.267+0000 7f4fe9600640 10 client.17040 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f4fe9600640 1 -- 172.21.15.18:0/1913680208 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c8bdd738d0 con 0x55c8bde89840 2024-04-21T22:40:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f4fe9600640 10 client.17040 handle_command_reply: tid=0 2024-04-21T22:40:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 client.17040 shutdown 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 msgr2=0x55c8bde19df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0019040 tx=0x7f4ff00056b0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 shutdown_connections 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8bde11de0 0x55c8bde16e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c8bde89840 0x55c8bde8bc30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8bde09200 0x55c8bde1a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 --2- 172.21.15.18:0/1913680208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8bde088e0 0x55c8bde19df0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 >> 172.21.15.18:0/1913680208 conn(0x55c8bde03010 msgr2=0x55c8bde017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f4fe9600640 0 client.17040 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 shutdown_connections 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 1 -- 172.21.15.18:0/1913680208 wait complete. 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.269+0000 7f5008d22740 20 client.17040 trim_cache size 0 max 16384 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:40:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "bdf04184-a2c6-4bff-83a2-885ce87370ce", 2024-04-21T22:40:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:40:23.277 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:23.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 msgr2=0x7f4fe40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 0x7f4fe40a5240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55c8bde083b0 tx=0x7f4ff0005f90 comp rx=0 tx=0).stop 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 msgr2=0x7f500019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9f0 tx=0x7f4fec00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 shutdown_connections 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4fe40a2d80 0x7f4fe40a5240 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5000109730 0x7f500019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50001040e0 0x7f500019a600 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 --2- 172.21.15.18:0/4049294265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000103720 0x7f500019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 >> 172.21.15.18:0/4049294265 conn(0x7f50000ff210 msgr2=0x7f50000ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 shutdown_connections 2024-04-21T22:40:23.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.270+0000 7f5004e00640 1 -- 172.21.15.18:0/4049294265 wait complete. 2024-04-21T22:40:23.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:40:23.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.527+0000 7fc37b000640 1 -- 172.21.15.18:0/2351785587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 msgr2=0x7fc3741019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.527+0000 7fc37b000640 1 --2- 172.21.15.18:0/2351785587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc3741019e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc360009930 tx=0x7fc36002bc30 comp rx=0 tx=0).stop 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.527+0000 7fc37b000640 1 -- 172.21.15.18:0/2351785587 shutdown_connections 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.527+0000 7fc37b000640 1 --2- 172.21.15.18:0/2351785587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 0x7fc37410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.528+0000 7fc37b000640 1 --2- 172.21.15.18:0/2351785587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc3741019e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.528+0000 7fc37b000640 1 --2- 172.21.15.18:0/2351785587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 0x7fc374107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.528+0000 7fc37b000640 1 -- 172.21.15.18:0/2351785587 >> 172.21.15.18:0/2351785587 conn(0x7fc3740fd090 msgr2=0x7fc3740ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.528+0000 7fc37b000640 1 -- 172.21.15.18:0/2351785587 shutdown_connections 2024-04-21T22:40:23.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.528+0000 7fc37b000640 1 -- 172.21.15.18:0/2351785587 wait complete. 2024-04-21T22:40:23.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.529+0000 7fc37b000640 1 Processor -- start 2024-04-21T22:40:23.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.529+0000 7fc37b000640 1 -- start start 2024-04-21T22:40:23.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 0x7fc374073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 0x7fc3740744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc374111930 con 0x7fc374107620 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741117b0 con 0x7fc374101f20 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc374111ab0 con 0x7fc374101560 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59402/0 (socket says 172.21.15.18:59402) 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 -- 172.21.15.18:0/2001356797 learned_addr learned my addr 172.21.15.18:0/2001356797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379200640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 0x7fc374073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc37a600640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 0x7fc3740744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 -- 172.21.15.18:0/2001356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 msgr2=0x7fc374073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 0x7fc374073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 -- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 msgr2=0x7fc3740744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.530+0000 7fc379c00640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 0x7fc3740744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc379c00640 1 -- 172.21.15.18:0/2001356797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3741a62f0 con 0x7fc374101560 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc379c00640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc36800d950 tx=0x7fc36800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc372000640 1 -- 172.21.15.18:0/2001356797 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368017030 con 0x7fc374101560 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc372000640 1 -- 172.21.15.18:0/2001356797 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc368004020 con 0x7fc374101560 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc372000640 1 -- 172.21.15.18:0/2001356797 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680047a0 con 0x7fc374101560 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.531+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3741a65e0 con 0x7fc374101560 2024-04-21T22:40:23.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.532+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3741a6ab0 con 0x7fc374101560 2024-04-21T22:40:23.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.536+0000 7fc37f22a740 1 Processor -- start 2024-04-21T22:40:23.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.536+0000 7fc37f22a740 1 -- start start 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.536+0000 7fc372000640 1 -- 172.21.15.18:0/2001356797 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc3680041d0 con 0x7fc374101560 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.536+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.536+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37f22a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7c31410 con 0x55ebb7cce3d0 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37f22a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7bd97e0 con 0x55ebb7cd6fb0 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37f22a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7c2d3d0 con 0x55ebb7ccdab0 2024-04-21T22:40:23.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59412/0 (socket says 172.21.15.18:59412) 2024-04-21T22:40:23.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 -- 172.21.15.18:0/593614974 learned_addr learned my addr 172.21.15.18:0/593614974 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc379200640 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc379c00640 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 -- 172.21.15.18:0/593614974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cd6fb0 msgr2=0x55ebb7cd93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 -- 172.21.15.18:0/593614974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cce3d0 msgr2=0x55ebb7cd6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.537+0000 7fc37a600640 1 -- 172.21.15.18:0/593614974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb7a0f7d0 con 0x55ebb7ccdab0 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.538+0000 7fc37a600640 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009fc0 tx=0x7fc36c010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344b8da3c7529659 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.538+0000 7fc366a00640 1 -- 172.21.15.18:0/593614974 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c003b70 con 0x55ebb7ccdab0 2024-04-21T22:40:23.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.538+0000 7fc366a00640 1 -- 172.21.15.18:0/593614974 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36c003d10 con 0x55ebb7ccdab0 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.538+0000 7fc366a00640 1 -- 172.21.15.18:0/593614974 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c011aa0 con 0x55ebb7ccdab0 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.539+0000 7fc372000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 0x7fc35c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.539+0000 7fc37f22a740 1 -- 172.21.15.18:0/593614974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 msgr2=0x55ebb7ccde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.539+0000 7fc37f22a740 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009fc0 tx=0x7fc36c010860 comp rx=0 tx=0).stop 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.539+0000 7fc372000640 1 -- 172.21.15.18:0/2001356797 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc3680ced50 con 0x7fc374101560 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.539+0000 7fc379c00640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 0x7fc35c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 -- 172.21.15.18:0/593614974 shutdown_connections 2024-04-21T22:40:23.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 --2- 172.21.15.18:0/593614974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7ccde90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 -- 172.21.15.18:0/593614974 >> 172.21.15.18:0/593614974 conn(0x55ebb7cc81e0 msgr2=0x55ebb7cc85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 -- 172.21.15.18:0/593614974 shutdown_connections 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 -- 172.21.15.18:0/593614974 wait complete. 2024-04-21T22:40:23.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc379c00640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 0x7fc35c0a5280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3680cc550 tx=0x7fc368000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.540+0000 7fc37f22a740 1 -- start start 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 Processor -- start 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7cd9da0 con 0x55ebb7cd6fb0 2024-04-21T22:40:23.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7becc40 con 0x55ebb7cce3d0 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ebb7cd9f20 con 0x55ebb7ccdab0 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.541+0000 7fc37f22a740 10 client.0 _ll_register_callbacks cb 0x55ebb7bec630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56788/0 (socket says 172.21.15.18:56788) 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 -- 172.21.15.18:0/381942054 learned_addr learned my addr 172.21.15.18:0/381942054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc37a600640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc37a600640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 -- 172.21.15.18:0/381942054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 msgr2=0x55ebb7cd4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 -- 172.21.15.18:0/381942054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 msgr2=0x55ebb7cd4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.542+0000 7fc379200640 1 -- 172.21.15.18:0/381942054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb79453f0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc379200640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc360009930 tx=0x7fc36002c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721466f0ea94d1ed server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc35b400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36002cc50 con 0x55ebb7cce3d0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc360005030 con 0x55ebb7cce3d0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc36c003d10 con 0x55ebb7cce3d0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc360005230 con 0x55ebb7cce3d0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc37f22a740 10 client.27119 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.543+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ebb79050f0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36c003d10 con 0x55ebb7cce3d0 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fc3600035f0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 10 client.27119 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 10 client.27119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 20 client.27119 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7cefb70 0x55ebb7cf1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 4 client.27119 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.544+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebb7c44c40 con 0x55ebb7cefb70 2024-04-21T22:40:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.545+0000 7fc37a600640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7cefb70 0x55ebb7cf1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.545+0000 7fc37a600640 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7cefb70 0x55ebb7cf1fb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5faca1b8fea9d336 server_cookie=895dfddc4e154e0a in_seq=0 out_seq=0 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.545+0000 7fc35b400640 10 client.27119 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.546+0000 7fc35b400640 1 -- 172.21.15.18:0/381942054 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ebb7c44c40 con 0x55ebb7cefb70 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.546+0000 7fc35b400640 10 client.27119 handle_command_reply: tid=0 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.546+0000 7fc37f22a740 1 client.27119 shutdown 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 msgr2=0x55ebb7cd45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc360009930 tx=0x7fc36002c7e0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 shutdown_connections 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd45c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7cefb70 0x55ebb7cf1fb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 --2- 172.21.15.18:0/381942054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 >> 172.21.15.18:0/381942054 conn(0x55ebb7cc81e0 msgr2=0x55ebb7cc7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc35b400640 0 client.27119 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 shutdown_connections 2024-04-21T22:40:23.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 1 -- 172.21.15.18:0/381942054 wait complete. 2024-04-21T22:40:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.547+0000 7fc37f22a740 20 client.27119 trim_cache size 0 max 16384 2024-04-21T22:40:23.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.572+0000 7fc37f22a740 1 Processor -- start 2024-04-21T22:40:23.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.572+0000 7fc37f22a740 1 -- start start 2024-04-21T22:40:23.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.572+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.572+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7ce2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.572+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cf7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37f22a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741ab250 con 0x55ebb7cd6fb0 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37f22a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741acd90 con 0x55ebb7cce3d0 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37f22a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741ab920 con 0x55ebb7ccdab0 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc379200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7ce2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59426/0 (socket says 172.21.15.18:59426) 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37a600640 1 -- 172.21.15.18:0/2708604248 learned_addr learned my addr 172.21.15.18:0/2708604248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.573+0000 7fc37a600640 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cf7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 -- 172.21.15.18:0/2708604248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 msgr2=0x55ebb7cd67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 -- 172.21.15.18:0/2708604248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 msgr2=0x55ebb7cf7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cf7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 -- 172.21.15.18:0/2708604248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebb7cd96d0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc37a600640 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc379200640 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7ce2c60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc360006010 tx=0x7fc36002bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44b5bae0db54003 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc366000640 1 -- 172.21.15.18:0/2708604248 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360005d50 con 0x55ebb7cce3d0 2024-04-21T22:40:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc366000640 1 -- 172.21.15.18:0/2708604248 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc360003c80 con 0x55ebb7cce3d0 2024-04-21T22:40:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.574+0000 7fc366000640 1 -- 172.21.15.18:0/2708604248 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36002c2b0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 -- 172.21.15.18:0/2708604248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 msgr2=0x55ebb7ce2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7ce2c60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc360006010 tx=0x7fc36002bc30 comp rx=0 tx=0).stop 2024-04-21T22:40:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 -- 172.21.15.18:0/2708604248 shutdown_connections 2024-04-21T22:40:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cf7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7cce3d0 0x55ebb7ce2c60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 --2- 172.21.15.18:0/2708604248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cd67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.575+0000 7fc37f22a740 1 -- 172.21.15.18:0/2708604248 >> 172.21.15.18:0/2708604248 conn(0x55ebb7cc81e0 msgr2=0x55ebb7ccf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.576+0000 7fc37f22a740 1 -- 172.21.15.18:0/2708604248 shutdown_connections 2024-04-21T22:40:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.576+0000 7fc37f22a740 1 -- 172.21.15.18:0/2708604248 wait complete. 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.576+0000 7fc37f22a740 1 -- start start 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.576+0000 7fc37f22a740 1 Processor -- start 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cdf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741ac6c0 con 0x55ebb7cd6fb0 2024-04-21T22:40:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741abff0 con 0x55ebb7ccdab0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741a9230 con 0x55ebb7cce3d0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37f22a740 10 client.0 _ll_register_callbacks cb 0x7fc360004520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59436/0 (socket says 172.21.15.18:59436) 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 -- 172.21.15.18:0/1998021310 learned_addr learned my addr 172.21.15.18:0/1998021310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37a600640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cdf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc37a600640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 -- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7ccdab0 msgr2=0x55ebb7cdf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cdf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 -- 172.21.15.18:0/1998021310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 msgr2=0x55ebb7cd1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.577+0000 7fc379200640 1 -- 172.21.15.18:0/1998021310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebb7d550f0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.578+0000 7fc379200640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc360009900 tx=0x7fc36002c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eac0d9d68b3b7e70 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.578+0000 7fc35b400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.578+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360063060 con 0x55ebb7cce3d0 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.578+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc3600046c0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.578+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc360003c80 con 0x55ebb7cce3d0 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc360003e30 con 0x55ebb7cce3d0 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 10 client.27187 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ebb7d561b0 con 0x55ebb7cce3d0 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc360003c80 con 0x55ebb7cce3d0 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fc360053940 con 0x55ebb7cce3d0 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 10 client.27187 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 10 client.27187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 20 client.27187 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.579+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7d567b0 0x55ebb7d58ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.580+0000 7fc37f22a740 4 client.27187 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:40:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.580+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ebb7c3e950 con 0x55ebb7d567b0 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.580+0000 7fc37a600640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7d567b0 0x55ebb7d58ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37a600640 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7d567b0 0x55ebb7d58ba0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ec7b154558f166 server_cookie=89ce78b77d772471 in_seq=0 out_seq=0 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc35b400640 10 client.27187 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc35b400640 1 -- 172.21.15.18:0/1998021310 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ebb7c3e950 con 0x55ebb7d567b0 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc35b400640 10 client.27187 handle_command_reply: tid=0 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 client.27187 shutdown 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 msgr2=0x55ebb7cd0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc360009900 tx=0x7fc36002c320 comp rx=0 tx=0).stop 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 shutdown_connections 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ebb7cd6fb0 0x55ebb7cd1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55ebb7d567b0 0x55ebb7d58ba0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ebb7cce3d0 0x55ebb7cd0b10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 --2- 172.21.15.18:0/1998021310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ebb7ccdab0 0x55ebb7cdf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 >> 172.21.15.18:0/1998021310 conn(0x55ebb7cc81e0 msgr2=0x55ebb7cc6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc35b400640 0 client.27187 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 shutdown_connections 2024-04-21T22:40:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 1 -- 172.21.15.18:0/1998021310 wait complete. 2024-04-21T22:40:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.581+0000 7fc37f22a740 20 client.27187 trim_cache size 0 max 16384 2024-04-21T22:40:23.590 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "bdf04184-a2c6-4bff-83a2-885ce87370ce": { 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "bdf04184-a2c6-4bff-83a2-885ce87370ce", 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:40:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:40:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:40:23.592 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 msgr2=0x7fc35c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 0x7fc35c0a5280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3680cc550 tx=0x7fc368000bc0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 msgr2=0x7fc374073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc36800d950 tx=0x7fc36800de10 comp rx=0 tx=0).stop 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 shutdown_connections 2024-04-21T22:40:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc35c0a2dc0 0x7fc35c0a5280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc374107620 0x7fc3740744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc374101f20 0x7fc374073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 --2- 172.21.15.18:0/2001356797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc374101560 0x7fc374073a40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.582+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 >> 172.21.15.18:0/2001356797 conn(0x7fc3740fd090 msgr2=0x7fc3740fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.583+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 shutdown_connections 2024-04-21T22:40:23.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:23.583+0000 7fc37b000640 1 -- 172.21.15.18:0/2001356797 wait complete. 2024-04-21T22:40:23.603 INFO:tasks.cephfs.filesystem:scrub status for tag:bdf04184-a2c6-4bff-83a2-885ce87370ce - {'path': '/', 'tag': 'bdf04184-a2c6-4bff-83a2-885ce87370ce', 'options': 'recursive,force'} 2024-04-21T22:40:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:23 smithi018 ceph-mon[26614]: pgmap v193: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:23 smithi081 ceph-mon[31692]: pgmap v193: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:23.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:23 smithi047 ceph-mon[31561]: pgmap v193: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:24.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:24 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:24 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:24.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:24 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:25.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:25 smithi018 ceph-mon[26614]: pgmap v194: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-04-21T22:40:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:25 smithi081 ceph-mon[31692]: pgmap v194: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-04-21T22:40:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:25 smithi047 ceph-mon[31561]: pgmap v194: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-04-21T22:40:27.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:27 smithi018 ceph-mon[26614]: pgmap v195: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:27 smithi081 ceph-mon[31692]: pgmap v195: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:27 smithi047 ceph-mon[31561]: pgmap v195: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:29.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:29 smithi018 ceph-mon[26614]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:29.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:29 smithi081 ceph-mon[31692]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:29.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:29 smithi047 ceph-mon[31561]: pgmap v196: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:31 smithi018 ceph-mon[26614]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:31 smithi081 ceph-mon[31692]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:31 smithi047 ceph-mon[31561]: pgmap v197: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:33.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:33 smithi018 ceph-mon[26614]: pgmap v198: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:33 smithi081 ceph-mon[31692]: pgmap v198: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:33 smithi047 ceph-mon[31561]: pgmap v198: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:34.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:34 smithi047 ceph-mon[31561]: pgmap v199: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:35.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:34 smithi018 ceph-mon[26614]: pgmap v199: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:35.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:34 smithi081 ceph-mon[31692]: pgmap v199: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:37.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:37 smithi018 ceph-mon[26614]: pgmap v200: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:37.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:37 smithi081 ceph-mon[31692]: pgmap v200: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:37.647 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:37 smithi047 ceph-mon[31561]: pgmap v200: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:40:38.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:38.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:38 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:38.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:38.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:38 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:38.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:38.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:38 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:39.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:39 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:39.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:39 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:40:39.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:39 smithi018 ceph-mon[26614]: pgmap v201: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:39 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:39.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:39 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:40:39.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:39 smithi081 ceph-mon[31692]: pgmap v201: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:39.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:39 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:39 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:40:39.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:39 smithi047 ceph-mon[31561]: pgmap v201: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:41.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:41 smithi018 ceph-mon[26614]: pgmap v202: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:41.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:41 smithi081 ceph-mon[31692]: pgmap v202: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:41.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:41 smithi047 ceph-mon[31561]: pgmap v202: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:43.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:43 smithi018 ceph-mon[26614]: pgmap v203: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:43 smithi081 ceph-mon[31692]: pgmap v203: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:43.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:43 smithi047 ceph-mon[31561]: pgmap v203: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:45.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:45 smithi018 ceph-mon[26614]: pgmap v204: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:45 smithi081 ceph-mon[31692]: pgmap v204: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:45.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:45 smithi047 ceph-mon[31561]: pgmap v204: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:47.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:47 smithi018 ceph-mon[26614]: pgmap v205: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:47 smithi081 ceph-mon[31692]: pgmap v205: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:47 smithi047 ceph-mon[31561]: pgmap v205: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:49 smithi018 ceph-mon[26614]: pgmap v206: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:49 smithi081 ceph-mon[31692]: pgmap v206: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:49 smithi047 ceph-mon[31561]: pgmap v206: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:51.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:51 smithi018 ceph-mon[26614]: pgmap v207: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:51 smithi081 ceph-mon[31692]: pgmap v207: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:51 smithi047 ceph-mon[31561]: pgmap v207: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:53.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:53 smithi018 ceph-mon[26614]: pgmap v208: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:53.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:40:53.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:40:53.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:53 smithi081 ceph-mon[31692]: pgmap v208: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:53.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:53 smithi047 ceph-mon[31561]: pgmap v208: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 -- 172.21.15.18:0/1116053749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28076590 msgr2=0x7f3d28112070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/1116053749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28076590 0x7f3d28112070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009930 tx=0x7f3d1002bc20 comp rx=0 tx=0).stop 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 -- 172.21.15.18:0/1116053749 shutdown_connections 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/1116053749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d281125b0 0x7f3d281149a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/1116053749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28076590 0x7f3d28112070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/1116053749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d28075c70 0x7f3d28076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 -- 172.21.15.18:0/1116053749 >> 172.21.15.18:0/1116053749 conn(0x7f3d280ff3c0 msgr2=0x7f3d281017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 -- 172.21.15.18:0/1116053749 shutdown_connections 2024-04-21T22:40:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.818+0000 7f3d2dc00640 1 -- 172.21.15.18:0/1116053749 wait complete. 2024-04-21T22:40:53.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.819+0000 7f3d2dc00640 1 Processor -- start 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.819+0000 7f3d2dc00640 1 -- start start 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 0x7f3d2819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 0x7f3d281a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28118120 con 0x7f3d28076590 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28117fa0 con 0x7f3d281125b0 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d2dc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281182a0 con 0x7f3d28075c70 2024-04-21T22:40:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d27400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 0x7f3d281a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 0x7f3d2819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36686/0 (socket says 172.21.15.18:36686) 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d1fe00640 1 -- 172.21.15.18:0/2766949368 learned_addr learned my addr 172.21.15.18:0/2766949368 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d27400640 1 -- 172.21.15.18:0/2766949368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 msgr2=0x7f3d2819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.820+0000 7f3d27400640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 0x7f3d2819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d27400640 1 -- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 msgr2=0x7f3d2819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d27400640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d27400640 1 -- 172.21.15.18:0/2766949368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d281a3660 con 0x7f3d281125b0 2024-04-21T22:40:53.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d26a00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 0x7f3d2819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d27400640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 0x7f3d281a2f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d20005fd0 tx=0x7f3d2000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d1f400640 1 -- 172.21.15.18:0/2766949368 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000cdf0 con 0x7f3d281125b0 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d1f400640 1 -- 172.21.15.18:0/2766949368 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d20005020 con 0x7f3d281125b0 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281a3950 con 0x7f3d281125b0 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d1f400640 1 -- 172.21.15.18:0/2766949368 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200106d0 con 0x7f3d281125b0 2024-04-21T22:40:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.821+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281ab1e0 con 0x7f3d281125b0 2024-04-21T22:40:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 Processor -- start 2024-04-21T22:40:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d1f400640 1 -- 172.21.15.18:0/2766949368 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3d200054d0 con 0x7f3d281125b0 2024-04-21T22:40:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 -- start start 2024-04-21T22:40:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 0x55731954dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x5573195591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573194b1410 con 0x55731954d8c0 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5573194597e0 con 0x55731954e1e0 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d3084f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573194ad3d0 con 0x557319556dc0 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.825+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 0x55731954dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55776/0 (socket says 172.21.15.18:55776) 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 -- 172.21.15.18:0/3675851302 learned_addr learned my addr 172.21.15.18:0/3675851302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 0x55731954dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36688/0 (socket says 172.21.15.18:36688) 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x5573195591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 -- 172.21.15.18:0/3675851302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 msgr2=0x5573195591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x5573195591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 -- 172.21.15.18:0/3675851302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 msgr2=0x55731954dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 0x55731954dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 -- 172.21.15.18:0/3675851302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55731928f7d0 con 0x55731954e1e0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x5573195591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d1f400640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 0x7f3d0c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.826+0000 7f3d26a00640 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d180115c0 tx=0x7f3d18011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89fe56c889f0088c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d1f400640 1 -- 172.21.15.18:0/2766949368 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3d200cfae0 con 0x7f3d281125b0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d17e00640 1 -- 172.21.15.18:0/3675851302 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800f640 con 0x55731954e1e0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d17e00640 1 -- 172.21.15.18:0/3675851302 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d1800fcc0 con 0x55731954e1e0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d17e00640 1 -- 172.21.15.18:0/3675851302 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18019dc0 con 0x55731954e1e0 2024-04-21T22:40:53.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 0x7f3d0c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 -- 172.21.15.18:0/3675851302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 msgr2=0x557319556880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d180115c0 tx=0x7f3d18011a80 comp rx=0 tx=0).stop 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 0x7f3d0c0a51c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d28101890 tx=0x7f3d10005bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 -- 172.21.15.18:0/3675851302 shutdown_connections 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x5573195591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954e1e0 0x557319556880 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3675851302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954d8c0 0x55731954dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.827+0000 7f3d3084f740 1 -- 172.21.15.18:0/3675851302 >> 172.21.15.18:0/3675851302 conn(0x557319547ff0 msgr2=0x5573195483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.828+0000 7f3d3084f740 1 -- 172.21.15.18:0/3675851302 shutdown_connections 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.828+0000 7f3d3084f740 1 -- 172.21.15.18:0/3675851302 wait complete. 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.828+0000 7f3d3084f740 1 -- start start 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.828+0000 7f3d3084f740 1 Processor -- start 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x557319553dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319554300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x557319554840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557319559bb0 con 0x55731954e1e0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55731946cc40 con 0x55731954d8c0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557319559d30 con 0x557319556dc0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d3084f740 10 client.0 _ll_register_callbacks cb 0x55731946c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x557319553dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319554300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x557319553dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55780/0 (socket says 172.21.15.18:55780) 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d26a00640 1 -- 172.21.15.18:0/1235006427 learned_addr learned my addr 172.21.15.18:0/1235006427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:53.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.829+0000 7f3d27400640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x557319554840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 -- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 msgr2=0x557319553dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x557319553dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 -- 172.21.15.18:0/1235006427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 msgr2=0x557319554300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319554300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 -- 172.21.15.18:0/1235006427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573191c53f0 con 0x557319556dc0 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d27400640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x557319554840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3d200cd230 tx=0x7f3d2009c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9575a397e6ba76ca server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d14c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20098670 con 0x557319556dc0 2024-04-21T22:40:53.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3d200a47e0 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d1800fcc0 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3d20098810 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d3084f740 10 client.27196 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.830+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573191850f0 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d1800fcc0 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3d2009b5e0 con 0x557319556dc0 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 10 client.27196 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 10 client.27196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:53.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 20 client.27196 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:53.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195670d0 0x557319569500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 4 client.27196 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:53.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573194c4c40 con 0x5573195670d0 2024-04-21T22:40:53.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.831+0000 7f3d26a00640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195670d0 0x557319569500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.832+0000 7f3d26a00640 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195670d0 0x557319569500 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259118859b7e10ec server_cookie=deef94508a29c795 in_seq=0 out_seq=0 2024-04-21T22:40:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.832+0000 7f3d14c00640 10 client.27196 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d14c00640 1 -- 172.21.15.18:0/1235006427 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5573194c4c40 con 0x5573195670d0 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d14c00640 10 client.27196 handle_command_reply: tid=0 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 client.27196 shutdown 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 msgr2=0x557319554840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x557319554840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3d200cd230 tx=0x7f3d2009c840 comp rx=0 tx=0).stop 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 shutdown_connections 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195670d0 0x557319569500 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x557319554840 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319554300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 --2- 172.21.15.18:0/1235006427 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x557319553dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 >> 172.21.15.18:0/1235006427 conn(0x557319547ff0 msgr2=0x557319549d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d14c00640 0 client.27196 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 shutdown_connections 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 1 -- 172.21.15.18:0/1235006427 wait complete. 2024-04-21T22:40:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.833+0000 7f3d3084f740 20 client.27196 trim_cache size 0 max 16384 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 Processor -- start 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 -- start start 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x5573195564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319562a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b3a70 con 0x55731954e1e0 2024-04-21T22:40:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b55b0 con 0x55731954d8c0 2024-04-21T22:40:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.853+0000 7f3d3084f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b4140 con 0x557319556dc0 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53890/0 (socket says 172.21.15.18:53890) 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 -- 172.21.15.18:0/3500867717 learned_addr learned my addr 172.21.15.18:0/3500867717 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d26a00640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x5573195564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319562a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 -- 172.21.15.18:0/3500867717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 msgr2=0x5573195564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x5573195564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 -- 172.21.15.18:0/3500867717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 msgr2=0x557319562a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319562a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 -- 172.21.15.18:0/3500867717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55731954ec30 con 0x557319556dc0 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319562a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.854+0000 7f3d27400640 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3d200cd2e0 tx=0x7f3d20005440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e998f938cdc3b594 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d17400640 1 -- 172.21.15.18:0/3500867717 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2007e070 con 0x557319556dc0 2024-04-21T22:40:53.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d17400640 1 -- 172.21.15.18:0/3500867717 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d200a47e0 con 0x557319556dc0 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d17400640 1 -- 172.21.15.18:0/3500867717 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20096dd0 con 0x557319556dc0 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 -- 172.21.15.18:0/3500867717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 msgr2=0x55731956edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3d200cd2e0 tx=0x7f3d20005440 comp rx=0 tx=0).stop 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 -- 172.21.15.18:0/3500867717 shutdown_connections 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731956edf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x557319562a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 --2- 172.21.15.18:0/3500867717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x5573195564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.855+0000 7f3d3084f740 1 -- 172.21.15.18:0/3500867717 >> 172.21.15.18:0/3500867717 conn(0x557319547ff0 msgr2=0x557319552690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.856+0000 7f3d3084f740 1 -- 172.21.15.18:0/3500867717 shutdown_connections 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.856+0000 7f3d3084f740 1 -- 172.21.15.18:0/3500867717 wait complete. 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.856+0000 7f3d3084f740 1 -- start start 2024-04-21T22:40:53.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.856+0000 7f3d3084f740 1 Processor -- start 2024-04-21T22:40:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.856+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x55731955ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731955a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b4ee0 con 0x55731954e1e0 2024-04-21T22:40:53.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b4810 con 0x55731954d8c0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b1a50 con 0x557319556dc0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d3084f740 10 client.0 _ll_register_callbacks cb 0x7f3d2009b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731955a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36728/0 (socket says 172.21.15.18:36728) 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d1fe00640 1 -- 172.21.15.18:0/378580438 learned_addr learned my addr 172.21.15.18:0/378580438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d26a00640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x55731955ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 -- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 msgr2=0x55731955ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x55731955ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 -- 172.21.15.18:0/378580438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 msgr2=0x55731955f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d27400640 1 -- 172.21.15.18:0/378580438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55731955a890 con 0x557319556dc0 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.857+0000 7f3d1fe00640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:53.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d27400640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731955a100 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3d200a4740 tx=0x7f3d2009c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965b7d62479e0bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d14c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2007e070 con 0x557319556dc0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f3d20085160 con 0x557319556dc0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d200a47e0 con 0x557319556dc0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3d200982a0 con 0x557319556dc0 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d3084f740 10 client.27202 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:53.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573195cd0b0 con 0x557319556dc0 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.858+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d200a47e0 con 0x557319556dc0 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3d200a16d0 con 0x557319556dc0 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 10 client.27202 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 10 client.27202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 20 client.27202 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195cd510 0x5573195cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:53.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 4 client.27202 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5573194be950 con 0x5573195cd510 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.859+0000 7f3d26a00640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195cd510 0x5573195cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d26a00640 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195cd510 0x5573195cf930 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48aa787f3cf122d8 server_cookie=a2ac1bb497f013ba in_seq=0 out_seq=0 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d14c00640 10 client.27202 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d14c00640 1 -- 172.21.15.18:0/378580438 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5573194be950 con 0x5573195cd510 2024-04-21T22:40:53.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d14c00640 10 client.27202 handle_command_reply: tid=0 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 client.27202 shutdown 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 msgr2=0x55731955a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731955a100 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3d200a4740 tx=0x7f3d2009c840 comp rx=0 tx=0).stop 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 shutdown_connections 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573195cd510 0x5573195cf930 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557319556dc0 0x55731955a100 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55731954e1e0 0x55731955f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 --2- 172.21.15.18:0/378580438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55731954d8c0 0x55731955ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 >> 172.21.15.18:0/378580438 conn(0x557319547ff0 msgr2=0x557319553d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d14c00640 0 client.27202 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 shutdown_connections 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.860+0000 7f3d3084f740 1 -- 172.21.15.18:0/378580438 wait complete. 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d3084f740 20 client.27202 trim_cache size 0 max 16384 2024-04-21T22:40:53.871 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:53.872 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:40:53.872 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:40:53.872 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 msgr2=0x7f3d0c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 0x7f3d0c0a51c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d28101890 tx=0x7f3d10005bc0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 msgr2=0x7f3d281a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 0x7f3d281a2f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d20005fd0 tx=0x7f3d2000ef10 comp rx=0 tx=0).stop 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 shutdown_connections 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3d0c0a2d00 0x7f3d0c0a51c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3d281125b0 0x7f3d281a2f30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d28076590 0x7f3d2819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 --2- 172.21.15.18:0/2766949368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d28075c70 0x7f3d2819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 >> 172.21.15.18:0/2766949368 conn(0x7f3d280ff3c0 msgr2=0x7f3d28113d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.861+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 shutdown_connections 2024-04-21T22:40:53.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:53.862+0000 7f3d2dc00640 1 -- 172.21.15.18:0/2766949368 wait complete. 2024-04-21T22:40:53.881 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:40:53.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:40:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 -- 172.21.15.18:0/1377392570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4010cf70 msgr2=0x7f6a40114b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 --2- 172.21.15.18:0/1377392570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4010cf70 0x7f6a40114b40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ca0 tx=0x7f6a3802c100 comp rx=0 tx=0).stop 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 -- 172.21.15.18:0/1377392570 shutdown_connections 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 --2- 172.21.15.18:0/1377392570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a4010cf70 0x7f6a40114b40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 --2- 172.21.15.18:0/1377392570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401088a0 0x7f6a4010c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 --2- 172.21.15.18:0/1377392570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a40107ef0 0x7f6a401082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 -- 172.21.15.18:0/1377392570 >> 172.21.15.18:0/1377392570 conn(0x7f6a40077510 msgr2=0x7f6a40106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 -- 172.21.15.18:0/1377392570 shutdown_connections 2024-04-21T22:40:54.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.089+0000 7f6a46200640 1 -- 172.21.15.18:0/1377392570 wait complete. 2024-04-21T22:40:54.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.090+0000 7f6a46200640 1 Processor -- start 2024-04-21T22:40:54.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.090+0000 7f6a46200640 1 -- start start 2024-04-21T22:40:54.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4010cf70 0x7f6a4019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 0x7f6a401a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40118020 con 0x7f6a401a2dc0 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40117ea0 con 0x7f6a4010cf70 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a46200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401181a0 con 0x7f6a40107ef0 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 0x7f6a401a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a44e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a44e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53924/0 (socket says 172.21.15.18:53924) 2024-04-21T22:40:54.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a44e00640 1 -- 172.21.15.18:0/777149754 learned_addr learned my addr 172.21.15.18:0/777149754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a37e00640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4010cf70 0x7f6a4019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 -- 172.21.15.18:0/777149754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 msgr2=0x7f6a4019e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 -- 172.21.15.18:0/777149754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4010cf70 msgr2=0x7f6a4019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4010cf70 0x7f6a4019ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a45800640 1 -- 172.21.15.18:0/777149754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a401a38b0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.091+0000 7f6a44e00640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:54.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a45800640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 0x7f6a401a3270 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6a3802c710 tx=0x7f6a38035d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38039040 con 0x7f6a401a2dc0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38044070 con 0x7f6a401a2dc0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a401a3b40 con 0x7f6a401a2dc0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004330 con 0x7f6a401a2dc0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.092+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401ab2a0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.093+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4004f570 con 0x7f6a401a2dc0 2024-04-21T22:40:54.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.096+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6a380044d0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.097+0000 7f6a3e000640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 0x7f6a240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.097+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6a380f18d0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.097+0000 7f6a44e00640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 0x7f6a240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.098+0000 7f6a44e00640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 0x7f6a240a51b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a30011550 tx=0x7f6a30005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.102+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6a380be5a0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.351+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a40110190 con 0x7f6a401a2dc0 2024-04-21T22:40:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.352+0000 7f6a3e000640 1 -- 172.21.15.18:0/777149754 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7f6a380bdea0 con 0x7f6a401a2dc0 2024-04-21T22:40:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:40:54.353 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:40:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:40:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 msgr2=0x7f6a240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 0x7f6a240a51b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6a30011550 tx=0x7f6a30005f90 comp rx=0 tx=0).stop 2024-04-21T22:40:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 msgr2=0x7f6a401a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 0x7f6a401a3270 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6a3802c710 tx=0x7f6a38035d90 comp rx=0 tx=0).stop 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 shutdown_connections 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6a240a2cf0 0x7f6a240a51b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a401a2dc0 0x7f6a401a3270 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4010cf70 0x7f6a4019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 --2- 172.21.15.18:0/777149754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a40107ef0 0x7f6a4019e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 >> 172.21.15.18:0/777149754 conn(0x7f6a40077510 msgr2=0x7f6a400790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 shutdown_connections 2024-04-21T22:40:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.355+0000 7f6a46200640 1 -- 172.21.15.18:0/777149754 wait complete. 2024-04-21T22:40:54.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:40:54.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 -- 172.21.15.18:0/1178865848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105dc0 msgr2=0x7f08701108f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 --2- 172.21.15.18:0/1178865848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105dc0 0x7f08701108f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0868009cd0 tx=0x7f086802c1d0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 -- 172.21.15.18:0/1178865848 shutdown_connections 2024-04-21T22:40:54.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 --2- 172.21.15.18:0/1178865848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105dc0 0x7f08701108f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 --2- 172.21.15.18:0/1178865848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870105420 0x7f0870105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 --2- 172.21.15.18:0/1178865848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870103ce0 0x7f08701040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 -- 172.21.15.18:0/1178865848 >> 172.21.15.18:0/1178865848 conn(0x7f08700ff3d0 msgr2=0x7f08701017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 -- 172.21.15.18:0/1178865848 shutdown_connections 2024-04-21T22:40:54.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.586+0000 7f0875800640 1 -- 172.21.15.18:0/1178865848 wait complete. 2024-04-21T22:40:54.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.587+0000 7f0875800640 1 Processor -- start 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.587+0000 7f0875800640 1 -- start start 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 0x7f087019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 0x7f087019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870105dc0 0x7f087019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0870113e30 con 0x7f0870105dc0 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0870113cb0 con 0x7f0870103ce0 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f0875800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0870113fb0 con 0x7f0870105420 2024-04-21T22:40:54.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f086ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 0x7f087019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f086f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870105dc0 0x7f087019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f086e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 0x7f087019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f086ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 0x7f087019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55838/0 (socket says 172.21.15.18:55838) 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.588+0000 7f086ea00640 1 -- 172.21.15.18:0/744549438 learned_addr learned my addr 172.21.15.18:0/744549438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 -- 172.21.15.18:0/744549438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 msgr2=0x7f087019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 0x7f087019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 -- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870105dc0 msgr2=0x7f087019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870105dc0 0x7f087019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 -- 172.21.15.18:0/744549438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087019f290 con 0x7f0870105420 2024-04-21T22:40:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f086e000640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 0x7f087019a830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e9f0 tx=0x7f085c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f0867400640 1 -- 172.21.15.18:0/744549438 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c00ccc0 con 0x7f0870105420 2024-04-21T22:40:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f0867400640 1 -- 172.21.15.18:0/744549438 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f085c005020 con 0x7f0870105420 2024-04-21T22:40:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087019f580 con 0x7f0870105420 2024-04-21T22:40:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f0867400640 1 -- 172.21.15.18:0/744549438 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c0049e0 con 0x7f0870105420 2024-04-21T22:40:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.589+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08701a6e10 con 0x7f0870105420 2024-04-21T22:40:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 Processor -- start 2024-04-21T22:40:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 -- start start 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 0x55b6696f6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b669701670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b66965a3a0 con 0x55b6696f66a0 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b669602930 con 0x55b6696f5d80 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0878584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b669656360 con 0x55b6696ff280 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f0867400640 1 -- 172.21.15.18:0/744549438 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f085c005560 con 0x7f0870105420 2024-04-21T22:40:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f086ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f086ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36770/0 (socket says 172.21.15.18:36770) 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f086ea00640 1 -- 172.21.15.18:0/4192588056 learned_addr learned my addr 172.21.15.18:0/4192588056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.593+0000 7f086f400640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 0x55b6696f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086e000640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b669701670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 -- 172.21.15.18:0/4192588056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 msgr2=0x55b669701670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b669701670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 -- 172.21.15.18:0/4192588056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 msgr2=0x55b6696f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 0x55b6696f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 -- 172.21.15.18:0/4192588056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b66936e3f0 con 0x55b6696f66a0 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086f400640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 0x55b6696f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086e000640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b669701670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f086ea00640 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0860009dc0 tx=0x7f0860011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fcf83498250318 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f085be00640 1 -- 172.21.15.18:0/4192588056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860005220 con 0x55b6696f66a0 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f085be00640 1 -- 172.21.15.18:0/4192588056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004c80 con 0x55b6696f66a0 2024-04-21T22:40:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.594+0000 7f085be00640 1 -- 172.21.15.18:0/4192588056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860019860 con 0x55b6696f66a0 2024-04-21T22:40:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0867400640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 0x7f08540a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 -- 172.21.15.18:0/4192588056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 msgr2=0x55b6696fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0860009dc0 tx=0x7f0860011810 comp rx=0 tx=0).stop 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0867400640 1 -- 172.21.15.18:0/744549438 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f085c0cf3a0 con 0x7f0870105420 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 -- 172.21.15.18:0/4192588056 shutdown_connections 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b669701670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f086f400640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 0x7f08540a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f66a0 0x55b6696fed40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 --2- 172.21.15.18:0/4192588056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f5d80 0x55b6696f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.595+0000 7f0878584740 1 -- 172.21.15.18:0/4192588056 >> 172.21.15.18:0/4192588056 conn(0x55b6696f04b0 msgr2=0x55b6696f0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.596+0000 7f0878584740 1 -- 172.21.15.18:0/4192588056 shutdown_connections 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.596+0000 7f0878584740 1 -- 172.21.15.18:0/4192588056 wait complete. 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.596+0000 7f0878584740 1 -- start start 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.596+0000 7f0878584740 1 Processor -- start 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.596+0000 7f086f400640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 0x7f08540a51c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0868005cc0 tx=0x7f086802e040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6696fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b669702070 con 0x55b6696f5d80 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b669615d80 con 0x55b6696f66a0 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b6697021f0 con 0x55b6696ff280 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f0878584740 10 client.0 _ll_register_callbacks cb 0x55b6696522b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:55852/0 (socket says 172.21.15.18:55852) 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086e000640 1 -- 172.21.15.18:0/1804069745 learned_addr learned my addr 172.21.15.18:0/1804069745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086f400640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6696fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.597+0000 7f086e000640 1 -- 172.21.15.18:0/1804069745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 msgr2=0x55b6696fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f086e000640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6696fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f086e000640 1 -- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 msgr2=0x55b6696fc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f086e000640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f086e000640 1 -- 172.21.15.18:0/1804069745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6694387d0 con 0x55b6696f66a0 2024-04-21T22:40:54.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f086e000640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c6a0 tx=0x7f085c09b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba6c84c86b53c7df server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f0858c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c01c070 con 0x55b6696f66a0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f085c097f30 con 0x55b6696f66a0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.598+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0860004c80 con 0x55b6696f66a0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f085c09bfc0 con 0x55b6696f66a0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 10 client.27161 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b66970e3a0 con 0x55b6696f66a0 2024-04-21T22:40:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004c80 con 0x55b6696f66a0 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f085c086100 con 0x55b6696f66a0 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 10 client.27161 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 10 client.27161 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 20 client.27161 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b66970f860 0x55b669711cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 4 client.27161 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6696678e0 con 0x55b66970f860 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.599+0000 7f086ea00640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b66970f860 0x55b669711cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.600+0000 7f086ea00640 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b66970f860 0x55b669711cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f45062ac41be981b server_cookie=6f4c57993ce657a2 in_seq=0 out_seq=0 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.600+0000 7f0858c00640 10 client.27161 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0858c00640 1 -- 172.21.15.18:0/1804069745 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b6696678e0 con 0x55b66970f860 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0858c00640 10 client.27161 handle_command_reply: tid=0 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 client.27161 shutdown 2024-04-21T22:40:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 msgr2=0x55b6696fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f085c00c6a0 tx=0x7f085c09b750 comp rx=0 tx=0).stop 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 shutdown_connections 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b66970f860 0x55b669711cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6696fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b6696fc820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 --2- 172.21.15.18:0/1804069745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 >> 172.21.15.18:0/1804069745 conn(0x55b6696f04b0 msgr2=0x55b6696f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0858c00640 0 client.27161 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 shutdown_connections 2024-04-21T22:40:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 1 -- 172.21.15.18:0/1804069745 wait complete. 2024-04-21T22:40:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.601+0000 7f0878584740 20 client.27161 trim_cache size 0 max 16384 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.616+0000 7f0878584740 1 Processor -- start 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.616+0000 7f0878584740 1 -- start start 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.616+0000 7f0878584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.616+0000 7f0878584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b66970af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f0878584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6697175c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f0878584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08701af650 con 0x55b6696f5d80 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f0878584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08701b1190 con 0x55b6696f66a0 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f0878584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08701afd20 con 0x55b6696ff280 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36780/0 (socket says 172.21.15.18:36780) 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 -- 172.21.15.18:0/3433733166 learned_addr learned my addr 172.21.15.18:0/3433733166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086e000640 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b66970af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086f400640 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6697175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 -- 172.21.15.18:0/3433733166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 msgr2=0x55b6697175c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6697175c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 -- 172.21.15.18:0/3433733166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 msgr2=0x55b66970af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b66970af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.617+0000 7f086ea00640 1 -- 172.21.15.18:0/3433733166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6696f64d0 con 0x55b6696f5d80 2024-04-21T22:40:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f086ea00640 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0860005c70 tx=0x7f0860019430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64f5bca4eebf03b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f085b400640 1 -- 172.21.15.18:0/3433733166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860031070 con 0x55b6696f5d80 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f085b400640 1 -- 172.21.15.18:0/3433733166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086002bd50 con 0x55b6696f5d80 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f085b400640 1 -- 172.21.15.18:0/3433733166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860003850 con 0x55b6696f5d80 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f0878584740 1 -- 172.21.15.18:0/3433733166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 msgr2=0x55b6696fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.618+0000 7f0878584740 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0860005c70 tx=0x7f0860019430 comp rx=0 tx=0).stop 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 -- 172.21.15.18:0/3433733166 shutdown_connections 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696ff280 0x55b6697175c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b66970af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 --2- 172.21.15.18:0/3433733166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696f5d80 0x55b6696fea10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 -- 172.21.15.18:0/3433733166 >> 172.21.15.18:0/3433733166 conn(0x55b6696f04b0 msgr2=0x55b6696fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 -- 172.21.15.18:0/3433733166 shutdown_connections 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 -- 172.21.15.18:0/3433733166 wait complete. 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.619+0000 7f0878584740 1 -- start start 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 Processor -- start 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b669703380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696ff280 0x55b6697038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08701b0ac0 con 0x55b6696ff280 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08701b03f0 con 0x55b6696f66a0 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08701ad630 con 0x55b6696f5d80 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.620+0000 7f0878584740 10 client.0 _ll_register_callbacks cb 0x7f085c0053d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696ff280 0x55b6697038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53976/0 (socket says 172.21.15.18:53976) 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 -- 172.21.15.18:0/343463489 learned_addr learned my addr 172.21.15.18:0/343463489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086e000640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b669703380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 -- 172.21.15.18:0/343463489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 msgr2=0x55b669703380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b669703380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 -- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696ff280 msgr2=0x55b6697038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696ff280 0x55b6697038c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 -- 172.21.15.18:0/343463489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b669774e30 con 0x55b6696f5d80 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f086ea00640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0860009ac0 tx=0x7f0860005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6efb1b8693d8142 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.621+0000 7f0858c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086003a060 con 0x55b6696f5d80 2024-04-21T22:40:54.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086002bd50 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0860005080 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0860031070 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0878584740 10 client.27226 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b6697760b0 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f086002bd50 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.622+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f086002b070 con 0x55b6696f5d80 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 10 client.27226 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 10 client.27226 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:40:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 20 client.27226 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b6697764e0 0x55b6697788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 4 client.27226 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b669661c30 con 0x55b6697764e0 2024-04-21T22:40:54.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f086e000640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b6697764e0 0x55b6697788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f086e000640 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b6697764e0 0x55b6697788d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2643bee5ba454963 server_cookie=66d433f24fed8bac in_seq=0 out_seq=0 2024-04-21T22:40:54.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.623+0000 7f0858c00640 10 client.27226 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0858c00640 1 -- 172.21.15.18:0/343463489 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b669661c30 con 0x55b6697764e0 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0858c00640 10 client.27226 handle_command_reply: tid=0 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 client.27226 shutdown 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 msgr2=0x55b669702e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0860009ac0 tx=0x7f0860005f10 comp rx=0 tx=0).stop 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 shutdown_connections 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55b6697764e0 0x55b6697788d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6696ff280 0x55b6697038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b6696f66a0 0x55b669703380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 --2- 172.21.15.18:0/343463489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6696f5d80 0x55b669702e40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 >> 172.21.15.18:0/343463489 conn(0x55b6696f04b0 msgr2=0x55b6696fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0858c00640 0 client.27226 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 shutdown_connections 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 1 -- 172.21.15.18:0/343463489 wait complete. 2024-04-21T22:40:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.624+0000 7f0878584740 20 client.27226 trim_cache size 0 max 16384 2024-04-21T22:40:54.633 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 msgr2=0x7f08540a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 0x7f08540a51c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0868005cc0 tx=0x7f086802e040 comp rx=0 tx=0).stop 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 msgr2=0x7f087019a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 0x7f087019a830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e9f0 tx=0x7f085c00eeb0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 shutdown_connections 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08540a2d00 0x7f08540a51c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0870105dc0 0x7f087019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0870105420 0x7f087019a830 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 --2- 172.21.15.18:0/744549438 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0870103ce0 0x7f087019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 >> 172.21.15.18:0/744549438 conn(0x7f08700ff3d0 msgr2=0x7f08701077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 shutdown_connections 2024-04-21T22:40:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.625+0000 7f0875800640 1 -- 172.21.15.18:0/744549438 wait complete. 2024-04-21T22:40:54.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:40:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.841+0000 7f63ed200640 1 -- 172.21.15.18:0/3247309894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 msgr2=0x7f63e8108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.841+0000 7f63ed200640 1 --2- 172.21.15.18:0/3247309894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e8108100 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009900 tx=0x7f63d002bc40 comp rx=0 tx=0).stop 2024-04-21T22:40:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 -- 172.21.15.18:0/3247309894 shutdown_connections 2024-04-21T22:40:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 --2- 172.21.15.18:0/3247309894 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 0x7f63e81149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 --2- 172.21.15.18:0/3247309894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e8108100 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 --2- 172.21.15.18:0/3247309894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 -- 172.21.15.18:0/3247309894 >> 172.21.15.18:0/3247309894 conn(0x7f63e8077550 msgr2=0x7f63e8106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 -- 172.21.15.18:0/3247309894 shutdown_connections 2024-04-21T22:40:54.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.842+0000 7f63ed200640 1 -- 172.21.15.18:0/3247309894 wait complete. 2024-04-21T22:40:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 Processor -- start 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 -- start start 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 0x7f63e819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e81a2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8117f00 con 0x7f63e8107c80 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8117d80 con 0x7f63e8108640 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.843+0000 7f63ed200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8118080 con 0x7f63e810dc00 2024-04-21T22:40:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36802/0 (socket says 172.21.15.18:36802) 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e81a2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7400640 1 -- 172.21.15.18:0/3078958851 learned_addr learned my addr 172.21.15.18:0/3078958851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63dea00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 0x7f63e819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 -- 172.21.15.18:0/3078958851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 msgr2=0x7f63e819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 0x7f63e819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 -- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 msgr2=0x7f63e819e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7e00640 1 -- 172.21.15.18:0/3078958851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e81a3390 con 0x7f63e810dc00 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.844+0000 7f63e7400640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63e7e00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e81a2c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63e000ec50 tx=0x7f63e000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63e4c00640 1 -- 172.21.15.18:0/3078958851 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0003b70 con 0x7f63e810dc00 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63e4c00640 1 -- 172.21.15.18:0/3078958851 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63e0003d10 con 0x7f63e810dc00 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63e4c00640 1 -- 172.21.15.18:0/3078958851 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0010890 con 0x7f63e810dc00 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e81a3680 con 0x7f63e810dc00 2024-04-21T22:40:54.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.845+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e81aaf10 con 0x7f63e810dc00 2024-04-21T22:40:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.848+0000 7f63f156c740 1 Processor -- start 2024-04-21T22:40:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.848+0000 7f63e4c00640 1 -- 172.21.15.18:0/3078958851 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f63e0003fe0 con 0x7f63e810dc00 2024-04-21T22:40:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 -- start start 2024-04-21T22:40:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48310350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48319470 0x55ab4831b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab482743a0 con 0x55ab48310890 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ab4821c930 con 0x55ab4830ff70 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63f156c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ab48270360 con 0x55ab48319470 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36804/0 (socket says 172.21.15.18:36804) 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63e7400640 1 -- 172.21.15.18:0/33081863 learned_addr learned my addr 172.21.15.18:0/33081863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63dea00640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48310350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.849+0000 7f63dea00640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48319470 0x55ab4831b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 -- 172.21.15.18:0/33081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48319470 msgr2=0x55ab4831b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48319470 0x55ab4831b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 -- 172.21.15.18:0/33081863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 msgr2=0x55ab48310350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48310350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 -- 172.21.15.18:0/33081863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab47f883f0 con 0x55ab48310890 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63dea00640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48310350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e4c00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 0x7f63cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e7400640 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f63d8011650 tx=0x7f63d8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d08d375a9192d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63e4c00640 1 -- 172.21.15.18:0/3078958851 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f63e00cfa10 con 0x7f63e810dc00 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63dea00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 0x7f63cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63dcc00640 1 -- 172.21.15.18:0/33081863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d801e070 con 0x55ab48310890 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63dcc00640 1 -- 172.21.15.18:0/33081863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63d800fba0 con 0x55ab48310890 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.850+0000 7f63dcc00640 1 -- 172.21.15.18:0/33081863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8019d80 con 0x55ab48310890 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 -- 172.21.15.18:0/33081863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 msgr2=0x55ab48318f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f63d8011650 tx=0x7f63d8009f90 comp rx=0 tx=0).stop 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63dea00640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 0x7f63cc0a5240 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009230 tx=0x7f63d0005b50 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 -- 172.21.15.18:0/33081863 shutdown_connections 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48319470 0x55ab4831b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48318f30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 --2- 172.21.15.18:0/33081863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48310350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 -- 172.21.15.18:0/33081863 >> 172.21.15.18:0/33081863 conn(0x55ab4830a6a0 msgr2=0x55ab4830aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 -- 172.21.15.18:0/33081863 shutdown_connections 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.851+0000 7f63f156c740 1 -- 172.21.15.18:0/33081863 wait complete. 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 -- start start 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 Processor -- start 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48316470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab48316ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.852+0000 7f63f156c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ab4831c260 con 0x55ab48319470 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63f156c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55ab4822fd80 con 0x55ab4830ff70 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63f156c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ab4831c3e0 con 0x55ab48310890 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63f156c740 10 client.0 _ll_register_callbacks cb 0x55ab4826c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab48316ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63dea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab48316ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36806/0 (socket says 172.21.15.18:36806) 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7e00640 1 -- 172.21.15.18:0/4236771219 learned_addr learned my addr 172.21.15.18:0/4236771219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63dea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54024/0 (socket says 172.21.15.18:54024) 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48316470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 -- 172.21.15.18:0/4236771219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 msgr2=0x55ab483169b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 -- 172.21.15.18:0/4236771219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 msgr2=0x55ab48316ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab48316ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63e7400640 1 -- 172.21.15.18:0/4236771219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab480527d0 con 0x55ab4830ff70 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.853+0000 7f63dea00640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63e7400640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48316470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000c00 tx=0x7f63d8019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8f9be23448b75e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63d5600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d801e040 con 0x55ab4830ff70 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f63d8009d80 con 0x55ab4830ff70 2024-04-21T22:40:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d800fba0 con 0x55ab4830ff70 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f63d802f050 con 0x55ab4830ff70 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63f156c740 10 client.27179 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.854+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ab483284c0 con 0x55ab4830ff70 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63d800fba0 con 0x55ab4830ff70 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f63d802a030 con 0x55ab4830ff70 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 10 client.27179 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 10 client.27179 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:40:54.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 20 client.27179 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:54.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab48329920 0x55ab4832bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 4 client.27179 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:54.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab482818e0 con 0x55ab48329920 2024-04-21T22:40:54.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.855+0000 7f63dea00640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab48329920 0x55ab4832bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.856+0000 7f63dea00640 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab48329920 0x55ab4832bd10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c98047306385c4b3 server_cookie=7934ba5e049dbdbe in_seq=0 out_seq=0 2024-04-21T22:40:54.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.856+0000 7f63d5600640 10 client.27179 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:54.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.856+0000 7f63d5600640 1 -- 172.21.15.18:0/4236771219 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ab482818e0 con 0x55ab48329920 2024-04-21T22:40:54.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.856+0000 7f63d5600640 10 client.27179 handle_command_reply: tid=0 2024-04-21T22:40:54.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 client.27179 shutdown 2024-04-21T22:40:54.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 msgr2=0x55ab48316470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48316470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000c00 tx=0x7f63d8019790 comp rx=0 tx=0).stop 2024-04-21T22:40:54.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 shutdown_connections 2024-04-21T22:40:54.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab48329920 0x55ab4832bd10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab48316ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab48310890 0x55ab483169b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63d5600640 0 client.27179 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:54.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 --2- 172.21.15.18:0/4236771219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab4830ff70 0x55ab48316470 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 >> 172.21.15.18:0/4236771219 conn(0x55ab4830a6a0 msgr2=0x55ab4830c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 shutdown_connections 2024-04-21T22:40:54.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 1 -- 172.21.15.18:0/4236771219 wait complete. 2024-04-21T22:40:54.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.857+0000 7f63f156c740 20 client.27179 trim_cache size 0 max 16384 2024-04-21T22:40:54.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.872+0000 7f63f156c740 1 Processor -- start 2024-04-21T22:40:54.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.872+0000 7f63f156c740 1 -- start start 2024-04-21T22:40:54.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.872+0000 7f63f156c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63f156c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48325120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63f156c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48319470 0x55ab48316d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63f156c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b3920 con 0x55ab48310890 2024-04-21T22:40:54.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63f156c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b5460 con 0x55ab48319470 2024-04-21T22:40:54.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63f156c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b3ff0 con 0x55ab4830ff70 2024-04-21T22:40:54.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54038/0 (socket says 172.21.15.18:54038) 2024-04-21T22:40:54.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 -- 172.21.15.18:0/3558645053 learned_addr learned my addr 172.21.15.18:0/3558645053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7e00640 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48319470 0x55ab48316d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63dea00640 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48325120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 -- 172.21.15.18:0/3558645053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48319470 msgr2=0x55ab48316d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48319470 0x55ab48316d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 -- 172.21.15.18:0/3558645053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 msgr2=0x55ab48325120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48325120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.873+0000 7f63e7400640 1 -- 172.21.15.18:0/3558645053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab483149c0 con 0x55ab4830ff70 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63e7400640 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f63d80057c0 tx=0x7f63d80196a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29511f5d74809735 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63d7e00640 1 -- 172.21.15.18:0/3558645053 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8015020 con 0x55ab4830ff70 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63d7e00640 1 -- 172.21.15.18:0/3558645053 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63d8005510 con 0x55ab4830ff70 2024-04-21T22:40:54.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63d7e00640 1 -- 172.21.15.18:0/3558645053 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d801e050 con 0x55ab4830ff70 2024-04-21T22:40:54.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63f156c740 1 -- 172.21.15.18:0/3558645053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 msgr2=0x55ab48318ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.874+0000 7f63f156c740 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f63d80057c0 tx=0x7f63d80196a0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 -- 172.21.15.18:0/3558645053 shutdown_connections 2024-04-21T22:40:54.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48319470 0x55ab48316d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48310890 0x55ab48325120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 --2- 172.21.15.18:0/3558645053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab48318ba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 -- 172.21.15.18:0/3558645053 >> 172.21.15.18:0/3558645053 conn(0x55ab4830a6a0 msgr2=0x55ab483154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 -- 172.21.15.18:0/3558645053 shutdown_connections 2024-04-21T22:40:54.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 -- 172.21.15.18:0/3558645053 wait complete. 2024-04-21T22:40:54.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 -- start start 2024-04-21T22:40:54.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.875+0000 7f63f156c740 1 Processor -- start 2024-04-21T22:40:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 0x55ab4831cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab4831d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b4d90 con 0x55ab48319470 2024-04-21T22:40:54.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b46c0 con 0x55ab48310890 2024-04-21T22:40:54.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b1900 con 0x55ab4830ff70 2024-04-21T22:40:54.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63f156c740 10 client.0 _ll_register_callbacks cb 0x7f63d801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63dea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 0x55ab4831cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54050/0 (socket says 172.21.15.18:54050) 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 -- 172.21.15.18:0/470279189 learned_addr learned my addr 172.21.15.18:0/470279189 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7e00640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab4831d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 -- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 msgr2=0x55ab4831cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 0x55ab4831cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 -- 172.21.15.18:0/470279189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 msgr2=0x55ab4831d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab4831d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63e7400640 1 -- 172.21.15.18:0/470279189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4838dfd0 con 0x55ab4830ff70 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.876+0000 7f63dea00640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 0x55ab4831cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:54.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63e7400640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f63d8019ac0 tx=0x7f63d8019af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f759f01585de3692 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63d5600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8015030 con 0x55ab4830ff70 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d8005510 con 0x55ab4830ff70 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f63d800fcb0 con 0x55ab4830ff70 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f63d801e040 con 0x55ab4830ff70 2024-04-21T22:40:54.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63f156c740 10 client.27244 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.877+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ab4838f2d0 con 0x55ab4830ff70 2024-04-21T22:40:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63d8005510 con 0x55ab4830ff70 2024-04-21T22:40:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f63d802a040 con 0x55ab4830ff70 2024-04-21T22:40:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 10 client.27244 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:54.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 10 client.27244 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 20 client.27244 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab4838f8e0 0x55ab48391cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 4 client.27244 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab4827bc30 con 0x55ab4838f8e0 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.878+0000 7f63dea00640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab4838f8e0 0x55ab48391cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63dea00640 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab4838f8e0 0x55ab48391cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a46dc7a334e6d3f8 server_cookie=f17bca9d267ab238 in_seq=0 out_seq=0 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63d5600640 10 client.27244 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:54.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63d5600640 1 -- 172.21.15.18:0/470279189 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab4827bc30 con 0x55ab4838f8e0 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63d5600640 10 client.27244 handle_command_reply: tid=0 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 client.27244 shutdown 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 msgr2=0x55ab4831c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f63d8019ac0 tx=0x7f63d8019af0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 shutdown_connections 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55ab4838f8e0 0x55ab48391cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ab48319470 0x55ab4831d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55ab48310890 0x55ab4831cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 --2- 172.21.15.18:0/470279189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab4830ff70 0x55ab4831c5f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63d5600640 0 client.27244 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 >> 172.21.15.18:0/470279189 conn(0x55ab4830a6a0 msgr2=0x55ab48308e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 shutdown_connections 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.879+0000 7f63f156c740 1 -- 172.21.15.18:0/470279189 wait complete. 2024-04-21T22:40:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63f156c740 20 client.27244 trim_cache size 0 max 16384 2024-04-21T22:40:54.898 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 msgr2=0x7f63cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 0x7f63cc0a5240 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009230 tx=0x7f63d0005b50 comp rx=0 tx=0).stop 2024-04-21T22:40:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 msgr2=0x7f63e81a2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e81a2c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63e000ec50 tx=0x7f63e000c6a0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 shutdown_connections 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f63cc0a2d80 0x7f63cc0a5240 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63e810dc00 0x7f63e81a2c60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f63e8108640 0x7f63e819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 --2- 172.21.15.18:0/3078958851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8107c80 0x7f63e819e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 >> 172.21.15.18:0/3078958851 conn(0x7f63e8077550 msgr2=0x7f63e80785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 shutdown_connections 2024-04-21T22:40:54.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:54.880+0000 7f63ed200640 1 -- 172.21.15.18:0/3078958851 wait complete. 2024-04-21T22:40:54.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:40:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 -- 172.21.15.18:0/1046435546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4103040 msgr2=0x7f62f410b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 --2- 172.21.15.18:0/1046435546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4103040 0x7f62f410b520 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009860 tx=0x7f62dc02bc20 comp rx=0 tx=0).stop 2024-04-21T22:40:55.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 -- 172.21.15.18:0/1046435546 shutdown_connections 2024-04-21T22:40:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 --2- 172.21.15.18:0/1046435546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 --2- 172.21.15.18:0/1046435546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4103040 0x7f62f410b520 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 --2- 172.21.15.18:0/1046435546 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4102720 0x7f62f4102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 -- 172.21.15.18:0/1046435546 >> 172.21.15.18:0/1046435546 conn(0x7f62f40771f0 msgr2=0x7f62f40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.099+0000 7f62f9600640 1 -- 172.21.15.18:0/1046435546 shutdown_connections 2024-04-21T22:40:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.100+0000 7f62f9600640 1 -- 172.21.15.18:0/1046435546 wait complete. 2024-04-21T22:40:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 Processor -- start 2024-04-21T22:40:55.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 -- start start 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4103040 0x7f62f419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41118d0 con 0x7f62f410bb40 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4111750 con 0x7f62f4103040 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.101+0000 7f62f9600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4111a50 con 0x7f62f4102720 2024-04-21T22:40:55.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54074/0 (socket says 172.21.15.18:54074) 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 -- 172.21.15.18:0/3344889793 learned_addr learned my addr 172.21.15.18:0/3344889793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62eb400640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4103040 0x7f62f419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f8c00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 -- 172.21.15.18:0/3344889793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4103040 msgr2=0x7f62f419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4103040 0x7f62f419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 -- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 msgr2=0x7f62f419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f3e00640 1 -- 172.21.15.18:0/3344889793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f419f020 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.102+0000 7f62f8c00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f3e00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f62e400efb0 tx=0x7f62e400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f1600640 1 -- 172.21.15.18:0/3344889793 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e401b070 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f419f310 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f1600640 1 -- 172.21.15.18:0/3344889793 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e400ba50 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f1600640 1 -- 172.21.15.18:0/3344889793 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4016c00 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.103+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41a6ba0 con 0x7f62f4102720 2024-04-21T22:40:55.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.106+0000 7f62fda27740 1 Processor -- start 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.106+0000 7f62fda27740 1 -- start start 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.106+0000 7f62f1600640 1 -- 172.21.15.18:0/3344889793 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f62e401e070 con 0x7f62f4102720 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7de7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7deff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5563b7d4b3a0 con 0x5563b7df0470 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5563b7cf3930 con 0x5563b7de6f70 2024-04-21T22:40:55.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62fda27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5563b7d47360 con 0x5563b7de7890 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62eb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7deff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62f8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7de7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62eb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36838/0 (socket says 172.21.15.18:36838) 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.107+0000 7f62eb400640 1 -- 172.21.15.18:0/699226120 learned_addr learned my addr 172.21.15.18:0/699226120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 -- 172.21.15.18:0/699226120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 msgr2=0x5563b7deff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7deff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 -- 172.21.15.18:0/699226120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 msgr2=0x5563b7de7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7de7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 -- 172.21.15.18:0/699226120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b7a5f3f0 con 0x5563b7df0470 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62f8c00640 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7de7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62f3e00640 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7deff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62eb400640 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009780 tx=0x7f62dc009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f74ea7aebe27db server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62f1600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 0x7f62d80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.108+0000 7f62e9200640 1 -- 172.21.15.18:0/699226120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc043020 con 0x5563b7df0470 2024-04-21T22:40:55.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62e9200640 1 -- 172.21.15.18:0/699226120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62dc02ce50 con 0x5563b7df0470 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62e9200640 1 -- 172.21.15.18:0/699226120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc039040 con 0x5563b7df0470 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62f1600640 1 -- 172.21.15.18:0/3344889793 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f62e40cf390 con 0x7f62f4102720 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62f8c00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 0x7f62d80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 -- 172.21.15.18:0/699226120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 msgr2=0x5563b7df2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009780 tx=0x7f62dc009510 comp rx=0 tx=0).stop 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 -- 172.21.15.18:0/699226120 shutdown_connections 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df2860 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7deff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 --2- 172.21.15.18:0/699226120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7de7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62fda27740 1 -- 172.21.15.18:0/699226120 >> 172.21.15.18:0/699226120 conn(0x5563b7de16a0 msgr2=0x5563b7de1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.109+0000 7f62f8c00640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 0x7f62d80a51c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005fd0 tx=0x7f62ec00d4c0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.110+0000 7f62fda27740 1 -- 172.21.15.18:0/699226120 shutdown_connections 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.110+0000 7f62fda27740 1 -- 172.21.15.18:0/699226120 wait complete. 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.110+0000 7f62fda27740 1 -- start start 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.110+0000 7f62fda27740 1 Processor -- start 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 0x5563b7deda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7df0470 0x5563b7dedf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5563b7df3200 con 0x5563b7de6f70 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5563b7d06d80 con 0x5563b7de7890 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5563b7df3380 con 0x5563b7df0470 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62fda27740 10 client.0 _ll_register_callbacks cb 0x5563b7d432b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62eb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 0x5563b7deda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36848/0 (socket says 172.21.15.18:36848) 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 -- 172.21.15.18:0/4057316167 learned_addr learned my addr 172.21.15.18:0/4057316167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f8c00640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7df0470 0x5563b7dedf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 -- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7df0470 msgr2=0x5563b7dedf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7df0470 0x5563b7dedf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.111+0000 7f62f3e00640 1 -- 172.21.15.18:0/4057316167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 msgr2=0x5563b7deda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62f3e00640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 0x5563b7deda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62f3e00640 1 -- 172.21.15.18:0/4057316167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b7b297d0 con 0x5563b7de6f70 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62eb400640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 0x5563b7deda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62f3e00640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f62e409b660 tx=0x7f62e409b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142725b65b9da094 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62e1600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:55.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e409b960 con 0x5563b7de6f70 2024-04-21T22:40:55.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f62e400bc00 con 0x5563b7de6f70 2024-04-21T22:40:55.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62dc02ce50 con 0x5563b7de6f70 2024-04-21T22:40:55.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f62e409fc60 con 0x5563b7de6f70 2024-04-21T22:40:55.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62fda27740 10 client.17130 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.112+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5563b7dff530 con 0x5563b7de6f70 2024-04-21T22:40:55.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62dc02ce50 con 0x5563b7de6f70 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f62e400b040 con 0x5563b7de6f70 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 10 client.17130 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 20 client.17130 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e00880 0x5563b7e02cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 4 client.17130 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563b7d588e0 con 0x5563b7e00880 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.113+0000 7f62eb400640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e00880 0x5563b7e02cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.114+0000 7f62eb400640 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e00880 0x5563b7e02cb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9725cc3a88715efe server_cookie=7fd15f6396578a43 in_seq=0 out_seq=0 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.114+0000 7f62e1600640 10 client.17130 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62e1600640 1 -- 172.21.15.18:0/4057316167 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563b7d588e0 con 0x5563b7e00880 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62e1600640 10 client.17130 handle_command_reply: tid=0 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 client.17130 shutdown 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 msgr2=0x5563b7ded4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f62e409b660 tx=0x7f62e409b730 comp rx=0 tx=0).stop 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 shutdown_connections 2024-04-21T22:40:55.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e00880 0x5563b7e02cb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7df0470 0x5563b7dedf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de7890 0x5563b7deda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62e1600640 0 client.17130 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 --2- 172.21.15.18:0/4057316167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7ded4d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.115+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 >> 172.21.15.18:0/4057316167 conn(0x5563b7de16a0 msgr2=0x5563b7de33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.116+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 shutdown_connections 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.116+0000 7f62fda27740 1 -- 172.21.15.18:0/4057316167 wait complete. 2024-04-21T22:40:55.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.116+0000 7f62fda27740 20 client.17130 trim_cache size 0 max 16384 2024-04-21T22:40:55.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.130+0000 7f62fda27740 1 Processor -- start 2024-04-21T22:40:55.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 -- start start 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7dfc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7df0470 0x5563b7de0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41af4e0 con 0x5563b7de6f70 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41b1020 con 0x5563b7df0470 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62fda27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41afbb0 con 0x5563b7de7890 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7dfc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54106/0 (socket says 172.21.15.18:54106) 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.131+0000 7f62eb400640 1 -- 172.21.15.18:0/2843085782 learned_addr learned my addr 172.21.15.18:0/2843085782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f8c00640 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7df0470 0x5563b7de0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 -- 172.21.15.18:0/2843085782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 msgr2=0x5563b7dedd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 -- 172.21.15.18:0/2843085782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7df0470 msgr2=0x5563b7de0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7df0470 0x5563b7de0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 -- 172.21.15.18:0/2843085782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b7de6260 con 0x5563b7de6f70 2024-04-21T22:40:55.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62eb400640 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7dfc0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62e40cf5e0 tx=0x7f62e400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f66f17c81564e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.132+0000 7f62e3e00640 1 -- 172.21.15.18:0/2843085782 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e409b960 con 0x5563b7de6f70 2024-04-21T22:40:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62e3e00640 1 -- 172.21.15.18:0/2843085782 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e40a4520 con 0x5563b7de6f70 2024-04-21T22:40:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62e3e00640 1 -- 172.21.15.18:0/2843085782 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e400bc00 con 0x5563b7de6f70 2024-04-21T22:40:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 -- 172.21.15.18:0/2843085782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 msgr2=0x5563b7dfc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7dfc0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62e40cf5e0 tx=0x7f62e400bf90 comp rx=0 tx=0).stop 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 -- 172.21.15.18:0/2843085782 shutdown_connections 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7df0470 0x5563b7de0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7dedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 --2- 172.21.15.18:0/2843085782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7de6f70 0x5563b7dfc0c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 -- 172.21.15.18:0/2843085782 >> 172.21.15.18:0/2843085782 conn(0x5563b7de16a0 msgr2=0x5563b7ddfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 -- 172.21.15.18:0/2843085782 shutdown_connections 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.133+0000 7f62fda27740 1 -- 172.21.15.18:0/2843085782 wait complete. 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 -- start start 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 Processor -- start 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7df82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41b0950 con 0x5563b7df0470 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41b0280 con 0x5563b7de6f70 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.134+0000 7f62fda27740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41ad4c0 con 0x5563b7de7890 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62fda27740 10 client.0 _ll_register_callbacks cb 0x7f62e40d2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54122/0 (socket says 172.21.15.18:54122) 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 -- 172.21.15.18:0/2584829591 learned_addr learned my addr 172.21.15.18:0/2584829591 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7df82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62f8c00640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 -- 172.21.15.18:0/2584829591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 msgr2=0x5563b7df82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7df82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 -- 172.21.15.18:0/2584829591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 msgr2=0x5563b7df3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62eb400640 1 -- 172.21.15.18:0/2584829591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b7df3ee0 con 0x5563b7de7890 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.135+0000 7f62f8c00640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62eb400640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009830 tx=0x7f62dc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15013baeb3e624c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62e1600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc059060 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f62dc005240 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e40a4520 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f62dc043050 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62fda27740 10 client.27262 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.136+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5563b7e66880 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e40a4520 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f62dc0540d0 con 0x5563b7de7890 2024-04-21T22:40:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 10 client.27262 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 10 client.27262 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 20 client.27262 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e66c10 0x5563b7e69000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 4 client.27262 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563b7d52c30 con 0x5563b7e66c10 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.137+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e66c10 0x5563b7e69000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62f3e00640 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e66c10 0x5563b7e69000 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1af228a0b4ca7ed5 server_cookie=d43c179b19768dfe in_seq=0 out_seq=0 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62e1600640 10 client.27262 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:55.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62e1600640 1 -- 172.21.15.18:0/2584829591 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563b7d52c30 con 0x5563b7e66c10 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62e1600640 10 client.27262 handle_command_reply: tid=0 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 client.27262 shutdown 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 msgr2=0x5563b7df8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009830 tx=0x7f62dc000bc0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 shutdown_connections 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5563b7e66c10 0x5563b7e69000 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563b7df0470 0x5563b7df3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563b7de7890 0x5563b7df8820 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 --2- 172.21.15.18:0/2584829591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5563b7de6f70 0x5563b7df82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62e1600640 0 client.27262 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 >> 172.21.15.18:0/2584829591 conn(0x5563b7de16a0 msgr2=0x5563b7de2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 shutdown_connections 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 1 -- 172.21.15.18:0/2584829591 wait complete. 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.138+0000 7f62fda27740 20 client.27262 trim_cache size 0 max 16384 2024-04-21T22:40:55.147 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:55.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 msgr2=0x7f62d80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 0x7f62d80a51c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005fd0 tx=0x7f62ec00d4c0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 msgr2=0x7f62f419a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f62e400efb0 tx=0x7f62e400c800 comp rx=0 tx=0).stop 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 shutdown_connections 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f62d80a2d00 0x7f62d80a51c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f410bb40 0x7f62f419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f62f4103040 0x7f62f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 --2- 172.21.15.18:0/3344889793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62f4102720 0x7f62f419a030 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 >> 172.21.15.18:0/3344889793 conn(0x7f62f40771f0 msgr2=0x7f62f4100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 shutdown_connections 2024-04-21T22:40:55.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.139+0000 7f62f9600640 1 -- 172.21.15.18:0/3344889793 wait complete. 2024-04-21T22:40:55.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:40:55.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 -- 172.21.15.18:0/1759175320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 msgr2=0x7f4c88073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 --2- 172.21.15.18:0/1759175320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c88073ec0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009900 tx=0x7f4c7802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 -- 172.21.15.18:0/1759175320 shutdown_connections 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 --2- 172.21.15.18:0/1759175320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 0x7f4c88114b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 --2- 172.21.15.18:0/1759175320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 0x7f4c881121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 --2- 172.21.15.18:0/1759175320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c88073ec0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 -- 172.21.15.18:0/1759175320 >> 172.21.15.18:0/1759175320 conn(0x7f4c880fd1f0 msgr2=0x7f4c880ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.375+0000 7f4c8d600640 1 -- 172.21.15.18:0/1759175320 shutdown_connections 2024-04-21T22:40:55.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.376+0000 7f4c8d600640 1 -- 172.21.15.18:0/1759175320 wait complete. 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.376+0000 7f4c8d600640 1 Processor -- start 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 -- start start 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 0x7f4c8819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 0x7f4c881a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88118100 con 0x7f4c88073ae0 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88117f80 con 0x7f4c88074400 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c8d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88118280 con 0x7f4c88112710 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36892/0 (socket says 172.21.15.18:36892) 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c86a00640 1 -- 172.21.15.18:0/2144916201 learned_addr learned my addr 172.21.15.18:0/2144916201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c87400640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 0x7f4c881a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.377+0000 7f4c86000640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 0x7f4c8819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 -- 172.21.15.18:0/2144916201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 msgr2=0x7f4c881a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 0x7f4c881a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 -- 172.21.15.18:0/2144916201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 msgr2=0x7f4c8819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 0x7f4c8819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 -- 172.21.15.18:0/2144916201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c881a36b0 con 0x7f4c88073ae0 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005940 tx=0x7f4c7802cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.378+0000 7f4c7f400640 1 -- 172.21.15.18:0/2144916201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78041070 con 0x7f4c88073ae0 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.379+0000 7f4c7f400640 1 -- 172.21.15.18:0/2144916201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c78004450 con 0x7f4c88073ae0 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.379+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c881a3940 con 0x7f4c88073ae0 2024-04-21T22:40:55.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.379+0000 7f4c7f400640 1 -- 172.21.15.18:0/2144916201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78003d80 con 0x7f4c88073ae0 2024-04-21T22:40:55.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.379+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c881ab230 con 0x7f4c88073ae0 2024-04-21T22:40:55.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c7f400640 1 -- 172.21.15.18:0/2144916201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4c78044070 con 0x7f4c88073ae0 2024-04-21T22:40:55.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 Processor -- start 2024-04-21T22:40:55.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 -- start start 2024-04-21T22:40:55.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1388160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad13886a0 0x55cad1390d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cad12ec3a0 con 0x55cad13886a0 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cad1294930 con 0x55cad1387d80 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.382+0000 7f4c903a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cad12e8360 con 0x55cad1391280 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54138/0 (socket says 172.21.15.18:54138) 2024-04-21T22:40:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c87400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1388160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 -- 172.21.15.18:0/1028132363 learned_addr learned my addr 172.21.15.18:0/1028132363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86a00640 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad13886a0 0x55cad1390d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 -- 172.21.15.18:0/1028132363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 msgr2=0x55cad1388160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1388160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 -- 172.21.15.18:0/1028132363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad13886a0 msgr2=0x55cad1390d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad13886a0 0x55cad1390d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.383+0000 7f4c86000640 1 -- 172.21.15.18:0/1028132363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad10003f0 con 0x55cad1391280 2024-04-21T22:40:55.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c86000640 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009c90 tx=0x7f4c74011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6140ac5db4e75787 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c7f400640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 0x7f4c6c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c73400640 1 -- 172.21.15.18:0/1028132363 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7401e070 con 0x55cad1391280 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c73400640 1 -- 172.21.15.18:0/1028132363 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c74019b10 con 0x55cad1391280 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c73400640 1 -- 172.21.15.18:0/1028132363 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400eac0 con 0x55cad1391280 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c7f400640 1 -- 172.21.15.18:0/2144916201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4c780f0de0 con 0x7f4c88073ae0 2024-04-21T22:40:55.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.384+0000 7f4c87400640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 0x7f4c6c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- 172.21.15.18:0/1028132363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 msgr2=0x55cad1393670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009c90 tx=0x7f4c74011810 comp rx=0 tx=0).stop 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- 172.21.15.18:0/1028132363 shutdown_connections 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1391280 0x55cad1393670 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad13886a0 0x55cad1390d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 --2- 172.21.15.18:0/1028132363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1388160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- 172.21.15.18:0/1028132363 >> 172.21.15.18:0/1028132363 conn(0x55cad13824b0 msgr2=0x55cad1382890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c87400640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 0x7f4c6c0a5240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c8806aed0 tx=0x7f4c80009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- 172.21.15.18:0/1028132363 shutdown_connections 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- 172.21.15.18:0/1028132363 wait complete. 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.385+0000 7f4c903a3740 1 -- start start 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 Processor -- start 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad13886a0 0x55cad138e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad138ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cad1394070 con 0x55cad1391280 2024-04-21T22:40:55.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55cad12a7d80 con 0x55cad13886a0 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55cad13941f0 con 0x55cad1387d80 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c903a3740 10 client.0 _ll_register_callbacks cb 0x55cad12e42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.386+0000 7f4c87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad138ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54144/0 (socket says 172.21.15.18:54144) 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 -- 172.21.15.18:0/422599687 learned_addr learned my addr 172.21.15.18:0/422599687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86000640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad13886a0 0x55cad138e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 -- 172.21.15.18:0/422599687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad13886a0 msgr2=0x55cad138e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad13886a0 0x55cad138e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 -- 172.21.15.18:0/422599687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 msgr2=0x55cad138ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad138ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 -- 172.21.15.18:0/422599687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad10ca7d0 con 0x55cad1387d80 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c86a00640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c7803f040 tx=0x7f4c78005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bc3adaec87236b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c67e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.387+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7804b070 con 0x55cad1387d80 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c74019b10 con 0x55cad1387d80 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4c780ee750 con 0x55cad1387d80 2024-04-21T22:40:55.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4c780b9700 con 0x55cad1387d80 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 10 client.27274 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cad13940c0 con 0x55cad1387d80 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c74019b10 con 0x55cad1387d80 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4c780d6140 con 0x55cad1387d80 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 10 client.27274 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 10 client.27274 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 20 client.27274 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad13a1720 0x55cad13a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 4 client.27274 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.388+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad12f98e0 con 0x55cad13a1720 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.389+0000 7f4c86000640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad13a1720 0x55cad13a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.389+0000 7f4c86000640 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad13a1720 0x55cad13a3b80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6cdbc5f3edd4cc70 server_cookie=f4eaf91709669302 in_seq=0 out_seq=0 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.389+0000 7f4c67e00640 10 client.27274 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:55.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.390+0000 7f4c67e00640 1 -- 172.21.15.18:0/422599687 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cad12f98e0 con 0x55cad13a1720 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.390+0000 7f4c67e00640 10 client.27274 handle_command_reply: tid=0 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.390+0000 7f4c903a3740 1 client.27274 shutdown 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.390+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 msgr2=0x55cad138e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.390+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4c7803f040 tx=0x7f4c78005c00 comp rx=0 tx=0).stop 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 shutdown_connections 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad13a1720 0x55cad13a3b80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad138ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad13886a0 0x55cad138e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c67e00640 0 client.27274 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 --2- 172.21.15.18:0/422599687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad1387d80 0x55cad138e1e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 >> 172.21.15.18:0/422599687 conn(0x55cad13824b0 msgr2=0x55cad1384200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 shutdown_connections 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 1 -- 172.21.15.18:0/422599687 wait complete. 2024-04-21T22:40:55.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.391+0000 7f4c903a3740 20 client.27274 trim_cache size 0 max 16384 2024-04-21T22:40:55.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 Processor -- start 2024-04-21T22:40:55.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 -- start start 2024-04-21T22:40:55.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1390910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad1383ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b3b50 con 0x55cad1391280 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b5690 con 0x55cad1387d80 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.406+0000 7f4c903a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b4220 con 0x55cad13886a0 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad1383ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54156/0 (socket says 172.21.15.18:54156) 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 -- 172.21.15.18:0/3969115255 learned_addr learned my addr 172.21.15.18:0/3969115255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad1383ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36932/0 (socket says 172.21.15.18:36932) 2024-04-21T22:40:55.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86a00640 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1390910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 -- 172.21.15.18:0/3969115255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 msgr2=0x55cad1390910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1390910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 -- 172.21.15.18:0/3969115255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 msgr2=0x55cad1383ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad1383ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 -- 172.21.15.18:0/3969115255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad13884d0 con 0x55cad13886a0 2024-04-21T22:40:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.407+0000 7f4c86000640 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400e6b0 tx=0x7f4c7400e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6b07bd87e9f7de server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c72a00640 1 -- 172.21.15.18:0/3969115255 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7401e040 con 0x55cad13886a0 2024-04-21T22:40:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c72a00640 1 -- 172.21.15.18:0/3969115255 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c7401f040 con 0x55cad13886a0 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c72a00640 1 -- 172.21.15.18:0/3969115255 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c740044a0 con 0x55cad13886a0 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 -- 172.21.15.18:0/3969115255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 msgr2=0x55cad138ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400e6b0 tx=0x7f4c7400e640 comp rx=0 tx=0).stop 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 -- 172.21.15.18:0/3969115255 shutdown_connections 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad1383ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad138ea80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 --2- 172.21.15.18:0/3969115255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad1390910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.408+0000 7f4c903a3740 1 -- 172.21.15.18:0/3969115255 >> 172.21.15.18:0/3969115255 conn(0x55cad13824b0 msgr2=0x55cad13838e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.409+0000 7f4c903a3740 1 -- 172.21.15.18:0/3969115255 shutdown_connections 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.409+0000 7f4c903a3740 1 -- 172.21.15.18:0/3969115255 wait complete. 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.409+0000 7f4c903a3740 1 -- start start 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.409+0000 7f4c903a3740 1 Processor -- start 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad13996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad13969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b4fc0 con 0x55cad1391280 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b48f0 con 0x55cad1387d80 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c881b1b30 con 0x55cad13886a0 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c903a3740 10 client.0 _ll_register_callbacks cb 0x7f4c78003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:54160/0 (socket says 172.21.15.18:54160) 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 -- 172.21.15.18:0/2230492250 learned_addr learned my addr 172.21.15.18:0/2230492250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad13996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 -- 172.21.15.18:0/2230492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 msgr2=0x55cad13996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad13996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 -- 172.21.15.18:0/2230492250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 msgr2=0x55cad13969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad13969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.410+0000 7f4c86000640 1 -- 172.21.15.18:0/2230492250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad1396f20 con 0x55cad13886a0 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c86000640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c74013040 tx=0x7f4c74009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec09ed73cf648223 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c67e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7401e040 con 0x55cad13886a0 2024-04-21T22:40:55.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c7401f040 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4c74005250 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4c74005450 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c903a3740 10 client.27280 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55cad14089f0 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.411+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c7401f040 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4c7402e070 con 0x55cad13886a0 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 10 client.27280 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 10 client.27280 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 20 client.27280 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad1408f80 0x55cad140b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 4 client.27280 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cad12f3c30 con 0x55cad1408f80 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.412+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad1408f80 0x55cad140b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c67e00640 10 client.27280 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c86a00640 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad1408f80 0x55cad140b3c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff512a44d61b5ef9 server_cookie=90842534653efe75 in_seq=0 out_seq=0 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c67e00640 1 -- 172.21.15.18:0/2230492250 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cad12f3c30 con 0x55cad1408f80 2024-04-21T22:40:55.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c67e00640 10 client.27280 handle_command_reply: tid=0 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 client.27280 shutdown 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 msgr2=0x55cad13964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c74013040 tx=0x7f4c74009640 comp rx=0 tx=0).stop 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 shutdown_connections 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55cad1408f80 0x55cad140b3c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cad1391280 0x55cad13969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cad13886a0 0x55cad13964a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 --2- 172.21.15.18:0/2230492250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cad1387d80 0x55cad13996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 >> 172.21.15.18:0/2230492250 conn(0x55cad13824b0 msgr2=0x55cad1384170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c67e00640 0 client.27280 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:40:55.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 shutdown_connections 2024-04-21T22:40:55.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 1 -- 172.21.15.18:0/2230492250 wait complete. 2024-04-21T22:40:55.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.413+0000 7f4c903a3740 20 client.27280 trim_cache size 0 max 16384 2024-04-21T22:40:55.422 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:55.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 msgr2=0x7f4c6c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 0x7f4c6c0a5240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c8806aed0 tx=0x7f4c80009500 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 msgr2=0x7f4c8819e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005940 tx=0x7f4c7802cbd0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 shutdown_connections 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4c6c0a2d80 0x7f4c6c0a5240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c88112710 0x7f4c881a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c88074400 0x7f4c8819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 --2- 172.21.15.18:0/2144916201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c88073ae0 0x7f4c8819e6c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 >> 172.21.15.18:0/2144916201 conn(0x7f4c880fd1f0 msgr2=0x7f4c880feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 shutdown_connections 2024-04-21T22:40:55.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.414+0000 7f4c8d600640 1 -- 172.21.15.18:0/2144916201 wait complete. 2024-04-21T22:40:55.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:55 smithi018 ceph-mon[26614]: pgmap v209: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:55.431 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:55 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/777149754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:55.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:40:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:55 smithi081 ceph-mon[31692]: pgmap v209: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:55.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:55 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/777149754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:55.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 -- 172.21.15.18:0/1963532476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 msgr2=0x7f10bc111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1963532476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc111e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009930 tx=0x7f10a802bc30 comp rx=0 tx=0).stop 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 -- 172.21.15.18:0/1963532476 shutdown_connections 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1963532476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1963532476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc111e80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1963532476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.646+0000 7f10c2c00640 1 -- 172.21.15.18:0/1963532476 >> 172.21.15.18:0/1963532476 conn(0x7f10bc0ff210 msgr2=0x7f10bc101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.647+0000 7f10c2c00640 1 -- 172.21.15.18:0/1963532476 shutdown_connections 2024-04-21T22:40:55.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.647+0000 7f10c2c00640 1 -- 172.21.15.18:0/1963532476 wait complete. 2024-04-21T22:40:55.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.648+0000 7f10c2c00640 1 Processor -- start 2024-04-21T22:40:55.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.648+0000 7f10c2c00640 1 -- start start 2024-04-21T22:40:55.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc117f70 con 0x7f10bc075c70 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc117df0 con 0x7f10bc076590 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1180f0 con 0x7f10bc1123c0 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36958/0 (socket says 172.21.15.18:36958) 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c1800640 1 -- 172.21.15.18:0/1312097559 learned_addr learned my addr 172.21.15.18:0/1312097559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2200640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 -- 172.21.15.18:0/1312097559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 msgr2=0x7f10bc1a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 -- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 msgr2=0x7f10bc19e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c0e00640 1 -- 172.21.15.18:0/1312097559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc1a34d0 con 0x7f10bc076590 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c1800640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.649+0000 7f10c2200640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc19ea70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f10a8036040 tx=0x7f10a8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10ba000640 1 -- 172.21.15.18:0/1312097559 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8043020 con 0x7f10bc076590 2024-04-21T22:40:55.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10ba000640 1 -- 172.21.15.18:0/1312097559 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8005000 con 0x7f10bc076590 2024-04-21T22:40:55.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10ba000640 1 -- 172.21.15.18:0/1312097559 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8003a80 con 0x7f10bc076590 2024-04-21T22:40:55.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc1a3760 con 0x7f10bc076590 2024-04-21T22:40:55.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.650+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc1ab050 con 0x7f10bc076590 2024-04-21T22:40:55.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 Processor -- start 2024-04-21T22:40:55.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10ba000640 1 -- 172.21.15.18:0/1312097559 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f10a8046020 con 0x7f10bc076590 2024-04-21T22:40:55.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 -- start start 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73542f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c73545860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561c7349e3a0 con 0x561c73539f70 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561c73446930 con 0x561c7353a890 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.654+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561c7349a360 con 0x561c73543470 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36966/0 (socket says 172.21.15.18:36966) 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 -- 172.21.15.18:0/515975443 learned_addr learned my addr 172.21.15.18:0/515975443 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c1800640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73542f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c0e00640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c73545860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 -- 172.21.15.18:0/515975443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 msgr2=0x561c73545860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c73545860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 -- 172.21.15.18:0/515975443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 msgr2=0x561c73542f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73542f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c2200640 1 -- 172.21.15.18:0/515975443 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c731b23f0 con 0x561c73539f70 2024-04-21T22:40:55.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.655+0000 7f10c1800640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73542f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10c2200640 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10b4011760 tx=0x7f10b4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78938c3cdb6b848f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10ba000640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 0x7f10a40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10aea00640 1 -- 172.21.15.18:0/515975443 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004d20 con 0x561c73539f70 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10aea00640 1 -- 172.21.15.18:0/515975443 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b400f9a0 con 0x561c73539f70 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10aea00640 1 -- 172.21.15.18:0/515975443 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004530 con 0x561c73539f70 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10ba000640 1 -- 172.21.15.18:0/1312097559 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f10a80f11b0 con 0x7f10bc076590 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.656+0000 7f10c1800640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 0x7f10a40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 -- 172.21.15.18:0/515975443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 msgr2=0x561c7353a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c1800640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 0x7f10a40a5240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009620 tx=0x7f10b0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10b4011760 tx=0x7f10b4011c20 comp rx=0 tx=0).stop 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 -- 172.21.15.18:0/515975443 shutdown_connections 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c73545860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73542f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/515975443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c7353a350 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 -- 172.21.15.18:0/515975443 >> 172.21.15.18:0/515975443 conn(0x561c735346a0 msgr2=0x561c73534a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 -- 172.21.15.18:0/515975443 shutdown_connections 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.657+0000 7f10c6e7b740 1 -- 172.21.15.18:0/515975443 wait complete. 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.658+0000 7f10c6e7b740 1 -- start start 2024-04-21T22:40:55.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.658+0000 7f10c6e7b740 1 Processor -- start 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 0x561c73540980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 0x561c73540ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561c73546260 con 0x561c73539f70 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561c73459d80 con 0x561c73543470 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561c735463e0 con 0x561c7353a890 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c6e7b740 10 client.0 _ll_register_callbacks cb 0x561c734962b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36980/0 (socket says 172.21.15.18:36980) 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 -- 172.21.15.18:0/2880912363 learned_addr learned my addr 172.21.15.18:0/2880912363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c0e00640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 0x561c73540980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c2200640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 0x561c73540ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 -- 172.21.15.18:0/2880912363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 msgr2=0x561c73540980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 0x561c73540980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 -- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 msgr2=0x561c73540ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 0x561c73540ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c1800640 1 -- 172.21.15.18:0/2880912363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c7327c7d0 con 0x561c73539f70 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c2200640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 0x561c73540ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.659+0000 7f10c0e00640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 0x561c73540980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10c1800640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f10b0004640 tx=0x7f10b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d422f88537703cf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10a3400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0003af0 con 0x561c73539f70 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f10b0003c90 con 0x561c73539f70 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10b400f9a0 con 0x561c73539f70 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f10b0029440 con 0x561c73539f70 2024-04-21T22:40:55.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10c6e7b740 10 client.17163 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.660+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561c73552560 con 0x561c73539f70 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b400f9a0 con 0x561c73539f70 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f10b0027020 con 0x561c73539f70 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 10 client.17163 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 20 client.17163 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c73553a20 0x561c73555e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 4 client.17163 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:55.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.661+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c734ab8e0 con 0x561c73553a20 2024-04-21T22:40:55.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.662+0000 7f10c0e00640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c73553a20 0x561c73555e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.662+0000 7f10a3400640 10 client.17163 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.662+0000 7f10c0e00640 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c73553a20 0x561c73555e70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1a15ad8ca2aed4 server_cookie=c25177e45be9abb7 in_seq=0 out_seq=0 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10a3400640 1 -- 172.21.15.18:0/2880912363 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c734ab8e0 con 0x561c73553a20 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10a3400640 10 client.17163 handle_command_reply: tid=0 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 client.17163 shutdown 2024-04-21T22:40:55.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 msgr2=0x561c73540440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f10b0004640 tx=0x7f10b0004730 comp rx=0 tx=0).stop 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 shutdown_connections 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73543470 0x561c73540ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c73553a20 0x561c73555e70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c7353a890 0x561c73540980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/2880912363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c73540440 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 >> 172.21.15.18:0/2880912363 conn(0x561c735346a0 msgr2=0x561c735363f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10a3400640 0 client.17163 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:55.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 shutdown_connections 2024-04-21T22:40:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 1 -- 172.21.15.18:0/2880912363 wait complete. 2024-04-21T22:40:55.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.664+0000 7f10c6e7b740 20 client.17163 trim_cache size 0 max 16384 2024-04-21T22:40:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.679+0000 7f10c6e7b740 1 Processor -- start 2024-04-21T22:40:55.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.679+0000 7f10c6e7b740 1 -- start start 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73539f70 0x561c7354f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c7355b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b3980 con 0x561c7353a890 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b54c0 con 0x561c73539f70 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b4050 con 0x561c73543470 2024-04-21T22:40:55.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36992/0 (socket says 172.21.15.18:36992) 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c0e00640 1 -- 172.21.15.18:0/1560442353 learned_addr learned my addr 172.21.15.18:0/1560442353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c1800640 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73539f70 0x561c7354f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.680+0000 7f10c2200640 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c7355b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 -- 172.21.15.18:0/1560442353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 msgr2=0x561c7355b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c7355b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 -- 172.21.15.18:0/1560442353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73539f70 msgr2=0x561c7354f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73539f70 0x561c7354f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 -- 172.21.15.18:0/1560442353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c73534fe0 con 0x561c7353a890 2024-04-21T22:40:55.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80a8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12c8933e117b5e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10ae000640 1 -- 172.21.15.18:0/1560442353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80bd550 con 0x561c7353a890 2024-04-21T22:40:55.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10ae000640 1 -- 172.21.15.18:0/1560442353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80bde80 con 0x561c7353a890 2024-04-21T22:40:55.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.681+0000 7f10ae000640 1 -- 172.21.15.18:0/1560442353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80bd0e0 con 0x561c7353a890 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1560442353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 msgr2=0x561c73540ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80a8040 comp rx=0 tx=0).stop 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1560442353 shutdown_connections 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c7355b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c7353a890 0x561c73540ce0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1560442353 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c73539f70 0x561c7354f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1560442353 >> 172.21.15.18:0/1560442353 conn(0x561c735346a0 msgr2=0x561c73533690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1560442353 shutdown_connections 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1560442353 wait complete. 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.682+0000 7f10c6e7b740 1 -- start start 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 Processor -- start 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c735468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c735b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b4df0 con 0x561c73539f70 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b4720 con 0x561c7353a890 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc1b1960 con 0x561c73543470 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c6e7b740 10 client.0 _ll_register_callbacks cb 0x7f10b0012ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c735468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c2200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c735b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:56066/0 (socket says 172.21.15.18:56066) 2024-04-21T22:40:55.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.683+0000 7f10c0e00640 1 -- 172.21.15.18:0/1226773535 learned_addr learned my addr 172.21.15.18:0/1226773535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 -- 172.21.15.18:0/1226773535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 msgr2=0x561c735b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c735b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 -- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 msgr2=0x561c73546de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 -- 172.21.15.18:0/1226773535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c735b85b0 con 0x561c73539f70 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c2200640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c735b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c1800640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c735468a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f10b001f700 tx=0x7f10b001fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c4634ad595819d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:55.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10a3400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0036070 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f10b00295e0 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.684+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a80bde80 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f10b00043d0 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 10 client.17169 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561c735b98b0 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80bde80 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f10b0027040 con 0x561c73539f70 2024-04-21T22:40:55.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 10 client.17169 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 20 client.17169 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c735ba010 0x561c735bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 4 client.17169 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.685+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c734a5c30 con 0x561c735ba010 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c735ba010 0x561c735bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10c0e00640 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c735ba010 0x561c735bc430 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bd5f257c6f3f2 server_cookie=1e02215043aa3334 in_seq=0 out_seq=0 2024-04-21T22:40:55.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10a3400640 10 client.17169 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10a3400640 1 -- 172.21.15.18:0/1226773535 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c734a5c30 con 0x561c735ba010 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10a3400640 10 client.17169 handle_command_reply: tid=0 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.686+0000 7f10c6e7b740 1 client.17169 shutdown 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 msgr2=0x561c735468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c735468a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f10b001f700 tx=0x7f10b001fa30 comp rx=0 tx=0).stop 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 shutdown_connections 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x561c735ba010 0x561c735bc430 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c73543470 0x561c735b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561c7353a890 0x561c73546de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 --2- 172.21.15.18:0/1226773535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c73539f70 0x561c735468a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10a3400640 0 client.17169 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 >> 172.21.15.18:0/1226773535 conn(0x561c735346a0 msgr2=0x561c735356a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 shutdown_connections 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 1 -- 172.21.15.18:0/1226773535 wait complete. 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.687+0000 7f10c6e7b740 20 client.17169 trim_cache size 0 max 16384 2024-04-21T22:40:55.695 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:40:55.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 msgr2=0x7f10a40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 0x7f10a40a5240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009620 tx=0x7f10b0005f90 comp rx=0 tx=0).stop 2024-04-21T22:40:55.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 msgr2=0x7f10bc19ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc19ea70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f10a8036040 tx=0x7f10a8005e80 comp rx=0 tx=0).stop 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 shutdown_connections 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f10a40a2d80 0x7f10a40a5240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10bc1123c0 0x7f10bc1a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10bc076590 0x7f10bc19ea70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 --2- 172.21.15.18:0/1312097559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10bc075c70 0x7f10bc19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 >> 172.21.15.18:0/1312097559 conn(0x7f10bc0ff210 msgr2=0x7f10bc113b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 shutdown_connections 2024-04-21T22:40:55.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:55.688+0000 7f10c2c00640 1 -- 172.21.15.18:0/1312097559 wait complete. 2024-04-21T22:40:55.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:55 smithi047 ceph-mon[31561]: pgmap v209: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:40:55.698 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:55 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/777149754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:40:56.706 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:40:56.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:40:56.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:40:56.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 -- 172.21.15.18:0/3402715785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 msgr2=0x7fb224109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 --2- 172.21.15.18:0/3402715785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb224109d10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb214009930 tx=0x7fb21402bc20 comp rx=0 tx=0).stop 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 -- 172.21.15.18:0/3402715785 shutdown_connections 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 --2- 172.21.15.18:0/3402715785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb2241107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 --2- 172.21.15.18:0/3402715785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb224103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 --2- 172.21.15.18:0/3402715785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb224109d10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.936+0000 7fb229000640 1 -- 172.21.15.18:0/3402715785 >> 172.21.15.18:0/3402715785 conn(0x7fb2240ff3b0 msgr2=0x7fb2241017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.937+0000 7fb229000640 1 -- 172.21.15.18:0/3402715785 shutdown_connections 2024-04-21T22:40:56.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.937+0000 7fb229000640 1 -- 172.21.15.18:0/3402715785 wait complete. 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 Processor -- start 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 -- start start 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb22419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb22419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb224113d60 con 0x7fb224103920 2024-04-21T22:40:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb224113be0 con 0x7fb2241042e0 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb229000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb224113ee0 con 0x7fb224109930 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb221e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb221e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40316/0 (socket says 172.21.15.18:40316) 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb221e00640 1 -- 172.21.15.18:0/2741536332 learned_addr learned my addr 172.21.15.18:0/2741536332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.938+0000 7fb222800640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb22419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221400640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb22419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 -- 172.21.15.18:0/2741536332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 msgr2=0x7fb22419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb22419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 -- 172.21.15.18:0/2741536332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 msgr2=0x7fb22419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb22419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 -- 172.21.15.18:0/2741536332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22419f240 con 0x7fb224103920 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb222800640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb22419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221400640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb22419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:40:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.939+0000 7fb221e00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb214005ab0 tx=0x7fb214005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.940+0000 7fb21aa00640 1 -- 172.21.15.18:0/2741536332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214043020 con 0x7fb224103920 2024-04-21T22:40:56.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.940+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22419f4d0 con 0x7fb224103920 2024-04-21T22:40:56.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.940+0000 7fb21aa00640 1 -- 172.21.15.18:0/2741536332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb214005000 con 0x7fb224103920 2024-04-21T22:40:56.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.940+0000 7fb21aa00640 1 -- 172.21.15.18:0/2741536332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214003ab0 con 0x7fb224103920 2024-04-21T22:40:56.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.940+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2241a6dc0 con 0x7fb224103920 2024-04-21T22:40:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.943+0000 7fb22bbfa740 1 Processor -- start 2024-04-21T22:40:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.943+0000 7fb21aa00640 1 -- 172.21.15.18:0/2741536332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb214046020 con 0x7fb224103920 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.943+0000 7fb22bbfa740 1 -- start start 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2819b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec28226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 0x559ec2825010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559ec2777df0 con 0x559ec2822c20 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559ec277d040 con 0x559ec281a040 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559ec27258c0 con 0x559ec2819720 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 0x559ec2825010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb222800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2819b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 0x559ec2825010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40328/0 (socket says 172.21.15.18:40328) 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb221400640 1 -- 172.21.15.18:0/3694427242 learned_addr learned my addr 172.21.15.18:0/3694427242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.944+0000 7fb221e00640 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec28226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 -- 172.21.15.18:0/3694427242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 msgr2=0x559ec28226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec28226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 -- 172.21.15.18:0/3694427242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 msgr2=0x559ec2825010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 0x559ec2825010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 -- 172.21.15.18:0/3694427242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec25597e0 con 0x559ec2819720 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb222800640 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2819b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011760 tx=0x7fb21c011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c8d90ef324c6b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb20f400640 1 -- 172.21.15.18:0/3694427242 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004d20 con 0x559ec2819720 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb20f400640 1 -- 172.21.15.18:0/3694427242 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c003970 con 0x559ec2819720 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb20f400640 1 -- 172.21.15.18:0/3694427242 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004420 con 0x559ec2819720 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb21aa00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 0x7fb2080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.945+0000 7fb21aa00640 1 -- 172.21.15.18:0/2741536332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb2140f11e0 con 0x7fb224103920 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb221e00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 0x7fb2080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3694427242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 msgr2=0x559ec2819b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2819b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011760 tx=0x7fb21c011c20 comp rx=0 tx=0).stop 2024-04-21T22:40:56.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3694427242 shutdown_connections 2024-04-21T22:40:56.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2822c20 0x559ec2825010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec28226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3694427242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2819b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3694427242 >> 172.21.15.18:0/3694427242 conn(0x559ec2813e50 msgr2=0x559ec2814230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3694427242 shutdown_connections 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3694427242 wait complete. 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.946+0000 7fb221e00640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 0x7fb2080a5240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2140eeaf0 tx=0x7fb2140f4d30 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 -- start start 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 Processor -- start 2024-04-21T22:40:56.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec2820190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559ec2738d20 con 0x559ec2819720 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559ec2779000 con 0x559ec281a040 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559ec2825a10 con 0x559ec2822c20 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.947+0000 7fb22bbfa740 10 client.0 _ll_register_callbacks cb 0x559ec27740a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40334/0 (socket says 172.21.15.18:40334) 2024-04-21T22:40:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 -- 172.21.15.18:0/3210695726 learned_addr learned my addr 172.21.15.18:0/3210695726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb221400640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec2820190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 -- 172.21.15.18:0/3210695726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 msgr2=0x559ec28206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 -- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 msgr2=0x559ec2820190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec2820190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 -- 172.21.15.18:0/3210695726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec25b9f70 con 0x559ec2819720 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb222800640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000f80 tx=0x7fb21c011060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8b269412f7e8e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.948+0000 7fb203e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c02e060 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb21c005200 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb21c003970 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb21c01d070 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb22bbfa740 10 client.17181 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559ec2451170 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.949+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c003970 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb21c029950 con 0x559ec2819720 2024-04-21T22:40:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 10 client.17181 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 20 client.17181 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec2832e50 0x559ec2835240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 4 client.17181 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ec278a580 con 0x559ec2832e50 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.950+0000 7fb221400640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec2832e50 0x559ec2835240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.951+0000 7fb221400640 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec2832e50 0x559ec2835240 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89879806242ab2f server_cookie=e5c4523060d20fb1 in_seq=0 out_seq=0 2024-04-21T22:40:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.951+0000 7fb203e00640 10 client.17181 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb203e00640 1 -- 172.21.15.18:0/3210695726 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559ec278a580 con 0x559ec2832e50 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb203e00640 10 client.17181 handle_command_reply: tid=0 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 client.17181 shutdown 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 msgr2=0x559ec281fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000f80 tx=0x7fb21c011060 comp rx=0 tx=0).stop 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 shutdown_connections 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec2832e50 0x559ec2835240 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec281a040 0x559ec2820190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/3210695726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec2819720 0x559ec281fc50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb203e00640 0 client.17181 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 >> 172.21.15.18:0/3210695726 conn(0x559ec2813e50 msgr2=0x559ec2815ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 shutdown_connections 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 1 -- 172.21.15.18:0/3210695726 wait complete. 2024-04-21T22:40:56.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.952+0000 7fb22bbfa740 20 client.17181 trim_cache size 0 max 16384 2024-04-21T22:40:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 Processor -- start 2024-04-21T22:40:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 -- start start 2024-04-21T22:40:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2822380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 0x559ec283a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241af750 con 0x559ec281a040 2024-04-21T22:40:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241b1290 con 0x559ec2822c20 2024-04-21T22:40:56.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.972+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241afe20 con 0x559ec2819720 2024-04-21T22:40:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40348/0 (socket says 172.21.15.18:40348) 2024-04-21T22:40:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 -- 172.21.15.18:0/2106282436 learned_addr learned my addr 172.21.15.18:0/2106282436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:56.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb222800640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2822380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb222800640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 0x559ec283a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 -- 172.21.15.18:0/2106282436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 msgr2=0x559ec2822380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2822380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 -- 172.21.15.18:0/2106282436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 msgr2=0x559ec283a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 0x559ec283a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb221400640 1 -- 172.21.15.18:0/2106282436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec2820bb0 con 0x559ec281a040 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.973+0000 7fb222800640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 0x559ec283a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:40:56.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.974+0000 7fb221400640 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb210012620 tx=0x7fb210005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2001c0762759e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.974+0000 7fb20ea00640 1 -- 172.21.15.18:0/2106282436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210012110 con 0x559ec281a040 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.974+0000 7fb20ea00640 1 -- 172.21.15.18:0/2106282436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210005500 con 0x559ec281a040 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.974+0000 7fb20ea00640 1 -- 172.21.15.18:0/2106282436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100035f0 con 0x559ec281a040 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- 172.21.15.18:0/2106282436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 msgr2=0x559ec282e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb210012620 tx=0x7fb210005f90 comp rx=0 tx=0).stop 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- 172.21.15.18:0/2106282436 shutdown_connections 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2822c20 0x559ec283a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec282e780 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/2106282436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2819720 0x559ec2822380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- 172.21.15.18:0/2106282436 >> 172.21.15.18:0/2106282436 conn(0x559ec2813e50 msgr2=0x559ec28204a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- 172.21.15.18:0/2106282436 shutdown_connections 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- 172.21.15.18:0/2106282436 wait complete. 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.975+0000 7fb22bbfa740 1 -- start start 2024-04-21T22:40:56.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 Processor -- start 2024-04-21T22:40:56.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2819720 0x559ec2827c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28286e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241b0bc0 con 0x559ec281a040 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241b04f0 con 0x559ec2819720 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2241ad730 con 0x559ec2822c20 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb22bbfa740 10 client.0 _ll_register_callbacks cb 0x7fb210009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb221400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40358/0 (socket says 172.21.15.18:40358) 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb221400640 1 -- 172.21.15.18:0/855304517 learned_addr learned my addr 172.21.15.18:0/855304517 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:56.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.976+0000 7fb222800640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2819720 0x559ec2827c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb222800640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28286e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 -- 172.21.15.18:0/855304517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 msgr2=0x559ec28286e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28286e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 -- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2819720 msgr2=0x559ec2827c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2819720 0x559ec2827c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 -- 172.21.15.18:0/855304517 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec28992a0 con 0x559ec281a040 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb221400640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb2100057c0 tx=0x7fb210012110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d76206096bac4d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb203e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:40:56.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21002e020 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb210005500 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.977+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb2100046c0 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb2100048c0 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 10 client.17187 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559ec289a5c0 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210005500 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb210010430 con 0x559ec281a040 2024-04-21T22:40:56.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 10 client.17187 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 20 client.17187 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec289ad10 0x559ec289d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 4 client.17187 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.978+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559ec27848d0 con 0x559ec289ad10 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.979+0000 7fb222800640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec289ad10 0x559ec289d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.979+0000 7fb222800640 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec289ad10 0x559ec289d130 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ec8d01e08a7c73 server_cookie=711d07e48d6ff1d2 in_seq=0 out_seq=0 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.979+0000 7fb203e00640 10 client.17187 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:56.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.980+0000 7fb203e00640 1 -- 172.21.15.18:0/855304517 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559ec27848d0 con 0x559ec289ad10 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.980+0000 7fb203e00640 10 client.17187 handle_command_reply: tid=0 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.980+0000 7fb22bbfa740 1 client.17187 shutdown 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 msgr2=0x559ec28281a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb2100057c0 tx=0x7fb210012110 comp rx=0 tx=0).stop 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 shutdown_connections 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559ec289ad10 0x559ec289d130 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ec2822c20 0x559ec28286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ec281a040 0x559ec28281a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 --2- 172.21.15.18:0/855304517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559ec2819720 0x559ec2827c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 >> 172.21.15.18:0/855304517 conn(0x559ec2813e50 msgr2=0x559ec2812620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb203e00640 0 client.17187 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 shutdown_connections 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 1 -- 172.21.15.18:0/855304517 wait complete. 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.981+0000 7fb22bbfa740 20 client.17187 trim_cache size 0 max 16384 2024-04-21T22:40:56.988 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:40:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "a45ff1a8-65b3-4b28-85cb-ebec83df5ed9", 2024-04-21T22:40:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:40:56.989 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 msgr2=0x7fb2080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 0x7fb2080a5240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2140eeaf0 tx=0x7fb2140f4d30 comp rx=0 tx=0).stop 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 msgr2=0x7fb22419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb214005ab0 tx=0x7fb214005e80 comp rx=0 tx=0).stop 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 shutdown_connections 2024-04-21T22:40:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2080a2d80 0x7fb2080a5240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224109930 0x7fb22419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2241042e0 0x7fb22419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 --2- 172.21.15.18:0/2741536332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb224103920 0x7fb22419a2a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 >> 172.21.15.18:0/2741536332 conn(0x7fb2240ff3b0 msgr2=0x7fb2240ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 shutdown_connections 2024-04-21T22:40:56.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:56.982+0000 7fb229000640 1 -- 172.21.15.18:0/2741536332 wait complete. 2024-04-21T22:40:57.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:40:57.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:40:57.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 -- 172.21.15.18:0/2289389237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600102780 msgr2=0x7f0600102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 --2- 172.21.15.18:0/2289389237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600102780 0x7f0600102b60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009ca0 tx=0x7f05f002c180 comp rx=0 tx=0).stop 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 -- 172.21.15.18:0/2289389237 shutdown_connections 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 --2- 172.21.15.18:0/2289389237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 0x7f060010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 --2- 172.21.15.18:0/2289389237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06001030a0 0x7f060010b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 --2- 172.21.15.18:0/2289389237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0600102780 0x7f0600102b60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 -- 172.21.15.18:0/2289389237 >> 172.21.15.18:0/2289389237 conn(0x7f06000771f0 msgr2=0x7f06000fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 -- 172.21.15.18:0/2289389237 shutdown_connections 2024-04-21T22:40:57.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.253+0000 7f0605600640 1 -- 172.21.15.18:0/2289389237 wait complete. 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.254+0000 7f0605600640 1 Processor -- start 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 -- start start 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 0x7f060019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 0x7f060019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 0x7f060019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06001118e0 con 0x7f0600102780 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0600111760 con 0x7f060010bb50 2024-04-21T22:40:57.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f0605600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0600111a60 con 0x7f06001030a0 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.255+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 0x7f060019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 0x7f060019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f0604c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 0x7f060019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 0x7f060019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40368/0 (socket says 172.21.15.18:40368) 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ffe00640 1 -- 172.21.15.18:0/2213636887 learned_addr learned my addr 172.21.15.18:0/2213636887 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 -- 172.21.15.18:0/2213636887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 msgr2=0x7f060019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 0x7f060019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 -- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 msgr2=0x7f060019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 0x7f060019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 -- 172.21.15.18:0/2213636887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060019f030 con 0x7f06001030a0 2024-04-21T22:40:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.256+0000 7f05ff400640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 0x7f060019a5d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d6d0 tx=0x7f05ec00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.257+0000 7f05fcc00640 1 -- 172.21.15.18:0/2213636887 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec017070 con 0x7f06001030a0 2024-04-21T22:40:57.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.257+0000 7f05fcc00640 1 -- 172.21.15.18:0/2213636887 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ec009820 con 0x7f06001030a0 2024-04-21T22:40:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.257+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060019f320 con 0x7f06001030a0 2024-04-21T22:40:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.257+0000 7f05fcc00640 1 -- 172.21.15.18:0/2213636887 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec004d00 con 0x7f06001030a0 2024-04-21T22:40:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.257+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001a6bb0 con 0x7f06001030a0 2024-04-21T22:40:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.261+0000 7f0609995740 1 Processor -- start 2024-04-21T22:40:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 -- start start 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 0x559f8cdfe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f8cd56410 con 0x559f8cdfbfb0 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f8ccfe7e0 con 0x559f8cdf2ab0 2024-04-21T22:40:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f0609995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f8cd523d0 con 0x559f8cdf33d0 2024-04-21T22:40:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.262+0000 7f05fcc00640 1 -- 172.21.15.18:0/2213636887 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f05ec0099d0 con 0x7f06001030a0 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:55920/0 (socket says 172.21.15.18:55920) 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 -- 172.21.15.18:0/584605242 learned_addr learned my addr 172.21.15.18:0/584605242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f0604c00640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 -- 172.21.15.18:0/584605242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 msgr2=0x559f8cdf2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.263+0000 7f05ffe00640 1 -- 172.21.15.18:0/584605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 msgr2=0x559f8cdfe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.264+0000 7f05ff400640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 0x559f8cdfe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.264+0000 7f05ffe00640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 0x559f8cdfe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.264+0000 7f05ffe00640 1 -- 172.21.15.18:0/584605242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8cb347d0 con 0x559f8cdf33d0 2024-04-21T22:40:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.264+0000 7f0604c00640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.264+0000 7f05ff400640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 0x559f8cdfe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.265+0000 7f05ffe00640 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006010 tx=0x7f05f0005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3afd3f1da481587b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.265+0000 7f05f5200640 1 -- 172.21.15.18:0/584605242 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0043070 con 0x559f8cdf33d0 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.265+0000 7f05f5200640 1 -- 172.21.15.18:0/584605242 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f0003b70 con 0x559f8cdf33d0 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.265+0000 7f05f5200640 1 -- 172.21.15.18:0/584605242 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0039040 con 0x559f8cdf33d0 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 -- 172.21.15.18:0/584605242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 msgr2=0x559f8cdfba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05f0006010 tx=0x7f05f0005f80 comp rx=0 tx=0).stop 2024-04-21T22:40:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f05fcc00640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 0x7f05e40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f05fcc00640 1 -- 172.21.15.18:0/2213636887 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f05ec0cef80 con 0x7f06001030a0 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 -- 172.21.15.18:0/584605242 shutdown_connections 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdfbfb0 0x559f8cdfe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdfba70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 --2- 172.21.15.18:0/584605242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.266+0000 7f0609995740 1 -- 172.21.15.18:0/584605242 >> 172.21.15.18:0/584605242 conn(0x559f8cded1e0 msgr2=0x559f8cded5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.267+0000 7f0609995740 1 -- 172.21.15.18:0/584605242 shutdown_connections 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.267+0000 7f0604c00640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 0x7f05e40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.267+0000 7f0609995740 1 -- 172.21.15.18:0/584605242 wait complete. 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.267+0000 7f0609995740 1 -- start start 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.267+0000 7f0609995740 1 Processor -- start 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0604c00640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 0x7f05e40a5240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f05f8004620 tx=0x7f05f800b2e0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8cdf99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f8cdfed40 con 0x559f8cdf2ab0 2024-04-21T22:40:57.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f8cd11c40 con 0x559f8cdfbfb0 2024-04-21T22:40:57.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f8cdfeec0 con 0x559f8cdf33d0 2024-04-21T22:40:57.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0609995740 10 client.0 _ll_register_callbacks cb 0x559f8cd11630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.268+0000 7f0604c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8cdf99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:55934/0 (socket says 172.21.15.18:55934) 2024-04-21T22:40:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 -- 172.21.15.18:0/1465146818 learned_addr learned my addr 172.21.15.18:0/1465146818 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ffe00640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 -- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 msgr2=0x559f8cdf99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8cdf99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 -- 172.21.15.18:0/1465146818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf2ab0 msgr2=0x559f8cdf8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 -- 172.21.15.18:0/1465146818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8ca6a3f0 con 0x559f8cdf33d0 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05ff400640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009610 tx=0x7f05ec09b030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa0ac753cb216ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.269+0000 7f05e9600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec020040 con 0x559f8cdf33d0 2024-04-21T22:40:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f05ec097b60 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0003b70 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f05ec09f7f0 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f0609995740 10 client.27328 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f8ca2a0f0 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.270+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f0003b70 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f05ec0d2020 con 0x559f8cdf33d0 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 10 client.27328 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 10 client.27328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 20 client.27328 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce0c210 0x559f8ce0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 4 client.27328 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f8cd69c40 con 0x559f8ce0c210 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.271+0000 7f05ffe00640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce0c210 0x559f8ce0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.272+0000 7f05ffe00640 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce0c210 0x559f8ce0e680 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ceea5251ba557b server_cookie=fe83fcf51c9c96ac in_seq=0 out_seq=0 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.272+0000 7f05e9600640 10 client.27328 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.272+0000 7f05e9600640 1 -- 172.21.15.18:0/1465146818 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559f8cd69c40 con 0x559f8ce0c210 2024-04-21T22:40:57.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.272+0000 7f05e9600640 10 client.27328 handle_command_reply: tid=0 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 client.27328 shutdown 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 msgr2=0x559f8cdf94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009610 tx=0x7f05ec09b030 comp rx=0 tx=0).stop 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 shutdown_connections 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8cdf99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce0c210 0x559f8ce0e680 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf33d0 0x559f8cdf94b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 --2- 172.21.15.18:0/1465146818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf2ab0 0x559f8cdf8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f05e9600640 0 client.27328 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:57.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 >> 172.21.15.18:0/1465146818 conn(0x559f8cded1e0 msgr2=0x559f8cdeef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 shutdown_connections 2024-04-21T22:40:57.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 1 -- 172.21.15.18:0/1465146818 wait complete. 2024-04-21T22:40:57.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.273+0000 7f0609995740 20 client.27328 trim_cache size 0 max 16384 2024-04-21T22:40:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.298+0000 7f0609995740 1 Processor -- start 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 -- start start 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce07c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8ce13f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06001af4f0 con 0x559f8cdf33d0 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06001b1030 con 0x559f8cdfbfb0 2024-04-21T22:40:57.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0609995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06001afbc0 con 0x559f8cdf2ab0 2024-04-21T22:40:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:55938/0 (socket says 172.21.15.18:55938) 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f05ffe00640 1 -- 172.21.15.18:0/4127172560 learned_addr learned my addr 172.21.15.18:0/4127172560 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.299+0000 7f0604c00640 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8ce13f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ff400640 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce07c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 -- 172.21.15.18:0/4127172560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 msgr2=0x559f8ce13f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8ce13f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 -- 172.21.15.18:0/4127172560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 msgr2=0x559f8ce07c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce07c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 -- 172.21.15.18:0/4127172560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8cdfec80 con 0x559f8cdf2ab0 2024-04-21T22:40:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.300+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f05f00047f0 tx=0x7f05f00325a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16213e6ae88d2448 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.301+0000 7f05ebe00640 1 -- 172.21.15.18:0/4127172560 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0039040 con 0x559f8cdf2ab0 2024-04-21T22:40:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.301+0000 7f05ebe00640 1 -- 172.21.15.18:0/4127172560 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f0032d10 con 0x559f8cdf2ab0 2024-04-21T22:40:57.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.301+0000 7f05ebe00640 1 -- 172.21.15.18:0/4127172560 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0043040 con 0x559f8cdf2ab0 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 -- 172.21.15.18:0/4127172560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 msgr2=0x559f8cdfb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f05f00047f0 tx=0x7f05f00325a0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 -- 172.21.15.18:0/4127172560 shutdown_connections 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdfbfb0 0x559f8ce13f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce07c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 --2- 172.21.15.18:0/4127172560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdf2ab0 0x559f8cdfb6a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 -- 172.21.15.18:0/4127172560 >> 172.21.15.18:0/4127172560 conn(0x559f8cded1e0 msgr2=0x559f8cded5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 -- 172.21.15.18:0/4127172560 shutdown_connections 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.302+0000 7f0609995740 1 -- 172.21.15.18:0/4127172560 wait complete. 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 -- start start 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 Processor -- start 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce04670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdfbfb0 0x559f8cdff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06001b0960 con 0x559f8cdf33d0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06001b0290 con 0x559f8cdf2ab0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.303+0000 7f0609995740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06001ad4d0 con 0x559f8cdfbfb0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f0609995740 10 client.0 _ll_register_callbacks cb 0x7f05ec097790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:44218/0 (socket says 172.21.15.18:44218) 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 -- 172.21.15.18:0/4146530695 learned_addr learned my addr 172.21.15.18:0/4146530695 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f0604c00640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdfbfb0 0x559f8cdff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ff400640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce04670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 -- 172.21.15.18:0/4146530695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdfbfb0 msgr2=0x559f8cdff6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdfbfb0 0x559f8cdff6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 -- 172.21.15.18:0/4146530695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 msgr2=0x559f8ce04670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:40:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce04670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.304+0000 7f05ffe00640 1 -- 172.21.15.18:0/4146530695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8cdffed0 con 0x559f8cdf2ab0 2024-04-21T22:40:57.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.305+0000 7f05ffe00640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05f0048bf0 tx=0x7f05f0009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567dc402dba9912f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:40:57.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.305+0000 7f05e9600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.305+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0043030 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.305+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f05f0048450 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.305+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0032d10 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f05f005e050 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 10 client.27272 fetch_fsmap learned FSMap version 38 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f8ce72400 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f0032d10 con 0x559f8cdf2ab0 2024-04-21T22:40:57.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f05f003f9b0 con 0x559f8cdf2ab0 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 10 client.27272 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 10 client.27272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 20 client.27272 populate_metadata read hostname 'smithi018' 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce72630 0x559f8ce74a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 4 client.27272 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.306+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f8cd63950 con 0x559f8ce72630 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.307+0000 7f05ff400640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce72630 0x559f8ce74a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.307+0000 7f05ff400640 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce72630 0x559f8ce74a20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fefc7f69ea33ea54 server_cookie=63974ae2350ef9ba in_seq=0 out_seq=0 2024-04-21T22:40:57.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.307+0000 7f05e9600640 10 client.27272 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f05e9600640 1 -- 172.21.15.18:0/4146530695 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559f8cd63950 con 0x559f8ce72630 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f05e9600640 10 client.27272 handle_command_reply: tid=0 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 client.27272 shutdown 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 msgr2=0x559f8ce04130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05f0048bf0 tx=0x7f05f0009360 comp rx=0 tx=0).stop 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 shutdown_connections 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559f8ce72630 0x559f8ce74a20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f8cdfbfb0 0x559f8cdff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f8cdf33d0 0x559f8ce04670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 --2- 172.21.15.18:0/4146530695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f8cdf2ab0 0x559f8ce04130 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 >> 172.21.15.18:0/4146530695 conn(0x559f8cded1e0 msgr2=0x559f8cdf8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f05e9600640 0 client.27272 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 shutdown_connections 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 1 -- 172.21.15.18:0/4146530695 wait complete. 2024-04-21T22:40:57.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.308+0000 7f0609995740 20 client.27272 trim_cache size 0 max 16384 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "a45ff1a8-65b3-4b28-85cb-ebec83df5ed9": { 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "a45ff1a8-65b3-4b28-85cb-ebec83df5ed9", 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:40:57.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:40:57.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:40:57.316 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:40:57.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 msgr2=0x7f05e40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 0x7f05e40a5240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f05f8004620 tx=0x7f05f800b2e0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 msgr2=0x7f060019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 0x7f060019a5d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d6d0 tx=0x7f05ec00db90 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 shutdown_connections 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f05e40a2d80 0x7f05e40a5240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f060010bb50 0x7f060019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06001030a0 0x7f060019a5d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 --2- 172.21.15.18:0/2213636887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0600102780 0x7f060019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:40:57.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 >> 172.21.15.18:0/2213636887 conn(0x7f06000771f0 msgr2=0x7f06001003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:40:57.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 shutdown_connections 2024-04-21T22:40:57.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:40:57.309+0000 7f0605600640 1 -- 172.21.15.18:0/2213636887 wait complete. 2024-04-21T22:40:57.329 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: pgmap v210: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:57.330 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:57.331 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:57 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.332 INFO:tasks.cephfs.filesystem:scrub status for tag:a45ff1a8-65b3-4b28-85cb-ebec83df5ed9 - {'path': '/', 'tag': 'a45ff1a8-65b3-4b28-85cb-ebec83df5ed9', 'options': 'recursive,force'} 2024-04-21T22:40:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: pgmap v210: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:57.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:57 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: pgmap v210: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:57.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:57.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:57.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:57 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:58 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:58.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:58 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:58 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:40:58.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:58 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:58 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:58 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:58 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:58 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:40:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:58 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:58 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:58 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:58.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:58 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:58 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:40:58.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:58 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:58.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:58 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:40:59.596 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:40:59 smithi018 ceph-mon[26614]: pgmap v211: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:40:59 smithi081 ceph-mon[31692]: pgmap v211: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:40:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:40:59 smithi047 ceph-mon[31561]: pgmap v211: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:01.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:01 smithi018 ceph-mon[26614]: pgmap v212: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:01 smithi081 ceph-mon[31692]: pgmap v212: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:01 smithi047 ceph-mon[31561]: pgmap v212: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:03 smithi081 ceph-mon[31692]: pgmap v213: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:03.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:03 smithi047 ceph-mon[31561]: pgmap v213: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:03 smithi018 ceph-mon[26614]: pgmap v213: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:05.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:05 smithi081 ceph-mon[31692]: pgmap v214: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:41:05.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:05 smithi047 ceph-mon[31561]: pgmap v214: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:41:05.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:05 smithi018 ceph-mon[26614]: pgmap v214: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:41:07.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:07 smithi081 ceph-mon[31692]: pgmap v215: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T22:41:07.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:07 smithi047 ceph-mon[31561]: pgmap v215: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T22:41:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:07 smithi018 ceph-mon[26614]: pgmap v215: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-04-21T22:41:08.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:08 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:08.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:08 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:08.640 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:08 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:08 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:08 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:08.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:08 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:08 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:08 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:08 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:09 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:09 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:09.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:09 smithi081 ceph-mon[31692]: pgmap v216: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:41:09.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:09 smithi081 ceph-mon[31692]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T22:41:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:09 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:09 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:09 smithi047 ceph-mon[31561]: pgmap v216: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:41:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:09 smithi047 ceph-mon[31561]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T22:41:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:09 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:09 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:09 smithi018 ceph-mon[26614]: pgmap v216: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:41:09.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:09 smithi018 ceph-mon[26614]: osdmap e89: 12 total, 12 up, 12 in 2024-04-21T22:41:11.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:11 smithi081 ceph-mon[31692]: pgmap v218: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:11.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:11 smithi047 ceph-mon[31561]: pgmap v218: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:11.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:11 smithi018 ceph-mon[26614]: pgmap v218: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:13.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:13 smithi081 ceph-mon[31692]: pgmap v219: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:13.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:13 smithi047 ceph-mon[31561]: pgmap v219: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:13 smithi018 ceph-mon[26614]: pgmap v219: 97 pgs: 97 active+clean; 96 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-04-21T22:41:15.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:15 smithi081 ceph-mon[31692]: pgmap v220: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:15.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:15 smithi047 ceph-mon[31561]: pgmap v220: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:15 smithi018 ceph-mon[26614]: pgmap v220: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:17.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:17 smithi047 ceph-mon[31561]: pgmap v221: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:17 smithi018 ceph-mon[26614]: pgmap v221: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:17 smithi081 ceph-mon[31692]: pgmap v221: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:41:19.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:19 smithi047 ceph-mon[31561]: pgmap v222: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:19 smithi047 ceph-mon[31561]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T22:41:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:19 smithi018 ceph-mon[26614]: pgmap v222: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:19.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:19 smithi018 ceph-mon[26614]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T22:41:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:19 smithi081 ceph-mon[31692]: pgmap v222: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:19 smithi081 ceph-mon[31692]: osdmap e90: 12 total, 12 up, 12 in 2024-04-21T22:41:21.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:21 smithi047 ceph-mon[31561]: pgmap v224: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:21.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:21 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:41:21.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:21 smithi018 ceph-mon[26614]: pgmap v224: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:21.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:21 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:41:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:21 smithi081 ceph-mon[31692]: pgmap v224: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:21 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:41:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:23 smithi047 ceph-mon[31561]: pgmap v225: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:23 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:41:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:23 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:41:23.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:23 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:41:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:23 smithi018 ceph-mon[26614]: pgmap v225: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:23 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:41:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:23 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:41:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:23 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:41:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:23 smithi081 ceph-mon[31692]: pgmap v225: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:41:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:23 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:41:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:23 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:41:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:23 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:41:25.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:25 smithi047 ceph-mon[31561]: pgmap v226: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:25.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:25 smithi018 ceph-mon[26614]: pgmap v226: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:25 smithi081 ceph-mon[31692]: pgmap v226: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:27.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:41:27.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:41:27.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.558+0000 7f38aa200640 1 -- 172.21.15.18:0/3991214399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 msgr2=0x7f38a4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.558+0000 7f38aa200640 1 --2- 172.21.15.18:0/3991214399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a4110620 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f389c009cd0 tx=0x7f389c02c0f0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 -- 172.21.15.18:0/3991214399 shutdown_connections 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 --2- 172.21.15.18:0/3991214399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a4110620 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 --2- 172.21.15.18:0/3991214399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4103750 0x7f38a4103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 --2- 172.21.15.18:0/3991214399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4109760 0x7f38a4109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 -- 172.21.15.18:0/3991214399 >> 172.21.15.18:0/3991214399 conn(0x7f38a40ff220 msgr2=0x7f38a4101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 -- 172.21.15.18:0/3991214399 shutdown_connections 2024-04-21T22:41:27.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.559+0000 7f38aa200640 1 -- 172.21.15.18:0/3991214399 wait complete. 2024-04-21T22:41:27.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 Processor -- start 2024-04-21T22:41:27.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 -- start start 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4103750 0x7f38a419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 0x7f38a419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38a4113b70 con 0x7f38a4104110 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41139f0 con 0x7f38a4109760 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.560+0000 7f38aa200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38a4113cf0 con 0x7f38a4103750 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55410/0 (socket says 172.21.15.18:55410) 2024-04-21T22:41:27.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 -- 172.21.15.18:0/1276018378 learned_addr learned my addr 172.21.15.18:0/1276018378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a8e00640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4103750 0x7f38a419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a9800640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 0x7f38a419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 -- 172.21.15.18:0/1276018378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4103750 msgr2=0x7f38a419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4103750 0x7f38a419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 -- 172.21.15.18:0/1276018378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 msgr2=0x7f38a419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 0x7f38a419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 -- 172.21.15.18:0/1276018378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a419f020 con 0x7f38a4104110 2024-04-21T22:41:27.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a9800640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 0x7f38a419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a3e00640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f388c00ea60 tx=0x7f388c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.561+0000 7f38a1600640 1 -- 172.21.15.18:0/1276018378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c00cde0 con 0x7f38a4104110 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.562+0000 7f38a1600640 1 -- 172.21.15.18:0/1276018378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c0035f0 con 0x7f38a4104110 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.562+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a419f310 con 0x7f38a4104110 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.562+0000 7f38a1600640 1 -- 172.21.15.18:0/1276018378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c010670 con 0x7f38a4104110 2024-04-21T22:41:27.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.562+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a41a6ba0 con 0x7f38a4104110 2024-04-21T22:41:27.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.565+0000 7f38ae625740 1 Processor -- start 2024-04-21T22:41:27.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.565+0000 7f38a1600640 1 -- 172.21.15.18:0/1276018378 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f388c0037a0 con 0x7f38a4104110 2024-04-21T22:41:27.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.565+0000 7f38ae625740 1 -- start start 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b208668e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b2085cc410 con 0x55b208668ab0 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b2085747e0 con 0x55b208671fb0 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38ae625740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b2085c83d0 con 0x55b2086693d0 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38a9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b208668e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60516/0 (socket says 172.21.15.18:60516) 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38a8e00640 1 -- 172.21.15.18:0/317823583 learned_addr learned my addr 172.21.15.18:0/317823583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.566+0000 7f38a3e00640 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 -- 172.21.15.18:0/317823583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 msgr2=0x55b2086743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 -- 172.21.15.18:0/317823583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 msgr2=0x55b208668e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b208668e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 -- 172.21.15.18:0/317823583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2083aa7d0 con 0x55b2086693d0 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a8e00640 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3894009c70 tx=0x7f3894011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3e5fe2891c0304 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f38a1600640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 0x7f38880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.567+0000 7f389a000640 1 -- 172.21.15.18:0/317823583 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894004230 con 0x55b2086693d0 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f389a000640 1 -- 172.21.15.18:0/317823583 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38940043d0 con 0x55b2086693d0 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f389a000640 1 -- 172.21.15.18:0/317823583 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894019800 con 0x55b2086693d0 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38a1600640 1 -- 172.21.15.18:0/1276018378 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f388c0cf840 con 0x7f38a4104110 2024-04-21T22:41:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38a9800640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 0x7f38880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 -- 172.21.15.18:0/317823583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 msgr2=0x55b208671a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3894009c70 tx=0x7f3894011810 comp rx=0 tx=0).stop 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 -- 172.21.15.18:0/317823583 shutdown_connections 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b208671a70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 --2- 172.21.15.18:0/317823583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b208668e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.568+0000 7f38ae625740 1 -- 172.21.15.18:0/317823583 >> 172.21.15.18:0/317823583 conn(0x55b2086631e0 msgr2=0x55b2086635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.569+0000 7f38a9800640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 0x7f38880a51c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f389c02c630 tx=0x7f389c004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.569+0000 7f38ae625740 1 -- 172.21.15.18:0/317823583 shutdown_connections 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.569+0000 7f38ae625740 1 -- 172.21.15.18:0/317823583 wait complete. 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.569+0000 7f38ae625740 1 -- start start 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.569+0000 7f38ae625740 1 Processor -- start 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b2086693d0 0x55b20866f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208671fb0 0x55b20866fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b208674da0 con 0x55b2086693d0 2024-04-21T22:41:27.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b208587c40 con 0x55b208668ab0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b208674f20 con 0x55b208671fb0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38ae625740 10 client.0 _ll_register_callbacks cb 0x55b208587630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b2086693d0 0x55b20866f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48602/0 (socket says 172.21.15.18:48602) 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38a8e00640 1 -- 172.21.15.18:0/692959136 learned_addr learned my addr 172.21.15.18:0/692959136 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.570+0000 7f38a9800640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208671fb0 0x55b20866fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 -- 172.21.15.18:0/692959136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208671fb0 msgr2=0x55b20866fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208671fb0 0x55b20866fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 -- 172.21.15.18:0/692959136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b2086693d0 msgr2=0x55b20866f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b2086693d0 0x55b20866f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 -- 172.21.15.18:0/692959136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2082e03f0 con 0x55b208668ab0 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38a8e00640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3894009560 tx=0x7f3894005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cfbc044742a69bf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f3892a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894027070 con 0x55b208668ab0 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38940043d0 con 0x55b208668ab0 2024-04-21T22:41:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f3894003800 con 0x55b208668ab0 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.571+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3894033050 con 0x55b208668ab0 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 10 client.27284 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b2082a00f0 con 0x55b208668ab0 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38940043d0 con 0x55b208668ab0 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3894018070 con 0x55b208668ab0 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 10 client.27284 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 10 client.27284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 20 client.27284 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b208682280 0x55b208684670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 4 client.27284 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.572+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2085dfc40 con 0x55b208682280 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.573+0000 7f38a3e00640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b208682280 0x55b208684670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.573+0000 7f38a3e00640 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b208682280 0x55b208684670 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0a435ce571d863 server_cookie=7628ee0199a15261 in_seq=0 out_seq=0 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.573+0000 7f3892a00640 10 client.27284 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f3892a00640 1 -- 172.21.15.18:0/692959136 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b2085dfc40 con 0x55b208682280 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f3892a00640 10 client.27284 handle_command_reply: tid=0 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 client.27284 shutdown 2024-04-21T22:41:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 msgr2=0x55b20866efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3894009560 tx=0x7f3894005760 comp rx=0 tx=0).stop 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 shutdown_connections 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b208682280 0x55b208684670 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208671fb0 0x55b20866fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b2086693d0 0x55b20866f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 --2- 172.21.15.18:0/692959136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208668ab0 0x55b20866efa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 >> 172.21.15.18:0/692959136 conn(0x55b2086631e0 msgr2=0x55b208664f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f3892a00640 0 client.27284 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 shutdown_connections 2024-04-21T22:41:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 1 -- 172.21.15.18:0/692959136 wait complete. 2024-04-21T22:41:27.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.574+0000 7f38ae625740 20 client.27284 trim_cache size 0 max 16384 2024-04-21T22:41:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.594+0000 7f38ae625740 1 Processor -- start 2024-04-21T22:41:27.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.594+0000 7f38ae625740 1 -- start start 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.594+0000 7f38ae625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38ae625740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b20867dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38ae625740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38ae625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41af700 con 0x55b208668ab0 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38ae625740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41b1240 con 0x55b208671fb0 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38ae625740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41afdd0 con 0x55b2086693d0 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55440/0 (socket says 172.21.15.18:55440) 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 -- 172.21.15.18:0/1485285415 learned_addr learned my addr 172.21.15.18:0/1485285415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a3e00640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b20867dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a9800640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 -- 172.21.15.18:0/1485285415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 msgr2=0x55b20867dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b20867dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 -- 172.21.15.18:0/1485285415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 msgr2=0x55b2086622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a8e00640 1 -- 172.21.15.18:0/1485285415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b208669200 con 0x55b208668ab0 2024-04-21T22:41:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.595+0000 7f38a3e00640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b20867dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:27.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.596+0000 7f38a8e00640 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3894009bc0 tx=0x7f3894001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77270ef76e1ecae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.596+0000 7f3899600640 1 -- 172.21.15.18:0/1485285415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894027030 con 0x55b208668ab0 2024-04-21T22:41:27.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.596+0000 7f3899600640 1 -- 172.21.15.18:0/1485285415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3894015070 con 0x55b208668ab0 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.596+0000 7f3899600640 1 -- 172.21.15.18:0/1485285415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389401a900 con 0x55b208668ab0 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- 172.21.15.18:0/1485285415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 msgr2=0x55b2086716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3894009bc0 tx=0x7f3894001e50 comp rx=0 tx=0).stop 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- 172.21.15.18:0/1485285415 shutdown_connections 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b208671fb0 0x55b2086622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b2086693d0 0x55b20867dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 --2- 172.21.15.18:0/1485285415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208668ab0 0x55b2086716d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- 172.21.15.18:0/1485285415 >> 172.21.15.18:0/1485285415 conn(0x55b2086631e0 msgr2=0x55b208661bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- 172.21.15.18:0/1485285415 shutdown_connections 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- 172.21.15.18:0/1485285415 wait complete. 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 -- start start 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.597+0000 7f38ae625740 1 Processor -- start 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2086693d0 0x55b20867a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208671fb0 0x55b2086755a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41b0b70 con 0x55b208671fb0 2024-04-21T22:41:27.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41b04a0 con 0x55b2086693d0 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38a41ad700 con 0x55b208668ab0 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38ae625740 10 client.0 _ll_register_callbacks cb 0x7f3894009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38a8e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60550/0 (socket says 172.21.15.18:60550) 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38a8e00640 1 -- 172.21.15.18:0/2713176761 learned_addr learned my addr 172.21.15.18:0/2713176761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38a9800640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208671fb0 0x55b2086755a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.598+0000 7f38a3e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2086693d0 0x55b20867a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 -- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2086693d0 msgr2=0x55b20867a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2086693d0 0x55b20867a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 -- 172.21.15.18:0/2713176761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208671fb0 msgr2=0x55b2086755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208671fb0 0x55b2086755a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 -- 172.21.15.18:0/2713176761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b208675d80 con 0x55b208668ab0 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38a8e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f38940059e0 tx=0x7f3894003ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1030bc819e8d1431 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f3892a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:27.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389403b070 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3894015070 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f38940055d0 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.599+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3894027070 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 10 client.27352 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b2086f0a00 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3894015070 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3894018070 con 0x55b208668ab0 2024-04-21T22:41:27.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 10 client.27352 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 10 client.27352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 20 client.27352 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b2086f10c0 0x55b2086f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 4 client.27352 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2085d9950 con 0x55b2086f10c0 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.600+0000 7f38a3e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b2086f10c0 0x55b2086f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38a3e00640 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b2086f10c0 0x55b2086f34e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9a51f64a8ce8dd0 server_cookie=26c0b1fa4ec70b50 in_seq=0 out_seq=0 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f3892a00640 10 client.27352 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:27.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f3892a00640 1 -- 172.21.15.18:0/2713176761 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2085d9950 con 0x55b2086f10c0 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f3892a00640 10 client.27352 handle_command_reply: tid=0 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 client.27352 shutdown 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 msgr2=0x55b208679f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f38940059e0 tx=0x7f3894003ef0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 shutdown_connections 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b208671fb0 0x55b2086755a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b2086693d0 0x55b20867a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b2086f10c0 0x55b2086f34e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 --2- 172.21.15.18:0/2713176761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b208668ab0 0x55b208679f70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 >> 172.21.15.18:0/2713176761 conn(0x55b2086631e0 msgr2=0x55b208662440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f3892a00640 0 client.27352 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.601+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 shutdown_connections 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38ae625740 1 -- 172.21.15.18:0/2713176761 wait complete. 2024-04-21T22:41:27.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38ae625740 20 client.27352 trim_cache size 0 max 16384 2024-04-21T22:41:27.611 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:41:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:41:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:41:27.611 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 msgr2=0x7f38880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 0x7f38880a51c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f389c02c630 tx=0x7f389c004a40 comp rx=0 tx=0).stop 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 msgr2=0x7f38a419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f388c00ea60 tx=0x7f388c00ef20 comp rx=0 tx=0).stop 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 shutdown_connections 2024-04-21T22:41:27.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f38880a2d00 0x7f38880a51c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38a4109760 0x7f38a419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4104110 0x7f38a419a570 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 --2- 172.21.15.18:0/1276018378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a4103750 0x7f38a419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.602+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 >> 172.21.15.18:0/1276018378 conn(0x7f38a40ff220 msgr2=0x7f38a40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.603+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 shutdown_connections 2024-04-21T22:41:27.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.603+0000 7f38aa200640 1 -- 172.21.15.18:0/1276018378 wait complete. 2024-04-21T22:41:27.620 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:41:27.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:41:27.690 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:27 smithi018 ceph-mon[26614]: pgmap v227: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:27 smithi047 ceph-mon[31561]: pgmap v227: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:27.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 -- 172.21.15.18:0/749051160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804109930 msgr2=0x7fc804109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 --2- 172.21.15.18:0/749051160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804109930 0x7fc804109d10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009930 tx=0x7fc7f402bc30 comp rx=0 tx=0).stop 2024-04-21T22:41:27.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 -- 172.21.15.18:0/749051160 shutdown_connections 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 --2- 172.21.15.18:0/749051160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 0x7fc8041107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 --2- 172.21.15.18:0/749051160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804103920 0x7fc804103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 --2- 172.21.15.18:0/749051160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804109930 0x7fc804109d10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 -- 172.21.15.18:0/749051160 >> 172.21.15.18:0/749051160 conn(0x7fc8040ff450 msgr2=0x7fc804101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 -- 172.21.15.18:0/749051160 shutdown_connections 2024-04-21T22:41:27.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.830+0000 7fc809e00640 1 -- 172.21.15.18:0/749051160 wait complete. 2024-04-21T22:41:27.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 Processor -- start 2024-04-21T22:41:27.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 -- start start 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 0x7fc80419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804109930 0x7fc80419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113d90 con 0x7fc8041042e0 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113c10 con 0x7fc804109930 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.831+0000 7fc809e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113f10 con 0x7fc804103920 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc7fa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 0x7fc80419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60554/0 (socket says 172.21.15.18:60554) 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 -- 172.21.15.18:0/3347350318 learned_addr learned my addr 172.21.15.18:0/3347350318 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc803400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804109930 0x7fc80419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 -- 172.21.15.18:0/3347350318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804109930 msgr2=0x7fc80419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804109930 0x7fc80419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 -- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 msgr2=0x7fc80419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 0x7fc80419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.832+0000 7fc802a00640 1 -- 172.21.15.18:0/3347350318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80419f260 con 0x7fc804103920 2024-04-21T22:41:27.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc802a00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009900 tx=0x7fc7f4004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4043020 con 0x7fc804103920 2024-04-21T22:41:27.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f40054e0 con 0x7fc804103920 2024-04-21T22:41:27.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4003b80 con 0x7fc804103920 2024-04-21T22:41:27.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80419f4f0 con 0x7fc804103920 2024-04-21T22:41:27.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.833+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8041a6de0 con 0x7fc804103920 2024-04-21T22:41:27.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.834+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc804105060 con 0x7fc804103920 2024-04-21T22:41:27.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.836+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc7f4046020 con 0x7fc804103920 2024-04-21T22:41:27.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.838+0000 7fc808a00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 0x7fc7e80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:27.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.838+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fc7f40f13e0 con 0x7fc804103920 2024-04-21T22:41:27.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.838+0000 7fc7fa000640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 0x7fc7e80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:27.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.839+0000 7fc7fa000640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 0x7fc7e80a5240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc804101af0 tx=0x7fc7ec005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:27.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:27.842+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc7f404d020 con 0x7fc804103920 2024-04-21T22:41:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:27 smithi081 ceph-mon[31692]: pgmap v227: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:41:28.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.090+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc80410be90 con 0x7fc804103920 2024-04-21T22:41:28.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.091+0000 7fc808a00640 1 -- 172.21.15.18:0/3347350318 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7fc7f40be080 con 0x7fc804103920 2024-04-21T22:41:28.092 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:41:28.092 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:41:28.092 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.094+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 msgr2=0x7fc7e80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.094+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 0x7fc7e80a5240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc804101af0 tx=0x7fc7ec005f90 comp rx=0 tx=0).stop 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.094+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 msgr2=0x7fc80419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.094+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009900 tx=0x7fc7f4004360 comp rx=0 tx=0).stop 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 shutdown_connections 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc7e80a2d80 0x7fc7e80a5240 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc804109930 0x7fc80419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8041042e0 0x7fc80419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 --2- 172.21.15.18:0/3347350318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc804103920 0x7fc80419a270 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 >> 172.21.15.18:0/3347350318 conn(0x7fc8040ff450 msgr2=0x7fc8040ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 shutdown_connections 2024-04-21T22:41:28.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.095+0000 7fc809e00640 1 -- 172.21.15.18:0/3347350318 wait complete. 2024-04-21T22:41:28.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:41:28.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 -- 172.21.15.18:0/1689235825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 msgr2=0x7f08241101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 --2- 172.21.15.18:0/1689235825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f08241101c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f081c009860 tx=0x7f081c02bc00 comp rx=0 tx=0).stop 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 -- 172.21.15.18:0/1689235825 shutdown_connections 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 --2- 172.21.15.18:0/1689235825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f08241101c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 --2- 172.21.15.18:0/1689235825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824074430 0x7f082410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 --2- 172.21.15.18:0/1689235825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824073b10 0x7f0824073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 -- 172.21.15.18:0/1689235825 >> 172.21.15.18:0/1689235825 conn(0x7f08240fd020 msgr2=0x7f08240ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 -- 172.21.15.18:0/1689235825 shutdown_connections 2024-04-21T22:41:28.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.333+0000 7f0823e00640 1 -- 172.21.15.18:0/1689235825 wait complete. 2024-04-21T22:41:28.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.334+0000 7f0823e00640 1 Processor -- start 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 -- start start 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 0x7f082419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824074430 0x7f082419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0824113b10 con 0x7f0824073b10 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0824113990 con 0x7f0824074430 2024-04-21T22:41:28.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0824113c90 con 0x7f082410ddb0 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0822a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 0x7f082419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60582/0 (socket says 172.21.15.18:60582) 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.335+0000 7f0823400640 1 -- 172.21.15.18:0/3773949259 learned_addr learned my addr 172.21.15.18:0/3773949259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0822000640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824074430 0x7f082419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 -- 172.21.15.18:0/3773949259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824074430 msgr2=0x7f082419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824074430 0x7f082419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 -- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 msgr2=0x7f082419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 0x7f082419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 -- 172.21.15.18:0/3773949259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082419f090 con 0x7f082410ddb0 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0822a00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 0x7f082419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0823400640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f081c02c210 tx=0x7f081c034440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.336+0000 7f0828a00640 1 -- 172.21.15.18:0/3773949259 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c041030 con 0x7f082410ddb0 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.337+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082419f320 con 0x7f082410ddb0 2024-04-21T22:41:28.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.337+0000 7f0828a00640 1 -- 172.21.15.18:0/3773949259 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f081c034b50 con 0x7f082410ddb0 2024-04-21T22:41:28.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.337+0000 7f0828a00640 1 -- 172.21.15.18:0/3773949259 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c039040 con 0x7f082410ddb0 2024-04-21T22:41:28.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.337+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08241a6c10 con 0x7f082410ddb0 2024-04-21T22:41:28.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.340+0000 7f082cbe5740 1 Processor -- start 2024-04-21T22:41:28.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.340+0000 7f0828a00640 1 -- 172.21.15.18:0/3773949259 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f081c02c5a0 con 0x7f082410ddb0 2024-04-21T22:41:28.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.340+0000 7f082cbe5740 1 -- start start 2024-04-21T22:41:28.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae049350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 0x55d0ae054860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0adfad3a0 con 0x55d0ae049890 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d0adf55930 con 0x55d0ae048f70 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f082cbe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d0adfa9360 con 0x55d0ae052470 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f0822a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f0822a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55498/0 (socket says 172.21.15.18:55498) 2024-04-21T22:41:28.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f0822a00640 1 -- 172.21.15.18:0/3615823005 learned_addr learned my addr 172.21.15.18:0/3615823005 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f0822000640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae049350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.341+0000 7f0822000640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 0x55d0ae054860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 -- 172.21.15.18:0/3615823005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 msgr2=0x55d0ae054860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 0x55d0ae054860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 -- 172.21.15.18:0/3615823005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 msgr2=0x55d0ae049350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae049350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 -- 172.21.15.18:0/3615823005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0adcc13f0 con 0x55d0ae049890 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822000640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 0x55d0ae054860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822a00640 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08140115f0 tx=0x7f0814011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f1b4909347df38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0828a00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 0x7f08040a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0828a00640 1 -- 172.21.15.18:0/3773949259 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f081c0f0100 con 0x7f082410ddb0 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0813e00640 1 -- 172.21.15.18:0/3615823005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081401e070 con 0x55d0ae049890 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0813e00640 1 -- 172.21.15.18:0/3615823005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f081400fb20 con 0x55d0ae049890 2024-04-21T22:41:28.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0813e00640 1 -- 172.21.15.18:0/3615823005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814019c40 con 0x55d0ae049890 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.342+0000 7f0822000640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 0x7f08040a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 -- 172.21.15.18:0/3615823005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 msgr2=0x55d0ae051f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f08140115f0 tx=0x7f0814011ab0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f0822000640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 0x7f08040a51c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d0ae044830 tx=0x7f080c010040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 -- 172.21.15.18:0/3615823005 shutdown_connections 2024-04-21T22:41:28.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae052470 0x55d0ae054860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae049890 0x55d0ae051f30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3615823005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae049350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 -- 172.21.15.18:0/3615823005 >> 172.21.15.18:0/3615823005 conn(0x55d0ae0436a0 msgr2=0x55d0ae043a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 -- 172.21.15.18:0/3615823005 shutdown_connections 2024-04-21T22:41:28.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.343+0000 7f082cbe5740 1 -- 172.21.15.18:0/3615823005 wait complete. 2024-04-21T22:41:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.344+0000 7f082cbe5740 1 -- start start 2024-04-21T22:41:28.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.344+0000 7f082cbe5740 1 Processor -- start 2024-04-21T22:41:28.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 0x55d0ae04f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae049890 0x55d0ae04f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae055260 con 0x55d0ae052470 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d0adf68d80 con 0x55d0ae049890 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d0ae0553e0 con 0x55d0ae048f70 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f082cbe5740 10 client.0 _ll_register_callbacks cb 0x55d0adfa52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0823400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 0x55d0ae04f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0823400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55514/0 (socket says 172.21.15.18:55514) 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0823400640 1 -- 172.21.15.18:0/3443604042 learned_addr learned my addr 172.21.15.18:0/3443604042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822000640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae049890 0x55d0ae04f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 -- 172.21.15.18:0/3443604042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae049890 msgr2=0x55d0ae04f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae049890 0x55d0ae04f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 -- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 msgr2=0x55d0ae04ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0822a00640 1 -- 172.21.15.18:0/3443604042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0add8b7d0 con 0x55d0ae048f70 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.345+0000 7f0823400640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f0822a00640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 0x55d0ae04f4a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55d0ae048a40 tx=0x7f081400f870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe09e599ff5e033b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f0810c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081401e040 con 0x55d0ae048f70 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f08140199c0 con 0x55d0ae048f70 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f081400fb20 con 0x55d0ae048f70 2024-04-21T22:41:28.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0814019410 con 0x55d0ae048f70 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f082cbe5740 10 client.27367 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.346+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d0ae0614a0 con 0x55d0ae048f70 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f081400fb20 con 0x55d0ae048f70 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f0814021070 con 0x55d0ae048f70 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 10 client.27367 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 10 client.27367 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:41:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 20 client.27367 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae062850 0x55d0ae064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 4 client.27367 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0adfba8e0 con 0x55d0ae062850 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.347+0000 7f0822000640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae062850 0x55d0ae064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.348+0000 7f0822000640 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae062850 0x55d0ae064c40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ab1cfb43caf6e8b8 server_cookie=9e42857149861530 in_seq=0 out_seq=0 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.348+0000 7f0810c00640 10 client.27367 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:41:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f0810c00640 1 -- 172.21.15.18:0/3443604042 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0adfba8e0 con 0x55d0ae062850 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f0810c00640 10 client.27367 handle_command_reply: tid=0 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 client.27367 shutdown 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 msgr2=0x55d0ae04f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 0x55d0ae04f4a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55d0ae048a40 tx=0x7f081400f870 comp rx=0 tx=0).stop 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 shutdown_connections 2024-04-21T22:41:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae062850 0x55d0ae064c40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae04ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae049890 0x55d0ae04f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f0810c00640 0 client.27367 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:41:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3443604042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae048f70 0x55d0ae04f4a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 >> 172.21.15.18:0/3443604042 conn(0x55d0ae0436a0 msgr2=0x55d0ae0453f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 shutdown_connections 2024-04-21T22:41:28.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 1 -- 172.21.15.18:0/3443604042 wait complete. 2024-04-21T22:41:28.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.349+0000 7f082cbe5740 20 client.27367 trim_cache size 0 max 16384 2024-04-21T22:41:28.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.364+0000 7f082cbe5740 1 Processor -- start 2024-04-21T22:41:28.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.364+0000 7f082cbe5740 1 -- start start 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae052470 0x55d0ae042510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08241af5b0 con 0x55d0ae048f70 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08241b10f0 con 0x55d0ae052470 2024-04-21T22:41:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f082cbe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08241afc80 con 0x55d0ae049890 2024-04-21T22:41:28.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f0822a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f0822a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55524/0 (socket says 172.21.15.18:55524) 2024-04-21T22:41:28.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f0822a00640 1 -- 172.21.15.18:0/1240909636 learned_addr learned my addr 172.21.15.18:0/1240909636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f0822000640 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.365+0000 7f0823400640 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae052470 0x55d0ae042510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 -- 172.21.15.18:0/1240909636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 msgr2=0x55d0ae04fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae04fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 -- 172.21.15.18:0/1240909636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae052470 msgr2=0x55d0ae042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae052470 0x55d0ae042510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 -- 172.21.15.18:0/1240909636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ae04d9f0 con 0x55d0ae048f70 2024-04-21T22:41:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0822a00640 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0814000c00 tx=0x7f0814012fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a1fc7c730a7a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0813400640 1 -- 172.21.15.18:0/1240909636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081401e040 con 0x55d0ae048f70 2024-04-21T22:41:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0813400640 1 -- 172.21.15.18:0/1240909636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814005c50 con 0x55d0ae048f70 2024-04-21T22:41:28.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.366+0000 7f0813400640 1 -- 172.21.15.18:0/1240909636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814003850 con 0x55d0ae048f70 2024-04-21T22:41:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- 172.21.15.18:0/1240909636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 msgr2=0x55d0ae05e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0814000c00 tx=0x7f0814012fc0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- 172.21.15.18:0/1240909636 shutdown_connections 2024-04-21T22:41:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae052470 0x55d0ae042510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae04fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 --2- 172.21.15.18:0/1240909636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae048f70 0x55d0ae05e150 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- 172.21.15.18:0/1240909636 >> 172.21.15.18:0/1240909636 conn(0x55d0ae0436a0 msgr2=0x55d0ae041e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- 172.21.15.18:0/1240909636 shutdown_connections 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- 172.21.15.18:0/1240909636 wait complete. 2024-04-21T22:41:28.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.367+0000 7f082cbe5740 1 -- start start 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 Processor -- start 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae05aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae055e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08241b0a20 con 0x55d0ae052470 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f08241b0350 con 0x55d0ae048f70 2024-04-21T22:41:28.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08241ad5b0 con 0x55d0ae049890 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.368+0000 7f082cbe5740 10 client.0 _ll_register_callbacks cb 0x7f081401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0823400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae055e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0823400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55534/0 (socket says 172.21.15.18:55534) 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0823400640 1 -- 172.21.15.18:0/3369608177 learned_addr learned my addr 172.21.15.18:0/3369608177 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822a00640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae05aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 -- 172.21.15.18:0/3369608177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 msgr2=0x55d0ae05aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae05aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 -- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 msgr2=0x55d0ae0563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 -- 172.21.15.18:0/3369608177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ae056be0 con 0x55d0ae049890 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0823400640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0822000640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae055e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55d0ae065350 tx=0x7f080c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d2f53da079f90a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.369+0000 7f0810c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c004500 con 0x55d0ae049890 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0814005c50 con 0x55d0ae049890 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f080c0046a0 con 0x55d0ae049890 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f080c00d560 con 0x55d0ae049890 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 10 client.27373 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d0ae0c8d20 con 0x55d0ae049890 2024-04-21T22:41:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0814005c50 con 0x55d0ae049890 2024-04-21T22:41:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f080c033020 con 0x55d0ae049890 2024-04-21T22:41:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 10 client.27373 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 10 client.27373 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:41:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 20 client.27373 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.370+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae0c9470 0x55d0ae0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.371+0000 7f082cbe5740 4 client.27373 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:41:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.371+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0adfb4c30 con 0x55d0ae0c9470 2024-04-21T22:41:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.371+0000 7f0822a00640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae0c9470 0x55d0ae0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.371+0000 7f0822a00640 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae0c9470 0x55d0ae0cb890 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=87504bac33f13a0f server_cookie=1645b9159dddd936 in_seq=0 out_seq=0 2024-04-21T22:41:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.371+0000 7f0810c00640 10 client.27373 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:41:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f0810c00640 1 -- 172.21.15.18:0/3369608177 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0adfb4c30 con 0x55d0ae0c9470 2024-04-21T22:41:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f0810c00640 10 client.27373 handle_command_reply: tid=0 2024-04-21T22:41:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 client.27373 shutdown 2024-04-21T22:41:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 msgr2=0x55d0ae055e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae055e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55d0ae065350 tx=0x7f080c0095c0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 shutdown_connections 2024-04-21T22:41:28.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55d0ae0c9470 0x55d0ae0cb890 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d0ae052470 0x55d0ae0563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d0ae049890 0x55d0ae055e30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f0810c00640 0 client.27373 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:41:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 --2- 172.21.15.18:0/3369608177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0ae048f70 0x55d0ae05aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 >> 172.21.15.18:0/3369608177 conn(0x55d0ae0436a0 msgr2=0x55d0ae042690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 shutdown_connections 2024-04-21T22:41:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 1 -- 172.21.15.18:0/3369608177 wait complete. 2024-04-21T22:41:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.372+0000 7f082cbe5740 20 client.27373 trim_cache size 0 max 16384 2024-04-21T22:41:28.387 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:41:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 msgr2=0x7f08040a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 0x7f08040a51c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d0ae044830 tx=0x7f080c010040 comp rx=0 tx=0).stop 2024-04-21T22:41:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 msgr2=0x7f082419e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f081c02c210 tx=0x7f081c034440 comp rx=0 tx=0).stop 2024-04-21T22:41:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 shutdown_connections 2024-04-21T22:41:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f08040a2d00 0x7f08040a51c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f082410ddb0 0x7f082419e960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0824074430 0x7f082419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 --2- 172.21.15.18:0/3773949259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0824073b10 0x7f082419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 >> 172.21.15.18:0/3773949259 conn(0x7f08240fd020 msgr2=0x7f08240fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 shutdown_connections 2024-04-21T22:41:28.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.373+0000 7f0823e00640 1 -- 172.21.15.18:0/3773949259 wait complete. 2024-04-21T22:41:28.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:41:28.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 -- 172.21.15.18:0/2163905039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 msgr2=0x7fbb5c1149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 --2- 172.21.15.18:0/2163905039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c1149c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009ca0 tx=0x7fbb5402c100 comp rx=0 tx=0).stop 2024-04-21T22:41:28.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 -- 172.21.15.18:0/2163905039 shutdown_connections 2024-04-21T22:41:28.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 --2- 172.21.15.18:0/2163905039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c1149c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 --2- 172.21.15.18:0/2163905039 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c107c80 0x7fbb5c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 --2- 172.21.15.18:0/2163905039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 -- 172.21.15.18:0/2163905039 >> 172.21.15.18:0/2163905039 conn(0x7fbb5c077550 msgr2=0x7fbb5c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 -- 172.21.15.18:0/2163905039 shutdown_connections 2024-04-21T22:41:28.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.604+0000 7fbb62800640 1 -- 172.21.15.18:0/2163905039 wait complete. 2024-04-21T22:41:28.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 Processor -- start 2024-04-21T22:41:28.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 -- start start 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c1a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c117f40 con 0x7fbb5c108640 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c117dc0 con 0x7fbb5c10dc00 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.605+0000 7fbb62800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1180c0 con 0x7fbb5c107c80 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60660/0 (socket says 172.21.15.18:60660) 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb60a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 -- 172.21.15.18:0/4088408772 learned_addr learned my addr 172.21.15.18:0/4088408772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61e00640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c1a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 -- 172.21.15.18:0/4088408772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 msgr2=0x7fbb5c1a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c1a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 -- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 msgr2=0x7fbb5c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61400640 1 -- 172.21.15.18:0/4088408772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c1a3350 con 0x7fbb5c107c80 2024-04-21T22:41:28.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.606+0000 7fbb61e00640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c1a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb61400640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9f0 tx=0x7fbb4c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb5a000640 1 -- 172.21.15.18:0/4088408772 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00cd80 con 0x7fbb5c107c80 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c1a3640 con 0x7fbb5c107c80 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb5a000640 1 -- 172.21.15.18:0/4088408772 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb4c005500 con 0x7fbb5c107c80 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb5a000640 1 -- 172.21.15.18:0/4088408772 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c010690 con 0x7fbb5c107c80 2024-04-21T22:41:28.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.607+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1aaed0 con 0x7fbb5c107c80 2024-04-21T22:41:28.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.610+0000 7fbb669ee740 1 Processor -- start 2024-04-21T22:41:28.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.610+0000 7fbb669ee740 1 -- start start 2024-04-21T22:41:28.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb5a000640 1 -- 172.21.15.18:0/4088408772 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fbb4c0046c0 con 0x7fbb5c107c80 2024-04-21T22:41:28.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293007f70 0x559293008350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293008890 0x559293010f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559292f6c3a0 con 0x559293008890 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559292f14930 con 0x559293011470 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb669ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559292f68360 con 0x559293007f70 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb61400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293008890 0x559293010f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb60a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb61e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293007f70 0x559293008350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb60a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48708/0 (socket says 172.21.15.18:48708) 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb60a00640 1 -- 172.21.15.18:0/2323558319 learned_addr learned my addr 172.21.15.18:0/2323558319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.611+0000 7fbb60a00640 1 -- 172.21.15.18:0/2323558319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293007f70 msgr2=0x559293008350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb60a00640 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293007f70 0x559293008350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb60a00640 1 -- 172.21.15.18:0/2323558319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293008890 msgr2=0x559293010f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb60a00640 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293008890 0x559293010f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb60a00640 1 -- 172.21.15.18:0/2323558319 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559292c803f0 con 0x559293011470 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb60a00640 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009c90 tx=0x7fbb48011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86942e54ba8cf79 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb52600640 1 -- 172.21.15.18:0/2323558319 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4801e070 con 0x559293011470 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb52600640 1 -- 172.21.15.18:0/2323558319 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb48019b10 con 0x559293011470 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb5a000640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 0x7fbb400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.612+0000 7fbb52600640 1 -- 172.21.15.18:0/2323558319 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800eaf0 con 0x559293011470 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb5a000640 1 -- 172.21.15.18:0/4088408772 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fbb4c0cf9b0 con 0x7fbb5c107c80 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb61e00640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 0x7fbb400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 -- 172.21.15.18:0/2323558319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 msgr2=0x559293013860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009c90 tx=0x7fbb48011810 comp rx=0 tx=0).stop 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 -- 172.21.15.18:0/2323558319 shutdown_connections 2024-04-21T22:41:28.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293013860 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293008890 0x559293010f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2323558319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293007f70 0x559293008350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 -- 172.21.15.18:0/2323558319 >> 172.21.15.18:0/2323558319 conn(0x5592930026a0 msgr2=0x559293002a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 -- 172.21.15.18:0/2323558319 shutdown_connections 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb669ee740 1 -- 172.21.15.18:0/2323558319 wait complete. 2024-04-21T22:41:28.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.613+0000 7fbb61e00640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 0x7fbb400a51c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb54004af0 tx=0x7fbb54004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.614+0000 7fbb669ee740 1 -- start start 2024-04-21T22:41:28.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.614+0000 7fbb669ee740 1 Processor -- start 2024-04-21T22:41:28.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.614+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x55929300e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.614+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x55929300eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb669ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559293014260 con 0x559293011470 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb669ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559292f27d80 con 0x559293007f70 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb669ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5592930143e0 con 0x559293008890 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb669ee740 10 client.0 _ll_register_callbacks cb 0x559292f642b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb61e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x55929300eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60686/0 (socket says 172.21.15.18:60686) 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 -- 172.21.15.18:0/3625962328 learned_addr learned my addr 172.21.15.18:0/3625962328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb61400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x55929300e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 -- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 msgr2=0x55929300e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x55929300e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 -- 172.21.15.18:0/3625962328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 msgr2=0x55929300eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x55929300eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.615+0000 7fbb60a00640 1 -- 172.21.15.18:0/3625962328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559292d4a7d0 con 0x559293008890 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb60a00640 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009890 tx=0x7fbb48019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226c2c3ccde86598 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb46a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4801e040 con 0x559293008890 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb48019b10 con 0x559293008890 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fbb48019880 con 0x559293008890 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbb48033050 con 0x559293008890 2024-04-21T22:41:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb669ee740 10 client.27385 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5592930204c0 con 0x559293008890 2024-04-21T22:41:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.616+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb48019b10 con 0x559293008890 2024-04-21T22:41:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fbb4800e7f0 con 0x559293008890 2024-04-21T22:41:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 10 client.27385 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 10 client.27385 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:41:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 20 client.27385 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x559293021920 0x559293023d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 4 client.27385 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559292f798e0 con 0x559293021920 2024-04-21T22:41:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.617+0000 7fbb61400640 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x559293021920 0x559293023d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.618+0000 7fbb61400640 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x559293021920 0x559293023d10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4858420d13510f90 server_cookie=5eb4ceca6616cdc7 in_seq=0 out_seq=0 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.618+0000 7fbb46a00640 10 client.27385 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.618+0000 7fbb46a00640 1 -- 172.21.15.18:0/3625962328 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559292f798e0 con 0x559293021920 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.618+0000 7fbb46a00640 10 client.27385 handle_command_reply: tid=0 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.618+0000 7fbb669ee740 1 client.27385 shutdown 2024-04-21T22:41:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 msgr2=0x55929300e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009890 tx=0x7fbb48019660 comp rx=0 tx=0).stop 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 shutdown_connections 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x559293021920 0x559293023d10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x55929300eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929300e9b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 --2- 172.21.15.18:0/3625962328 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x55929300e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb46a00640 0 client.27385 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:41:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 >> 172.21.15.18:0/3625962328 conn(0x5592930026a0 msgr2=0x5592930043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 shutdown_connections 2024-04-21T22:41:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 1 -- 172.21.15.18:0/3625962328 wait complete. 2024-04-21T22:41:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.619+0000 7fbb669ee740 20 client.27385 trim_cache size 0 max 16384 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.634+0000 7fbb669ee740 1 Processor -- start 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 -- start start 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929301d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293001510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b3990 con 0x559293007f70 2024-04-21T22:41:28.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b54d0 con 0x559293011470 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb669ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b4060 con 0x559293008890 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55576/0 (socket says 172.21.15.18:55576) 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61400640 1 -- 172.21.15.18:0/2121307567 learned_addr learned my addr 172.21.15.18:0/2121307567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb60a00640 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929301d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61e00640 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293001510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61400640 1 -- 172.21.15.18:0/2121307567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 msgr2=0x55929301d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.635+0000 7fbb61400640 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929301d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb61400640 1 -- 172.21.15.18:0/2121307567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 msgr2=0x559293001510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb61400640 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293001510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb61400640 1 -- 172.21.15.18:0/2121307567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559292ffcae0 con 0x559293007f70 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb61400640 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c098810 tx=0x7fbb4c0d1e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad658ff098066c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb51c00640 1 -- 172.21.15.18:0/2121307567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c09e070 con 0x559293007f70 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb51c00640 1 -- 172.21.15.18:0/2121307567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb4c09c540 con 0x559293007f70 2024-04-21T22:41:28.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.636+0000 7fbb51c00640 1 -- 172.21.15.18:0/2121307567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0984b0 con 0x559293007f70 2024-04-21T22:41:28.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- 172.21.15.18:0/2121307567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 msgr2=0x559293010b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c098810 tx=0x7fbb4c0d1e00 comp rx=0 tx=0).stop 2024-04-21T22:41:28.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- 172.21.15.18:0/2121307567 shutdown_connections 2024-04-21T22:41:28.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293011470 0x559293001510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x55929301d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 --2- 172.21.15.18:0/2121307567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293007f70 0x559293010b30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- 172.21.15.18:0/2121307567 >> 172.21.15.18:0/2121307567 conn(0x5592930026a0 msgr2=0x559293000e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- 172.21.15.18:0/2121307567 shutdown_connections 2024-04-21T22:41:28.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- 172.21.15.18:0/2121307567 wait complete. 2024-04-21T22:41:28.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 -- start start 2024-04-21T22:41:28.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.637+0000 7fbb669ee740 1 Processor -- start 2024-04-21T22:41:28.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x559293019b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x559293014e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b4e00 con 0x559293011470 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b4730 con 0x559293007f70 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c1b1990 con 0x559293008890 2024-04-21T22:41:28.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb669ee740 10 client.0 _ll_register_callbacks cb 0x7fbb4801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb61e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb61e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55582/0 (socket says 172.21.15.18:55582) 2024-04-21T22:41:28.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb61e00640 1 -- 172.21.15.18:0/271842212 learned_addr learned my addr 172.21.15.18:0/271842212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb61400640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x559293019b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.638+0000 7fbb60a00640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x559293014e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 -- 172.21.15.18:0/271842212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 msgr2=0x559293014e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x559293014e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 -- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 msgr2=0x559293019b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x559293019b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 -- 172.21.15.18:0/271842212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559293015c80 con 0x559293011470 2024-04-21T22:41:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61400640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x559293019b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb61e00640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009ca0 tx=0x7fbb5402c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52c2f2a1aeb7ae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb46a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54053030 con 0x559293011470 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fbb54040460 con 0x559293011470 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.639+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb4c09c540 con 0x559293011470 2024-04-21T22:41:28.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbb54039040 con 0x559293011470 2024-04-21T22:41:28.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 10 client.17262 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559293087e10 con 0x559293011470 2024-04-21T22:41:28.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb4c09c540 con 0x559293011470 2024-04-21T22:41:28.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fbb5405e020 con 0x559293011470 2024-04-21T22:41:28.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 10 client.17262 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 10 client.17262 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 20 client.17262 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5592930885c0 0x55929308a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 4 client.17262 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559292f73c30 con 0x5592930885c0 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.640+0000 7fbb61400640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5592930885c0 0x55929308a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb61400640 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5592930885c0 0x55929308a9e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba54df8f5b94 server_cookie=4df3b2d33cf5008c in_seq=0 out_seq=0 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb46a00640 10 client.17262 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb46a00640 1 -- 172.21.15.18:0/271842212 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559292f73c30 con 0x5592930885c0 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb46a00640 10 client.17262 handle_command_reply: tid=0 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb669ee740 1 client.17262 shutdown 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 msgr2=0x559293015480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.641+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009ca0 tx=0x7fbb5402c100 comp rx=0 tx=0).stop 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 shutdown_connections 2024-04-21T22:41:28.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5592930885c0 0x55929308a9e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559293011470 0x559293015480 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559293008890 0x559293014e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 --2- 172.21.15.18:0/271842212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559293007f70 0x559293019b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 >> 172.21.15.18:0/271842212 conn(0x5592930026a0 msgr2=0x559293001690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb46a00640 0 client.17262 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:41:28.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 shutdown_connections 2024-04-21T22:41:28.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 1 -- 172.21.15.18:0/271842212 wait complete. 2024-04-21T22:41:28.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.642+0000 7fbb669ee740 20 client.17262 trim_cache size 0 max 16384 2024-04-21T22:41:28.654 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:41:28.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 msgr2=0x7fbb400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 0x7fbb400a51c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb54004af0 tx=0x7fbb54004a40 comp rx=0 tx=0).stop 2024-04-21T22:41:28.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 msgr2=0x7fbb5c19e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9f0 tx=0x7fbb4c00edf0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 shutdown_connections 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbb400a2d00 0x7fbb400a51c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb5c10dc00 0x7fbb5c1a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb5c108640 0x7fbb5c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 --2- 172.21.15.18:0/4088408772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb5c107c80 0x7fbb5c19e360 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 >> 172.21.15.18:0/4088408772 conn(0x7fbb5c077550 msgr2=0x7fbb5c0784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 shutdown_connections 2024-04-21T22:41:28.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.643+0000 7fbb62800640 1 -- 172.21.15.18:0/4088408772 wait complete. 2024-04-21T22:41:28.657 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:28 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3347350318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:41:28.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:41:28.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:28 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3347350318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:41:28.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.864+0000 7efca7200640 1 -- 172.21.15.18:0/1547354294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 msgr2=0x7efca010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.864+0000 7efca7200640 1 --2- 172.21.15.18:0/1547354294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca010dfe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efc94009930 tx=0x7efc9402bc20 comp rx=0 tx=0).stop 2024-04-21T22:41:28.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 -- 172.21.15.18:0/1547354294 shutdown_connections 2024-04-21T22:41:28.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 --2- 172.21.15.18:0/1547354294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca01149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 --2- 172.21.15.18:0/1547354294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 --2- 172.21.15.18:0/1547354294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca010dfe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 -- 172.21.15.18:0/1547354294 >> 172.21.15.18:0/1547354294 conn(0x7efca0077550 msgr2=0x7efca0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 -- 172.21.15.18:0/1547354294 shutdown_connections 2024-04-21T22:41:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.865+0000 7efca7200640 1 -- 172.21.15.18:0/1547354294 wait complete. 2024-04-21T22:41:28.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.866+0000 7efca7200640 1 Processor -- start 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.866+0000 7efca7200640 1 -- start start 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca01a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efca0117f90 con 0x7efca0107c80 2024-04-21T22:41:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efca0117e10 con 0x7efca0108640 2024-04-21T22:41:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efca0118110 con 0x7efca010dc00 2024-04-21T22:41:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca019e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55606/0 (socket says 172.21.15.18:55606) 2024-04-21T22:41:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca5e00640 1 -- 172.21.15.18:0/3293506206 learned_addr learned my addr 172.21.15.18:0/3293506206 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca5400640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48760/0 (socket says 172.21.15.18:48760) 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.867+0000 7efca6800640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca01a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 -- 172.21.15.18:0/3293506206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 msgr2=0x7efca01a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca01a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 -- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 msgr2=0x7efca019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 -- 172.21.15.18:0/3293506206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca01a33d0 con 0x7efca0108640 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca5400640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e9f0 tx=0x7efc9000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efc9aa00640 1 -- 172.21.15.18:0/3293506206 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9000ccc0 con 0x7efca0108640 2024-04-21T22:41:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca01a36c0 con 0x7efca0108640 2024-04-21T22:41:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efc9aa00640 1 -- 172.21.15.18:0/3293506206 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc90010910 con 0x7efca0108640 2024-04-21T22:41:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.868+0000 7efc9aa00640 1 -- 172.21.15.18:0/3293506206 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90018960 con 0x7efca0108640 2024-04-21T22:41:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.869+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca01aaf50 con 0x7efca0108640 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 Processor -- start 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 -- start start 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efc9aa00640 1 -- 172.21.15.18:0/3293506206 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efc90010ac0 con 0x7efca0108640 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba34350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8db9983a0 con 0x55c8dba3d470 2024-04-21T22:41:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8db940930 con 0x55c8dba34890 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.872+0000 7efcab584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8db994360 con 0x55c8dba33f70 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48772/0 (socket says 172.21.15.18:48772) 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 -- 172.21.15.18:0/2973799016 learned_addr learned my addr 172.21.15.18:0/2973799016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5400640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55618/0 (socket says 172.21.15.18:55618) 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca6800640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba34350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 -- 172.21.15.18:0/2973799016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 msgr2=0x55c8dba34350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba34350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 -- 172.21.15.18:0/2973799016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 msgr2=0x55c8dba3f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5e00640 1 -- 172.21.15.18:0/2973799016 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8db6ac3f0 con 0x55c8dba34890 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca5400640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.873+0000 7efca6800640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba34350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efca5e00640 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc94036040 tx=0x7efc94005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5407df9651b201cc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efc9aa00640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 0x7efc880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efc8f000640 1 -- 172.21.15.18:0/2973799016 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94045070 con 0x55c8dba34890 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efc8f000640 1 -- 172.21.15.18:0/2973799016 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc9402c640 con 0x55c8dba34890 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efc8f000640 1 -- 172.21.15.18:0/2973799016 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94004ee0 con 0x55c8dba34890 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efc9aa00640 1 -- 172.21.15.18:0/3293506206 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efc900cf850 con 0x7efca0108640 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.874+0000 7efca6800640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 0x7efc880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 -- 172.21.15.18:0/2973799016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 msgr2=0x55c8dba3cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc94036040 tx=0x7efc94005e40 comp rx=0 tx=0).stop 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 -- 172.21.15.18:0/2973799016 shutdown_connections 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba3f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3cf30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 --2- 172.21.15.18:0/2973799016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba34350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 -- 172.21.15.18:0/2973799016 >> 172.21.15.18:0/2973799016 conn(0x55c8dba2e6a0 msgr2=0x55c8dba2ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efca6800640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 0x7efc880a51c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009fd0 tx=0x7efc9c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 -- 172.21.15.18:0/2973799016 shutdown_connections 2024-04-21T22:41:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.875+0000 7efcab584740 1 -- 172.21.15.18:0/2973799016 wait complete. 2024-04-21T22:41:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 -- start start 2024-04-21T22:41:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 Processor -- start 2024-04-21T22:41:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba3d470 0x55c8dba3af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8dba40200 con 0x55c8dba34890 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8db953d80 con 0x55c8dba33f70 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.876+0000 7efcab584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8dba40380 con 0x55c8dba3d470 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efcab584740 10 client.0 _ll_register_callbacks cb 0x55c8db9902b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48782/0 (socket says 172.21.15.18:48782) 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba3d470 0x55c8dba3af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 -- 172.21.15.18:0/3530412775 learned_addr learned my addr 172.21.15.18:0/3530412775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 -- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba3d470 msgr2=0x55c8dba3af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba3d470 0x55c8dba3af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 -- 172.21.15.18:0/3530412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 msgr2=0x55c8dba3aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba3aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 -- 172.21.15.18:0/3530412775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8db7767d0 con 0x55c8dba33f70 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5400640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba3aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efca5e00640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efc94005ab0 tx=0x7efc94009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1887c50c11147448 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.877+0000 7efc83400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94045040 con 0x55c8dba33f70 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efc940052f0 con 0x55c8dba33f70 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9402c640 con 0x55c8dba33f70 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7efc9405a050 con 0x55c8dba33f70 2024-04-21T22:41:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efcab584740 10 client.27344 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.878+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8dba4c4f0 con 0x55c8dba33f70 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc9402c640 con 0x55c8dba33f70 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7efc9404aa70 con 0x55c8dba33f70 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 10 client.27344 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 10 client.27344 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 20 client.27344 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dba4d840 0x55c8dba4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 4 client.27344 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:28.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8db9a58e0 con 0x55c8dba4d840 2024-04-21T22:41:28.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:28 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3347350318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.879+0000 7efca5400640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dba4d840 0x55c8dba4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.880+0000 7efca5400640 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dba4d840 0x55c8dba4fc30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ec4667945372304 server_cookie=a8d24db46a904c7 in_seq=0 out_seq=0 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.880+0000 7efc83400640 10 client.27344 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efc83400640 1 -- 172.21.15.18:0/3530412775 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c8db9a58e0 con 0x55c8dba4d840 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efc83400640 10 client.27344 handle_command_reply: tid=0 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 client.27344 shutdown 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 msgr2=0x55c8dba3a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efc94005ab0 tx=0x7efc94009260 comp rx=0 tx=0).stop 2024-04-21T22:41:28.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 shutdown_connections 2024-04-21T22:41:28.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dba4d840 0x55c8dba4fc30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba3d470 0x55c8dba3af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba3aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efc83400640 0 client.27344 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 --2- 172.21.15.18:0/3530412775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba33f70 0x55c8dba3a4e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 >> 172.21.15.18:0/3530412775 conn(0x55c8dba2e6a0 msgr2=0x55c8dba303f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 shutdown_connections 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 1 -- 172.21.15.18:0/3530412775 wait complete. 2024-04-21T22:41:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.881+0000 7efcab584740 20 client.27344 trim_cache size 0 max 16384 2024-04-21T22:41:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.896+0000 7efcab584740 1 Processor -- start 2024-04-21T22:41:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.896+0000 7efcab584740 1 -- start start 2024-04-21T22:41:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba55260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b3920 con 0x55c8dba3d470 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b5460 con 0x55c8dba34890 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efcab584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b3ff0 con 0x55c8dba33f70 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba55260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60746/0 (socket says 172.21.15.18:60746) 2024-04-21T22:41:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48796/0 (socket says 172.21.15.18:48796) 2024-04-21T22:41:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.897+0000 7efca5e00640 1 -- 172.21.15.18:0/2723164925 learned_addr learned my addr 172.21.15.18:0/2723164925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 -- 172.21.15.18:0/2723164925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 msgr2=0x55c8dba3ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 -- 172.21.15.18:0/2723164925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 msgr2=0x55c8dba55260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba55260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 -- 172.21.15.18:0/2723164925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dba2e1d0 con 0x55c8dba33f70 2024-04-21T22:41:28.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5400640 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efca5e00640 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc94036040 tx=0x7efc94005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49889a27285fd64c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.898+0000 7efc8e600640 1 -- 172.21.15.18:0/2723164925 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94062020 con 0x55c8dba33f70 2024-04-21T22:41:28.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efc8e600640 1 -- 172.21.15.18:0/2723164925 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc940047d0 con 0x55c8dba33f70 2024-04-21T22:41:28.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efc8e600640 1 -- 172.21.15.18:0/2723164925 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94045040 con 0x55c8dba33f70 2024-04-21T22:41:28.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 -- 172.21.15.18:0/2723164925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 msgr2=0x55c8dba490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc94036040 tx=0x7efc94005fd0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 -- 172.21.15.18:0/2723164925 shutdown_connections 2024-04-21T22:41:28.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba3d470 0x55c8dba55260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba34890 0x55c8dba3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 --2- 172.21.15.18:0/2723164925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba490c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 -- 172.21.15.18:0/2723164925 >> 172.21.15.18:0/2723164925 conn(0x55c8dba2e6a0 msgr2=0x55c8dba2d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 -- 172.21.15.18:0/2723164925 shutdown_connections 2024-04-21T22:41:28.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.899+0000 7efcab584740 1 -- 172.21.15.18:0/2723164925 wait complete. 2024-04-21T22:41:28.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 -- start start 2024-04-21T22:41:28.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 Processor -- start 2024-04-21T22:41:28.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba3d470 0x55c8dba40cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b4d90 con 0x55c8dba34890 2024-04-21T22:41:28.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b46c0 con 0x55c8dba3d470 2024-04-21T22:41:28.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efca01b1920 con 0x55c8dba33f70 2024-04-21T22:41:28.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.900+0000 7efcab584740 10 client.0 _ll_register_callbacks cb 0x7efc900d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:28.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55648/0 (socket says 172.21.15.18:55648) 2024-04-21T22:41:28.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5400640 1 -- 172.21.15.18:0/2123400212 learned_addr learned my addr 172.21.15.18:0/2123400212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:28.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca6800640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba3d470 0x55c8dba40cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 -- 172.21.15.18:0/2123400212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba3d470 msgr2=0x55c8dba40cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba3d470 0x55c8dba40cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 -- 172.21.15.18:0/2123400212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 msgr2=0x55c8dba45b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:28.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 -- 172.21.15.18:0/2123400212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dba41520 con 0x55c8dba33f70 2024-04-21T22:41:28.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5400640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:28.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efca5e00640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba45620 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efc9402c200 tx=0x7efc94009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f0f2bd65dd22313 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:28.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.901+0000 7efc83400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:28.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94062040 con 0x55c8dba33f70 2024-04-21T22:41:28.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc940047d0 con 0x55c8dba33f70 2024-04-21T22:41:28.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7efc9402c640 con 0x55c8dba33f70 2024-04-21T22:41:28.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7efc94045040 con 0x55c8dba33f70 2024-04-21T22:41:28.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efcab584740 10 client.27409 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:28.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8dbab37a0 con 0x55c8dba33f70 2024-04-21T22:41:28.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.902+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc940047d0 con 0x55c8dba33f70 2024-04-21T22:41:28.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7efc9403f4e0 con 0x55c8dba33f70 2024-04-21T22:41:28.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 10 client.27409 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:28.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 10 client.27409 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:41:28.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 20 client.27409 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:28.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dbab3cd0 0x55c8dbab60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:28.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 4 client.27409 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:41:28.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8db99fc30 con 0x55c8dbab3cd0 2024-04-21T22:41:28.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efca5400640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dbab3cd0 0x55c8dbab60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:28.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efca5400640 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dbab3cd0 0x55c8dbab60f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1c844325ecc51a6 server_cookie=f74937b6f2b08fb0 in_seq=0 out_seq=0 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.903+0000 7efc83400640 10 client.27409 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efc83400640 1 -- 172.21.15.18:0/2123400212 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8db99fc30 con 0x55c8dbab3cd0 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efc83400640 10 client.27409 handle_command_reply: tid=0 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 client.27409 shutdown 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 msgr2=0x55c8dba45620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba45620 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efc9402c200 tx=0x7efc94009260 comp rx=0 tx=0).stop 2024-04-21T22:41:28.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 shutdown_connections 2024-04-21T22:41:28.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8dbab3cd0 0x55c8dbab60f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8dba3d470 0x55c8dba40cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8dba34890 0x55c8dba45b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efc83400640 0 client.27409 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:41:28.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 --2- 172.21.15.18:0/2123400212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8dba33f70 0x55c8dba45620 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 >> 172.21.15.18:0/2123400212 conn(0x55c8dba2e6a0 msgr2=0x55c8dba2f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 shutdown_connections 2024-04-21T22:41:28.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 1 -- 172.21.15.18:0/2123400212 wait complete. 2024-04-21T22:41:28.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.904+0000 7efcab584740 20 client.27409 trim_cache size 0 max 16384 2024-04-21T22:41:28.926 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:41:28.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 msgr2=0x7efc880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 0x7efc880a51c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009fd0 tx=0x7efc9c009500 comp rx=0 tx=0).stop 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 msgr2=0x7efca019e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efc9000e9f0 tx=0x7efc9000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 shutdown_connections 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7efc880a2d00 0x7efc880a51c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efca010dc00 0x7efca01a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efca0108640 0x7efca019e970 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 --2- 172.21.15.18:0/3293506206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efca0107c80 0x7efca019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:28.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 >> 172.21.15.18:0/3293506206 conn(0x7efca0077550 msgr2=0x7efca0078530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:28.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 shutdown_connections 2024-04-21T22:41:28.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:28.905+0000 7efca7200640 1 -- 172.21.15.18:0/3293506206 wait complete. 2024-04-21T22:41:28.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:41:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 -- 172.21.15.18:0/4071394237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 msgr2=0x7f66c4102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 --2- 172.21.15.18:0/4071394237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4102b00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009900 tx=0x7f66b402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 -- 172.21.15.18:0/4071394237 shutdown_connections 2024-04-21T22:41:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 --2- 172.21.15.18:0/4071394237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 0x7f66c410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 --2- 172.21.15.18:0/4071394237 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 0x7f66c410b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 --2- 172.21.15.18:0/4071394237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4102b00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 -- 172.21.15.18:0/4071394237 >> 172.21.15.18:0/4071394237 conn(0x7f66c40771f0 msgr2=0x7f66c40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 -- 172.21.15.18:0/4071394237 shutdown_connections 2024-04-21T22:41:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.140+0000 7f66c3e00640 1 -- 172.21.15.18:0/4071394237 wait complete. 2024-04-21T22:41:29.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.141+0000 7f66c3e00640 1 Processor -- start 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.141+0000 7f66c3e00640 1 -- start start 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 0x7f66c41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 0x7f66c419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4111920 con 0x7f66c410bb40 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41117a0 con 0x7f66c4103040 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4111aa0 con 0x7f66c4102720 2024-04-21T22:41:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60766/0 (socket says 172.21.15.18:60766) 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c2a00640 1 -- 172.21.15.18:0/1155433738 learned_addr learned my addr 172.21.15.18:0/1155433738 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c3400640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 0x7f66c419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.142+0000 7f66c2000640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 0x7f66c41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 -- 172.21.15.18:0/1155433738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 msgr2=0x7f66c41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 0x7f66c41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 -- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 msgr2=0x7f66c419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 0x7f66c419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 -- 172.21.15.18:0/1155433738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c419ce50 con 0x7f66c4102720 2024-04-21T22:41:29.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c2a00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66bb400640 1 -- 172.21.15.18:0/1155433738 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4042020 con 0x7f66c4102720 2024-04-21T22:41:29.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c419d0e0 con 0x7f66c4102720 2024-04-21T22:41:29.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c41a49d0 con 0x7f66c4102720 2024-04-21T22:41:29.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.143+0000 7f66bb400640 1 -- 172.21.15.18:0/1155433738 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66b40054e0 con 0x7f66c4102720 2024-04-21T22:41:29.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.144+0000 7f66bb400640 1 -- 172.21.15.18:0/1155433738 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4003c90 con 0x7f66c4102720 2024-04-21T22:41:29.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.147+0000 7f66bb400640 1 -- 172.21.15.18:0/1155433738 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f66b4045020 con 0x7f66c4102720 2024-04-21T22:41:29.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.147+0000 7f66cc624740 1 Processor -- start 2024-04-21T22:41:29.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.147+0000 7f66cc624740 1 -- start start 2024-04-21T22:41:29.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.147+0000 7f66cc624740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55380 0x5605dbc55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66cc624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66cc624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc60c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66cc624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5605dbbb53a0 con 0x5605dbc55ca0 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66cc624740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605dbb5d930 con 0x5605dbc55380 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66cc624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5605dbbb1360 con 0x5605dbc5e880 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc60c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55682/0 (socket says 172.21.15.18:55682) 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2a00640 1 -- 172.21.15.18:0/3730095706 learned_addr learned my addr 172.21.15.18:0/3730095706 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c3400640 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55380 0x5605dbc55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 -- 172.21.15.18:0/3730095706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55380 msgr2=0x5605dbc55760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55380 0x5605dbc55760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 -- 172.21.15.18:0/3730095706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 msgr2=0x5605dbc5e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2000640 1 -- 172.21.15.18:0/3730095706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db8c93f0 con 0x5605dbc5e880 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.148+0000 7f66c2a00640 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66c2000640 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc60c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005fd0 tx=0x7f66b0003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a196b6bed6f1ad server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66bb400640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 0x7f66a80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66afe00640 1 -- 172.21.15.18:0/3730095706 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0004b20 con 0x5605dbc5e880 2024-04-21T22:41:29.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66afe00640 1 -- 172.21.15.18:0/3730095706 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66b0004cc0 con 0x5605dbc5e880 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66bb400640 1 -- 172.21.15.18:0/1155433738 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f66b40f0a40 con 0x7f66c4102720 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66afe00640 1 -- 172.21.15.18:0/3730095706 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b00126b0 con 0x5605dbc5e880 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.149+0000 7f66c3400640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 0x7f66a80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 -- 172.21.15.18:0/3730095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 msgr2=0x5605dbc60c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc60c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005fd0 tx=0x7f66b0003e00 comp rx=0 tx=0).stop 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66c3400640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 0x7f66a80a5240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00b6c0 tx=0x7f66bc00b2e0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 -- 172.21.15.18:0/3730095706 shutdown_connections 2024-04-21T22:41:29.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc60c70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55ca0 0x5605dbc5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 --2- 172.21.15.18:0/3730095706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55380 0x5605dbc55760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 -- 172.21.15.18:0/3730095706 >> 172.21.15.18:0/3730095706 conn(0x5605dbc4fab0 msgr2=0x5605dbc4fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 -- 172.21.15.18:0/3730095706 shutdown_connections 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.150+0000 7f66cc624740 1 -- 172.21.15.18:0/3730095706 wait complete. 2024-04-21T22:41:29.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 -- start start 2024-04-21T22:41:29.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 Processor -- start 2024-04-21T22:41:29.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 0x5605dbc5b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc5bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5605dbc61670 con 0x5605dbc5e880 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5605dbb70d80 con 0x5605dbc55ca0 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5605dbc617f0 con 0x5605dbc55380 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.151+0000 7f66cc624740 10 client.0 _ll_register_callbacks cb 0x5605dbbad2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc5bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55688/0 (socket says 172.21.15.18:55688) 2024-04-21T22:41:29.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc5bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48842/0 (socket says 172.21.15.18:48842) 2024-04-21T22:41:29.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 -- 172.21.15.18:0/3710891793 learned_addr learned my addr 172.21.15.18:0/3710891793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c2a00640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 0x5605dbc5b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 -- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 msgr2=0x5605dbc5b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 0x5605dbc5b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 -- 172.21.15.18:0/3710891793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 msgr2=0x5605dbc5bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc5bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 -- 172.21.15.18:0/3710891793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605db9937d0 con 0x5605dbc5e880 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c2a00640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 0x5605dbc5b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66c3400640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f66bc003c20 tx=0x7f66bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a88176faf572e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.152+0000 7f66acc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:41:29.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc01fc80 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f66bc011440 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b0004cc0 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f66bc01fe20 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66cc624740 10 client.17292 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5605dbc6d940 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66b0004cc0 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.153+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f66bc026070 con 0x5605dbc5e880 2024-04-21T22:41:29.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 10 client.17292 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 10 client.17292 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 20 client.17292 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbc6ee50 0x5605dbc71280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 4 client.17292 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605dbbc28e0 con 0x5605dbc6ee50 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66c2a00640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbc6ee50 0x5605dbc71280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66c2a00640 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbc6ee50 0x5605dbc71280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5edf5c5538d1d921 server_cookie=d13fa8700f9b6780 in_seq=0 out_seq=0 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.154+0000 7f66acc00640 10 client.17292 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:41:29.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.155+0000 7f66acc00640 1 -- 172.21.15.18:0/3710891793 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5605dbbc28e0 con 0x5605dbc6ee50 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.155+0000 7f66acc00640 10 client.17292 handle_command_reply: tid=0 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.155+0000 7f66cc624740 1 client.17292 shutdown 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.155+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 msgr2=0x5605dbc5c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.155+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f66bc003c20 tx=0x7f66bc004730 comp rx=0 tx=0).stop 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 shutdown_connections 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbc6ee50 0x5605dbc71280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc5e880 0x5605dbc5c2b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc5bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 --2- 172.21.15.18:0/3710891793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55380 0x5605dbc5b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 >> 172.21.15.18:0/3710891793 conn(0x5605dbc4fab0 msgr2=0x5605dbc51800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66acc00640 0 client.17292 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 shutdown_connections 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 1 -- 172.21.15.18:0/3710891793 wait complete. 2024-04-21T22:41:29.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.156+0000 7f66cc624740 20 client.17292 trim_cache size 0 max 16384 2024-04-21T22:41:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 Processor -- start 2024-04-21T22:41:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 -- start start 2024-04-21T22:41:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc5df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55ca0 0x5605dbc6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41ab170 con 0x5605dbc55380 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41accb0 con 0x5605dbc5e880 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.171+0000 7f66cc624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41ab840 con 0x5605dbc55ca0 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48852/0 (socket says 172.21.15.18:48852) 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 -- 172.21.15.18:0/1794924766 learned_addr learned my addr 172.21.15.18:0/1794924766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c2000640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55ca0 0x5605dbc6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 -- 172.21.15.18:0/1794924766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55ca0 msgr2=0x5605dbc6a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55ca0 0x5605dbc6a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 -- 172.21.15.18:0/1794924766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 msgr2=0x5605dbc5df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c2a00640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc5df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc5df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c3400640 1 -- 172.21.15.18:0/1794924766 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605dbc55ad0 con 0x5605dbc5e880 2024-04-21T22:41:29.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.172+0000 7f66c2a00640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc5df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66c3400640 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f66bc018040 tx=0x7f66bc005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c4a122a94d3e2a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66af400640 1 -- 172.21.15.18:0/1794924766 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc028640 con 0x5605dbc5e880 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66af400640 1 -- 172.21.15.18:0/1794924766 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66bc005520 con 0x5605dbc5e880 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66af400640 1 -- 172.21.15.18:0/1794924766 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc004e50 con 0x5605dbc5e880 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66cc624740 1 -- 172.21.15.18:0/1794924766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 msgr2=0x5605dbc76b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.173+0000 7f66cc624740 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f66bc018040 tx=0x7f66bc005970 comp rx=0 tx=0).stop 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 -- 172.21.15.18:0/1794924766 shutdown_connections 2024-04-21T22:41:29.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc5e880 0x5605dbc76b50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc55ca0 0x5605dbc6a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 --2- 172.21.15.18:0/1794924766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc5df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 -- 172.21.15.18:0/1794924766 >> 172.21.15.18:0/1794924766 conn(0x5605dbc4fab0 msgr2=0x5605dbc56b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 -- 172.21.15.18:0/1794924766 shutdown_connections 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 -- 172.21.15.18:0/1794924766 wait complete. 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 -- start start 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.174+0000 7f66cc624740 1 Processor -- start 2024-04-21T22:41:29.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc66f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc58080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41ac5e0 con 0x5605dbc55380 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41abf10 con 0x5605dbc55ca0 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66c41a9170 con 0x5605dbc5e880 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66cc624740 10 client.0 _ll_register_callbacks cb 0x7f66bc0043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55706/0 (socket says 172.21.15.18:55706) 2024-04-21T22:41:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 -- 172.21.15.18:0/95943283 learned_addr learned my addr 172.21.15.18:0/95943283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2000640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc66f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c3400640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc58080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 -- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 msgr2=0x5605dbc58080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc58080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 -- 172.21.15.18:0/95943283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 msgr2=0x5605dbc66f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc66f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c2a00640 1 -- 172.21.15.18:0/95943283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605dbc588b0 con 0x5605dbc55380 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.175+0000 7f66c3400640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc58080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66c2a00640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f66b40b9960 tx=0x7f66b40f44f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8a075bd7abfb8f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66acc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b40bcdb0 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f66b40bb2e0 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66bc005520 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f66b40bc940 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66cc624740 10 client.17295 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.176+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5605dbcd4f70 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66bc005520 con 0x5605dbc55380 2024-04-21T22:41:29.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f66b40ee380 con 0x5605dbc55380 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 10 client.17295 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 10 client.17295 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 20 client.17295 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbcd56c0 0x5605dbcd7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 4 client.17295 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605dbbbcc30 con 0x5605dbcd56c0 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.177+0000 7f66c2000640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbcd56c0 0x5605dbcd7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.178+0000 7f66c2000640 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbcd56c0 0x5605dbcd7ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=948d8ea760ed56d7 server_cookie=cde3691262843a87 in_seq=0 out_seq=0 2024-04-21T22:41:29.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.178+0000 7f66acc00640 10 client.17295 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.178+0000 7f66acc00640 1 -- 172.21.15.18:0/95943283 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605dbbbcc30 con 0x5605dbcd56c0 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.178+0000 7f66acc00640 10 client.17295 handle_command_reply: tid=0 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.178+0000 7f66cc624740 1 client.17295 shutdown 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 msgr2=0x5605dbc66a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f66b40b9960 tx=0x7f66b40f44f0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 shutdown_connections 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5605dbcd56c0 0x5605dbcd7ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605dbc5e880 0x5605dbc58080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5605dbc55ca0 0x5605dbc66f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 --2- 172.21.15.18:0/95943283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5605dbc55380 0x5605dbc66a40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 >> 172.21.15.18:0/95943283 conn(0x5605dbc4fab0 msgr2=0x5605dbc50ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66acc00640 0 client.17295 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 shutdown_connections 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 1 -- 172.21.15.18:0/95943283 wait complete. 2024-04-21T22:41:29.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.179+0000 7f66cc624740 20 client.17295 trim_cache size 0 max 16384 2024-04-21T22:41:29.188 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:41:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 msgr2=0x7f66a80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 0x7f66a80a5240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00b6c0 tx=0x7f66bc00b2e0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 msgr2=0x7f66c4197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4004430 comp rx=0 tx=0).stop 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 shutdown_connections 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f66a80a2d80 0x7f66a80a5240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66c410bb40 0x7f66c419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c4103040 0x7f66c41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 --2- 172.21.15.18:0/1155433738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c4102720 0x7f66c4197e60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 >> 172.21.15.18:0/1155433738 conn(0x7f66c40771f0 msgr2=0x7f66c40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 shutdown_connections 2024-04-21T22:41:29.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.180+0000 7f66c3e00640 1 -- 172.21.15.18:0/1155433738 wait complete. 2024-04-21T22:41:29.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:41:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 -- 172.21.15.18:0/1776959933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11881075f0 msgr2=0x7f11881079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 --2- 172.21.15.18:0/1776959933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11881075f0 0x7f11881079d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1178009930 tx=0x7f117802bc20 comp rx=0 tx=0).stop 2024-04-21T22:41:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 -- 172.21.15.18:0/1776959933 shutdown_connections 2024-04-21T22:41:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 --2- 172.21.15.18:0/1776959933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f118810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 --2- 172.21.15.18:0/1776959933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1188101530 0x7f11881019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 --2- 172.21.15.18:0/1776959933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11881075f0 0x7f11881079d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.408+0000 7f118d400640 1 -- 172.21.15.18:0/1776959933 >> 172.21.15.18:0/1776959933 conn(0x7f11880fd020 msgr2=0x7f11880ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.409+0000 7f118d400640 1 -- 172.21.15.18:0/1776959933 shutdown_connections 2024-04-21T22:41:29.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.409+0000 7f118d400640 1 -- 172.21.15.18:0/1776959933 wait complete. 2024-04-21T22:41:29.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.410+0000 7f118d400640 1 Processor -- start 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.410+0000 7f118d400640 1 -- start start 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 0x7f11880744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11881118b0 con 0x7f1188101ef0 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1188111730 con 0x7f11881075f0 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118d400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1188111a30 con 0x7f1188101530 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55724/0 (socket says 172.21.15.18:55724) 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187400640 1 -- 172.21.15.18:0/886679681 learned_addr learned my addr 172.21.15.18:0/886679681 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187e00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60814/0 (socket says 172.21.15.18:60814) 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f118ca00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 0x7f11880744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187400640 1 -- 172.21.15.18:0/886679681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 msgr2=0x7f1188073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.411+0000 7f1187400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1187400640 1 -- 172.21.15.18:0/886679681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 msgr2=0x7f11880744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1187400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 0x7f11880744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1187400640 1 -- 172.21.15.18:0/886679681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11881a62f0 con 0x7f1188101ef0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1187e00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f118ca00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 0x7f11880744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1187400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f117400ebc0 tx=0x7f117400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1184c00640 1 -- 172.21.15.18:0/886679681 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174010630 con 0x7f1188101ef0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1184c00640 1 -- 172.21.15.18:0/886679681 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1174010cb0 con 0x7f1188101ef0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11881a65e0 con 0x7f1188101ef0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f1184c00640 1 -- 172.21.15.18:0/886679681 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174018bd0 con 0x7f1188101ef0 2024-04-21T22:41:29.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.412+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11881a6b30 con 0x7f1188101ef0 2024-04-21T22:41:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 Processor -- start 2024-04-21T22:41:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 -- start start 2024-04-21T22:41:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3efd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f08860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3e613a0 con 0x55aeb3f06470 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3e09930 con 0x55aeb3efcf70 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f119163b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3e5d360 con 0x55aeb3efd890 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f1184c00640 1 -- 172.21.15.18:0/886679681 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f11740107d0 con 0x7f1188101ef0 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.416+0000 7f118ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3efd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60824/0 (socket says 172.21.15.18:60824) 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f118ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3efd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48888/0 (socket says 172.21.15.18:48888) 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 -- 172.21.15.18:0/3950837605 learned_addr learned my addr 172.21.15.18:0/3950837605 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187400640 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f08860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 -- 172.21.15.18:0/3950837605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 msgr2=0x55aeb3efd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3efd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 -- 172.21.15.18:0/3950837605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 msgr2=0x55aeb3f08860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f08860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 -- 172.21.15.18:0/3950837605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb3b753f0 con 0x55aeb3efd890 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.417+0000 7f1187e00640 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1178009930 tx=0x7f1178005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab2fde62fac704c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f117d200640 1 -- 172.21.15.18:0/3950837605 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178004a70 con 0x55aeb3efd890 2024-04-21T22:41:29.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f117d200640 1 -- 172.21.15.18:0/3950837605 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1178004c10 con 0x55aeb3efd890 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f117d200640 1 -- 172.21.15.18:0/3950837605 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178005270 con 0x55aeb3efd890 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f1184c00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 0x7f116c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f1184c00640 1 -- 172.21.15.18:0/886679681 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f11740cfac0 con 0x7f1188101ef0 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f118ca00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 0x7f116c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f119163b740 1 -- 172.21.15.18:0/3950837605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 msgr2=0x55aeb3f05f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.418+0000 7f119163b740 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1178009930 tx=0x7f1178005d50 comp rx=0 tx=0).stop 2024-04-21T22:41:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 -- 172.21.15.18:0/3950837605 shutdown_connections 2024-04-21T22:41:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f08860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f05f30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 --2- 172.21.15.18:0/3950837605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3efd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 -- 172.21.15.18:0/3950837605 >> 172.21.15.18:0/3950837605 conn(0x55aeb3ef76a0 msgr2=0x55aeb3ef7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 -- 172.21.15.18:0/3950837605 shutdown_connections 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 -- 172.21.15.18:0/3950837605 wait complete. 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f118ca00640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 0x7f116c0a51c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1180012560 tx=0x7f1180005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.419+0000 7f119163b740 1 -- start start 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 Processor -- start 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f03430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f03eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3f09200 con 0x55aeb3f06470 2024-04-21T22:41:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3e1cd80 con 0x55aeb3efcf70 2024-04-21T22:41:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aeb3f09380 con 0x55aeb3efd890 2024-04-21T22:41:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f119163b740 10 client.0 _ll_register_callbacks cb 0x55aeb3e592b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f1187400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f118ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f03eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f1187400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60838/0 (socket says 172.21.15.18:60838) 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f1187400640 1 -- 172.21.15.18:0/3048399073 learned_addr learned my addr 172.21.15.18:0/3048399073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.420+0000 7f1187e00640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f03430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 -- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 msgr2=0x55aeb3f03430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f03430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 -- 172.21.15.18:0/3048399073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 msgr2=0x55aeb3f03eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f03eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 -- 172.21.15.18:0/3048399073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb3c3f7d0 con 0x55aeb3efd890 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1187400640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f117400eb90 tx=0x7f11740982e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4fe2c97c260dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1171600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174010e60 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1178004c10 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.421+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f11740a4770 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f11740d7040 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f119163b740 10 client.27439 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55aeb3f154c0 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1178004c10 con 0x55aeb3efd890 2024-04-21T22:41:29.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f117409b490 con 0x55aeb3efd890 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f119163b740 10 client.27439 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f119163b740 10 client.27439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.422+0000 7f119163b740 20 client.27439 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.423+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f16860 0x55aeb3f18c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.423+0000 7f119163b740 4 client.27439 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.423+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeb3e6e8e0 con 0x55aeb3f16860 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.423+0000 7f1187e00640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f16860 0x55aeb3f18c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.424+0000 7f1187e00640 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f16860 0x55aeb3f18c50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e6ca6b7a4c2db3 server_cookie=88a0a30e31e1a3bc in_seq=0 out_seq=0 2024-04-21T22:41:29.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.424+0000 7f1171600640 10 client.27439 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f1171600640 1 -- 172.21.15.18:0/3048399073 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aeb3e6e8e0 con 0x55aeb3f16860 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f1171600640 10 client.27439 handle_command_reply: tid=0 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 client.27439 shutdown 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 msgr2=0x55aeb3f03970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f117400eb90 tx=0x7f11740982e0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 shutdown_connections 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f03eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f16860 0x55aeb3f18c50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f03970 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 --2- 172.21.15.18:0/3048399073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f03430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 >> 172.21.15.18:0/3048399073 conn(0x55aeb3ef76a0 msgr2=0x55aeb3ef93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f1171600640 0 client.27439 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 shutdown_connections 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 1 -- 172.21.15.18:0/3048399073 wait complete. 2024-04-21T22:41:29.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.425+0000 7f119163b740 20 client.27439 trim_cache size 0 max 16384 2024-04-21T22:41:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 Processor -- start 2024-04-21T22:41:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 -- start start 2024-04-21T22:41:29.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 0x55aeb3f03cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3f06470 0x55aeb3f1e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11881af540 con 0x55aeb3efd890 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11881b1080 con 0x55aeb3efcf70 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f119163b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11881afc10 con 0x55aeb3f06470 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f1187400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 0x55aeb3f03cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.441+0000 7f1187e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48902/0 (socket says 172.21.15.18:48902) 2024-04-21T22:41:29.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187e00640 1 -- 172.21.15.18:0/3529433326 learned_addr learned my addr 172.21.15.18:0/3529433326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f118ca00640 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3f06470 0x55aeb3f1e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 -- 172.21.15.18:0/3529433326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3f06470 msgr2=0x55aeb3f1e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3f06470 0x55aeb3f1e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 -- 172.21.15.18:0/3529433326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 msgr2=0x55aeb3f120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 -- 172.21.15.18:0/3529433326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeb3f192d0 con 0x55aeb3efd890 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187e00640 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:29.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1187400640 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 0x55aeb3f03cd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f11740984a0 tx=0x7f1174098410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0da636bc004785a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.442+0000 7f1173e00640 1 -- 172.21.15.18:0/3529433326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117409bb80 con 0x55aeb3efd890 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f1173e00640 1 -- 172.21.15.18:0/3529433326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117409b690 con 0x55aeb3efd890 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f1173e00640 1 -- 172.21.15.18:0/3529433326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117409be10 con 0x55aeb3efd890 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 -- 172.21.15.18:0/3529433326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 msgr2=0x55aeb3f03cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 0x55aeb3f03cd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f11740984a0 tx=0x7f1174098410 comp rx=0 tx=0).stop 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 -- 172.21.15.18:0/3529433326 shutdown_connections 2024-04-21T22:41:29.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3f06470 0x55aeb3f1e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3efd890 0x55aeb3f03cd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 --2- 172.21.15.18:0/3529433326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 -- 172.21.15.18:0/3529433326 >> 172.21.15.18:0/3529433326 conn(0x55aeb3ef76a0 msgr2=0x55aeb3ef6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.443+0000 7f119163b740 1 -- 172.21.15.18:0/3529433326 shutdown_connections 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.444+0000 7f119163b740 1 -- 172.21.15.18:0/3529433326 wait complete. 2024-04-21T22:41:29.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.444+0000 7f119163b740 1 -- start start 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.444+0000 7f119163b740 1 Processor -- start 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.444+0000 7f119163b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f0e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f0a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11881b09b0 con 0x55aeb3f06470 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11881b02e0 con 0x55aeb3efcf70 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11881ad540 con 0x55aeb3efd890 2024-04-21T22:41:29.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f119163b740 10 client.0 _ll_register_callbacks cb 0x7f117400eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f0e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60850/0 (socket says 172.21.15.18:60850) 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 -- 172.21.15.18:0/266369398 learned_addr learned my addr 172.21.15.18:0/266369398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f118ca00640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f0a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 -- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 msgr2=0x55aeb3f0e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f0e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 -- 172.21.15.18:0/266369398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 msgr2=0x55aeb3f0a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f0a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.445+0000 7f1187400640 1 -- 172.21.15.18:0/266369398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeb3f0a640 con 0x55aeb3efd890 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1187400640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1174098a10 tx=0x7f117409a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98ccd4ca7c1b8a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1171600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117409be10 con 0x55aeb3efd890 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117409b690 con 0x55aeb3efd890 2024-04-21T22:41:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f117409b110 con 0x55aeb3efd890 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f117409bb80 con 0x55aeb3efd890 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f119163b740 10 client.27445 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55aeb3f0a640 con 0x55aeb3efd890 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.446+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117409b690 con 0x55aeb3efd890 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f1174004a40 con 0x55aeb3efd890 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 10 client.27445 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 10 client.27445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 20 client.27445 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:29.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f7cd50 0x55aeb3f7f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:29.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 4 client.27445 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:41:29.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aeb3e68c30 con 0x55aeb3f7cd50 2024-04-21T22:41:29.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.447+0000 7f1187e00640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f7cd50 0x55aeb3f7f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f1187e00640 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f7cd50 0x55aeb3f7f140 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f1ab46f8839e51 server_cookie=db48395cd83e9d4d in_seq=0 out_seq=0 2024-04-21T22:41:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f1171600640 10 client.27445 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f1171600640 1 -- 172.21.15.18:0/266369398 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aeb3e68c30 con 0x55aeb3f7cd50 2024-04-21T22:41:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f1171600640 10 client.27445 handle_command_reply: tid=0 2024-04-21T22:41:29.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 client.27445 shutdown 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 msgr2=0x55aeb3f09bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1174098a10 tx=0x7f117409a550 comp rx=0 tx=0).stop 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 shutdown_connections 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aeb3f06470 0x55aeb3f0a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aeb3f7cd50 0x55aeb3f7f140 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aeb3efd890 0x55aeb3f09bc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 --2- 172.21.15.18:0/266369398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aeb3efcf70 0x55aeb3f0e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 >> 172.21.15.18:0/266369398 conn(0x55aeb3ef76a0 msgr2=0x55aeb3ef86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f1171600640 0 client.27445 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 shutdown_connections 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 1 -- 172.21.15.18:0/266369398 wait complete. 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.448+0000 7f119163b740 20 client.27445 trim_cache size 0 max 16384 2024-04-21T22:41:29.457 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:41:29.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 msgr2=0x7f116c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 0x7f116c0a51c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1180012560 tx=0x7f1180005f90 comp rx=0 tx=0).stop 2024-04-21T22:41:29.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 msgr2=0x7f1188073f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:29.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f117400ebc0 tx=0x7f117400c6a0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 shutdown_connections 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f116c0a2d00 0x7f116c0a51c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11881075f0 0x7f11880744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1188101ef0 0x7f1188073f80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 --2- 172.21.15.18:0/886679681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1188101530 0x7f1188073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 >> 172.21.15.18:0/886679681 conn(0x7f11880fd020 msgr2=0x7f11880fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 shutdown_connections 2024-04-21T22:41:29.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:29.449+0000 7f118d400640 1 -- 172.21.15.18:0/886679681 wait complete. 2024-04-21T22:41:29.465 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:29 smithi018 ceph-mon[26614]: pgmap v228: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:41:29.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:29 smithi047 ceph-mon[31561]: pgmap v228: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:41:29.789 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:29 smithi081 ceph-mon[31692]: pgmap v228: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:41:30.469 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:41:30.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:41:30.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:41:30.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 -- 172.21.15.18:0/769243111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 msgr2=0x7f86b4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 --2- 172.21.15.18:0/769243111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b4109d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009890 tx=0x7f86a402bb70 comp rx=0 tx=0).stop 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 -- 172.21.15.18:0/769243111 shutdown_connections 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 --2- 172.21.15.18:0/769243111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b41107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 --2- 172.21.15.18:0/769243111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 --2- 172.21.15.18:0/769243111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b4109d10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 -- 172.21.15.18:0/769243111 >> 172.21.15.18:0/769243111 conn(0x7f86b40ff3b0 msgr2=0x7f86b41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 -- 172.21.15.18:0/769243111 shutdown_connections 2024-04-21T22:41:30.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.700+0000 7f86baa00640 1 -- 172.21.15.18:0/769243111 wait complete. 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.701+0000 7f86baa00640 1 Processor -- start 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 -- start start 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4113d10 con 0x7f86b41042e0 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4113b90 con 0x7f86b4103920 2024-04-21T22:41:30.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86baa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4113e90 con 0x7f86b4109930 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48932/0 (socket says 172.21.15.18:48932) 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86b3e00640 1 -- 172.21.15.18:0/2624770617 learned_addr learned my addr 172.21.15.18:0/2624770617 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.702+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 -- 172.21.15.18:0/2624770617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 msgr2=0x7f86b419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 -- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 msgr2=0x7f86b419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 -- 172.21.15.18:0/2624770617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b419f230 con 0x7f86b4103920 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3400640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.703+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86a40057c0 tx=0x7f86a40045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.704+0000 7f86b0c00640 1 -- 172.21.15.18:0/2624770617 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4041020 con 0x7f86b4103920 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.704+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b419f4c0 con 0x7f86b4103920 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.704+0000 7f86b0c00640 1 -- 172.21.15.18:0/2624770617 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a402c9f0 con 0x7f86b4103920 2024-04-21T22:41:30.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.704+0000 7f86b0c00640 1 -- 172.21.15.18:0/2624770617 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4039040 con 0x7f86b4103920 2024-04-21T22:41:30.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.704+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41a6db0 con 0x7f86b4103920 2024-04-21T22:41:30.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.707+0000 7f86bd7cc740 1 Processor -- start 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.707+0000 7f86b0c00640 1 -- 172.21.15.18:0/2624770617 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f86a4044020 con 0x7f86b4103920 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.707+0000 7f86bd7cc740 1 -- start start 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbe040 0x558e99dc66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 0x558e99dc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558e99d1bdf0 con 0x558e99dbe040 2024-04-21T22:41:30.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558e99d21040 con 0x558e99dbd720 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e99cc98c0 con 0x558e99dc6c20 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:48944/0 (socket says 172.21.15.18:48944) 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b8a00640 1 -- 172.21.15.18:0/2683760984 learned_addr learned my addr 172.21.15.18:0/2683760984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbe040 0x558e99dc66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b3400640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 0x558e99dc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b8a00640 1 -- 172.21.15.18:0/2683760984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 msgr2=0x558e99dc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.708+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 0x558e99dc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b8a00640 1 -- 172.21.15.18:0/2683760984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbe040 msgr2=0x558e99dc66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbe040 0x558e99dc66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b8a00640 1 -- 172.21.15.18:0/2683760984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e99afd7e0 con 0x558e99dbd720 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b3400640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 0x558e99dc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009f50 tx=0x7f86ac0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f680aefd1b17c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b0c00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 0x7f86980a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86a9200640 1 -- 172.21.15.18:0/2683760984 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac004d20 con 0x558e99dbd720 2024-04-21T22:41:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86a9200640 1 -- 172.21.15.18:0/2683760984 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac004050 con 0x558e99dbd720 2024-04-21T22:41:30.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86a9200640 1 -- 172.21.15.18:0/2683760984 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac005280 con 0x558e99dbd720 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b0c00640 1 -- 172.21.15.18:0/2624770617 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f86a40f0bb0 con 0x7f86b4103920 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.709+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 0x7f86980a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2683760984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 msgr2=0x558e99dbdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009f50 tx=0x7f86ac0118d0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2683760984 shutdown_connections 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dc6c20 0x558e99dc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbe040 0x558e99dc66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2683760984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dbdb00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2683760984 >> 172.21.15.18:0/2683760984 conn(0x558e99db7e50 msgr2=0x558e99db8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86b3e00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 0x7f86980a51c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x558e99dbd1f0 tx=0x7f86a40dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2683760984 shutdown_connections 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.710+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2683760984 wait complete. 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 -- start start 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 Processor -- start 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dc3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dc4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 0x558e99dc46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558e99cdcd20 con 0x558e99dbd720 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558e99d1d000 con 0x558e99dc6c20 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e99dc9a10 con 0x558e99dbe040 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.711+0000 7f86bd7cc740 10 client.0 _ll_register_callbacks cb 0x558e99d180a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dc3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dc3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55796/0 (socket says 172.21.15.18:55796) 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b8a00640 1 -- 172.21.15.18:0/3027098134 learned_addr learned my addr 172.21.15.18:0/3027098134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dc4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b8a00640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 0x558e99dc46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 -- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 msgr2=0x558e99dc46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 0x558e99dc46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 -- 172.21.15.18:0/3027098134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 msgr2=0x558e99dc3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dc3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 -- 172.21.15.18:0/3027098134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e99b5df70 con 0x558e99dbe040 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b8a00640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 0x558e99dc46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f86b3400640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dc4170 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009530 tx=0x7f86a000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b60aca2625c664 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.712+0000 7f869d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:41:30.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a001a3f0 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f86a001a590 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac004050 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f86a0027050 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f86bd7cc740 10 client.27457 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e999f5170 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.713+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac004050 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f86a0022030 con 0x558e99dbe040 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 10 client.27457 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:30.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 10 client.27457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 20 client.27457 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dd6ee0 0x558e99dd9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 4 client.27457 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:30.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e99d2e580 con 0x558e99dd6ee0 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.714+0000 7f86b8a00640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dd6ee0 0x558e99dd9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.715+0000 7f86b8a00640 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dd6ee0 0x558e99dd9320 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd161554154f8923 server_cookie=1185507ac8b8882e in_seq=0 out_seq=0 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.715+0000 7f869d600640 10 client.27457 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f869d600640 1 -- 172.21.15.18:0/3027098134 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558e99d2e580 con 0x558e99dd6ee0 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f869d600640 10 client.27457 handle_command_reply: tid=0 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 client.27457 shutdown 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 msgr2=0x558e99dc4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dc4170 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009530 tx=0x7f86a000f790 comp rx=0 tx=0).stop 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 shutdown_connections 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dc6c20 0x558e99dc46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dd6ee0 0x558e99dd9320 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dc4170 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/3027098134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dc3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f869d600640 0 client.27457 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 >> 172.21.15.18:0/3027098134 conn(0x558e99db7e50 msgr2=0x558e99db9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 shutdown_connections 2024-04-21T22:41:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 1 -- 172.21.15.18:0/3027098134 wait complete. 2024-04-21T22:41:30.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.716+0000 7f86bd7cc740 20 client.27457 trim_cache size 0 max 16384 2024-04-21T22:41:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 Processor -- start 2024-04-21T22:41:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 -- start start 2024-04-21T22:41:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dd2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99ddec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41af790 con 0x558e99db7e50 2024-04-21T22:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b12d0 con 0x558e99dbd720 2024-04-21T22:41:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.736+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41afe60 con 0x558e99dbe040 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55798/0 (socket says 172.21.15.18:55798) 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 -- 172.21.15.18:0/598244624 learned_addr learned my addr 172.21.15.18:0/598244624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b3400640 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dd2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99ddec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 -- 172.21.15.18:0/598244624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 msgr2=0x558e99ddec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99ddec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 -- 172.21.15.18:0/598244624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 msgr2=0x558e99dd2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dd2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.737+0000 7f86b8a00640 1 -- 172.21.15.18:0/598244624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e99dc2b70 con 0x558e99db7e50 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.738+0000 7f86b8a00640 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009540 tx=0x7f86ac011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706c47c368078493 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.738+0000 7f869fe00640 1 -- 172.21.15.18:0/598244624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac009bf0 con 0x558e99db7e50 2024-04-21T22:41:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.738+0000 7f869fe00640 1 -- 172.21.15.18:0/598244624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac004d80 con 0x558e99db7e50 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.738+0000 7f869fe00640 1 -- 172.21.15.18:0/598244624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac005630 con 0x558e99db7e50 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- 172.21.15.18:0/598244624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 msgr2=0x558e99dc6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009540 tx=0x7f86ac011e10 comp rx=0 tx=0).stop 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- 172.21.15.18:0/598244624 shutdown_connections 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99ddec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99dbd720 0x558e99dd2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/598244624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99db7e50 0x558e99dc6360 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- 172.21.15.18:0/598244624 >> 172.21.15.18:0/598244624 conn(0x558e99dbe790 msgr2=0x558e99dc4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- 172.21.15.18:0/598244624 shutdown_connections 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- 172.21.15.18:0/598244624 wait complete. 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 -- start start 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.739+0000 7f86bd7cc740 1 Processor -- start 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99db7e50 0x558e99dcbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dcc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b0c00 con 0x558e99dbd720 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b0530 con 0x558e99db7e50 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41ad790 con 0x558e99dbe040 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86bd7cc740 10 client.0 _ll_register_callbacks cb 0x7f86a0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86b3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55804/0 (socket says 172.21.15.18:55804) 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86b3400640 1 -- 172.21.15.18:0/2771310471 learned_addr learned my addr 172.21.15.18:0/2771310471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99db7e50 0x558e99dcbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.740+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dcc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 -- 172.21.15.18:0/2771310471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 msgr2=0x558e99dcc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dcc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 -- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99db7e50 msgr2=0x558e99dcbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99db7e50 0x558e99dcbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 -- 172.21.15.18:0/2771310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e99e3d610 con 0x558e99dbd720 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f86b3400640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x558e99dc5200 tx=0x7f86a0019e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3ad2df2ceac9bf server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:30.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f869d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.741+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a002f070 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f86a00195a0 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac004d80 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f86a003b050 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 10 client.17331 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e99e3e930 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac004d80 con 0x558e99dbd720 2024-04-21T22:41:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f86a0022070 con 0x558e99dbd720 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 10 client.17331 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 20 client.17331 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dc6c20 0x558e99e410c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 4 client.17331 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:41:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.742+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558e99d288d0 con 0x558e99dc6c20 2024-04-21T22:41:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.743+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dc6c20 0x558e99e410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.743+0000 7f86b8a00640 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dc6c20 0x558e99e410c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed47a18e3e8e729 server_cookie=3134481e7a052a16 in_seq=0 out_seq=0 2024-04-21T22:41:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.743+0000 7f869d600640 10 client.17331 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f869d600640 1 -- 172.21.15.18:0/2771310471 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558e99d288d0 con 0x558e99dc6c20 2024-04-21T22:41:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f869d600640 10 client.17331 handle_command_reply: tid=0 2024-04-21T22:41:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 client.17331 shutdown 2024-04-21T22:41:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 msgr2=0x558e99dcc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x558e99dc5200 tx=0x7f86a0019e30 comp rx=0 tx=0).stop 2024-04-21T22:41:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 shutdown_connections 2024-04-21T22:41:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558e99dc6c20 0x558e99e410c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e99dbe040 0x558e99dcc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e99dbd720 0x558e99dcc1a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 --2- 172.21.15.18:0/2771310471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558e99db7e50 0x558e99dcbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f869d600640 0 client.17331 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 >> 172.21.15.18:0/2771310471 conn(0x558e99dbe790 msgr2=0x558e99db91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 shutdown_connections 2024-04-21T22:41:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 1 -- 172.21.15.18:0/2771310471 wait complete. 2024-04-21T22:41:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.745+0000 7f86bd7cc740 20 client.17331 trim_cache size 0 max 16384 2024-04-21T22:41:30.757 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:41:30.757 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:41:30.757 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "4c05bf70-f0bc-42e2-911b-94a8069a772c", 2024-04-21T22:41:30.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:41:30.757 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:41:30.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 msgr2=0x7f86980a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 0x7f86980a51c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x558e99dbd1f0 tx=0x7f86a40dd040 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 msgr2=0x7f86b419a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86a40057c0 tx=0x7f86a40045d0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 shutdown_connections 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f86980a2d00 0x7f86980a51c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4109930 0x7f86b419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86b41042e0 0x7f86b419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 --2- 172.21.15.18:0/2624770617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f86b4103920 0x7f86b419a290 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:30.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 >> 172.21.15.18:0/2624770617 conn(0x7f86b40ff3b0 msgr2=0x7f86b40ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 shutdown_connections 2024-04-21T22:41:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:30.746+0000 7f86baa00640 1 -- 172.21.15.18:0/2624770617 wait complete. 2024-04-21T22:41:30.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:41:30.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:41:31.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 -- 172.21.15.18:0/84232550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f822410dd80 msgr2=0x7f82241101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 --2- 172.21.15.18:0/84232550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f822410dd80 0x7f82241101d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f821c009be0 tx=0x7f821c02bf80 comp rx=0 tx=0).stop 2024-04-21T22:41:31.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 -- 172.21.15.18:0/84232550 shutdown_connections 2024-04-21T22:41:31.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 --2- 172.21.15.18:0/84232550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f822410dd80 0x7f82241101d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 --2- 172.21.15.18:0/84232550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8224074490 0x7f822410d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 --2- 172.21.15.18:0/84232550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8224073b70 0x7f8224073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 -- 172.21.15.18:0/84232550 >> 172.21.15.18:0/84232550 conn(0x7f82240fd090 msgr2=0x7f82240ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 -- 172.21.15.18:0/84232550 shutdown_connections 2024-04-21T22:41:31.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.004+0000 7f8229c00640 1 -- 172.21.15.18:0/84232550 wait complete. 2024-04-21T22:41:31.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.005+0000 7f8229c00640 1 Processor -- start 2024-04-21T22:41:31.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.005+0000 7f8229c00640 1 -- start start 2024-04-21T22:41:31.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8224074490 0x7f822419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f822410dd80 0x7f822419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8224113b70 con 0x7f8224074490 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82241139f0 con 0x7f822410dd80 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8224113cf0 con 0x7f8224073b70 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8223e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8223e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60918/0 (socket says 172.21.15.18:60918) 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8223e00640 1 -- 172.21.15.18:0/3373371687 learned_addr learned my addr 172.21.15.18:0/3373371687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.006+0000 7f8229200640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f822410dd80 0x7f822419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 -- 172.21.15.18:0/3373371687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f822410dd80 msgr2=0x7f822419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f822410dd80 0x7f822419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 -- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8224074490 msgr2=0x7f822419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8224074490 0x7f822419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 -- 172.21.15.18:0/3373371687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822419efd0 con 0x7f8224073b70 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8223e00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9c0 tx=0x7f821400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8221600640 1 -- 172.21.15.18:0/3373371687 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821400ccc0 con 0x7f8224073b70 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822419f2c0 con 0x7f8224073b70 2024-04-21T22:41:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8221600640 1 -- 172.21.15.18:0/3373371687 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8214005500 con 0x7f8224073b70 2024-04-21T22:41:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.007+0000 7f8221600640 1 -- 172.21.15.18:0/3373371687 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214010430 con 0x7f8224073b70 2024-04-21T22:41:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.008+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a6b50 con 0x7f8224073b70 2024-04-21T22:41:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.012+0000 7f8221600640 1 -- 172.21.15.18:0/3373371687 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f82140046c0 con 0x7f8224073b70 2024-04-21T22:41:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.012+0000 7f822dfad740 1 Processor -- start 2024-04-21T22:41:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 -- start start 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6072a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d60753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5fcd410 con 0x55a2d6072fb0 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5f757e0 con 0x55a2d606a3d0 2024-04-21T22:41:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f822dfad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5fc93d0 con 0x55a2d6069ab0 2024-04-21T22:41:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f8223e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f8229200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f8223e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6072a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49018/0 (socket says 172.21.15.18:49018) 2024-04-21T22:41:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.013+0000 7f8223e00640 1 -- 172.21.15.18:0/1087718587 learned_addr learned my addr 172.21.15.18:0/1087718587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f821be00640 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d60753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f8229200640 1 -- 172.21.15.18:0/1087718587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 msgr2=0x55a2d6072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f8229200640 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6072a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f8229200640 1 -- 172.21.15.18:0/1087718587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 msgr2=0x55a2d60753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f8229200640 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d60753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.014+0000 7f8229200640 1 -- 172.21.15.18:0/1087718587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d5dab7d0 con 0x55a2d6069ab0 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8229200640 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6069e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f821c02c4c0 tx=0x7f821c033480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd497f0bd345b36a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8221600640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 0x7f82080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8219600640 1 -- 172.21.15.18:0/1087718587 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c043070 con 0x55a2d6069ab0 2024-04-21T22:41:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8221600640 1 -- 172.21.15.18:0/3373371687 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f82140cf890 con 0x7f8224073b70 2024-04-21T22:41:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8219600640 1 -- 172.21.15.18:0/1087718587 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c02c920 con 0x55a2d6069ab0 2024-04-21T22:41:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8219600640 1 -- 172.21.15.18:0/1087718587 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0044a0 con 0x55a2d6069ab0 2024-04-21T22:41:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.015+0000 7f8223e00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 0x7f82080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 -- 172.21.15.18:0/1087718587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 msgr2=0x55a2d6069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6069e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f821c02c4c0 tx=0x7f821c033480 comp rx=0 tx=0).stop 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f8223e00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 0x7f82080a5240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f821409bcb0 tx=0x7f82140d5530 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 -- 172.21.15.18:0/1087718587 shutdown_connections 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d60753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 --2- 172.21.15.18:0/1087718587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6069e90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.016+0000 7f822dfad740 1 -- 172.21.15.18:0/1087718587 >> 172.21.15.18:0/1087718587 conn(0x55a2d60641e0 msgr2=0x55a2d60645c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.017+0000 7f822dfad740 1 -- 172.21.15.18:0/1087718587 shutdown_connections 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.017+0000 7f822dfad740 1 -- 172.21.15.18:0/1087718587 wait complete. 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.017+0000 7f822dfad740 1 -- start start 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.017+0000 7f822dfad740 1 Processor -- start 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d6070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a2d6075d40 con 0x55a2d6072fb0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5f88c40 con 0x55a2d606a3d0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a2d6075ec0 con 0x55a2d6069ab0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f822dfad740 10 client.0 _ll_register_callbacks cb 0x55a2d5f88630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.018+0000 7f821be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f8229200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49030/0 (socket says 172.21.15.18:49030) 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 -- 172.21.15.18:0/3933348357 learned_addr learned my addr 172.21.15.18:0/3933348357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f8229200640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d6070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 -- 172.21.15.18:0/3933348357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 msgr2=0x55a2d6070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 -- 172.21.15.18:0/3933348357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 msgr2=0x55a2d6070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d6070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 -- 172.21.15.18:0/3933348357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d5ce13f0 con 0x55a2d606a3d0 2024-04-21T22:41:31.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f8229200640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d6070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:31.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f821be00640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f820c011480 tx=0x7f820c011940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17541152c3541e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.019+0000 7f8212000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c005220 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c02c920 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f820c0053c0 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f820c0055c0 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f822dfad740 10 client.27413 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a2d5ca10f0 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.020+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c02c920 con 0x55a2d606a3d0 2024-04-21T22:41:31.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f820c022430 con 0x55a2d606a3d0 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 10 client.27413 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 10 client.27413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 20 client.27413 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60833f0 0x55a2d6085850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 4 client.27413 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2d5fe0c40 con 0x55a2d60833f0 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.021+0000 7f8229200640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60833f0 0x55a2d6085850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.022+0000 7f8229200640 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60833f0 0x55a2d6085850 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d37ed0d087867733 server_cookie=ac0c69e415c90593 in_seq=0 out_seq=0 2024-04-21T22:41:31.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.022+0000 7f8212000640 10 client.27413 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.022+0000 7f8212000640 1 -- 172.21.15.18:0/3933348357 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a2d5fe0c40 con 0x55a2d60833f0 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.022+0000 7f8212000640 10 client.27413 handle_command_reply: tid=0 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.022+0000 7f822dfad740 1 client.27413 shutdown 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 msgr2=0x55a2d6070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f820c011480 tx=0x7f820c011940 comp rx=0 tx=0).stop 2024-04-21T22:41:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 shutdown_connections 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6072fb0 0x55a2d6070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d6070540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60833f0 0x55a2d6085850 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 --2- 172.21.15.18:0/3933348357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6069ab0 0x55a2d6070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 >> 172.21.15.18:0/3933348357 conn(0x55a2d60641e0 msgr2=0x55a2d6063440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f8212000640 0 client.27413 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 shutdown_connections 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 1 -- 172.21.15.18:0/3933348357 wait complete. 2024-04-21T22:41:31.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.023+0000 7f822dfad740 20 client.27413 trim_cache size 0 max 16384 2024-04-21T22:41:31.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 Processor -- start 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 -- start start 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 0x55a2d607ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82241af600 con 0x55a2d606a3d0 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b1140 con 0x55a2d6069ab0 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.048+0000 7f822dfad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82241afcd0 con 0x55a2d6072fb0 2024-04-21T22:41:31.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:49034/0 (socket says 172.21.15.18:49034) 2024-04-21T22:41:31.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 -- 172.21.15.18:0/3379856429 learned_addr learned my addr 172.21.15.18:0/3379856429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:31.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f821be00640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 0x55a2d607ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 -- 172.21.15.18:0/3379856429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 msgr2=0x55a2d606b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 -- 172.21.15.18:0/3379856429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 msgr2=0x55a2d607ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 0x55a2d607ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 -- 172.21.15.18:0/3379856429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d605f2d0 con 0x55a2d6069ab0 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f821be00640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 0x55a2d607ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.049+0000 7f8229200640 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f821c006010 tx=0x7f821c041040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5db5f83b34c9dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.050+0000 7f8218c00640 1 -- 172.21.15.18:0/3379856429 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c043040 con 0x55a2d6069ab0 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.050+0000 7f8218c00640 1 -- 172.21.15.18:0/3379856429 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c02c920 con 0x55a2d6069ab0 2024-04-21T22:41:31.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.050+0000 7f8218c00640 1 -- 172.21.15.18:0/3379856429 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0044a0 con 0x55a2d6069ab0 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.050+0000 7f822dfad740 1 -- 172.21.15.18:0/3379856429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 msgr2=0x55a2d6072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.050+0000 7f822dfad740 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f821c006010 tx=0x7f821c041040 comp rx=0 tx=0).stop 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 -- 172.21.15.18:0/3379856429 shutdown_connections 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d606a3d0 0x55a2d607ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 --2- 172.21.15.18:0/3379856429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d6069ab0 0x55a2d6072730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 -- 172.21.15.18:0/3379856429 >> 172.21.15.18:0/3379856429 conn(0x55a2d60641e0 msgr2=0x55a2d606a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 -- 172.21.15.18:0/3379856429 shutdown_connections 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 -- 172.21.15.18:0/3379856429 wait complete. 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.051+0000 7f822dfad740 1 -- start start 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 Processor -- start 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d607b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b0a70 con 0x55a2d6069ab0 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b03a0 con 0x55a2d606a3d0 2024-04-21T22:41:31.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82241ad600 con 0x55a2d6072fb0 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f822dfad740 10 client.0 _ll_register_callbacks cb 0x7f820c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f8229200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.052+0000 7f8229200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55854/0 (socket says 172.21.15.18:55854) 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f8229200640 1 -- 172.21.15.18:0/4118474837 learned_addr learned my addr 172.21.15.18:0/4118474837 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f8229200640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d607b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 -- 172.21.15.18:0/4118474837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 msgr2=0x55a2d606c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 -- 172.21.15.18:0/4118474837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 msgr2=0x55a2d607b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f821be00640 1 -- 172.21.15.18:0/4118474837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d606d030 con 0x55a2d606a3d0 2024-04-21T22:41:31.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.053+0000 7f8229200640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:41:31.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f821be00640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d607b650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f820c022920 tx=0x7f820c004690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09927e5cbb3b15b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:41:31.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f8212000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:41:31.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c022430 con 0x55a2d606a3d0 2024-04-21T22:41:31.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f820c0225d0 con 0x55a2d606a3d0 2024-04-21T22:41:31.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c02c920 con 0x55a2d606a3d0 2024-04-21T22:41:31.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f820c012780 con 0x55a2d606a3d0 2024-04-21T22:41:31.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f822dfad740 10 client.27419 fetch_fsmap learned FSMap version 38 2024-04-21T22:41:31.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.054+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a2d60e9560 con 0x55a2d606a3d0 2024-04-21T22:41:31.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c02c920 con 0x55a2d606a3d0 2024-04-21T22:41:31.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f820c01a9e0 con 0x55a2d606a3d0 2024-04-21T22:41:31.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 10 client.27419 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:41:31.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 10 client.27419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 20 client.27419 populate_metadata read hostname 'smithi018' 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60e9bc0 0x55a2d60ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 4 client.27419 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.055+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a2d5fda950 con 0x55a2d60e9bc0 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f8229200640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60e9bc0 0x55a2d60ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f8212000640 10 client.27419 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f8229200640 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60e9bc0 0x55a2d60ebfe0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d23ce0d46ca92311 server_cookie=a485d7258bcb174a in_seq=0 out_seq=0 2024-04-21T22:41:31.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f8212000640 1 -- 172.21.15.18:0/4118474837 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a2d5fda950 con 0x55a2d60e9bc0 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f8212000640 10 client.27419 handle_command_reply: tid=0 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.056+0000 7f822dfad740 1 client.27419 shutdown 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 msgr2=0x55a2d607b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d607b650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f820c022920 tx=0x7f820c004690 comp rx=0 tx=0).stop 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 shutdown_connections 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55a2d60e9bc0 0x55a2d60ebfe0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2d6072fb0 0x55a2d606c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a2d606a3d0 0x55a2d607b650 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 --2- 172.21.15.18:0/4118474837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a2d6069ab0 0x55a2d607b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f8212000640 0 client.27419 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 >> 172.21.15.18:0/4118474837 conn(0x55a2d60641e0 msgr2=0x55a2d606b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 shutdown_connections 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 1 -- 172.21.15.18:0/4118474837 wait complete. 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.057+0000 7f822dfad740 20 client.27419 trim_cache size 0 max 16384 2024-04-21T22:41:31.065 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "4c05bf70-f0bc-42e2-911b-94a8069a772c": { 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "4c05bf70-f0bc-42e2-911b-94a8069a772c", 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:41:31.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:41:31.067 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:41:31.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 msgr2=0x7f82080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 0x7f82080a5240 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f821409bcb0 tx=0x7f82140d5530 comp rx=0 tx=0).stop 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 msgr2=0x7f822419a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9c0 tx=0x7f821400ee80 comp rx=0 tx=0).stop 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 shutdown_connections 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f82080a2d80 0x7f82080a5240 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f822410dd80 0x7f822419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8224074490 0x7f822419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 --2- 172.21.15.18:0/3373371687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8224073b70 0x7f822419a030 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:41:31.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.058+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 >> 172.21.15.18:0/3373371687 conn(0x7f82240fd090 msgr2=0x7f82240fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:41:31.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.059+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 shutdown_connections 2024-04-21T22:41:31.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:41:31.059+0000 7f8229c00640 1 -- 172.21.15.18:0/3373371687 wait complete. 2024-04-21T22:41:31.082 INFO:tasks.cephfs.filesystem:scrub status for tag:4c05bf70-f0bc-42e2-911b-94a8069a772c - {'path': '/', 'tag': '4c05bf70-f0bc-42e2-911b-94a8069a772c', 'options': 'recursive,force'} 2024-04-21T22:41:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: pgmap v229: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:41:31.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:31.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:31 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: pgmap v229: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:31.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:31.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:31 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: pgmap v229: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:41:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:31.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:31 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:32 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:32.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:32 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:32 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:41:32.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:32 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:32 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:32 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:32 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:32 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:41:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:32 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:32 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:32 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:32.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:32 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:32 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:41:32.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:32 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:32.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:32 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:41:33.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:33 smithi047 ceph-mon[31561]: pgmap v230: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:33.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:33 smithi018 ceph-mon[26614]: pgmap v230: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:33 smithi081 ceph-mon[31692]: pgmap v230: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:35.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:35 smithi018 ceph-mon[26614]: pgmap v231: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:35 smithi081 ceph-mon[31692]: pgmap v231: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:35.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:35 smithi047 ceph-mon[31561]: pgmap v231: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:37.746 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:37 smithi047 ceph-mon[31561]: pgmap v232: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:37 smithi018 ceph-mon[26614]: pgmap v232: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:37 smithi081 ceph-mon[31692]: pgmap v232: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:39.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:39 smithi018 ceph-mon[26614]: pgmap v233: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:39.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:39 smithi081 ceph-mon[31692]: pgmap v233: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:39.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:39 smithi047 ceph-mon[31561]: pgmap v233: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:41 smithi018 ceph-mon[26614]: pgmap v234: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:41.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:41 smithi081 ceph-mon[31692]: pgmap v234: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:41.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:41 smithi047 ceph-mon[31561]: pgmap v234: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:43.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:43 smithi018 ceph-mon[26614]: pgmap v235: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:43.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:43 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:43.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:43 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:43.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:43 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:43 smithi081 ceph-mon[31692]: pgmap v235: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:43 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:43 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:43.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:43 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:43.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:43 smithi047 ceph-mon[31561]: pgmap v235: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:41:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:43 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:43 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:43 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:44.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:44 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:44.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:44 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:41:44.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:44 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:44.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:44 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:41:44.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:44 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:44.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:44 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:41:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:45 smithi018 ceph-mon[26614]: pgmap v236: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:45 smithi081 ceph-mon[31692]: pgmap v236: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:45.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:45 smithi047 ceph-mon[31561]: pgmap v236: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:41:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:47 smithi018 ceph-mon[26614]: pgmap v237: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:47 smithi081 ceph-mon[31692]: pgmap v237: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:47.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:47 smithi047 ceph-mon[31561]: pgmap v237: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:49 smithi018 ceph-mon[26614]: pgmap v238: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:49 smithi081 ceph-mon[31692]: pgmap v238: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:49.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:49 smithi047 ceph-mon[31561]: pgmap v238: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:51.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:51 smithi018 ceph-mon[26614]: pgmap v239: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:51 smithi081 ceph-mon[31692]: pgmap v239: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:51 smithi047 ceph-mon[31561]: pgmap v239: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:53 smithi018 ceph-mon[26614]: pgmap v240: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:53 smithi081 ceph-mon[31692]: pgmap v240: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:53.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:53 smithi047 ceph-mon[31561]: pgmap v240: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:41:55.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:55 smithi018 ceph-mon[26614]: pgmap v241: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:55.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:55 smithi081 ceph-mon[31692]: pgmap v241: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:55.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:55 smithi047 ceph-mon[31561]: pgmap v241: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:57 smithi018 ceph-mon[26614]: pgmap v242: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:41:57.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:57 smithi081 ceph-mon[31692]: pgmap v242: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:41:57.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:57 smithi047 ceph-mon[31561]: pgmap v242: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:41:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:41:59 smithi018 ceph-mon[26614]: pgmap v243: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:59.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:41:59 smithi081 ceph-mon[31692]: pgmap v243: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:41:59.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:41:59 smithi047 ceph-mon[31561]: pgmap v243: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:01.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:42:01.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:42:01.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 -- 172.21.15.18:0/3614239833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac103040 msgr2=0x7fd7ac10b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 --2- 172.21.15.18:0/3614239833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac103040 0x7fd7ac10b520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd794009ca0 tx=0x7fd79402c180 comp rx=0 tx=0).stop 2024-04-21T22:42:01.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 -- 172.21.15.18:0/3614239833 shutdown_connections 2024-04-21T22:42:01.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 --2- 172.21.15.18:0/3614239833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 --2- 172.21.15.18:0/3614239833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac103040 0x7fd7ac10b520 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 --2- 172.21.15.18:0/3614239833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac102720 0x7fd7ac102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 -- 172.21.15.18:0/3614239833 >> 172.21.15.18:0/3614239833 conn(0x7fd7ac0771f0 msgr2=0x7fd7ac0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 -- 172.21.15.18:0/3614239833 shutdown_connections 2024-04-21T22:42:01.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.315+0000 7fd7b1400640 1 -- 172.21.15.18:0/3614239833 wait complete. 2024-04-21T22:42:01.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 Processor -- start 2024-04-21T22:42:01.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 -- start start 2024-04-21T22:42:01.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac102720 0x7fd7ac19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac103040 0x7fd7ac19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1118d0 con 0x7fd7ac10bb40 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac111750 con 0x7fd7ac102720 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.316+0000 7fd7b1400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac111a50 con 0x7fd7ac103040 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42352/0 (socket says 172.21.15.18:42352) 2024-04-21T22:42:01.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 -- 172.21.15.18:0/413239300 learned_addr learned my addr 172.21.15.18:0/413239300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7abe00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac102720 0x7fd7ac19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7ab400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac103040 0x7fd7ac19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 -- 172.21.15.18:0/413239300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac103040 msgr2=0x7fd7ac19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac103040 0x7fd7ac19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 -- 172.21.15.18:0/413239300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac102720 msgr2=0x7fd7ac19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac102720 0x7fd7ac19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.317+0000 7fd7b0a00640 1 -- 172.21.15.18:0/413239300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac19f050 con 0x7fd7ac10bb40 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7b0a00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400d750 tx=0x7fd7a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7a8c00640 1 -- 172.21.15.18:0/413239300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4017070 con 0x7fd7ac10bb40 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7a8c00640 1 -- 172.21.15.18:0/413239300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a4005500 con 0x7fd7ac10bb40 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac19f340 con 0x7fd7ac10bb40 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7a8c00640 1 -- 172.21.15.18:0/413239300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4004d90 con 0x7fd7ac10bb40 2024-04-21T22:42:01.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.318+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac1a6bd0 con 0x7fd7ac10bb40 2024-04-21T22:42:01.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.321+0000 7fd7b581d740 1 Processor -- start 2024-04-21T22:42:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.321+0000 7fd7a8c00640 1 -- 172.21.15.18:0/413239300 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd7a4004f30 con 0x7fd7ac10bb40 2024-04-21T22:42:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 -- start start 2024-04-21T22:42:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d58e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 0x55aa25d61a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aa25cbc410 con 0x55aa25d61fb0 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa25c647e0 con 0x55aa25d593d0 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7b581d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa25cb83d0 con 0x55aa25d58ab0 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42362/0 (socket says 172.21.15.18:42362) 2024-04-21T22:42:01.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7ab400640 1 -- 172.21.15.18:0/4128052429 learned_addr learned my addr 172.21.15.18:0/4128052429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7abe00640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 0x55aa25d61a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.322+0000 7fd7ab400640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d58e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7a8c00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 0x7fd78c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 -- 172.21.15.18:0/4128052429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 msgr2=0x55aa25d58e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d58e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 -- 172.21.15.18:0/4128052429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 msgr2=0x55aa25d61a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 0x55aa25d61a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 -- 172.21.15.18:0/4128052429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa25a9a7d0 con 0x55aa25d61fb0 2024-04-21T22:42:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7abe00640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 0x55aa25d61a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7a8c00640 1 -- 172.21.15.18:0/413239300 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fd7a40ceda0 con 0x7fd7ac10bb40 2024-04-21T22:42:01.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7b0a00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 0x7fd78c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.323+0000 7fd7ab400640 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd79402c790 tx=0x7fd79402e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe1085a1e56925 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7a1200640 1 -- 172.21.15.18:0/4128052429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79404a070 con 0x55aa25d61fb0 2024-04-21T22:42:01.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7a1200640 1 -- 172.21.15.18:0/4128052429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd794032d50 con 0x55aa25d61fb0 2024-04-21T22:42:01.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7a1200640 1 -- 172.21.15.18:0/4128052429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794039040 con 0x55aa25d61fb0 2024-04-21T22:42:01.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7b581d740 1 -- 172.21.15.18:0/4128052429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 msgr2=0x55aa25d643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7b581d740 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd79402c790 tx=0x7fd79402e040 comp rx=0 tx=0).stop 2024-04-21T22:42:01.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.324+0000 7fd7b0a00640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 0x7fd78c0a51c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4097740 tx=0x7fd7a4005bb0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 -- 172.21.15.18:0/4128052429 shutdown_connections 2024-04-21T22:42:01.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d643a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d593d0 0x55aa25d61a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 --2- 172.21.15.18:0/4128052429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d58e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 -- 172.21.15.18:0/4128052429 >> 172.21.15.18:0/4128052429 conn(0x55aa25d531e0 msgr2=0x55aa25d535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 -- 172.21.15.18:0/4128052429 shutdown_connections 2024-04-21T22:42:01.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 -- 172.21.15.18:0/4128052429 wait complete. 2024-04-21T22:42:01.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 -- start start 2024-04-21T22:42:01.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.325+0000 7fd7b581d740 1 Processor -- start 2024-04-21T22:42:01.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d58ab0 0x55aa25d5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aa25d64d40 con 0x55aa25d58ab0 2024-04-21T22:42:01.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55aa25c77c40 con 0x55aa25d61fb0 2024-04-21T22:42:01.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa25d64ec0 con 0x55aa25d593d0 2024-04-21T22:42:01.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7b581d740 10 client.0 _ll_register_callbacks cb 0x55aa25c77630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:01.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d58ab0 0x55aa25d5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60312/0 (socket says 172.21.15.18:60312) 2024-04-21T22:42:01.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7abe00640 1 -- 172.21.15.18:0/3356193469 learned_addr learned my addr 172.21.15.18:0/3356193469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.326+0000 7fd7ab400640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 -- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 msgr2=0x55aa25d5fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 -- 172.21.15.18:0/3356193469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d58ab0 msgr2=0x55aa25d5f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d58ab0 0x55aa25d5f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 -- 172.21.15.18:0/3356193469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa259d03f0 con 0x55aa25d593d0 2024-04-21T22:42:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7ab400640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7abe00640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd79c012740 tx=0x7fd79c012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5648e3603d6d7a80 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd799600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c004030 con 0x55aa25d593d0 2024-04-21T22:42:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd794032d50 con 0x55aa25d593d0 2024-04-21T22:42:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.327+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fd79c0041d0 con 0x55aa25d593d0 2024-04-21T22:42:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd79c0043d0 con 0x55aa25d593d0 2024-04-21T22:42:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 10 client.27493 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:01.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55aa259900f0 con 0x55aa25d593d0 2024-04-21T22:42:01.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd794032d50 con 0x55aa25d593d0 2024-04-21T22:42:01.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fd79c023070 con 0x55aa25d593d0 2024-04-21T22:42:01.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 10 client.27493 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:01.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 10 client.27493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 20 client.27493 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25d723c0 0x55aa25d747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 4 client.27493 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.328+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa25ccfc40 con 0x55aa25d723c0 2024-04-21T22:42:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.329+0000 7fd7ab400640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25d723c0 0x55aa25d747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.329+0000 7fd7ab400640 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25d723c0 0x55aa25d747b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2733738aa8fff10b server_cookie=455e6efa60175004 in_seq=0 out_seq=0 2024-04-21T22:42:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.329+0000 7fd799600640 10 client.27493 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.330+0000 7fd799600640 1 -- 172.21.15.18:0/3356193469 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa25ccfc40 con 0x55aa25d723c0 2024-04-21T22:42:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.330+0000 7fd799600640 10 client.27493 handle_command_reply: tid=0 2024-04-21T22:42:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 client.27493 shutdown 2024-04-21T22:42:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 msgr2=0x55aa25d5f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd79c012740 tx=0x7fd79c012c00 comp rx=0 tx=0).stop 2024-04-21T22:42:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 shutdown_connections 2024-04-21T22:42:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25d723c0 0x55aa25d747b0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d5f5d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 --2- 172.21.15.18:0/3356193469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d58ab0 0x55aa25d5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 >> 172.21.15.18:0/3356193469 conn(0x55aa25d531e0 msgr2=0x55aa25d54f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd799600640 0 client.27493 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 shutdown_connections 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 1 -- 172.21.15.18:0/3356193469 wait complete. 2024-04-21T22:42:01.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.331+0000 7fd7b581d740 20 client.27493 trim_cache size 0 max 16384 2024-04-21T22:42:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 Processor -- start 2024-04-21T22:42:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 -- start start 2024-04-21T22:42:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d58ab0 0x55aa25d617c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1af610 con 0x55aa25d61fb0 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1b1150 con 0x55aa25d58ab0 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.351+0000 7fd7b581d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1afce0 con 0x55aa25d593d0 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60316/0 (socket says 172.21.15.18:60316) 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 -- 172.21.15.18:0/1009725286 learned_addr learned my addr 172.21.15.18:0/1009725286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7ab400640 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d58ab0 0x55aa25d617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7ab400640 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 -- 172.21.15.18:0/1009725286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d58ab0 msgr2=0x55aa25d617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d58ab0 0x55aa25d617c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 -- 172.21.15.18:0/1009725286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 msgr2=0x55aa25d535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.352+0000 7fd7abe00640 1 -- 172.21.15.18:0/1009725286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa25d64710 con 0x55aa25d593d0 2024-04-21T22:42:01.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.353+0000 7fd7abe00640 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c00 tx=0x7fd79c0096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c71696601bf575 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.353+0000 7fd79be00640 1 -- 172.21.15.18:0/1009725286 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c029070 con 0x55aa25d593d0 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.353+0000 7fd79be00640 1 -- 172.21.15.18:0/1009725286 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd79c012e50 con 0x55aa25d593d0 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.353+0000 7fd79be00640 1 -- 172.21.15.18:0/1009725286 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c00fd90 con 0x55aa25d593d0 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- 172.21.15.18:0/1009725286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 msgr2=0x55aa25d6dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000c00 tx=0x7fd79c0096c0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- 172.21.15.18:0/1009725286 shutdown_connections 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d61fb0 0x55aa25d535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d593d0 0x55aa25d6dc30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 --2- 172.21.15.18:0/1009725286 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d58ab0 0x55aa25d617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- 172.21.15.18:0/1009725286 >> 172.21.15.18:0/1009725286 conn(0x55aa25d531e0 msgr2=0x55aa25d51bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- 172.21.15.18:0/1009725286 shutdown_connections 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- 172.21.15.18:0/1009725286 wait complete. 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 -- start start 2024-04-21T22:42:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.354+0000 7fd7b581d740 1 Processor -- start 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d6a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1b0a80 con 0x55aa25d593d0 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1b03b0 con 0x55aa25d61fb0 2024-04-21T22:42:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1ad610 con 0x55aa25d58ab0 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7b581d740 10 client.0 _ll_register_callbacks cb 0x7fd79c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42370/0 (socket says 172.21.15.18:42370) 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7abe00640 1 -- 172.21.15.18:0/2697355811 learned_addr learned my addr 172.21.15.18:0/2697355811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7ab400640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d6a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.355+0000 7fd7ab400640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 -- 172.21.15.18:0/2697355811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 msgr2=0x55aa25d6a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d6a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 -- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 msgr2=0x55aa25d5bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 -- 172.21.15.18:0/2697355811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa25d5c660 con 0x55aa25d593d0 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7abe00640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a010 tx=0x7fd79c004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3105ea3a32921859 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd799600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c029040 con 0x55aa25d593d0 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fd79c018070 con 0x55aa25d593d0 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.356+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd79c012e50 con 0x55aa25d593d0 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd79c03a050 con 0x55aa25d593d0 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 10 client.17364 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55aa25dd8870 con 0x55aa25d593d0 2024-04-21T22:42:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd79c012e50 con 0x55aa25d593d0 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fd79c023070 con 0x55aa25d593d0 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 10 client.17364 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 10 client.17364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 20 client.17364 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25dd8e70 0x55aa25ddb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 4 client.17364 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:42:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.357+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa25cc9950 con 0x55aa25dd8e70 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd7ab400640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25dd8e70 0x55aa25ddb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd7ab400640 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25dd8e70 0x55aa25ddb290 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92960262a29779e0 server_cookie=a2bc18854aed565 in_seq=0 out_seq=0 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd799600640 10 client.17364 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd799600640 1 -- 172.21.15.18:0/2697355811 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55aa25cc9950 con 0x55aa25dd8e70 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd799600640 10 client.17364 handle_command_reply: tid=0 2024-04-21T22:42:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.358+0000 7fd7b581d740 1 client.17364 shutdown 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 msgr2=0x55aa25d5b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00a010 tx=0x7fd79c004130 comp rx=0 tx=0).stop 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 shutdown_connections 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55aa25d61fb0 0x55aa25d5bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa25d593d0 0x55aa25d5b9e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55aa25dd8e70 0x55aa25ddb290 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 --2- 172.21.15.18:0/2697355811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa25d58ab0 0x55aa25d6a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 >> 172.21.15.18:0/2697355811 conn(0x55aa25d531e0 msgr2=0x55aa25d52440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd799600640 0 client.17364 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:01.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 shutdown_connections 2024-04-21T22:42:01.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 1 -- 172.21.15.18:0/2697355811 wait complete. 2024-04-21T22:42:01.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.359+0000 7fd7b581d740 20 client.17364 trim_cache size 0 max 16384 2024-04-21T22:42:01.372 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:01.373 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:42:01.373 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:42:01.373 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 msgr2=0x7fd78c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 0x7fd78c0a51c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4097740 tx=0x7fd7a4005bb0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 msgr2=0x7fd7ac19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400d750 tx=0x7fd7a400dc10 comp rx=0 tx=0).stop 2024-04-21T22:42:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 shutdown_connections 2024-04-21T22:42:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd78c0a2d00 0x7fd78c0a51c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7ac10bb40 0x7fd7ac19e920 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7ac103040 0x7fd7ac19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 --2- 172.21.15.18:0/413239300 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7ac102720 0x7fd7ac19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 >> 172.21.15.18:0/413239300 conn(0x7fd7ac0771f0 msgr2=0x7fd7ac0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 shutdown_connections 2024-04-21T22:42:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.360+0000 7fd7b1400640 1 -- 172.21.15.18:0/413239300 wait complete. 2024-04-21T22:42:01.379 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:42:01.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:42:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 -- 172.21.15.18:0/2931569989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4109910 msgr2=0x7fbce4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 --2- 172.21.15.18:0/2931569989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4109910 0x7fbce4109cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009930 tx=0x7fbcd402bc20 comp rx=0 tx=0).stop 2024-04-21T22:42:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 -- 172.21.15.18:0/2931569989 shutdown_connections 2024-04-21T22:42:01.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 --2- 172.21.15.18:0/2931569989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce41042c0 0x7fbce41107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 --2- 172.21.15.18:0/2931569989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4103900 0x7fbce4103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 --2- 172.21.15.18:0/2931569989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce4109910 0x7fbce4109cf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 -- 172.21.15.18:0/2931569989 >> 172.21.15.18:0/2931569989 conn(0x7fbce40ff3f0 msgr2=0x7fbce4101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 -- 172.21.15.18:0/2931569989 shutdown_connections 2024-04-21T22:42:01.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.597+0000 7fbce9600640 1 -- 172.21.15.18:0/2931569989 wait complete. 2024-04-21T22:42:01.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.598+0000 7fbce9600640 1 Processor -- start 2024-04-21T22:42:01.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.598+0000 7fbce9600640 1 -- start start 2024-04-21T22:42:01.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 0x7fbce419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 0x7fbce419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4113d70 con 0x7fbce4103900 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4113bf0 con 0x7fbce4109910 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce9600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4113ef0 con 0x7fbce41042c0 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 0x7fbce419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42386/0 (socket says 172.21.15.18:42386) 2024-04-21T22:42:01.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 0x7fbce419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce2a00640 1 -- 172.21.15.18:0/705329742 learned_addr learned my addr 172.21.15.18:0/705329742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.599+0000 7fbce2a00640 1 -- 172.21.15.18:0/705329742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 msgr2=0x7fbce419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2a00640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 0x7fbce419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2a00640 1 -- 172.21.15.18:0/705329742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 msgr2=0x7fbce419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2a00640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 0x7fbce419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2a00640 1 -- 172.21.15.18:0/705329742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce419f1f0 con 0x7fbce4103900 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce3400640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 0x7fbce419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2000640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 0x7fbce419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:01.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce2a00640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ab0 tx=0x7fbcd4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4043020 con 0x7fbce4103900 2024-04-21T22:42:01.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce419f480 con 0x7fbce4103900 2024-04-21T22:42:01.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd4005000 con 0x7fbce4103900 2024-04-21T22:42:01.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.600+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41a6d70 con 0x7fbce4103900 2024-04-21T22:42:01.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.601+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4003a20 con 0x7fbce4103900 2024-04-21T22:42:01.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.602+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce4068a40 con 0x7fbce4103900 2024-04-21T22:42:01.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.604+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fbcd4046020 con 0x7fbce4103900 2024-04-21T22:42:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.606+0000 7fbcdb400640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 0x7fbcc80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.606+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fbcd40f1770 con 0x7fbce4103900 2024-04-21T22:42:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.606+0000 7fbce2000640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 0x7fbcc80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:01.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.607+0000 7fbce2000640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 0x7fbcc80a51c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbce4101a80 tx=0x7fbcd0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.608+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fbcd404d020 con 0x7fbce4103900 2024-04-21T22:42:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:01 smithi018 ceph-mon[26614]: pgmap v244: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:01.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.857+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbce419b550 con 0x7fbce4103900 2024-04-21T22:42:01.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.858+0000 7fbcdb400640 1 -- 172.21.15.18:0/705329742 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7fbce419b550 con 0x7fbce4103900 2024-04-21T22:42:01.860 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:42:01.860 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:42:01.860 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.861+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 msgr2=0x7fbcc80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.861+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 0x7fbcc80a51c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbce4101a80 tx=0x7fbcd0005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.861+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 msgr2=0x7fbce419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.861+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ab0 tx=0x7fbcd4005e80 comp rx=0 tx=0).stop 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 shutdown_connections 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbcc80a2d00 0x7fbcc80a51c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbce4109910 0x7fbce419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce41042c0 0x7fbce419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 --2- 172.21.15.18:0/705329742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbce4103900 0x7fbce419a250 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 >> 172.21.15.18:0/705329742 conn(0x7fbce40ff3f0 msgr2=0x7fbce40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 shutdown_connections 2024-04-21T22:42:01.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:01.862+0000 7fbce9600640 1 -- 172.21.15.18:0/705329742 wait complete. 2024-04-21T22:42:01.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:42:01.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:01 smithi081 ceph-mon[31692]: pgmap v244: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:01 smithi047 ceph-mon[31561]: pgmap v244: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 -- 172.21.15.18:0/731144396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 msgr2=0x7f8d4410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 --2- 172.21.15.18:0/731144396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4410e3b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009cd0 tx=0x7f8d3c02c0e0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 -- 172.21.15.18:0/731144396 shutdown_connections 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 --2- 172.21.15.18:0/731144396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4410e3b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 --2- 172.21.15.18:0/731144396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d44101530 0x7f8d441019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 --2- 172.21.15.18:0/731144396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d441075f0 0x7f8d441079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 -- 172.21.15.18:0/731144396 >> 172.21.15.18:0/731144396 conn(0x7f8d440fd020 msgr2=0x7f8d440ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 -- 172.21.15.18:0/731144396 shutdown_connections 2024-04-21T22:42:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.103+0000 7f8d48e00640 1 -- 172.21.15.18:0/731144396 wait complete. 2024-04-21T22:42:02.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.104+0000 7f8d48e00640 1 Processor -- start 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 -- start start 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d44101530 0x7f8d44199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441118d0 con 0x7f8d441075f0 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d44111750 con 0x7f8d44101530 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d48e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d44111a50 con 0x7f8d44101ef0 2024-04-21T22:42:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d43e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d43400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d44101530 0x7f8d44199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d43e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42398/0 (socket says 172.21.15.18:42398) 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d43e00640 1 -- 172.21.15.18:0/284855873 learned_addr learned my addr 172.21.15.18:0/284855873 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.105+0000 7f8d42a00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 -- 172.21.15.18:0/284855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 msgr2=0x7f8d4419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 -- 172.21.15.18:0/284855873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d44101530 msgr2=0x7f8d44199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d44101530 0x7f8d44199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 -- 172.21.15.18:0/284855873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4419efc0 con 0x7f8d441075f0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d43e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009ca0 tx=0x7f8d3c0324a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d3be00640 1 -- 172.21.15.18:0/284855873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c039040 con 0x7f8d441075f0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4419f250 con 0x7f8d441075f0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d3be00640 1 -- 172.21.15.18:0/284855873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3c044070 con 0x7f8d441075f0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.106+0000 7f8d3be00640 1 -- 172.21.15.18:0/284855873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c004280 con 0x7f8d441075f0 2024-04-21T22:42:02.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.107+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d441a6b40 con 0x7f8d441075f0 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.110+0000 7f8d4d06b740 1 Processor -- start 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.110+0000 7f8d3be00640 1 -- 172.21.15.18:0/284855873 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8d3c003970 con 0x7f8d441075f0 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.110+0000 7f8d4d06b740 1 -- start start 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.110+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e81af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f4e7763a0 con 0x559f4e812890 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f4e71e930 con 0x559f4e81b470 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f4e772360 con 0x559f4e811f70 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d43400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e81af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60364/0 (socket says 172.21.15.18:60364) 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 -- 172.21.15.18:0/4058058143 learned_addr learned my addr 172.21.15.18:0/4058058143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 -- 172.21.15.18:0/4058058143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 msgr2=0x559f4e81d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 -- 172.21.15.18:0/4058058143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 msgr2=0x559f4e81af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e81af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d42a00640 1 -- 172.21.15.18:0/4058058143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f4e48a3f0 con 0x559f4e811f70 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.111+0000 7f8d43400640 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e81af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d3be00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 0x7f8d280a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d42a00640 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8d30012790 tx=0x7f8d30009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5339d1aea50443e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d3be00640 1 -- 172.21.15.18:0/284855873 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f8d3c0f1830 con 0x7f8d441075f0 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d43400640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 0x7f8d280a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d38c00640 1 -- 172.21.15.18:0/4058058143 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30012d10 con 0x559f4e811f70 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d38c00640 1 -- 172.21.15.18:0/4058058143 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d30010cb0 con 0x559f4e811f70 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.112+0000 7f8d38c00640 1 -- 172.21.15.18:0/4058058143 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3001eaa0 con 0x559f4e811f70 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 -- 172.21.15.18:0/4058058143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 msgr2=0x559f4e812350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d43400640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 0x7f8d280a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x559f4e811a40 tx=0x7f8d34005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8d30012790 tx=0x7f8d30009700 comp rx=0 tx=0).stop 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 -- 172.21.15.18:0/4058058143 shutdown_connections 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e81af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/4058058143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e812350 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 -- 172.21.15.18:0/4058058143 >> 172.21.15.18:0/4058058143 conn(0x559f4e80c6a0 msgr2=0x559f4e80ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 -- 172.21.15.18:0/4058058143 shutdown_connections 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.113+0000 7f8d4d06b740 1 -- 172.21.15.18:0/4058058143 wait complete. 2024-04-21T22:42:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 -- start start 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 Processor -- start 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e811f70 0x559f4e818530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e818fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f4e81e260 con 0x559f4e812890 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f4e731d80 con 0x559f4e811f70 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.114+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f4e81e3e0 con 0x559f4e81b470 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d4d06b740 10 client.0 _ll_register_callbacks cb 0x559f4e76e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e811f70 0x559f4e818530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e818fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42416/0 (socket says 172.21.15.18:42416) 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d42a00640 1 -- 172.21.15.18:0/678679303 learned_addr learned my addr 172.21.15.18:0/678679303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 -- 172.21.15.18:0/678679303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e811f70 msgr2=0x559f4e818530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e811f70 0x559f4e818530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 -- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 msgr2=0x559f4e818a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 -- 172.21.15.18:0/678679303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f4e5547d0 con 0x559f4e81b470 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d42a00640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.115+0000 7f8d43e00640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e818fb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ef000 tx=0x7f8d3c0bdcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817b879fa420b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d2d600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c032790 con 0x559f4e81b470 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d30010cb0 con 0x559f4e81b470 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f8d3c0be030 con 0x559f4e81b470 2024-04-21T22:42:02.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8d3c0be4d0 con 0x559f4e81b470 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d4d06b740 10 client.27517 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f4e81e310 con 0x559f4e81b470 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.116+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d30010cb0 con 0x559f4e81b470 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8d3c0d3020 con 0x559f4e81b470 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 10 client.27517 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 10 client.27517 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 20 client.27517 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e82ba40 0x559f4e82de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 4 client.27517 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:02.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f4e7838e0 con 0x559f4e82ba40 2024-04-21T22:42:02.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.117+0000 7f8d43400640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e82ba40 0x559f4e82de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.118+0000 7f8d43400640 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e82ba40 0x559f4e82de30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90e38a19d17399ae server_cookie=9902ec33b9b94b87 in_seq=0 out_seq=0 2024-04-21T22:42:02.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.118+0000 7f8d2d600640 10 client.27517 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:02.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.118+0000 7f8d2d600640 1 -- 172.21.15.18:0/678679303 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559f4e7838e0 con 0x559f4e82ba40 2024-04-21T22:42:02.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.118+0000 7f8d2d600640 10 client.27517 handle_command_reply: tid=0 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.118+0000 7f8d4d06b740 1 client.27517 shutdown 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 msgr2=0x559f4e818fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e818fb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ef000 tx=0x7f8d3c0bdcd0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 shutdown_connections 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e82ba40 0x559f4e82de30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e818fb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e818a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/678679303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e811f70 0x559f4e818530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 >> 172.21.15.18:0/678679303 conn(0x559f4e80c6a0 msgr2=0x559f4e80e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d2d600640 0 client.27517 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:02.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 shutdown_connections 2024-04-21T22:42:02.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 1 -- 172.21.15.18:0/678679303 wait complete. 2024-04-21T22:42:02.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.119+0000 7f8d4d06b740 20 client.27517 trim_cache size 0 max 16384 2024-04-21T22:42:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 Processor -- start 2024-04-21T22:42:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 -- start start 2024-04-21T22:42:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 0x559f4e818dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e80b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441af510 con 0x559f4e811f70 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441b1050 con 0x559f4e812890 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.134+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441afbe0 con 0x559f4e81b470 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42428/0 (socket says 172.21.15.18:42428) 2024-04-21T22:42:02.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 -- 172.21.15.18:0/3898454411 learned_addr learned my addr 172.21.15.18:0/3898454411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43e00640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e80b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d42a00640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 0x559f4e818dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 -- 172.21.15.18:0/3898454411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 msgr2=0x559f4e80b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e80b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 -- 172.21.15.18:0/3898454411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 msgr2=0x559f4e818dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 0x559f4e818dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 -- 172.21.15.18:0/3898454411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f4e82e480 con 0x559f4e811f70 2024-04-21T22:42:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d42a00640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 0x559f4e818dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.135+0000 7f8d43400640 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009fd0 tx=0x7f8d3401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcb8e9092cc7b9d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d2fe00640 1 -- 172.21.15.18:0/3898454411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34033070 con 0x559f4e811f70 2024-04-21T22:42:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d2fe00640 1 -- 172.21.15.18:0/3898454411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3402d160 con 0x559f4e811f70 2024-04-21T22:42:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d2fe00640 1 -- 172.21.15.18:0/3898454411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3401d7f0 con 0x559f4e811f70 2024-04-21T22:42:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 -- 172.21.15.18:0/3898454411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 msgr2=0x559f4e827150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009fd0 tx=0x7f8d3401b000 comp rx=0 tx=0).stop 2024-04-21T22:42:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 -- 172.21.15.18:0/3898454411 shutdown_connections 2024-04-21T22:42:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e81b470 0x559f4e80b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e812890 0x559f4e818dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/3898454411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e811f70 0x559f4e827150 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.136+0000 7f8d4d06b740 1 -- 172.21.15.18:0/3898454411 >> 172.21.15.18:0/3898454411 conn(0x559f4e80c6a0 msgr2=0x559f4e80ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.137+0000 7f8d4d06b740 1 -- 172.21.15.18:0/3898454411 shutdown_connections 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.137+0000 7f8d4d06b740 1 -- 172.21.15.18:0/3898454411 wait complete. 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.137+0000 7f8d4d06b740 1 -- start start 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.137+0000 7f8d4d06b740 1 Processor -- start 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e823b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441b0980 con 0x559f4e812890 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441b02b0 con 0x559f4e81b470 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441ad510 con 0x559f4e811f70 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d4d06b740 10 client.0 _ll_register_callbacks cb 0x7f8d3c0ba0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d42a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e823b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60378/0 (socket says 172.21.15.18:60378) 2024-04-21T22:42:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43400640 1 -- 172.21.15.18:0/422234666 learned_addr learned my addr 172.21.15.18:0/422234666 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 -- 172.21.15.18:0/422234666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 msgr2=0x559f4e8235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 -- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 msgr2=0x559f4e823b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e823b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43e00640 1 -- 172.21.15.18:0/422234666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f4e81e140 con 0x559f4e81b470 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.138+0000 7f8d43400640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d43e00640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81eb20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ba7a0 tx=0x7f8d3c0327c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41da9584e3b34ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d2d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0bd730 con 0x559f4e81b470 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d3402d160 con 0x559f4e81b470 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f8d3c0c6740 con 0x559f4e81b470 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8d3c0c2180 con 0x559f4e81b470 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d4d06b740 10 client.27458 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.139+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f4e8919a0 con 0x559f4e81b470 2024-04-21T22:42:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d3402d160 con 0x559f4e81b470 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8d3c0d3040 con 0x559f4e81b470 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 10 client.27458 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 10 client.27458 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 20 client.27458 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e891fb0 0x559f4e8943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 4 client.27458 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f4e77dc30 con 0x559f4e891fb0 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.140+0000 7f8d43400640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e891fb0 0x559f4e8943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d43400640 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e891fb0 0x559f4e8943d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bc77b9b63ea6e0c4 server_cookie=907c1ca4468ad4cd in_seq=0 out_seq=0 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d2d600640 10 client.27458 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d2d600640 1 -- 172.21.15.18:0/422234666 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f4e77dc30 con 0x559f4e891fb0 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d2d600640 10 client.27458 handle_command_reply: tid=0 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 client.27458 shutdown 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 msgr2=0x559f4e81eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81eb20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ba7a0 tx=0x7f8d3c0327c0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 shutdown_connections 2024-04-21T22:42:02.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f4e891fb0 0x559f4e8943d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f4e81b470 0x559f4e81eb20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f4e812890 0x559f4e823b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d2d600640 0 client.27458 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 --2- 172.21.15.18:0/422234666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f4e811f70 0x559f4e8235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.141+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 >> 172.21.15.18:0/422234666 conn(0x559f4e80c6a0 msgr2=0x559f4e80b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 shutdown_connections 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d4d06b740 1 -- 172.21.15.18:0/422234666 wait complete. 2024-04-21T22:42:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d4d06b740 20 client.27458 trim_cache size 0 max 16384 2024-04-21T22:42:02.151 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 msgr2=0x7f8d280a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 0x7f8d280a51c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x559f4e811a40 tx=0x7f8d34005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 msgr2=0x7f8d4419e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009ca0 tx=0x7f8d3c0324a0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 shutdown_connections 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8d280a2d00 0x7f8d280a51c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d441075f0 0x7f8d4419e890 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d44101ef0 0x7f8d4419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 --2- 172.21.15.18:0/284855873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d44101530 0x7f8d44199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.142+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 >> 172.21.15.18:0/284855873 conn(0x7f8d440fd020 msgr2=0x7f8d440fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.143+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 shutdown_connections 2024-04-21T22:42:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.143+0000 7f8d48e00640 1 -- 172.21.15.18:0/284855873 wait complete. 2024-04-21T22:42:02.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:42:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 -- 172.21.15.18:0/3696813596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab841032d0 msgr2=0x7fab8410b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 --2- 172.21.15.18:0/3696813596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab841032d0 0x7fab8410b7b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fab70009900 tx=0x7fab7002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 -- 172.21.15.18:0/3696813596 shutdown_connections 2024-04-21T22:42:02.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 --2- 172.21.15.18:0/3696813596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab8410bd80 0x7fab8410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 --2- 172.21.15.18:0/3696813596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab841032d0 0x7fab8410b7b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 --2- 172.21.15.18:0/3696813596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 -- 172.21.15.18:0/3696813596 >> 172.21.15.18:0/3696813596 conn(0x7fab84077730 msgr2=0x7fab84077b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 -- 172.21.15.18:0/3696813596 shutdown_connections 2024-04-21T22:42:02.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.376+0000 7fab8c600640 1 -- 172.21.15.18:0/3696813596 wait complete. 2024-04-21T22:42:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 Processor -- start 2024-04-21T22:42:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 -- start start 2024-04-21T22:42:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab841032d0 0x7fab84103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab8410bd80 0x7fab841042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111b10 con 0x7fab841029b0 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111990 con 0x7fab8410bd80 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.377+0000 7fab8c600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab84111c90 con 0x7fab841032d0 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42464/0 (socket says 172.21.15.18:42464) 2024-04-21T22:42:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 -- 172.21.15.18:0/806294609 learned_addr learned my addr 172.21.15.18:0/806294609 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab8a600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab8410bd80 0x7fab841042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89200640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab841032d0 0x7fab84103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 -- 172.21.15.18:0/806294609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab841032d0 msgr2=0x7fab84103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab841032d0 0x7fab84103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 -- 172.21.15.18:0/806294609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab8410bd80 msgr2=0x7fab841042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab8410bd80 0x7fab841042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.378+0000 7fab89c00640 1 -- 172.21.15.18:0/806294609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab841aa8c0 con 0x7fab841029b0 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab89c00640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab7800ea20 tx=0x7fab7800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab82000640 1 -- 172.21.15.18:0/806294609 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7800ccc0 con 0x7fab841029b0 2024-04-21T22:42:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab82000640 1 -- 172.21.15.18:0/806294609 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7800ce60 con 0x7fab841029b0 2024-04-21T22:42:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab82000640 1 -- 172.21.15.18:0/806294609 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab780187e0 con 0x7fab841029b0 2024-04-21T22:42:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab841aabb0 con 0x7fab841029b0 2024-04-21T22:42:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.379+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab841ab0d0 con 0x7fab841029b0 2024-04-21T22:42:02.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.382+0000 7fab8f1eb740 1 Processor -- start 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.382+0000 7fab8f1eb740 1 -- start start 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab82000640 1 -- 172.21.15.18:0/806294609 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fab78010430 con 0x7fab841029b0 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafdfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafe2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5654caf3b3a0 con 0x5654cafe0280 2024-04-21T22:42:02.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5654caee3930 con 0x5654cafd6d80 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654caf37360 con 0x5654cafd76a0 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab89200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafe2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36398/0 (socket says 172.21.15.18:36398) 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab8a600640 1 -- 172.21.15.18:0/1108482101 learned_addr learned my addr 172.21.15.18:0/1108482101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.383+0000 7fab89c00640 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafdfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 -- 172.21.15.18:0/1108482101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 msgr2=0x5654cafdfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafdfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 -- 172.21.15.18:0/1108482101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 msgr2=0x5654cafe2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafe2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 -- 172.21.15.18:0/1108482101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654cac4f3f0 con 0x5654cafd6d80 2024-04-21T22:42:02.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab89c00640 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafdfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:02.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab8a600640 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009f40 tx=0x7fab7c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5baa17690926e3f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab76a00640 1 -- 172.21.15.18:0/1108482101 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c004d20 con 0x5654cafd6d80 2024-04-21T22:42:02.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab76a00640 1 -- 172.21.15.18:0/1108482101 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c004050 con 0x5654cafd6d80 2024-04-21T22:42:02.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.384+0000 7fab76a00640 1 -- 172.21.15.18:0/1108482101 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c005280 con 0x5654cafd6d80 2024-04-21T22:42:02.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab82000640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 0x7fab6c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab82000640 1 -- 172.21.15.18:0/806294609 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fab780cf7e0 con 0x7fab841029b0 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab89c00640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 0x7fab6c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 -- 172.21.15.18:0/1108482101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 msgr2=0x5654cafd7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009f40 tx=0x7fab7c0118d0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 -- 172.21.15.18:0/1108482101 shutdown_connections 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafe2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafdfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/1108482101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd7160 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 -- 172.21.15.18:0/1108482101 >> 172.21.15.18:0/1108482101 conn(0x5654cafd14b0 msgr2=0x5654cafd1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.385+0000 7fab8f1eb740 1 -- 172.21.15.18:0/1108482101 shutdown_connections 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.386+0000 7fab8f1eb740 1 -- 172.21.15.18:0/1108482101 wait complete. 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.386+0000 7fab89c00640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 0x7fab6c0a51c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fab780ccfb0 tx=0x7fab78010e50 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.386+0000 7fab8f1eb740 1 -- start start 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.386+0000 7fab8f1eb740 1 Processor -- start 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafddd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5654cafe3070 con 0x5654cafe0280 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5654caef6d80 con 0x5654cafd76a0 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5654cafe31f0 con 0x5654cafd6d80 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8f1eb740 10 client.0 _ll_register_callbacks cb 0x5654caf332b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36406/0 (socket says 172.21.15.18:36406) 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab89200640 1 -- 172.21.15.18:0/2782077421 learned_addr learned my addr 172.21.15.18:0/2782077421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.387+0000 7fab8a600640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 -- 172.21.15.18:0/2782077421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 msgr2=0x5654cafdd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 -- 172.21.15.18:0/2782077421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 msgr2=0x5654cafddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 -- 172.21.15.18:0/2782077421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654cad197d0 con 0x5654cafd76a0 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab89200640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fab7002c210 tx=0x7fab7002ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cef05d44d1524e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab6b400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:02.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.388+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70004450 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab7c004050 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fab700046c0 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fab700048c0 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab8f1eb740 10 client.27470 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5654cafef390 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c004050 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.389+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fab70046070 con 0x5654cafd76a0 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 10 client.27470 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 10 client.27470 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 20 client.27470 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654caff07a0 0x5654caff2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 4 client.27470 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654caf488e0 con 0x5654caff07a0 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8a600640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654caff07a0 0x5654caff2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab8a600640 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654caff07a0 0x5654caff2bc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4c3ebaffa3d42129 server_cookie=c0e3545415e0b2a0 in_seq=0 out_seq=0 2024-04-21T22:42:02.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.390+0000 7fab6b400640 10 client.27470 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:02.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.391+0000 7fab6b400640 1 -- 172.21.15.18:0/2782077421 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5654caf488e0 con 0x5654caff07a0 2024-04-21T22:42:02.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.391+0000 7fab6b400640 10 client.27470 handle_command_reply: tid=0 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.391+0000 7fab8f1eb740 1 client.27470 shutdown 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.391+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 msgr2=0x5654cafdd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.391+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fab7002c210 tx=0x7fab7002ceb0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 shutdown_connections 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654caff07a0 0x5654caff2bc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafdd820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab6b400640 0 client.27470 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:02.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/2782077421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 >> 172.21.15.18:0/2782077421 conn(0x5654cafd14b0 msgr2=0x5654cafd3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 shutdown_connections 2024-04-21T22:42:02.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 1 -- 172.21.15.18:0/2782077421 wait complete. 2024-04-21T22:42:02.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.392+0000 7fab8f1eb740 20 client.27470 trim_cache size 0 max 16384 2024-04-21T22:42:02.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 Processor -- start 2024-04-21T22:42:02.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 -- start start 2024-04-21T22:42:02.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654caff8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b3bd0 con 0x5654cafe0280 2024-04-21T22:42:02.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b5710 con 0x5654cafd76a0 2024-04-21T22:42:02.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.407+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b42a0 con 0x5654cafd6d80 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab8a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654caff8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60414/0 (socket says 172.21.15.18:60414) 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab8a600640 1 -- 172.21.15.18:0/3864216735 learned_addr learned my addr 172.21.15.18:0/3864216735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 -- 172.21.15.18:0/3864216735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 msgr2=0x5654cafdfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 -- 172.21.15.18:0/3864216735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 msgr2=0x5654caff8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654caff8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.408+0000 7fab89200640 1 -- 172.21.15.18:0/3864216735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654cafcbaa0 con 0x5654cafd76a0 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.409+0000 7fab89200640 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafebf30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fab70003780 tx=0x7fab70001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a499c49fc4132aa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.409+0000 7fab76000640 1 -- 172.21.15.18:0/3864216735 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70005d50 con 0x5654cafd76a0 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.409+0000 7fab76000640 1 -- 172.21.15.18:0/3864216735 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab70003c60 con 0x5654cafd76a0 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.409+0000 7fab76000640 1 -- 172.21.15.18:0/3864216735 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70003a60 con 0x5654cafd76a0 2024-04-21T22:42:02.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3864216735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 msgr2=0x5654cafebf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafebf30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fab70003780 tx=0x7fab70001e70 comp rx=0 tx=0).stop 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3864216735 shutdown_connections 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654caff8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd76a0 0x5654cafebf30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3864216735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd6d80 0x5654cafdfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3864216735 >> 172.21.15.18:0/3864216735 conn(0x5654cafd14b0 msgr2=0x5654cafd0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3864216735 shutdown_connections 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3864216735 wait complete. 2024-04-21T22:42:02.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 -- start start 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.410+0000 7fab8f1eb740 1 Processor -- start 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafda500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafdaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b5040 con 0x5654cafe0280 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b4970 con 0x5654cafd6d80 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab841b1bd0 con 0x5654cafd76a0 2024-04-21T22:42:02.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8f1eb740 10 client.0 _ll_register_callbacks cb 0x7fab70009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafdaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab89200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafda500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36418/0 (socket says 172.21.15.18:36418) 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.411+0000 7fab8a600640 1 -- 172.21.15.18:0/3751728025 learned_addr learned my addr 172.21.15.18:0/3751728025 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 -- 172.21.15.18:0/3751728025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 msgr2=0x5654cafda500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafda500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 -- 172.21.15.18:0/3751728025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 msgr2=0x5654cafdaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafdaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 -- 172.21.15.18:0/3751728025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654cb055d80 con 0x5654cafd6d80 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8a600640 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fab7c011dd0 tx=0x7fab7c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4e1e7eb233a3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab6b400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c005040 con 0x5654cafd6d80 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab70003c60 con 0x5654cafd6d80 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fab7c0051e0 con 0x5654cafd6d80 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.412+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fab7c0053e0 con 0x5654cafd6d80 2024-04-21T22:42:02.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 10 client.27476 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5654cb0570b0 con 0x5654cafd6d80 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab70003c60 con 0x5654cafd6d80 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fab7c043070 con 0x5654cafd6d80 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 10 client.27476 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 10 client.27476 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 20 client.27476 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654cb057650 0x5654cb059a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 4 client.27476 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:02.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654caf42c30 con 0x5654cb057650 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.413+0000 7fab89200640 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654cb057650 0x5654cb059a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab89200640 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654cb057650 0x5654cb059a70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bb7a31c538cd4116 server_cookie=3abc942e7a57607d in_seq=0 out_seq=0 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab6b400640 10 client.27476 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab6b400640 1 -- 172.21.15.18:0/3751728025 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654caf42c30 con 0x5654cb057650 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab6b400640 10 client.27476 handle_command_reply: tid=0 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 client.27476 shutdown 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 msgr2=0x5654cafd9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fab7c011dd0 tx=0x7fab7c0118d0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 shutdown_connections 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5654cb057650 0x5654cb059a70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5654cafe0280 0x5654cafdaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654cafd76a0 0x5654cafda500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 --2- 172.21.15.18:0/3751728025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5654cafd6d80 0x5654cafd9fc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab6b400640 0 client.27476 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.414+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 >> 172.21.15.18:0/3751728025 conn(0x5654cafd14b0 msgr2=0x5654cafdd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 shutdown_connections 2024-04-21T22:42:02.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8f1eb740 1 -- 172.21.15.18:0/3751728025 wait complete. 2024-04-21T22:42:02.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8f1eb740 20 client.27476 trim_cache size 0 max 16384 2024-04-21T22:42:02.423 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 msgr2=0x7fab6c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 0x7fab6c0a51c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fab780ccfb0 tx=0x7fab78010e50 comp rx=0 tx=0).stop 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 msgr2=0x7fab84103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.415+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab7800ea20 tx=0x7fab7800ee20 comp rx=0 tx=0).stop 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 shutdown_connections 2024-04-21T22:42:02.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fab6c0a2d00 0x7fab6c0a51c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab8410bd80 0x7fab841042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab841032d0 0x7fab84103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 --2- 172.21.15.18:0/806294609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab841029b0 0x7fab84103820 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 >> 172.21.15.18:0/806294609 conn(0x7fab84077730 msgr2=0x7fab840fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 shutdown_connections 2024-04-21T22:42:02.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.416+0000 7fab8c600640 1 -- 172.21.15.18:0/806294609 wait complete. 2024-04-21T22:42:02.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 -- 172.21.15.18:0/784844230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c073af0 msgr2=0x7f024c073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 --2- 172.21.15.18:0/784844230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c073af0 0x7f024c073ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f023c009900 tx=0x7f023c02bcd0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 -- 172.21.15.18:0/784844230 shutdown_connections 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 --2- 172.21.15.18:0/784844230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c10ddd0 0x7f024c1101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 --2- 172.21.15.18:0/784844230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c074410 0x7f024c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 --2- 172.21.15.18:0/784844230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c073af0 0x7f024c073ed0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.628+0000 7f0250e00640 1 -- 172.21.15.18:0/784844230 >> 172.21.15.18:0/784844230 conn(0x7f024c0fd020 msgr2=0x7f024c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.629+0000 7f0250e00640 1 -- 172.21.15.18:0/784844230 shutdown_connections 2024-04-21T22:42:02.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.629+0000 7f0250e00640 1 -- 172.21.15.18:0/784844230 wait complete. 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 Processor -- start 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 -- start start 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c10ddd0 0x7f024c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f024c113b40 con 0x7f024c074410 2024-04-21T22:42:02.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1139c0 con 0x7f024c073af0 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f0250e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f024c113cc0 con 0x7f024c10ddd0 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f024aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.630+0000 7f024b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42510/0 (socket says 172.21.15.18:42510) 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36434/0 (socket says 172.21.15.18:36434) 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024aa00640 1 -- 172.21.15.18:0/1607242978 learned_addr learned my addr 172.21.15.18:0/1607242978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024be00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c10ddd0 0x7f024c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 -- 172.21.15.18:0/1607242978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c10ddd0 msgr2=0x7f024c19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c10ddd0 0x7f024c19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 -- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 msgr2=0x7f024c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 -- 172.21.15.18:0/1607242978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c19f060 con 0x7f024c073af0 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024aa00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.631+0000 7f024b400640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f023c02c210 tx=0x7f023c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.632+0000 7f0243e00640 1 -- 172.21.15.18:0/1607242978 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c042020 con 0x7f024c073af0 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.632+0000 7f0243e00640 1 -- 172.21.15.18:0/1607242978 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f023c02ce00 con 0x7f024c073af0 2024-04-21T22:42:02.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.632+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c19f2f0 con 0x7f024c073af0 2024-04-21T22:42:02.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.632+0000 7f0243e00640 1 -- 172.21.15.18:0/1607242978 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c003a50 con 0x7f024c073af0 2024-04-21T22:42:02.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.632+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1a6be0 con 0x7f024c073af0 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0243e00640 1 -- 172.21.15.18:0/1607242978 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f023c045020 con 0x7f024c073af0 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 Processor -- start 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 -- start start 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47662f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47665860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e475be3a0 con 0x564e4765a890 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e47566930 con 0x564e47663470 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.635+0000 7f0255074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e475ba360 con 0x564e47659f70 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47662f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47665860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60438/0 (socket says 172.21.15.18:60438) 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 -- 172.21.15.18:0/2611869083 learned_addr learned my addr 172.21.15.18:0/2611869083 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 -- 172.21.15.18:0/2611869083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 msgr2=0x564e47665860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47665860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 -- 172.21.15.18:0/2611869083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 msgr2=0x564e47662f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47662f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.636+0000 7f024be00640 1 -- 172.21.15.18:0/2611869083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e472d23f0 con 0x564e47659f70 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f024be00640 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0244009f50 tx=0x7f02440118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef7eb2b91044fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f0243e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 0x7f02300a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f0240c00640 1 -- 172.21.15.18:0/2611869083 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244004d20 con 0x564e47659f70 2024-04-21T22:42:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f0240c00640 1 -- 172.21.15.18:0/2611869083 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244004050 con 0x564e47659f70 2024-04-21T22:42:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f0240c00640 1 -- 172.21.15.18:0/2611869083 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244005280 con 0x564e47659f70 2024-04-21T22:42:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f0243e00640 1 -- 172.21.15.18:0/1607242978 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f023c0f0ec0 con 0x7f024c073af0 2024-04-21T22:42:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.637+0000 7f024b400640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 0x7f02300a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- 172.21.15.18:0/2611869083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 msgr2=0x564e4765a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0244009f50 tx=0x7f02440118d0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- 172.21.15.18:0/2611869083 shutdown_connections 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47665860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47662f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 --2- 172.21.15.18:0/2611869083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4765a350 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- 172.21.15.18:0/2611869083 >> 172.21.15.18:0/2611869083 conn(0x564e476546a0 msgr2=0x564e47654a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f024b400640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 0x7f02300a51c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x564e47659a40 tx=0x7f023c0f4970 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- 172.21.15.18:0/2611869083 shutdown_connections 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- 172.21.15.18:0/2611869083 wait complete. 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.638+0000 7f0255074740 1 -- start start 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 Processor -- start 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 0x564e476604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47660a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47663470 0x564e47660f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564e47666260 con 0x564e4765a890 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x564e47579d80 con 0x564e47659f70 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564e476663e0 con 0x564e47663470 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f0255074740 10 client.0 _ll_register_callbacks cb 0x564e475b62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f024be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 0x564e476604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f024aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47660a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f024be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 0x564e476604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36462/0 (socket says 172.21.15.18:36462) 2024-04-21T22:42:02.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.639+0000 7f024be00640 1 -- 172.21.15.18:0/3178813398 learned_addr learned my addr 172.21.15.18:0/3178813398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024be00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47663470 0x564e47660f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 -- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47663470 msgr2=0x564e47660f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47663470 0x564e47660f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 -- 172.21.15.18:0/3178813398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 msgr2=0x564e476604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 0x564e476604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 -- 172.21.15.18:0/3178813398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4739c7d0 con 0x564e4765a890 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f024aa00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47660a30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0238009640 tx=0x7f023800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bd9f0f3f37fd87 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.640+0000 7f0235600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:02.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02380120d0 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f0238005020 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244004050 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0238012270 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0255074740 10 client.17418 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564e476725b0 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244004050 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.641+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f0238023070 con 0x564e4765a890 2024-04-21T22:42:02.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 10 client.17418 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 10 client.17418 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 20 client.17418 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e47673a70 0x564e47675e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 4 client.17418 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e475cb8e0 con 0x564e47673a70 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f024be00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e47673a70 0x564e47675e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f024be00640 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e47673a70 0x564e47675e60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd3e28cb22db0eb2 server_cookie=911c272dda323db0 in_seq=0 out_seq=0 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.642+0000 7f0235600640 10 client.17418 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:02.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.643+0000 7f0235600640 1 -- 172.21.15.18:0/3178813398 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564e475cb8e0 con 0x564e47673a70 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.643+0000 7f0235600640 10 client.17418 handle_command_reply: tid=0 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 client.17418 shutdown 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 msgr2=0x564e47660a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47660a30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0238009640 tx=0x7f023800f790 comp rx=0 tx=0).stop 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 shutdown_connections 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e47673a70 0x564e47675e60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47663470 0x564e47660f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e47660a30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0235600640 0 client.17418 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 --2- 172.21.15.18:0/3178813398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47659f70 0x564e476604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 >> 172.21.15.18:0/3178813398 conn(0x564e476546a0 msgr2=0x564e476563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 shutdown_connections 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 1 -- 172.21.15.18:0/3178813398 wait complete. 2024-04-21T22:42:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.644+0000 7f0255074740 20 client.17418 trim_cache size 0 max 16384 2024-04-21T22:42:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.659+0000 7f0255074740 1 Processor -- start 2024-04-21T22:42:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.659+0000 7f0255074740 1 -- start start 2024-04-21T22:42:02.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e47662c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47653510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1af5e0 con 0x564e4765a890 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b1120 con 0x564e47663470 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f0255074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1afcb0 con 0x564e47659f70 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e47662c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42532/0 (socket says 172.21.15.18:42532) 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024aa00640 1 -- 172.21.15.18:0/3803745674 learned_addr learned my addr 172.21.15.18:0/3803745674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47653510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 -- 172.21.15.18:0/3803745674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 msgr2=0x564e47653510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47653510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 -- 172.21.15.18:0/3803745674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 msgr2=0x564e4766f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024be00640 1 -- 172.21.15.18:0/3803745674 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e476764e0 con 0x564e47659f70 2024-04-21T22:42:02.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.660+0000 7f024aa00640 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.661+0000 7f024be00640 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e47662c20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x564e476766b0 tx=0x7f02440047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e91a5ec5e5781 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.661+0000 7f0237e00640 1 -- 172.21.15.18:0/3803745674 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244003b70 con 0x564e47659f70 2024-04-21T22:42:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.661+0000 7f0237e00640 1 -- 172.21.15.18:0/3803745674 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244004530 con 0x564e47659f70 2024-04-21T22:42:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.661+0000 7f0237e00640 1 -- 172.21.15.18:0/3803745674 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024402e860 con 0x564e47659f70 2024-04-21T22:42:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- 172.21.15.18:0/3803745674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 msgr2=0x564e47662c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e47662c20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x564e476766b0 tx=0x7f02440047b0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- 172.21.15.18:0/3803745674 shutdown_connections 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e47663470 0x564e47653510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e4765a890 0x564e4766f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 --2- 172.21.15.18:0/3803745674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e47662c20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- 172.21.15.18:0/3803745674 >> 172.21.15.18:0/3803745674 conn(0x564e476546a0 msgr2=0x564e47652e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- 172.21.15.18:0/3803745674 shutdown_connections 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- 172.21.15.18:0/3803745674 wait complete. 2024-04-21T22:42:02.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 -- start start 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.662+0000 7f0255074740 1 Processor -- start 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4766ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e47663470 0x564e4765d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b0a50 con 0x564e47663470 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b0380 con 0x564e4765a890 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1ad5e0 con 0x564e47659f70 2024-04-21T22:42:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f0255074740 10 client.0 _ll_register_callbacks cb 0x7f0238012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f024aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f024aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36482/0 (socket says 172.21.15.18:36482) 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f024aa00640 1 -- 172.21.15.18:0/513410256 learned_addr learned my addr 172.21.15.18:0/513410256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f024be00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4766ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.663+0000 7f024be00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e47663470 0x564e4765d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 -- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 msgr2=0x564e4766ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4766ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 -- 172.21.15.18:0/513410256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e47663470 msgr2=0x564e4765d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e47663470 0x564e4765d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 -- 172.21.15.18:0/513410256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4765dbc0 con 0x564e4765a890 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f024aa00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023801c470 tx=0x7f0238005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50acf120d162efe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f0235600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238029040 con 0x564e4765a890 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f023801c7a0 con 0x564e4765a890 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244004530 con 0x564e4765a890 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.664+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f023801c9a0 con 0x564e4765a890 2024-04-21T22:42:02.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 10 client.27494 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564e476d9fd0 con 0x564e4765a890 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244004530 con 0x564e4765a890 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f023802c070 con 0x564e4765a890 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 10 client.27494 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 10 client.27494 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 20 client.27494 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e476da770 0x564e476dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 4 client.27494 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:02.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e475c5c30 con 0x564e476da770 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.665+0000 7f024be00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e476da770 0x564e476dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f024be00640 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e476da770 0x564e476dcb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=868f8f0cdbb514ae server_cookie=ed3a5287eb1b38c9 in_seq=0 out_seq=0 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0235600640 10 client.27494 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0235600640 1 -- 172.21.15.18:0/513410256 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e475c5c30 con 0x564e476da770 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0235600640 10 client.27494 handle_command_reply: tid=0 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 client.27494 shutdown 2024-04-21T22:42:02.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 msgr2=0x564e4765ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f023801c470 tx=0x7f0238005750 comp rx=0 tx=0).stop 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 shutdown_connections 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x564e476da770 0x564e476dcb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564e47663470 0x564e4765d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x564e4765a890 0x564e4765ce80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0235600640 0 client.27494 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 --2- 172.21.15.18:0/513410256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564e47659f70 0x564e4766ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.666+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 >> 172.21.15.18:0/513410256 conn(0x564e476546a0 msgr2=0x564e47653690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 shutdown_connections 2024-04-21T22:42:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0255074740 1 -- 172.21.15.18:0/513410256 wait complete. 2024-04-21T22:42:02.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0255074740 20 client.27494 trim_cache size 0 max 16384 2024-04-21T22:42:02.676 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 msgr2=0x7f02300a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 0x7f02300a51c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x564e47659a40 tx=0x7f023c0f4970 comp rx=0 tx=0).stop 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 msgr2=0x7f024c19a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f023c02c210 tx=0x7f023c005e80 comp rx=0 tx=0).stop 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 shutdown_connections 2024-04-21T22:42:02.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f02300a2d00 0x7f02300a51c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f024c10ddd0 0x7f024c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f024c074410 0x7f024c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 --2- 172.21.15.18:0/1607242978 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f024c073af0 0x7f024c19a0c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.667+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 >> 172.21.15.18:0/1607242978 conn(0x7f024c0fd020 msgr2=0x7f024c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.668+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 shutdown_connections 2024-04-21T22:42:02.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.668+0000 7f0250e00640 1 -- 172.21.15.18:0/1607242978 wait complete. 2024-04-21T22:42:02.683 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:02 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/705329742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:02.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:42:02.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:02 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/705329742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 -- 172.21.15.18:0/3554182828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8109770 msgr2=0x7f70a8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3554182828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8109770 0x7f70a8109b50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7098009900 tx=0x7f709802bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 -- 172.21.15.18:0/3554182828 shutdown_connections 2024-04-21T22:42:02.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3554182828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3554182828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8103760 0x7f70a8103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3554182828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8109770 0x7f70a8109b50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 -- 172.21.15.18:0/3554182828 >> 172.21.15.18:0/3554182828 conn(0x7f70a80ff230 msgr2=0x7f70a8101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 -- 172.21.15.18:0/3554182828 shutdown_connections 2024-04-21T22:42:02.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.896+0000 7f70a7e00640 1 -- 172.21.15.18:0/3554182828 wait complete. 2024-04-21T22:42:02.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.897+0000 7f70a7e00640 1 Processor -- start 2024-04-21T22:42:02.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.897+0000 7f70a7e00640 1 -- start start 2024-04-21T22:42:02.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.897+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8103760 0x7f70a819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8109770 0x7f70a819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8113b90 con 0x7f70a8109770 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8113a10 con 0x7f70a8103760 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8113d10 con 0x7f70a8104120 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8109770 0x7f70a819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60474/0 (socket says 172.21.15.18:60474) 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 -- 172.21.15.18:0/3868282079 learned_addr learned my addr 172.21.15.18:0/3868282079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8103760 0x7f70a819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 -- 172.21.15.18:0/3868282079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8103760 msgr2=0x7f70a819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8103760 0x7f70a819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 -- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8109770 msgr2=0x7f70a819e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8109770 0x7f70a819e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.898+0000 7f70a6000640 1 -- 172.21.15.18:0/3868282079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a819f080 con 0x7f70a8104120 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f70a6000640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f709400e9f0 tx=0x7f709400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f709f400640 1 -- 172.21.15.18:0/3868282079 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709400cd80 con 0x7f70a8104120 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a819f370 con 0x7f70a8104120 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f709f400640 1 -- 172.21.15.18:0/3868282079 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7094010910 con 0x7f70a8104120 2024-04-21T22:42:02.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f709f400640 1 -- 172.21.15.18:0/3868282079 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094018990 con 0x7f70a8104120 2024-04-21T22:42:02.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.899+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a6c00 con 0x7f70a8104120 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.902+0000 7f70b096e740 1 Processor -- start 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.902+0000 7f70b096e740 1 -- start start 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 0x555b58118350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 0x555b58123860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b5807c3a0 con 0x555b58118890 2024-04-21T22:42:02.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555b58024930 con 0x555b58117f70 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70b096e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b58078360 con 0x555b58121470 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f709f400640 1 -- 172.21.15.18:0/3868282079 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7094010ac0 con 0x7f70a8104120 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 0x555b58118350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42564/0 (socket says 172.21.15.18:42564) 2024-04-21T22:42:02.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a6a00640 1 -- 172.21.15.18:0/173080491 learned_addr learned my addr 172.21.15.18:0/173080491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a6000640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 0x555b58123860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a7400640 1 -- 172.21.15.18:0/173080491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 msgr2=0x555b58123860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.903+0000 7f70a7400640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 0x555b58123860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a7400640 1 -- 172.21.15.18:0/173080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 msgr2=0x555b58120f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a7400640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a7400640 1 -- 172.21.15.18:0/173080491 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b57d903f0 con 0x555b58117f70 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a6a00640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a6000640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 0x555b58123860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f70a7400640 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 0x555b58118350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009f00 tx=0x7f70a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41240aa245dd423e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f7093e00640 1 -- 172.21.15.18:0/173080491 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0004d20 con 0x555b58117f70 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f7093e00640 1 -- 172.21.15.18:0/173080491 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a0004050 con 0x555b58117f70 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.904+0000 7f7093e00640 1 -- 172.21.15.18:0/173080491 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005280 con 0x555b58117f70 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f709f400640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 0x7f708c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f709f400640 1 -- 172.21.15.18:0/3868282079 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f70940cf7d0 con 0x7f70a8104120 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 -- 172.21.15.18:0/173080491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 msgr2=0x555b58118350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 0x555b58118350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009f00 tx=0x7f70a0011810 comp rx=0 tx=0).stop 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 0x7f708c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 -- 172.21.15.18:0/173080491 shutdown_connections 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58121470 0x555b58123860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b58120f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 --2- 172.21.15.18:0/173080491 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58117f70 0x555b58118350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 -- 172.21.15.18:0/173080491 >> 172.21.15.18:0/173080491 conn(0x555b581126a0 msgr2=0x555b58112a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 -- 172.21.15.18:0/173080491 shutdown_connections 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.905+0000 7f70b096e740 1 -- 172.21.15.18:0/173080491 wait complete. 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.906+0000 7f70b096e740 1 -- start start 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.906+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 0x7f708c0a51c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70980096c0 tx=0x7f7098000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.906+0000 7f70b096e740 1 Processor -- start 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.906+0000 7f70b096e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 0x555b5811e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 0x555b5811ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b5811ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555b58124260 con 0x555b58117f70 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555b58037d80 con 0x555b58121470 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b581243e0 con 0x555b58118890 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70b096e740 10 client.0 _ll_register_callbacks cb 0x555b580742b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 0x555b5811e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 0x555b5811ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 0x555b5811e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42570/0 (socket says 172.21.15.18:42570) 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6a00640 1 -- 172.21.15.18:0/526362603 learned_addr learned my addr 172.21.15.18:0/526362603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a7400640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b5811ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 -- 172.21.15.18:0/526362603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 msgr2=0x555b5811ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b5811ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 -- 172.21.15.18:0/526362603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 msgr2=0x555b5811e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 0x555b5811e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.907+0000 7f70a6000640 1 -- 172.21.15.18:0/526362603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b57e5a7d0 con 0x555b58118890 2024-04-21T22:42:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f70a6000640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 0x555b5811ea20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f70940cce60 tx=0x7f709409bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfffe925944afb2f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f7090c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940cd320 con 0x555b58118890 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a0004050 con 0x555b58118890 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f70940cfdc0 con 0x555b58118890 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f70940b4e60 con 0x555b58118890 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f70b096e740 10 client.27568 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.908+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555b58130540 con 0x555b58118890 2024-04-21T22:42:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a0004050 con 0x555b58118890 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f7094097a60 con 0x555b58118890 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 10 client.27568 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 10 client.27568 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 20 client.27568 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b58131950 0x555b58133d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 4 client.27568 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b580898e0 con 0x555b58131950 2024-04-21T22:42:02.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.909+0000 7f70a6a00640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b58131950 0x555b58133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.910+0000 7f70a6a00640 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b58131950 0x555b58133d40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ee078732a880857 server_cookie=1bbe5ee46f96b9a9 in_seq=0 out_seq=0 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.910+0000 7f7090c00640 10 client.27568 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f7090c00640 1 -- 172.21.15.18:0/526362603 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555b580898e0 con 0x555b58131950 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f7090c00640 10 client.27568 handle_command_reply: tid=0 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 client.27568 shutdown 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 msgr2=0x555b5811ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 0x555b5811ea20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f70940cce60 tx=0x7f709409bc10 comp rx=0 tx=0).stop 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 shutdown_connections 2024-04-21T22:42:02.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b58131950 0x555b58133d40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b5811ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58118890 0x555b5811ea20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 --2- 172.21.15.18:0/526362603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58117f70 0x555b5811e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f7090c00640 0 client.27568 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 >> 172.21.15.18:0/526362603 conn(0x555b581126a0 msgr2=0x555b581143f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 shutdown_connections 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 1 -- 172.21.15.18:0/526362603 wait complete. 2024-04-21T22:42:02.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.911+0000 7f70b096e740 20 client.27568 trim_cache size 0 max 16384 2024-04-21T22:42:02.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.926+0000 7f70b096e740 1 Processor -- start 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 -- start start 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58118890 0x555b5811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58121470 0x555b58114190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81af610 con 0x555b58121470 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81b1150 con 0x555b58118890 2024-04-21T22:42:02.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70b096e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81afce0 con 0x555b58117f70 2024-04-21T22:42:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70a6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58118890 0x555b5811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60482/0 (socket says 172.21.15.18:60482) 2024-04-21T22:42:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70a6a00640 1 -- 172.21.15.18:0/3024434746 learned_addr learned my addr 172.21.15.18:0/3024434746 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.927+0000 7f70a7400640 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58121470 0x555b58114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 -- 172.21.15.18:0/3024434746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58118890 msgr2=0x555b5811ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58118890 0x555b5811ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 -- 172.21.15.18:0/3024434746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58121470 msgr2=0x555b58114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58121470 0x555b58114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 -- 172.21.15.18:0/3024434746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b581340b0 con 0x555b58117f70 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f70a6a00640 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7098009900 tx=0x7f7098041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e02c6a638761712 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f7093400640 1 -- 172.21.15.18:0/3024434746 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098059070 con 0x555b58117f70 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f7093400640 1 -- 172.21.15.18:0/3024434746 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7098004f80 con 0x555b58117f70 2024-04-21T22:42:02.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.928+0000 7f7093400640 1 -- 172.21.15.18:0/3024434746 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980038e0 con 0x555b58117f70 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- 172.21.15.18:0/3024434746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 msgr2=0x555b5812d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7098009900 tx=0x7f7098041000 comp rx=0 tx=0).stop 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- 172.21.15.18:0/3024434746 shutdown_connections 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58121470 0x555b58114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58118890 0x555b5811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 --2- 172.21.15.18:0/3024434746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b5812d150 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- 172.21.15.18:0/3024434746 >> 172.21.15.18:0/3024434746 conn(0x555b581126a0 msgr2=0x555b58113a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- 172.21.15.18:0/3024434746 shutdown_connections 2024-04-21T22:42:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- 172.21.15.18:0/3024434746 wait complete. 2024-04-21T22:42:02.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.929+0000 7f70b096e740 1 -- start start 2024-04-21T22:42:02.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 Processor -- start 2024-04-21T22:42:02.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b581254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b58125a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81b0a80 con 0x555b58118890 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81b03b0 con 0x555b58121470 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ad610 con 0x555b58117f70 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70b096e740 10 client.0 _ll_register_callbacks cb 0x7f709400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70a6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b581254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70a6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60486/0 (socket says 172.21.15.18:60486) 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.930+0000 7f70a6a00640 1 -- 172.21.15.18:0/901827663 learned_addr learned my addr 172.21.15.18:0/901827663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a7400640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b58125a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 -- 172.21.15.18:0/901827663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 msgr2=0x555b58125a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b58125a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 -- 172.21.15.18:0/901827663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 msgr2=0x555b581254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b581254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 -- 172.21.15.18:0/901827663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5819f690 con 0x555b58117f70 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a7400640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b58125a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f70a6a00640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7098004650 tx=0x7f7098004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd60303d768039b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f7090c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:02.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.931+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098059040 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7098004f80 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f7098005570 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f70980046c0 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 10 client.27574 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555b581a0890 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7098004f80 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f709805c070 con 0x555b58117f70 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 10 client.27574 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:02.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 10 client.27574 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 20 client.27574 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b581a0fc0 0x555b581a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 4 client.27574 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.932+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b58083c30 con 0x555b581a0fc0 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f70a6000640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b581a0fc0 0x555b581a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f70a6000640 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b581a0fc0 0x555b581a33e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9d7731c7831a78e server_cookie=f6c9e2e3a57a1130 in_seq=0 out_seq=0 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f7090c00640 10 client.27574 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f7090c00640 1 -- 172.21.15.18:0/901827663 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b58083c30 con 0x555b581a0fc0 2024-04-21T22:42:02.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f7090c00640 10 client.27574 handle_command_reply: tid=0 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.933+0000 7f70b096e740 1 client.27574 shutdown 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 msgr2=0x555b58124f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7098004650 tx=0x7f7098004430 comp rx=0 tx=0).stop 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 shutdown_connections 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x555b581a0fc0 0x555b581a33e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555b58121470 0x555b58125a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555b58118890 0x555b581254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 --2- 172.21.15.18:0/901827663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b58117f70 0x555b58124f90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f7090c00640 0 client.27574 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 >> 172.21.15.18:0/901827663 conn(0x555b581126a0 msgr2=0x555b58111690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 shutdown_connections 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 1 -- 172.21.15.18:0/901827663 wait complete. 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70b096e740 20 client.27574 trim_cache size 0 max 16384 2024-04-21T22:42:02.942 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:02.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.934+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 msgr2=0x7f708c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 0x7f708c0a51c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70980096c0 tx=0x7f7098000bc0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 msgr2=0x7f70a819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f709400e9f0 tx=0x7f709400eeb0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 shutdown_connections 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f708c0a2d00 0x7f708c0a51c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70a8109770 0x7f70a819e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70a8104120 0x7f70a819a5d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 --2- 172.21.15.18:0/3868282079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70a8103760 0x7f70a819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 >> 172.21.15.18:0/3868282079 conn(0x7f70a80ff230 msgr2=0x7f70a80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:02.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 shutdown_connections 2024-04-21T22:42:02.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:02.935+0000 7f70a7e00640 1 -- 172.21.15.18:0/3868282079 wait complete. 2024-04-21T22:42:02.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:02 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/705329742' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:02.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:42:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 -- 172.21.15.18:0/995595131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 msgr2=0x7fa2d810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/995595131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d810d970 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009ca0 tx=0x7fa2c002c100 comp rx=0 tx=0).stop 2024-04-21T22:42:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 -- 172.21.15.18:0/995595131 shutdown_connections 2024-04-21T22:42:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/995595131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d810deb0 0x7fa2d81102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/995595131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d810d970 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/995595131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d8100300 0x7fa2d81006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 -- 172.21.15.18:0/995595131 >> 172.21.15.18:0/995595131 conn(0x7fa2d80771f0 msgr2=0x7fa2d80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 -- 172.21.15.18:0/995595131 shutdown_connections 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.169+0000 7fa2ddc00640 1 -- 172.21.15.18:0/995595131 wait complete. 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.170+0000 7fa2ddc00640 1 Processor -- start 2024-04-21T22:42:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.170+0000 7fa2ddc00640 1 -- start start 2024-04-21T22:42:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8100300 0x7fa2d819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d810deb0 0x7fa2d819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113b50 con 0x7fa2d8100300 2024-04-21T22:42:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81139d0 con 0x7fa2d810deb0 2024-04-21T22:42:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2ddc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113cd0 con 0x7fa2d8100cb0 2024-04-21T22:42:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8100300 0x7fa2d819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60512/0 (socket says 172.21.15.18:60512) 2024-04-21T22:42:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 -- 172.21.15.18:0/2055216374 learned_addr learned my addr 172.21.15.18:0/2055216374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2dd200640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d810deb0 0x7fa2d819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 -- 172.21.15.18:0/2055216374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d810deb0 msgr2=0x7fa2d819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d810deb0 0x7fa2d819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 -- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8100300 msgr2=0x7fa2d819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8100300 0x7fa2d819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.171+0000 7fa2d7400640 1 -- 172.21.15.18:0/2055216374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d819f0c0 con 0x7fa2d8100cb0 2024-04-21T22:42:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005e30 tx=0x7fa2c0035d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2d4c00640 1 -- 172.21.15.18:0/2055216374 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0039040 con 0x7fa2d8100cb0 2024-04-21T22:42:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d819f350 con 0x7fa2d8100cb0 2024-04-21T22:42:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2d4c00640 1 -- 172.21.15.18:0/2055216374 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c0044070 con 0x7fa2d8100cb0 2024-04-21T22:42:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2d4c00640 1 -- 172.21.15.18:0/2055216374 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00043c0 con 0x7fa2d8100cb0 2024-04-21T22:42:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.172+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81a6c40 con 0x7fa2d8100cb0 2024-04-21T22:42:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.175+0000 7fa2e1e43740 1 Processor -- start 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 -- start start 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2d4c00640 1 -- 172.21.15.18:0/2055216374 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa2c0004560 con 0x7fa2d8100cb0 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b58f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b598470 0x55961b59a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55961b4f33a0 con 0x55961b58f890 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55961b49b930 con 0x55961b598470 2024-04-21T22:42:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55961b4ef360 con 0x55961b58ef70 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b58f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42624/0 (socket says 172.21.15.18:42624) 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.176+0000 7fa2d7e00640 1 -- 172.21.15.18:0/4187677370 learned_addr learned my addr 172.21.15.18:0/4187677370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2d7400640 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b598470 0x55961b59a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 -- 172.21.15.18:0/4187677370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b598470 msgr2=0x55961b59a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b598470 0x55961b59a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 -- 172.21.15.18:0/4187677370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 msgr2=0x55961b597f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 -- 172.21.15.18:0/4187677370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961b2073f0 con 0x55961b58ef70 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2dd200640 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b58f350 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa2d81012e0 tx=0x7fa2d0005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fc9957357e9be8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.177+0000 7fa2d4c00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 0x7fa2b80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2cd600640 1 -- 172.21.15.18:0/4187677370 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004050 con 0x55961b58ef70 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2cd600640 1 -- 172.21.15.18:0/4187677370 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d0005500 con 0x55961b58ef70 2024-04-21T22:42:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2cd600640 1 -- 172.21.15.18:0/4187677370 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004ca0 con 0x55961b58ef70 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2d4c00640 1 -- 172.21.15.18:0/2055216374 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fa2c00f1690 con 0x7fa2d8100cb0 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 0x7fa2b80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2e1e43740 1 -- 172.21.15.18:0/4187677370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 msgr2=0x55961b58f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.178+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b58f350 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa2d81012e0 tx=0x7fa2d0005850 comp rx=0 tx=0).stop 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 0x7fa2b80a51c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55961b58ea40 tx=0x7fa2c8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 -- 172.21.15.18:0/4187677370 shutdown_connections 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b598470 0x55961b59a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b597f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/4187677370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b58f350 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 -- 172.21.15.18:0/4187677370 >> 172.21.15.18:0/4187677370 conn(0x55961b5896a0 msgr2=0x55961b589a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 -- 172.21.15.18:0/4187677370 shutdown_connections 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 -- 172.21.15.18:0/4187677370 wait complete. 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 -- start start 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.179+0000 7fa2e1e43740 1 Processor -- start 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b595580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b595ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55961b59b260 con 0x55961b598470 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55961b4aed80 con 0x55961b58f890 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55961b59b3e0 con 0x55961b58ef70 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2e1e43740 10 client.0 _ll_register_callbacks cb 0x55961b4eb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b595580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42628/0 (socket says 172.21.15.18:42628) 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2dd200640 1 -- 172.21.15.18:0/2926712682 learned_addr learned my addr 172.21.15.18:0/2926712682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.180+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b595ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 -- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 msgr2=0x55961b595ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b595ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 -- 172.21.15.18:0/2926712682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 msgr2=0x55961b596000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 -- 172.21.15.18:0/2926712682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961b2d17d0 con 0x55961b58ef70 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b595ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2dd200640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b595580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800fa30 tx=0x7fa2c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6276449cfb8aa05 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2c6000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.181+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800fe60 con 0x55961b58ef70 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fa2c8018030 con 0x55961b58ef70 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d0005500 con 0x55961b58ef70 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa2c8005020 con 0x55961b58ef70 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 10 client.27586 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55961b5a7690 con 0x55961b58ef70 2024-04-21T22:42:03.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2d0005500 con 0x55961b58ef70 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa2c801d620 con 0x55961b58ef70 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 10 client.27586 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 10 client.27586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.182+0000 7fa2e1e43740 20 client.27586 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b5a8ba0 0x55961b5aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2e1e43740 4 client.27586 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55961b5008e0 con 0x55961b5a8ba0 2024-04-21T22:42:03.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b5a8ba0 0x55961b5aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2d7400640 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b5a8ba0 0x55961b5aaff0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1681172c932671 server_cookie=5561ac232953094b in_seq=0 out_seq=0 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.183+0000 7fa2c6000640 10 client.27586 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2c6000640 1 -- 172.21.15.18:0/2926712682 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55961b5008e0 con 0x55961b5a8ba0 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2c6000640 10 client.27586 handle_command_reply: tid=0 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 client.27586 shutdown 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 msgr2=0x55961b595580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b595580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800fa30 tx=0x7fa2c80046c0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 shutdown_connections 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b598470 0x55961b596000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b595ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b5a8ba0 0x55961b5aaff0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/2926712682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b58ef70 0x55961b595580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 >> 172.21.15.18:0/2926712682 conn(0x55961b5896a0 msgr2=0x55961b58b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.184+0000 7fa2c6000640 0 client.27586 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.185+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 shutdown_connections 2024-04-21T22:42:03.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.185+0000 7fa2e1e43740 1 -- 172.21.15.18:0/2926712682 wait complete. 2024-04-21T22:42:03.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.185+0000 7fa2e1e43740 20 client.27586 trim_cache size 0 max 16384 2024-04-21T22:42:03.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 Processor -- start 2024-04-21T22:42:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 -- start start 2024-04-21T22:42:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 0x55961b5a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b595e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b588510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81ab1d0 con 0x55961b58f890 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81acd10 con 0x55961b58ef70 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81ab8a0 con 0x55961b598470 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.200+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b595e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 0x55961b5a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b595e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42642/0 (socket says 172.21.15.18:42642) 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7400640 1 -- 172.21.15.18:0/3839880848 learned_addr learned my addr 172.21.15.18:0/3839880848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2dd200640 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b588510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3839880848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 msgr2=0x55961b588510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b588510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3839880848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 msgr2=0x55961b595e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b595e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3839880848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961b583ae0 con 0x55961b58ef70 2024-04-21T22:42:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.201+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 0x55961b5a4120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8019040 tx=0x7fa2c8004fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d4bf712379f6ef server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2ccc00640 1 -- 172.21.15.18:0/3839880848 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800fe30 con 0x55961b58ef70 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2ccc00640 1 -- 172.21.15.18:0/3839880848 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c801dc60 con 0x55961b58ef70 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2ccc00640 1 -- 172.21.15.18:0/3839880848 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004af0 con 0x55961b58ef70 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3839880848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 msgr2=0x55961b5a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 0x55961b5a4120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8019040 tx=0x7fa2c8004fb0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3839880848 shutdown_connections 2024-04-21T22:42:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b588510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58f890 0x55961b595e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3839880848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58ef70 0x55961b5a4120 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3839880848 >> 172.21.15.18:0/3839880848 conn(0x55961b5896a0 msgr2=0x55961b587e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3839880848 shutdown_connections 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.202+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3839880848 wait complete. 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.203+0000 7fa2e1e43740 1 -- start start 2024-04-21T22:42:03.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.203+0000 7fa2e1e43740 1 Processor -- start 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.203+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.203+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b5a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2e1e43740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b59bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81ac640 con 0x55961b58ef70 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81abf70 con 0x55961b58f890 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2e1e43740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81a91d0 con 0x55961b598470 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2e1e43740 10 client.0 _ll_register_callbacks cb 0x7fa2c80099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42644/0 (socket says 172.21.15.18:42644) 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3886828320 learned_addr learned my addr 172.21.15.18:0/3886828320 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7400640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b5a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2dd200640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b59bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3886828320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 msgr2=0x55961b59bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b59bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 msgr2=0x55961b5a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b5a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.204+0000 7fa2d7e00640 1 -- 172.21.15.18:0/3886828320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961b59c5d0 con 0x55961b58ef70 2024-04-21T22:42:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2d7e00640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005680 tx=0x7fa2c80056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a323e76488335e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2c6000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004680 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7fa2c8004820 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c801dc60 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa2c8004a20 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2e1e43740 10 client.17460 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55961b60ed60 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.205+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c801dc60 con 0x55961b58ef70 2024-04-21T22:42:03.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa2c8048070 con 0x55961b58ef70 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 10 client.17460 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 20 client.17460 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b60f310 0x55961b611700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 4 client.17460 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55961b4fac30 con 0x55961b60f310 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2d7400640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b60f310 0x55961b611700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:03.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2d7400640 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b60f310 0x55961b611700 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a924b3f72cb62516 server_cookie=2e6a8d67f129caf9 in_seq=0 out_seq=0 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.206+0000 7fa2c6000640 10 client.17460 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2c6000640 1 -- 172.21.15.18:0/3886828320 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55961b4fac30 con 0x55961b60f310 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2c6000640 10 client.17460 handle_command_reply: tid=0 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 client.17460 shutdown 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 msgr2=0x55961b5a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005680 tx=0x7fa2c80056b0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 shutdown_connections 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55961b60f310 0x55961b611700 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55961b598470 0x55961b59bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55961b58f890 0x55961b5a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 --2- 172.21.15.18:0/3886828320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55961b58ef70 0x55961b5a0640 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2c6000640 0 client.17460 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 >> 172.21.15.18:0/3886828320 conn(0x55961b5896a0 msgr2=0x55961b587e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 shutdown_connections 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 1 -- 172.21.15.18:0/3886828320 wait complete. 2024-04-21T22:42:03.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.207+0000 7fa2e1e43740 20 client.17460 trim_cache size 0 max 16384 2024-04-21T22:42:03.217 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:03.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 msgr2=0x7fa2b80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 0x7fa2b80a51c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55961b58ea40 tx=0x7fa2c8005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:03.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 msgr2=0x7fa2d819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0005e30 tx=0x7fa2c0035d90 comp rx=0 tx=0).stop 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 shutdown_connections 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa2b80a2d00 0x7fa2b80a51c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d810deb0 0x7fa2d819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2d8100cb0 0x7fa2d819a610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 --2- 172.21.15.18:0/2055216374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2d8100300 0x7fa2d819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:03.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 >> 172.21.15.18:0/2055216374 conn(0x7fa2d80771f0 msgr2=0x7fa2d80fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:03.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 shutdown_connections 2024-04-21T22:42:03.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:03.208+0000 7fa2ddc00640 1 -- 172.21.15.18:0/2055216374 wait complete. 2024-04-21T22:42:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:03 smithi018 ceph-mon[26614]: pgmap v245: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:03 smithi081 ceph-mon[31692]: pgmap v245: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:03.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:03 smithi047 ceph-mon[31561]: pgmap v245: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:42:04.229 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:42:04.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:42:04.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.458+0000 7f16bf200640 1 -- 172.21.15.18:0/3006533566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101ef0 msgr2=0x7f16c010e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.458+0000 7f16bf200640 1 --2- 172.21.15.18:0/3006533566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101ef0 0x7f16c010e3b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009c10 tx=0x7f16b802bef0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 -- 172.21.15.18:0/3006533566 shutdown_connections 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 --2- 172.21.15.18:0/3006533566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101ef0 0x7f16c010e3b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 --2- 172.21.15.18:0/3006533566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101530 0x7f16c01019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 --2- 172.21.15.18:0/3006533566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 0x7f16c01079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 -- 172.21.15.18:0/3006533566 >> 172.21.15.18:0/3006533566 conn(0x7f16c00fd020 msgr2=0x7f16c00ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 -- 172.21.15.18:0/3006533566 shutdown_connections 2024-04-21T22:42:04.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.459+0000 7f16bf200640 1 -- 172.21.15.18:0/3006533566 wait complete. 2024-04-21T22:42:04.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.460+0000 7f16bf200640 1 Processor -- start 2024-04-21T22:42:04.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.460+0000 7f16bf200640 1 -- start start 2024-04-21T22:42:04.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101530 0x7f16c0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 0x7f16c019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01118b0 con 0x7f16c01075f0 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0111730 con 0x7f16c0101530 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bf200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0111a30 con 0x7f16c0101ef0 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16be800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 0x7f16c019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60572/0 (socket says 172.21.15.18:60572) 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bd400640 1 -- 172.21.15.18:0/3207336334 learned_addr learned my addr 172.21.15.18:0/3207336334 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.461+0000 7f16bde00640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101530 0x7f16c0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 -- 172.21.15.18:0/3207336334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101530 msgr2=0x7f16c0197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101530 0x7f16c0197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 -- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 msgr2=0x7f16c019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 0x7f16c019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 -- 172.21.15.18:0/3207336334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c019cda0 con 0x7f16c0101ef0 2024-04-21T22:42:04.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bd400640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e9c0 tx=0x7f16ac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16b6a00640 1 -- 172.21.15.18:0/3207336334 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00cde0 con 0x7f16c0101ef0 2024-04-21T22:42:04.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c019d090 con 0x7f16c0101ef0 2024-04-21T22:42:04.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16b6a00640 1 -- 172.21.15.18:0/3207336334 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16ac0035f0 con 0x7f16c0101ef0 2024-04-21T22:42:04.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16b6a00640 1 -- 172.21.15.18:0/3207336334 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac010650 con 0x7f16c0101ef0 2024-04-21T22:42:04.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.462+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c0073970 con 0x7f16c0101ef0 2024-04-21T22:42:04.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.465+0000 7f16c7a18740 1 Processor -- start 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 -- start start 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573b8925df0 con 0x5573b89c8200 2024-04-21T22:42:04.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5573b892b040 con 0x5573b89d0de0 2024-04-21T22:42:04.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16c7a18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573b88d38c0 con 0x5573b89c78e0 2024-04-21T22:42:04.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16b6a00640 1 -- 172.21.15.18:0/3207336334 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f16ac0037a0 con 0x7f16c0101ef0 2024-04-21T22:42:04.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16be800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42662/0 (socket says 172.21.15.18:42662) 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.466+0000 7f16bde00640 1 -- 172.21.15.18:0/3565810441 learned_addr learned my addr 172.21.15.18:0/3565810441 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16bd400640 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 -- 172.21.15.18:0/3565810441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 msgr2=0x5573b89d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 -- 172.21.15.18:0/3565810441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 msgr2=0x5573b89d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 -- 172.21.15.18:0/3565810441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b87077e0 con 0x5573b89c78e0 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16be800640 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89c7cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f16b802c430 tx=0x7f16b8005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3130c9f62f73f8dd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.467+0000 7f16ab000640 1 -- 172.21.15.18:0/3565810441 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8033d90 con 0x5573b89c78e0 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16ab000640 1 -- 172.21.15.18:0/3565810441 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b8003970 con 0x5573b89c78e0 2024-04-21T22:42:04.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16ab000640 1 -- 172.21.15.18:0/3565810441 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b802cd90 con 0x5573b89c78e0 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16b6a00640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 0x7f16a40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16b6a00640 1 -- 172.21.15.18:0/3207336334 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f16ac0cf800 con 0x7f16c0101ef0 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16bde00640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 0x7f16a40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 -- 172.21.15.18:0/3565810441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 msgr2=0x5573b89c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89c7cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f16b802c430 tx=0x7f16b8005ec0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 -- 172.21.15.18:0/3565810441 shutdown_connections 2024-04-21T22:42:04.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 --2- 172.21.15.18:0/3565810441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89c7cc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.468+0000 7f16c7a18740 1 -- 172.21.15.18:0/3565810441 >> 172.21.15.18:0/3565810441 conn(0x5573b89c2010 msgr2=0x5573b89c23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.469+0000 7f16c7a18740 1 -- 172.21.15.18:0/3565810441 shutdown_connections 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.469+0000 7f16c7a18740 1 -- 172.21.15.18:0/3565810441 wait complete. 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.469+0000 7f16bde00640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 0x7f16a40a51c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5573b89c73b0 tx=0x7f16b0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.469+0000 7f16c7a18740 1 -- start start 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.469+0000 7f16c7a18740 1 Processor -- start 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5573b88e6d20 con 0x5573b89c8200 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5573b8927000 con 0x5573b89d0de0 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5573b89d3b70 con 0x5573b89c78e0 2024-04-21T22:42:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16c7a18740 10 client.0 _ll_register_callbacks cb 0x5573b89220a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16bde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42672/0 (socket says 172.21.15.18:42672) 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16bde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60592/0 (socket says 172.21.15.18:60592) 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16bd400640 1 -- 172.21.15.18:0/1244990782 learned_addr learned my addr 172.21.15.18:0/1244990782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.470+0000 7f16be800640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 -- 172.21.15.18:0/1244990782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 msgr2=0x5573b89cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 -- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 msgr2=0x5573b89ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 -- 172.21.15.18:0/1244990782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b8767f70 con 0x5573b89c8200 2024-04-21T22:42:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16be800640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bde00640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:04.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16bd400640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f16ac09b990 tx=0x7f16ac09b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ba73bb1f217b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f169f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac0a4900 con 0x5573b89c8200 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f16ac0cd140 con 0x5573b89c8200 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.471+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b8003970 con 0x5573b89c8200 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f16ac0cd340 con 0x5573b89c8200 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 10 client.17472 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:04.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573b85ff170 con 0x5573b89c8200 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16b8003970 con 0x5573b89c8200 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f16ac004190 con 0x5573b89c8200 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 10 client.17472 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 20 client.17472 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:04.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b89e10d0 0x5573b89e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 4 client.17472 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:04.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.472+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573b8938580 con 0x5573b89e10d0 2024-04-21T22:42:04.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.473+0000 7f16bde00640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b89e10d0 0x5573b89e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.473+0000 7f16bde00640 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b89e10d0 0x5573b89e34c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6644cd09c4d0d264 server_cookie=8875ef0fcb6e607f in_seq=0 out_seq=0 2024-04-21T22:42:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.473+0000 7f169f400640 10 client.17472 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f169f400640 1 -- 172.21.15.18:0/1244990782 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5573b8938580 con 0x5573b89e10d0 2024-04-21T22:42:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f169f400640 10 client.17472 handle_command_reply: tid=0 2024-04-21T22:42:04.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 client.17472 shutdown 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 msgr2=0x5573b89ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f16ac09b990 tx=0x7f16ac09b6b0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 shutdown_connections 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89ce3b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b89e10d0 0x5573b89e34c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1244990782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c78e0 0x5573b89cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 >> 172.21.15.18:0/1244990782 conn(0x5573b89c2010 msgr2=0x5573b89c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f169f400640 0 client.17472 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.474+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 shutdown_connections 2024-04-21T22:42:04.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.475+0000 7f16c7a18740 1 -- 172.21.15.18:0/1244990782 wait complete. 2024-04-21T22:42:04.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.475+0000 7f16c7a18740 20 client.17472 trim_cache size 0 max 16384 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.494+0000 7f16c7a18740 1 Processor -- start 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.494+0000 7f16c7a18740 1 -- start start 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.494+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 0x5573b89d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.494+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.494+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16c7a18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01ab080 con 0x5573b89c78e0 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16c7a18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01acbc0 con 0x5573b89d0de0 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16c7a18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01ab750 con 0x5573b89c8200 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60598/0 (socket says 172.21.15.18:60598) 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 -- 172.21.15.18:0/1494950146 learned_addr learned my addr 172.21.15.18:0/1494950146 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16be800640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bde00640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 0x5573b89d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 -- 172.21.15.18:0/1494950146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 msgr2=0x5573b89ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 -- 172.21.15.18:0/1494950146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 msgr2=0x5573b89d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 0x5573b89d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bd400640 1 -- 172.21.15.18:0/1494950146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b89e3b40 con 0x5573b89c8200 2024-04-21T22:42:04.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.495+0000 7f16bde00640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 0x5573b89d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:04.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16bd400640 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f16ac099f40 tx=0x7f16ac09bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a6bae1c9d508c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16aa600640 1 -- 172.21.15.18:0/1494950146 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac09aca0 con 0x5573b89c8200 2024-04-21T22:42:04.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16aa600640 1 -- 172.21.15.18:0/1494950146 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16ac0cd140 con 0x5573b89c8200 2024-04-21T22:42:04.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16aa600640 1 -- 172.21.15.18:0/1494950146 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac0ba300 con 0x5573b89c8200 2024-04-21T22:42:04.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 -- 172.21.15.18:0/1494950146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 msgr2=0x5573b89dc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f16ac099f40 tx=0x7f16ac09bdd0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 -- 172.21.15.18:0/1494950146 shutdown_connections 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89d0de0 0x5573b89ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89c8200 0x5573b89dc8b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1494950146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c78e0 0x5573b89d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 -- 172.21.15.18:0/1494950146 >> 172.21.15.18:0/1494950146 conn(0x5573b89c2010 msgr2=0x5573b89cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.496+0000 7f16c7a18740 1 -- 172.21.15.18:0/1494950146 shutdown_connections 2024-04-21T22:42:04.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.497+0000 7f16c7a18740 1 -- 172.21.15.18:0/1494950146 wait complete. 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.497+0000 7f16c7a18740 1 -- start start 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.497+0000 7f16c7a18740 1 Processor -- start 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.497+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89c78e0 0x5573b89d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.497+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16c7a18740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16c7a18740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01ac4f0 con 0x5573b89c8200 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16c7a18740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01abe20 con 0x5573b89c78e0 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16c7a18740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16c01a9080 con 0x5573b89d0de0 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16c7a18740 10 client.0 _ll_register_callbacks cb 0x7f16ac09bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60614/0 (socket says 172.21.15.18:60614) 2024-04-21T22:42:04.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 -- 172.21.15.18:0/1480696104 learned_addr learned my addr 172.21.15.18:0/1480696104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16bde00640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89c78e0 0x5573b89d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 -- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89c78e0 msgr2=0x5573b89d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89c78e0 0x5573b89d4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 -- 172.21.15.18:0/1480696104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 msgr2=0x5573b89d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16be800640 1 -- 172.21.15.18:0/1480696104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b8a467a0 con 0x5573b89d0de0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.498+0000 7f16bd400640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f16be800640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033420 tx=0x7f16b802c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f9eef8b78bf743 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f169f400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8055070 con 0x5573b89d0de0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16ac0cd140 con 0x5573b89d0de0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f16b8003970 con 0x5573b89d0de0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f16b8033890 con 0x5573b89d0de0 2024-04-21T22:42:04.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f16c7a18740 10 client.27610 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5573b8a47a80 con 0x5573b89d0de0 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.499+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16ac0cd140 con 0x5573b89d0de0 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f16b8047440 con 0x5573b89d0de0 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 10 client.27610 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 10 client.27610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 20 client.27610 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b8a47db0 0x5573b8a4a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 4 client.27610 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:42:04.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5573b89328d0 con 0x5573b8a47db0 2024-04-21T22:42:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.500+0000 7f16bde00640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b8a47db0 0x5573b8a4a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.501+0000 7f16bde00640 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b8a47db0 0x5573b8a4a1a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3108f03fbf86e819 server_cookie=1649af4b26006531 in_seq=0 out_seq=0 2024-04-21T22:42:04.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.501+0000 7f169f400640 10 client.27610 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f169f400640 1 -- 172.21.15.18:0/1480696104 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5573b89328d0 con 0x5573b8a47db0 2024-04-21T22:42:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f169f400640 10 client.27610 handle_command_reply: tid=0 2024-04-21T22:42:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 client.27610 shutdown 2024-04-21T22:42:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 msgr2=0x5573b89d53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033420 tx=0x7f16b802c890 comp rx=0 tx=0).stop 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 shutdown_connections 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5573b8a47db0 0x5573b8a4a1a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5573b89d0de0 0x5573b89d53a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5573b89c8200 0x5573b89d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 --2- 172.21.15.18:0/1480696104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5573b89c78e0 0x5573b89d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f169f400640 0 client.27610 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 >> 172.21.15.18:0/1480696104 conn(0x5573b89c2010 msgr2=0x5573b89ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.502+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 shutdown_connections 2024-04-21T22:42:04.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16c7a18740 1 -- 172.21.15.18:0/1480696104 wait complete. 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16c7a18740 20 client.27610 trim_cache size 0 max 16384 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "21bbed93-85a0-4d94-bec2-3ec63d3fcba5", 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:42:04.512 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:04.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 msgr2=0x7f16a40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 0x7f16a40a51c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5573b89c73b0 tx=0x7f16b0005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:04.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 msgr2=0x7f16c01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.503+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00e9c0 tx=0x7f16ac00ee80 comp rx=0 tx=0).stop 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 shutdown_connections 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f16a40a2d00 0x7f16a40a51c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c01075f0 0x7f16c019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16c0101ef0 0x7f16c01982f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 --2- 172.21.15.18:0/3207336334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16c0101530 0x7f16c0197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 >> 172.21.15.18:0/3207336334 conn(0x7f16c00fd020 msgr2=0x7f16c00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 shutdown_connections 2024-04-21T22:42:04.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.504+0000 7f16bf200640 1 -- 172.21.15.18:0/3207336334 wait complete. 2024-04-21T22:42:04.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:42:04.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:42:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 -- 172.21.15.18:0/2741570647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00109760 msgr2=0x7f9c00109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 --2- 172.21.15.18:0/2741570647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00109760 0x7f9c00109b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009900 tx=0x7f9bf002bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 -- 172.21.15.18:0/2741570647 shutdown_connections 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 --2- 172.21.15.18:0/2741570647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00104110 0x7f9c00110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 --2- 172.21.15.18:0/2741570647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c00103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 --2- 172.21.15.18:0/2741570647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00109760 0x7f9c00109b40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 -- 172.21.15.18:0/2741570647 >> 172.21.15.18:0/2741570647 conn(0x7f9c000ff240 msgr2=0x7f9c00101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 -- 172.21.15.18:0/2741570647 shutdown_connections 2024-04-21T22:42:04.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.758+0000 7f9bff200640 1 -- 172.21.15.18:0/2741570647 wait complete. 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.759+0000 7f9bff200640 1 Processor -- start 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 -- start start 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c0019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 0x7f9c0019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00109760 0x7f9c0019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00113b80 con 0x7f9c00109760 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00113a00 con 0x7f9c00104110 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bff200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00113d00 con 0x7f9c00103750 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 0x7f9c0019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bfde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c0019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 0x7f9c0019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36696/0 (socket says 172.21.15.18:36696) 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bfd400640 1 -- 172.21.15.18:0/3297826348 learned_addr learned my addr 172.21.15.18:0/3297826348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.760+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00109760 0x7f9c0019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 -- 172.21.15.18:0/3297826348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 msgr2=0x7f9c0019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 0x7f9c0019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 -- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00109760 msgr2=0x7f9c0019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00109760 0x7f9c0019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 -- 172.21.15.18:0/3297826348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0019f030 con 0x7f9c00103750 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.761+0000 7f9bfde00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c0019a040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9bf002c170 tx=0x7f9bf0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.762+0000 7f9bf6a00640 1 -- 172.21.15.18:0/3297826348 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0041070 con 0x7f9c00103750 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.762+0000 7f9bf6a00640 1 -- 172.21.15.18:0/3297826348 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf00054e0 con 0x7f9c00103750 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.762+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0019f2c0 con 0x7f9c00103750 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.762+0000 7f9bf6a00640 1 -- 172.21.15.18:0/3297826348 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0003bf0 con 0x7f9c00103750 2024-04-21T22:42:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.762+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c001a6bb0 con 0x7f9c00103750 2024-04-21T22:42:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.766+0000 7f9c07773740 1 Processor -- start 2024-04-21T22:42:04.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.766+0000 7f9c07773740 1 -- start start 2024-04-21T22:42:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.766+0000 7f9bf6a00640 1 -- 172.21.15.18:0/3297826348 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f9bf0044070 con 0x7f9c00103750 2024-04-21T22:42:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d99aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d99d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b19d8f5410 con 0x55b19d99afb0 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19d89d7e0 con 0x55b19d9923d0 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9c07773740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b19d8f13d0 con 0x55b19d991ab0 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d99aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60656/0 (socket says 172.21.15.18:60656) 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 -- 172.21.15.18:0/4160045765 learned_addr learned my addr 172.21.15.18:0/4160045765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfd400640 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d99d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 -- 172.21.15.18:0/4160045765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 msgr2=0x55b19d99aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d99aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 -- 172.21.15.18:0/4160045765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 msgr2=0x55b19d99d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d99d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfe800640 1 -- 172.21.15.18:0/4160045765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d6d37d0 con 0x55b19d991ab0 2024-04-21T22:42:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.767+0000 7f9bfd400640 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d99d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:04.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.768+0000 7f9bfe800640 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009f50 tx=0x7f9bf80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a3a5f71f3f1c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.768+0000 7f9beb000640 1 -- 172.21.15.18:0/4160045765 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8004d20 con 0x55b19d991ab0 2024-04-21T22:42:04.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.768+0000 7f9beb000640 1 -- 172.21.15.18:0/4160045765 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf8004050 con 0x55b19d991ab0 2024-04-21T22:42:04.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.768+0000 7f9beb000640 1 -- 172.21.15.18:0/4160045765 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8005280 con 0x55b19d991ab0 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.769+0000 7f9bf6a00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 0x7f9be40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.769+0000 7f9bf6a00640 1 -- 172.21.15.18:0/3297826348 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f9bf00f0c80 con 0x7f9c00103750 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.769+0000 7f9c07773740 1 -- 172.21.15.18:0/4160045765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 msgr2=0x55b19d991e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.769+0000 7f9c07773740 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009f50 tx=0x7f9bf80118d0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.769+0000 7f9bfde00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 0x7f9be40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 -- 172.21.15.18:0/4160045765 shutdown_connections 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d99d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d99aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 --2- 172.21.15.18:0/4160045765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d991e90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 -- 172.21.15.18:0/4160045765 >> 172.21.15.18:0/4160045765 conn(0x55b19d98c1e0 msgr2=0x55b19d98c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 -- 172.21.15.18:0/4160045765 shutdown_connections 2024-04-21T22:42:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9c07773740 1 -- 172.21.15.18:0/4160045765 wait complete. 2024-04-21T22:42:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.770+0000 7f9bfde00640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 0x7f9be40a5240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55b19d991580 tx=0x7f9bf00f4940 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.771+0000 7f9c07773740 1 -- start start 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.771+0000 7f9c07773740 1 Processor -- start 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9980b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d998b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b19d99dda0 con 0x55b19d99afb0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b19d8b0c40 con 0x55b19d9923d0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b19d99df20 con 0x55b19d991ab0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9c07773740 10 client.0 _ll_register_callbacks cb 0x55b19d8b0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:60666/0 (socket says 172.21.15.18:60666) 2024-04-21T22:42:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36704/0 (socket says 172.21.15.18:36704) 2024-04-21T22:42:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfe800640 1 -- 172.21.15.18:0/2785823035 learned_addr learned my addr 172.21.15.18:0/2785823035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.772+0000 7f9bfe800640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d998b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 -- 172.21.15.18:0/2785823035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 msgr2=0x55b19d9980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 -- 172.21.15.18:0/2785823035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 msgr2=0x55b19d998b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d998b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 -- 172.21.15.18:0/2785823035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19d6093f0 con 0x55b19d9923d0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c00101840 tx=0x7f9bec012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aff24999d7eb2e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bdf400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00f920 con 0x55b19d9923d0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.773+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f9bec00fac0 con 0x55b19d9923d0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf8004050 con 0x55b19d9923d0 2024-04-21T22:42:04.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9bec00fcc0 con 0x55b19d9923d0 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9c07773740 10 client.27560 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b19d5c90f0 con 0x55b19d9923d0 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf8004050 con 0x55b19d9923d0 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.774+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f9bec023070 con 0x55b19d9923d0 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 10 client.27560 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 10 client.27560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 20 client.27560 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:04.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19d9b3d20 0x55b19d9b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 4 client.27560 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b19d908c40 con 0x55b19d9b3d20 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9bfe800640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19d9b3d20 0x55b19d9b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9bfe800640 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19d9b3d20 0x55b19d9b6110 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f765cab99a2d5606 server_cookie=d60c0fe30ba12caa in_seq=0 out_seq=0 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.775+0000 7f9bdf400640 10 client.27560 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.776+0000 7f9bdf400640 1 -- 172.21.15.18:0/2785823035 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b19d908c40 con 0x55b19d9b3d20 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.776+0000 7f9bdf400640 10 client.27560 handle_command_reply: tid=0 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.776+0000 7f9c07773740 1 client.27560 shutdown 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 msgr2=0x55b19d9985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c00101840 tx=0x7f9bec012b60 comp rx=0 tx=0).stop 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 shutdown_connections 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d998b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d9985f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19d9b3d20 0x55b19d9b6110 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 --2- 172.21.15.18:0/2785823035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 >> 172.21.15.18:0/2785823035 conn(0x55b19d98c1e0 msgr2=0x55b19d98b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9bdf400640 0 client.27560 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 shutdown_connections 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 1 -- 172.21.15.18:0/2785823035 wait complete. 2024-04-21T22:42:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.777+0000 7f9c07773740 20 client.27560 trim_cache size 0 max 16384 2024-04-21T22:42:04.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.801+0000 7f9c07773740 1 Processor -- start 2024-04-21T22:42:04.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.801+0000 7f9c07773740 1 -- start start 2024-04-21T22:42:04.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d991ab0 0x55b19d99a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d99afb0 0x55b19d9bb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ab1e0 con 0x55b19d991ab0 2024-04-21T22:42:04.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001acd20 con 0x55b19d9923d0 2024-04-21T22:42:04.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9c07773740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ab8b0 con 0x55b19d99afb0 2024-04-21T22:42:04.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36718/0 (socket says 172.21.15.18:36718) 2024-04-21T22:42:04.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 -- 172.21.15.18:0/2970972999 learned_addr learned my addr 172.21.15.18:0/2970972999 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfe800640 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d991ab0 0x55b19d99a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfe800640 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d99afb0 0x55b19d9bb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 -- 172.21.15.18:0/2970972999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d99afb0 msgr2=0x55b19d9bb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d99afb0 0x55b19d9bb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 -- 172.21.15.18:0/2970972999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d991ab0 msgr2=0x55b19d99a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d991ab0 0x55b19d99a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.802+0000 7f9bfd400640 1 -- 172.21.15.18:0/2970972999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19d992200 con 0x55b19d9923d0 2024-04-21T22:42:04.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.803+0000 7f9bfd400640 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9bec001eb0 tx=0x7f9bec0098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c9cf3f73673208 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.803+0000 7f9bea600640 1 -- 172.21.15.18:0/2970972999 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec029070 con 0x55b19d9923d0 2024-04-21T22:42:04.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.803+0000 7f9bea600640 1 -- 172.21.15.18:0/2970972999 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bec00f920 con 0x55b19d9923d0 2024-04-21T22:42:04.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.803+0000 7f9bea600640 1 -- 172.21.15.18:0/2970972999 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec005190 con 0x55b19d9923d0 2024-04-21T22:42:04.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 -- 172.21.15.18:0/2970972999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 msgr2=0x55b19d98b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9bec001eb0 tx=0x7f9bec0098a0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 -- 172.21.15.18:0/2970972999 shutdown_connections 2024-04-21T22:42:04.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d99afb0 0x55b19d9bb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d98b2c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 --2- 172.21.15.18:0/2970972999 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d991ab0 0x55b19d99a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 -- 172.21.15.18:0/2970972999 >> 172.21.15.18:0/2970972999 conn(0x55b19d98c1e0 msgr2=0x55b19d98abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 -- 172.21.15.18:0/2970972999 shutdown_connections 2024-04-21T22:42:04.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.804+0000 7f9c07773740 1 -- 172.21.15.18:0/2970972999 wait complete. 2024-04-21T22:42:04.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.805+0000 7f9c07773740 1 -- start start 2024-04-21T22:42:04.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.805+0000 7f9c07773740 1 Processor -- start 2024-04-21T22:42:04.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d995070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ac650 con 0x55b19d99afb0 2024-04-21T22:42:04.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001abf80 con 0x55b19d9923d0 2024-04-21T22:42:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001a91e0 con 0x55b19d991ab0 2024-04-21T22:42:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9c07773740 10 client.0 _ll_register_callbacks cb 0x7f9bec009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9bfd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36724/0 (socket says 172.21.15.18:36724) 2024-04-21T22:42:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9bfd400640 1 -- 172.21.15.18:0/3882777783 learned_addr learned my addr 172.21.15.18:0/3882777783 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.806+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d995070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 -- 172.21.15.18:0/3882777783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 msgr2=0x55b19d9abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 -- 172.21.15.18:0/3882777783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 msgr2=0x55b19d995070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d995070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 -- 172.21.15.18:0/3882777783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19d9958a0 con 0x55b19d9923d0 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d995070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bfd400640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003cc0 tx=0x7f9bec003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38101ab8f2552148 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bdf400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec032020 con 0x55b19d9923d0 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8571+0+0 (secure 0 0 0) 0x7f9bec004ff0 con 0x55b19d9923d0 2024-04-21T22:42:04.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.807+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bec00f920 con 0x55b19d9923d0 2024-04-21T22:42:04.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9bec03d050 con 0x55b19d9923d0 2024-04-21T22:42:04.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 10 client.27566 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:04.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b19da1a2a0 con 0x55b19d9923d0 2024-04-21T22:42:04.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bec00f920 con 0x55b19d9923d0 2024-04-21T22:42:04.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f9bec023040 con 0x55b19d9923d0 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 10 client.27566 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 10 client.27566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 20 client.27566 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19da1aa00 0x55b19da1ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 4 client.27566 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:42:04.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.808+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b19d902950 con 0x55b19da1aa00 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19da1aa00 0x55b19da1ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9bfe800640 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19da1aa00 0x55b19da1ce20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9edf42102b9470a server_cookie=8b7d8ddc91e531dd in_seq=0 out_seq=0 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9bdf400640 10 client.27566 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9bdf400640 1 -- 172.21.15.18:0/3882777783 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b19d902950 con 0x55b19da1aa00 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9bdf400640 10 client.27566 handle_command_reply: tid=0 2024-04-21T22:42:04.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.809+0000 7f9c07773740 1 client.27566 shutdown 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 msgr2=0x55b19d994ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003cc0 tx=0x7f9bec003cf0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 shutdown_connections 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b19d99afb0 0x55b19d995070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b19d9923d0 0x55b19d994ad0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b19da1aa00 0x55b19da1ce20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 --2- 172.21.15.18:0/3882777783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b19d991ab0 0x55b19d9abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9bdf400640 0 client.27566 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:04.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 >> 172.21.15.18:0/3882777783 conn(0x55b19d98c1e0 msgr2=0x55b19d98b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 shutdown_connections 2024-04-21T22:42:04.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.810+0000 7f9c07773740 1 -- 172.21.15.18:0/3882777783 wait complete. 2024-04-21T22:42:04.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.811+0000 7f9c07773740 20 client.27566 trim_cache size 0 max 16384 2024-04-21T22:42:04.832 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:04.832 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:42:04.832 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: "21bbed93-85a0-4d94-bec2-3ec63d3fcba5": { 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "21bbed93-85a0-4d94-bec2-3ec63d3fcba5", 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:42:04.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:42:04.834 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:04.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 msgr2=0x7f9be40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 0x7f9be40a5240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55b19d991580 tx=0x7f9bf00f4940 comp rx=0 tx=0).stop 2024-04-21T22:42:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 msgr2=0x7f9c0019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c0019a040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9bf002c170 tx=0x7f9bf0004270 comp rx=0 tx=0).stop 2024-04-21T22:42:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 shutdown_connections 2024-04-21T22:42:04.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f9be40a2d80 0x7f9be40a5240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c00109760 0x7f9c0019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c00104110 0x7f9c0019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 --2- 172.21.15.18:0/3297826348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00103750 0x7f9c0019a040 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:04.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 >> 172.21.15.18:0/3297826348 conn(0x7f9c000ff240 msgr2=0x7f9c000ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 shutdown_connections 2024-04-21T22:42:04.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:04.812+0000 7f9bff200640 1 -- 172.21.15.18:0/3297826348 wait complete. 2024-04-21T22:42:04.838 INFO:tasks.cephfs.filesystem:scrub status for tag:21bbed93-85a0-4d94-bec2-3ec63d3fcba5 - {'path': '/', 'tag': '21bbed93-85a0-4d94-bec2-3ec63d3fcba5', 'options': 'recursive,force'} 2024-04-21T22:42:05.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: pgmap v246: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:42:05.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:42:05.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:05.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:05 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: pgmap v246: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:42:05.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:42:05.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:05.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:05 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: pgmap v246: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:05.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:05 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:07 smithi018 ceph-mon[26614]: pgmap v247: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:42:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:07 smithi081 ceph-mon[31692]: pgmap v247: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:42:07.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:07 smithi047 ceph-mon[31561]: pgmap v247: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:42:09.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:09 smithi018 ceph-mon[26614]: pgmap v248: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:42:09.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:09 smithi018 ceph-mon[26614]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T22:42:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:09 smithi081 ceph-mon[31692]: pgmap v248: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:42:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:09 smithi081 ceph-mon[31692]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T22:42:09.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:09 smithi047 ceph-mon[31561]: pgmap v248: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 30 op/s 2024-04-21T22:42:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:09 smithi047 ceph-mon[31561]: osdmap e91: 12 total, 12 up, 12 in 2024-04-21T22:42:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:11 smithi018 ceph-mon[26614]: pgmap v250: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:11 smithi081 ceph-mon[31692]: pgmap v250: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:11 smithi047 ceph-mon[31561]: pgmap v250: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:13.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:13 smithi018 ceph-mon[26614]: pgmap v251: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:13 smithi081 ceph-mon[31692]: pgmap v251: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:13 smithi047 ceph-mon[31561]: pgmap v251: 97 pgs: 97 active+clean; 96 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-21T22:42:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:15 smithi018 ceph-mon[26614]: pgmap v252: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:15 smithi081 ceph-mon[31692]: pgmap v252: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:15 smithi047 ceph-mon[31561]: pgmap v252: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:17 smithi018 ceph-mon[26614]: pgmap v253: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:17 smithi081 ceph-mon[31692]: pgmap v253: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:17 smithi047 ceph-mon[31561]: pgmap v253: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:42:18.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:18 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:18.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:18 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:18.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:18 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:18.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:18 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:18.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:18 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:18.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:18 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:18.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:18 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:18.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:18 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:18.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:18 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:19.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:19 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:19.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:19 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:19.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:19 smithi018 ceph-mon[26614]: pgmap v254: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:19.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:19 smithi018 ceph-mon[26614]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T22:42:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:19 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:19 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:19.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:19 smithi081 ceph-mon[31692]: pgmap v254: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:19.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:19 smithi081 ceph-mon[31692]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T22:42:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:19 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:19 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:19 smithi047 ceph-mon[31561]: pgmap v254: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:19 smithi047 ceph-mon[31561]: osdmap e92: 12 total, 12 up, 12 in 2024-04-21T22:42:21.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:21 smithi018 ceph-mon[26614]: pgmap v256: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:21 smithi081 ceph-mon[31692]: pgmap v256: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:21.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:21 smithi047 ceph-mon[31561]: pgmap v256: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:23.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:23 smithi018 ceph-mon[26614]: pgmap v257: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:23 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:42:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:23 smithi081 ceph-mon[31692]: pgmap v257: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:23 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:42:23.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:23 smithi047 ceph-mon[31561]: pgmap v257: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:42:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:23 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:42:24.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:24 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:42:24.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:24 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:42:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:24 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:42:24.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:24 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:42:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:24 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:42:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:24 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:42:25.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:24 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:42:25.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:24 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:42:25.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:24 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:42:25.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:25 smithi081 ceph-mon[31692]: pgmap v258: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:25 smithi047 ceph-mon[31561]: pgmap v258: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:26.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:25 smithi018 ceph-mon[26614]: pgmap v258: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:27 smithi081 ceph-mon[31692]: pgmap v259: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:27 smithi047 ceph-mon[31561]: pgmap v259: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:28.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:27 smithi018 ceph-mon[26614]: pgmap v259: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:42:29.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:29 smithi081 ceph-mon[31692]: pgmap v260: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:42:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:29 smithi047 ceph-mon[31561]: pgmap v260: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:42:30.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:29 smithi018 ceph-mon[26614]: pgmap v260: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:42:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:31 smithi081 ceph-mon[31692]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:31 smithi047 ceph-mon[31561]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:32.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:31 smithi018 ceph-mon[26614]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:33 smithi081 ceph-mon[31692]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:33 smithi047 ceph-mon[31561]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:34.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:33 smithi018 ceph-mon[26614]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:34.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:42:34.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:42:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 -- 172.21.15.18:0/214385830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 msgr2=0x7fda1c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 --2- 172.21.15.18:0/214385830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c108100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fda04009890 tx=0x7fda0402bb70 comp rx=0 tx=0).stop 2024-04-21T22:42:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 -- 172.21.15.18:0/214385830 shutdown_connections 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 --2- 172.21.15.18:0/214385830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c108640 0x7fda1c1149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 --2- 172.21.15.18:0/214385830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c108100 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 --2- 172.21.15.18:0/214385830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c10dc00 0x7fda1c10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 -- 172.21.15.18:0/214385830 >> 172.21.15.18:0/214385830 conn(0x7fda1c077550 msgr2=0x7fda1c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 -- 172.21.15.18:0/214385830 shutdown_connections 2024-04-21T22:42:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.070+0000 7fda21200640 1 -- 172.21.15.18:0/214385830 wait complete. 2024-04-21T22:42:35.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.071+0000 7fda21200640 1 Processor -- start 2024-04-21T22:42:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.071+0000 7fda21200640 1 -- start start 2024-04-21T22:42:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.071+0000 7fda21200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c19e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda21200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda21200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 0x7fda1c1a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda21200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c117f40 con 0x7fda1c10dc00 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda21200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c117dc0 con 0x7fda1c108640 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda21200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1180c0 con 0x7fda1c107c80 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:58848/0 (socket says 172.21.15.18:58848) 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 -- 172.21.15.18:0/3425550816 learned_addr learned my addr 172.21.15.18:0/3425550816 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda1b400640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c19e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda1be00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 0x7fda1c1a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 -- 172.21.15.18:0/3425550816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 msgr2=0x7fda1c19e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c19e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 -- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 msgr2=0x7fda1c1a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 0x7fda1c1a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda13e00640 1 -- 172.21.15.18:0/3425550816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c1a34b0 con 0x7fda1c108640 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.072+0000 7fda1be00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 0x7fda1c1a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda13e00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda040042f0 tx=0x7fda04004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda18c00640 1 -- 172.21.15.18:0/3425550816 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04041020 con 0x7fda1c108640 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda18c00640 1 -- 172.21.15.18:0/3425550816 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda0402c9f0 con 0x7fda1c108640 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c1a3740 con 0x7fda1c108640 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda18c00640 1 -- 172.21.15.18:0/3425550816 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04039040 con 0x7fda1c108640 2024-04-21T22:42:35.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.073+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c1ab030 con 0x7fda1c108640 2024-04-21T22:42:35.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.076+0000 7fda25122740 1 Processor -- start 2024-04-21T22:42:35.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.076+0000 7fda18c00640 1 -- 172.21.15.18:0/3425550816 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fda04044020 con 0x7fda1c108640 2024-04-21T22:42:35.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 -- start start 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee43d0 0x556388eeca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556388e47410 con 0x556388ee3ab0 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556388def7e0 con 0x556388eecfb0 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda25122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556388e433d0 con 0x556388ee43d0 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46212/0 (socket says 172.21.15.18:46212) 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda13e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda1be00640 1 -- 172.21.15.18:0/3522688408 learned_addr learned my addr 172.21.15.18:0/3522688408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.077+0000 7fda1b400640 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee43d0 0x556388eeca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 -- 172.21.15.18:0/3522688408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee43d0 msgr2=0x556388eeca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee43d0 0x556388eeca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 -- 172.21.15.18:0/3522688408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 msgr2=0x556388eef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 -- 172.21.15.18:0/3522688408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556388c257d0 con 0x556388ee3ab0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda1be00640 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda1400f480 tx=0x7fda1400f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cc10b78f8e785e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda18c00640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 0x7fda000a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda10c00640 1 -- 172.21.15.18:0/3522688408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1401d070 con 0x556388ee3ab0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda10c00640 1 -- 172.21.15.18:0/3522688408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda1400cc60 con 0x556388ee3ab0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.078+0000 7fda10c00640 1 -- 172.21.15.18:0/3522688408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14018d10 con 0x556388ee3ab0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda18c00640 1 -- 172.21.15.18:0/3425550816 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fda040f0d70 con 0x7fda1c108640 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda1b400640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 0x7fda000a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 -- 172.21.15.18:0/3522688408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 msgr2=0x556388ee3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fda1400f480 tx=0x7fda1400f940 comp rx=0 tx=0).stop 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 -- 172.21.15.18:0/3522688408 shutdown_connections 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee43d0 0x556388eeca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 --2- 172.21.15.18:0/3522688408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee3ab0 0x556388ee3e90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 -- 172.21.15.18:0/3522688408 >> 172.21.15.18:0/3522688408 conn(0x556388ede1e0 msgr2=0x556388ede5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda1b400640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 0x7fda000a5240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556388ee3580 tx=0x7fda0c005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 -- 172.21.15.18:0/3522688408 shutdown_connections 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.079+0000 7fda25122740 1 -- 172.21.15.18:0/3522688408 wait complete. 2024-04-21T22:42:35.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.080+0000 7fda25122740 1 -- start start 2024-04-21T22:42:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.080+0000 7fda25122740 1 Processor -- start 2024-04-21T22:42:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388eea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eeaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556388eefda0 con 0x556388ee43d0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556388e02c40 con 0x556388eecfb0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556388eeff20 con 0x556388ee3ab0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda25122740 10 client.0 _ll_register_callbacks cb 0x556388e02630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388eea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44014/0 (socket says 172.21.15.18:44014) 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 -- 172.21.15.18:0/398291285 learned_addr learned my addr 172.21.15.18:0/398291285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1be00640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eeaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 -- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 msgr2=0x556388eeaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eeaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 -- 172.21.15.18:0/398291285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 msgr2=0x556388eea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.081+0000 7fda1b400640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388eea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda1b400640 1 -- 172.21.15.18:0/398291285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556388b5b3f0 con 0x556388ee3ab0 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda13e00640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388eea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda1b400640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0045e0 tx=0x7fda0c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7a5805d46a3e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda09600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c01e680 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fda0c01e820 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.082+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1400cc60 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fda0c01ea20 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 10 client.27640 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556388b1b0f0 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda1400cc60 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fda0c027070 con 0x556388ee3ab0 2024-04-21T22:42:35.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 10 client.27640 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 10 client.27640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 20 client.27640 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388efd400 0x556388eff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 4 client.27640 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.083+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556388e5ac40 con 0x556388efd400 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.084+0000 7fda13e00640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388efd400 0x556388eff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.084+0000 7fda13e00640 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388efd400 0x556388eff870 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=befcdf429b5b26d server_cookie=ed46171f741b9320 in_seq=0 out_seq=0 2024-04-21T22:42:35.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.084+0000 7fda09600640 10 client.27640 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda09600640 1 -- 172.21.15.18:0/398291285 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556388e5ac40 con 0x556388efd400 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda09600640 10 client.27640 handle_command_reply: tid=0 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 client.27640 shutdown 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 msgr2=0x556388ee9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0045e0 tx=0x7fda0c004730 comp rx=0 tx=0).stop 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 shutdown_connections 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388eeaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388eea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388efd400 0x556388eff870 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 --2- 172.21.15.18:0/398291285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ee9fb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 >> 172.21.15.18:0/398291285 conn(0x556388ede1e0 msgr2=0x556388edff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.085+0000 7fda09600640 0 client.27640 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.086+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 shutdown_connections 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.086+0000 7fda25122740 1 -- 172.21.15.18:0/398291285 wait complete. 2024-04-21T22:42:35.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.086+0000 7fda25122740 20 client.27640 trim_cache size 0 max 16384 2024-04-21T22:42:35.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.105+0000 7fda25122740 1 Processor -- start 2024-04-21T22:42:35.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.105+0000 7fda25122740 1 -- start start 2024-04-21T22:42:35.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388eec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b3a50 con 0x556388ee43d0 2024-04-21T22:42:35.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b5590 con 0x556388eecfb0 2024-04-21T22:42:35.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda25122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b4120 con 0x556388ee3ab0 2024-04-21T22:42:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:58872/0 (socket says 172.21.15.18:58872) 2024-04-21T22:42:35.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda1be00640 1 -- 172.21.15.18:0/2617112911 learned_addr learned my addr 172.21.15.18:0/2617112911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda1b400640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388eec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.106+0000 7fda13e00640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 -- 172.21.15.18:0/2617112911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 msgr2=0x556388eec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388eec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 -- 172.21.15.18:0/2617112911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 msgr2=0x556388ef8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 -- 172.21.15.18:0/2617112911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556388ee5b80 con 0x556388eecfb0 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda13e00640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda1be00640 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fda1401b040 tx=0x7fda14009ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154ddf9901ee44bb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda0be00640 1 -- 172.21.15.18:0/2617112911 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14027030 con 0x556388eecfb0 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda0be00640 1 -- 172.21.15.18:0/2617112911 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda140189f0 con 0x556388eecfb0 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.107+0000 7fda0be00640 1 -- 172.21.15.18:0/2617112911 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1401d040 con 0x556388eecfb0 2024-04-21T22:42:35.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 -- 172.21.15.18:0/2617112911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 msgr2=0x556388edd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fda1401b040 tx=0x7fda14009ce0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 -- 172.21.15.18:0/2617112911 shutdown_connections 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388edd2c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 --2- 172.21.15.18:0/2617112911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388eec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 -- 172.21.15.18:0/2617112911 >> 172.21.15.18:0/2617112911 conn(0x556388ede1e0 msgr2=0x556388edcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 -- 172.21.15.18:0/2617112911 shutdown_connections 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.108+0000 7fda25122740 1 -- 172.21.15.18:0/2617112911 wait complete. 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 -- start start 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 Processor -- start 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ef56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388ef1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b4ec0 con 0x556388ee43d0 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b47f0 con 0x556388eecfb0 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c1b1a50 con 0x556388ee3ab0 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.109+0000 7fda25122740 10 client.0 _ll_register_callbacks cb 0x7fda0c0043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46234/0 (socket says 172.21.15.18:46234) 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 -- 172.21.15.18:0/2678451489 learned_addr learned my addr 172.21.15.18:0/2678451489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda1be00640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388ef1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda1b400640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ef56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 -- 172.21.15.18:0/2678451489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 msgr2=0x556388ef56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ef56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 -- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 msgr2=0x556388ef1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388ef1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 -- 172.21.15.18:0/2678451489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556388ef1860 con 0x556388ee43d0 2024-04-21T22:42:35.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda1b400640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ef56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda13e00640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda0402c180 tx=0x7fda040095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1334b13b867c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.110+0000 7fda09600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda040bce50 con 0x556388ee43d0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fda040b9980 con 0x556388ee43d0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda140189f0 con 0x556388ee43d0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fda040bcc70 con 0x556388ee43d0 2024-04-21T22:42:35.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda25122740 10 client.17505 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556388f63ac0 con 0x556388ee43d0 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda140189f0 con 0x556388ee43d0 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fda0403c030 con 0x556388ee43d0 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.111+0000 7fda25122740 10 client.17505 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda25122740 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda25122740 20 client.17505 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388f64240 0x556388f66660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda25122740 4 client.17505 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:42:35.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556388e54950 con 0x556388f64240 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda1b400640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388f64240 0x556388f66660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda1b400640 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388f64240 0x556388f66660 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fa18497cba04a3 server_cookie=16b28656ea59b315 in_seq=0 out_seq=0 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.112+0000 7fda09600640 10 client.17505 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda09600640 1 -- 172.21.15.18:0/2678451489 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556388e54950 con 0x556388f64240 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda09600640 10 client.17505 handle_command_reply: tid=0 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 client.17505 shutdown 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 msgr2=0x556388ef0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fda0402c180 tx=0x7fda040095b0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 shutdown_connections 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556388eecfb0 0x556388ef1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556388ee43d0 0x556388ef0a20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556388f64240 0x556388f66660 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 --2- 172.21.15.18:0/2678451489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556388ee3ab0 0x556388ef56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 >> 172.21.15.18:0/2678451489 conn(0x556388ede1e0 msgr2=0x556388edd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda09600640 0 client.17505 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 shutdown_connections 2024-04-21T22:42:35.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 1 -- 172.21.15.18:0/2678451489 wait complete. 2024-04-21T22:42:35.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.113+0000 7fda25122740 20 client.17505 trim_cache size 0 max 16384 2024-04-21T22:42:35.124 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:42:35.124 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:42:35.124 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 msgr2=0x7fda000a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 0x7fda000a5240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556388ee3580 tx=0x7fda0c005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:35.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 msgr2=0x7fda1c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda040042f0 tx=0x7fda04004320 comp rx=0 tx=0).stop 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 shutdown_connections 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fda000a2d80 0x7fda000a5240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1c10dc00 0x7fda1c1a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda1c108640 0x7fda1c19ea00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 --2- 172.21.15.18:0/3425550816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda1c107c80 0x7fda1c19e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 >> 172.21.15.18:0/3425550816 conn(0x7fda1c077550 msgr2=0x7fda1c078730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 shutdown_connections 2024-04-21T22:42:35.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.114+0000 7fda21200640 1 -- 172.21.15.18:0/3425550816 wait complete. 2024-04-21T22:42:35.133 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:42:35.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:42:35.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 -- 172.21.15.18:0/608503307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac074400 msgr2=0x7fccac1120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 --2- 172.21.15.18:0/608503307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac074400 0x7fccac1120b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009860 tx=0x7fcc9802bc10 comp rx=0 tx=0).stop 2024-04-21T22:42:35.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 -- 172.21.15.18:0/608503307 shutdown_connections 2024-04-21T22:42:35.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 --2- 172.21.15.18:0/608503307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac1125f0 0x7fccac1149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 --2- 172.21.15.18:0/608503307 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac074400 0x7fccac1120b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 --2- 172.21.15.18:0/608503307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac073ae0 0x7fccac073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.338+0000 7fccb2c00640 1 -- 172.21.15.18:0/608503307 >> 172.21.15.18:0/608503307 conn(0x7fccac0fd150 msgr2=0x7fccac0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.339+0000 7fccb2c00640 1 -- 172.21.15.18:0/608503307 shutdown_connections 2024-04-21T22:42:35.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.339+0000 7fccb2c00640 1 -- 172.21.15.18:0/608503307 wait complete. 2024-04-21T22:42:35.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.340+0000 7fccb2c00640 1 Processor -- start 2024-04-21T22:42:35.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.340+0000 7fccb2c00640 1 -- start start 2024-04-21T22:42:35.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.340+0000 7fccb2c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 0x7fccac19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.340+0000 7fccb2c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 0x7fccac19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.340+0000 7fccb2c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac1125f0 0x7fccac1a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb2c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccac117ff0 con 0x7fccac074400 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb2c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fccac117e70 con 0x7fccac1125f0 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb2c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccac118170 con 0x7fccac073ae0 2024-04-21T22:42:35.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 0x7fccac19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 0x7fccac19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb1800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 0x7fccac19e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:44034/0 (socket says 172.21.15.18:44034) 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb1800640 1 -- 172.21.15.18:0/1115851900 learned_addr learned my addr 172.21.15.18:0/1115851900 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb2200640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac1125f0 0x7fccac1a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 -- 172.21.15.18:0/1115851900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 msgr2=0x7fccac19e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 0x7fccac19e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 -- 172.21.15.18:0/1115851900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac1125f0 msgr2=0x7fccac1a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac1125f0 0x7fccac1a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.341+0000 7fccb0e00640 1 -- 172.21.15.18:0/1115851900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac1a3530 con 0x7fccac074400 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccb0e00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 0x7fccac19ead0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcc98037040 tx=0x7fcc980344c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98041020 con 0x7fccac074400 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc9802ca90 con 0x7fccac074400 2024-04-21T22:42:35.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98039040 con 0x7fccac074400 2024-04-21T22:42:35.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac1a37c0 con 0x7fccac074400 2024-04-21T22:42:35.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.342+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac1ab0b0 con 0x7fccac074400 2024-04-21T22:42:35.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.343+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac075220 con 0x7fccac074400 2024-04-21T22:42:35.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.346+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fcc98044020 con 0x7fccac074400 2024-04-21T22:42:35.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.347+0000 7fccaa000640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 0x7fcc940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.347+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fcc980f09e0 con 0x7fccac074400 2024-04-21T22:42:35.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.348+0000 7fccb1800640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 0x7fcc940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.348+0000 7fccb1800640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 0x7fcc940a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcca0005c80 tx=0x7fcca0009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.352+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fcc9804b020 con 0x7fccac074400 2024-04-21T22:42:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.596+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccac104ac0 con 0x7fccac074400 2024-04-21T22:42:35.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.598+0000 7fccaa000640 1 -- 172.21.15.18:0/1115851900 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7fcc980bd680 con 0x7fccac074400 2024-04-21T22:42:35.598 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:42:35.599 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:42:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:42:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.600+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 msgr2=0x7fcc940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.600+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 0x7fcc940a5230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcca0005c80 tx=0x7fcca0009260 comp rx=0 tx=0).stop 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.600+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 msgr2=0x7fccac19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.600+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 0x7fccac19ead0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcc98037040 tx=0x7fcc980344c0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 shutdown_connections 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fcc940a2d70 0x7fcc940a5230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccac1125f0 0x7fccac1a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac074400 0x7fccac19ead0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 --2- 172.21.15.18:0/1115851900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac073ae0 0x7fccac19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 >> 172.21.15.18:0/1115851900 conn(0x7fccac0fd150 msgr2=0x7fccac0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 shutdown_connections 2024-04-21T22:42:35.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.601+0000 7fccb2c00640 1 -- 172.21.15.18:0/1115851900 wait complete. 2024-04-21T22:42:35.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:42:35.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 -- 172.21.15.18:0/623141416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8109770 msgr2=0x7f8ac8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 --2- 172.21.15.18:0/623141416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8109770 0x7f8ac8109b50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009930 tx=0x7f8ab802bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:35.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 -- 172.21.15.18:0/623141416 shutdown_connections 2024-04-21T22:42:35.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 --2- 172.21.15.18:0/623141416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8104120 0x7f8ac8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 --2- 172.21.15.18:0/623141416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8103760 0x7f8ac8103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 --2- 172.21.15.18:0/623141416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8109770 0x7f8ac8109b50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 -- 172.21.15.18:0/623141416 >> 172.21.15.18:0/623141416 conn(0x7f8ac80ff230 msgr2=0x7f8ac8101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 -- 172.21.15.18:0/623141416 shutdown_connections 2024-04-21T22:42:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.827+0000 7f8acca00640 1 -- 172.21.15.18:0/623141416 wait complete. 2024-04-21T22:42:35.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.828+0000 7f8acca00640 1 Processor -- start 2024-04-21T22:42:35.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.828+0000 7f8acca00640 1 -- start start 2024-04-21T22:42:35.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 0x7f8ac819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8113bd0 con 0x7f8ac8103760 2024-04-21T22:42:35.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8113a50 con 0x7f8ac8109770 2024-04-21T22:42:35.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8acca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8113d50 con 0x7f8ac8104120 2024-04-21T22:42:35.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59364/0 (socket says 172.21.15.18:59364) 2024-04-21T22:42:35.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51262/0 (socket says 172.21.15.18:51262) 2024-04-21T22:42:35.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac5e00640 1 -- 172.21.15.18:0/1260315310 learned_addr learned my addr 172.21.15.18:0/1260315310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.829+0000 7f8ac7200640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 0x7f8ac819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 -- 172.21.15.18:0/1260315310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 msgr2=0x7f8ac819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 0x7f8ac819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 -- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 msgr2=0x7f8ac819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 -- 172.21.15.18:0/1260315310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac819f0b0 con 0x7f8ac8104120 2024-04-21T22:42:35.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac7200640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 0x7f8ac819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac6800640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e9f0 tx=0x7f8ab400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8abf400640 1 -- 172.21.15.18:0/1260315310 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400cd80 con 0x7f8ac8104120 2024-04-21T22:42:35.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac819f3a0 con 0x7f8ac8104120 2024-04-21T22:42:35.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8abf400640 1 -- 172.21.15.18:0/1260315310 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab4005500 con 0x7f8ac8104120 2024-04-21T22:42:35.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8abf400640 1 -- 172.21.15.18:0/1260315310 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4010690 con 0x7f8ac8104120 2024-04-21T22:42:35.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.830+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a6c30 con 0x7f8ac8104120 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 Processor -- start 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 -- start start 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce32860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f5cd8b3a0 con 0x559f5ce26f70 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f5cd33930 con 0x559f5ce27890 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.835+0000 7f8ad0074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f5cd87360 con 0x559f5ce30470 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51274/0 (socket says 172.21.15.18:51274) 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 -- 172.21.15.18:0/3891591699 learned_addr learned my addr 172.21.15.18:0/3891591699 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac6800640 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8abf400640 1 -- 172.21.15.18:0/1260315310 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8ab40046c0 con 0x7f8ac8104120 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 -- 172.21.15.18:0/3891591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 msgr2=0x559f5ce32860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce32860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 -- 172.21.15.18:0/3891591699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 msgr2=0x559f5ce2ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.836+0000 7f8ac7200640 1 -- 172.21.15.18:0/3891591699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f5ca9f3f0 con 0x559f5ce26f70 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.837+0000 7f8ac7200640 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0011790 tx=0x7f8ac0011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93be098f73d59512 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.837+0000 7f8ab3400640 1 -- 172.21.15.18:0/3891591699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0003c30 con 0x559f5ce26f70 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.837+0000 7f8ab3400640 1 -- 172.21.15.18:0/3891591699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac000fe80 con 0x559f5ce26f70 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.837+0000 7f8ab3400640 1 -- 172.21.15.18:0/3891591699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00193e0 con 0x559f5ce26f70 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.837+0000 7f8abf400640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 0x7f8aac0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 -- 172.21.15.18:0/3891591699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 msgr2=0x559f5ce27350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0011790 tx=0x7f8ac0011c50 comp rx=0 tx=0).stop 2024-04-21T22:42:35.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8abf400640 1 -- 172.21.15.18:0/1260315310 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f8ab40cf900 con 0x7f8ac8104120 2024-04-21T22:42:35.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 -- 172.21.15.18:0/3891591699 shutdown_connections 2024-04-21T22:42:35.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce32860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 --2- 172.21.15.18:0/3891591699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce27350 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 -- 172.21.15.18:0/3891591699 >> 172.21.15.18:0/3891591699 conn(0x559f5ce216a0 msgr2=0x559f5ce21a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 -- 172.21.15.18:0/3891591699 shutdown_connections 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ac6800640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 0x7f8aac0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.838+0000 7f8ad0074740 1 -- 172.21.15.18:0/3891591699 wait complete. 2024-04-21T22:42:35.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 -- start start 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ac6800640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 0x7f8aac0a51c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009900 tx=0x7f8ab802df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 Processor -- start 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce2e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f5ce33260 con 0x559f5ce26f70 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559f5cd46d80 con 0x559f5ce27890 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559f5ce333e0 con 0x559f5ce30470 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.839+0000 7f8ad0074740 10 client.0 _ll_register_callbacks cb 0x559f5cd832b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51286/0 (socket says 172.21.15.18:51286) 2024-04-21T22:42:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 -- 172.21.15.18:0/2808040611 learned_addr learned my addr 172.21.15.18:0/2808040611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac7200640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce2e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 -- 172.21.15.18:0/2808040611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 msgr2=0x559f5ce2e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce2e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 -- 172.21.15.18:0/2808040611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 msgr2=0x559f5ce2daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 -- 172.21.15.18:0/2808040611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f5cb697d0 con 0x559f5ce26f70 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8ac6800640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009930 tx=0x7f8ab8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a50f31387f1dda server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.840+0000 7f8aa7e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8046070 con 0x559f5ce26f70 2024-04-21T22:42:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f8ab8004450 con 0x559f5ce26f70 2024-04-21T22:42:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f5cd988e0 con 0x559f5ce26f70 2024-04-21T22:42:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8ab8004ee0 con 0x559f5ce26f70 2024-04-21T22:42:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8ad0074740 10 client.17523 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f5ce3f610 con 0x559f5ce26f70 2024-04-21T22:42:35.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.841+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559f5cd988e0 con 0x559f5ce26f70 2024-04-21T22:42:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8ab8034440 con 0x559f5ce26f70 2024-04-21T22:42:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 10 client.17523 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 10 client.17523 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:42:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 20 client.17523 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ce40b20 0x559f5ce42f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 4 client.17523 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f5cd92c30 con 0x559f5ce40b20 2024-04-21T22:42:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.842+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ce40b20 0x559f5ce42f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.843+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ce40b20 0x559f5ce42f30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a84b41cf2883a6b server_cookie=c5b9946d1e9c09d0 in_seq=0 out_seq=0 2024-04-21T22:42:35.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.843+0000 7f8aa7e00640 10 client.17523 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:35.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.843+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2808040611 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559f5cd92c30 con 0x559f5ce40b20 2024-04-21T22:42:35.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.843+0000 7f8aa7e00640 10 client.17523 handle_command_reply: tid=0 2024-04-21T22:42:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.843+0000 7f8ad0074740 1 client.17523 shutdown 2024-04-21T22:42:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 msgr2=0x559f5ce2d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009930 tx=0x7f8ab8009260 comp rx=0 tx=0).stop 2024-04-21T22:42:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 shutdown_connections 2024-04-21T22:42:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ce40b20 0x559f5ce42f30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ce2e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce27890 0x559f5ce2daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2808040611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce26f70 0x559f5ce2d5b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8aa7e00640 0 client.17523 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:35.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 >> 172.21.15.18:0/2808040611 conn(0x559f5ce216a0 msgr2=0x559f5ce233f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 shutdown_connections 2024-04-21T22:42:35.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 1 -- 172.21.15.18:0/2808040611 wait complete. 2024-04-21T22:42:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.844+0000 7f8ad0074740 20 client.17523 trim_cache size 0 max 16384 2024-04-21T22:42:35.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 Processor -- start 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 -- start start 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce3c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81af610 con 0x559f5ce30470 2024-04-21T22:42:35.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b1150 con 0x559f5ce26f70 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.859+0000 7f8ad0074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81afce0 con 0x559f5ce27890 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59400/0 (socket says 172.21.15.18:59400) 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51290/0 (socket says 172.21.15.18:51290) 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac6800640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce3c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac5e00640 1 -- 172.21.15.18:0/2743009072 learned_addr learned my addr 172.21.15.18:0/2743009072 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 -- 172.21.15.18:0/2743009072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 msgr2=0x559f5ce48800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 -- 172.21.15.18:0/2743009072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 msgr2=0x559f5ce3c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce3c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac7200640 1 -- 172.21.15.18:0/2743009072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f5ce2bb00 con 0x559f5ce30470 2024-04-21T22:42:35.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac6800640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce3c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.860+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.861+0000 7f8ac7200640 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000a010 tx=0x7f8ac00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab63de36a596dc3f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.861+0000 7f8ab2a00640 1 -- 172.21.15.18:0/2743009072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac002b070 con 0x559f5ce30470 2024-04-21T22:42:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.861+0000 7f8ab2a00640 1 -- 172.21.15.18:0/2743009072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac000fba0 con 0x559f5ce30470 2024-04-21T22:42:35.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.861+0000 7f8ab2a00640 1 -- 172.21.15.18:0/2743009072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac001f040 con 0x559f5ce30470 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- 172.21.15.18:0/2743009072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 msgr2=0x559f5ce48d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000a010 tx=0x7f8ac00044c0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- 172.21.15.18:0/2743009072 shutdown_connections 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce30470 0x559f5ce48d40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce27890 0x559f5ce48800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 --2- 172.21.15.18:0/2743009072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce3c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- 172.21.15.18:0/2743009072 >> 172.21.15.18:0/2743009072 conn(0x559f5ce216a0 msgr2=0x559f5ce20690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- 172.21.15.18:0/2743009072 shutdown_connections 2024-04-21T22:42:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- 172.21.15.18:0/2743009072 wait complete. 2024-04-21T22:42:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 -- start start 2024-04-21T22:42:35.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.862+0000 7f8ad0074740 1 Processor -- start 2024-04-21T22:42:35.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ceae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b0a80 con 0x559f5ce27890 2024-04-21T22:42:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81b03b0 con 0x559f5ce26f70 2024-04-21T22:42:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac81ad610 con 0x559f5ce30470 2024-04-21T22:42:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ad0074740 10 client.0 _ll_register_callbacks cb 0x7f8ab8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51306/0 (socket says 172.21.15.18:51306) 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39818/0 (socket says 172.21.15.18:39818) 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac5e00640 1 -- 172.21.15.18:0/164080365 learned_addr learned my addr 172.21.15.18:0/164080365 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.863+0000 7f8ac7200640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ceae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 -- 172.21.15.18:0/164080365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 msgr2=0x559f5ceae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ceae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 -- 172.21.15.18:0/164080365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 msgr2=0x559f5ce2a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 -- 172.21.15.18:0/164080365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f5ceaedc0 con 0x559f5ce27890 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac6800640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ac5e00640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40049d0 tx=0x7f8ab4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d891904f18c458 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8aa7e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40a0140 con 0x559f5ce27890 2024-04-21T22:42:35.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f8ab40cd240 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac000fba0 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8ab40cd440 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ad0074740 10 client.17529 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.864+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559f5ceaff20 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac000fba0 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f8ab409b1e0 con 0x559f5ce27890 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 10 client.17529 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 10 client.17529 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:42:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 20 client.17529 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ceb0650 0x559f5ceb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 4 client.17529 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f5cd105a0 con 0x559f5ceb0650 2024-04-21T22:42:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.865+0000 7f8ac6800640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ceb0650 0x559f5ceb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ac6800640 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ceb0650 0x559f5ceb2a70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5af3eab01b9b8c6a server_cookie=3cf0564999a19133 in_seq=0 out_seq=0 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8aa7e00640 10 client.17529 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8aa7e00640 1 -- 172.21.15.18:0/164080365 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f5cd105a0 con 0x559f5ceb0650 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8aa7e00640 10 client.17529 handle_command_reply: tid=0 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 client.17529 shutdown 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 msgr2=0x559f5ce2ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40049d0 tx=0x7f8ab4009310 comp rx=0 tx=0).stop 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 shutdown_connections 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x559f5ceb0650 0x559f5ceb2a70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f5ce30470 0x559f5ceae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f5ce27890 0x559f5ce2ab60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8aa7e00640 0 client.17529 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 --2- 172.21.15.18:0/164080365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559f5ce26f70 0x559f5ce2a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 >> 172.21.15.18:0/164080365 conn(0x559f5ce216a0 msgr2=0x559f5ce226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.866+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 shutdown_connections 2024-04-21T22:42:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8ad0074740 1 -- 172.21.15.18:0/164080365 wait complete. 2024-04-21T22:42:35.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8ad0074740 20 client.17529 trim_cache size 0 max 16384 2024-04-21T22:42:35.893 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 msgr2=0x7f8aac0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 0x7f8aac0a51c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009900 tx=0x7f8ab802df90 comp rx=0 tx=0).stop 2024-04-21T22:42:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 msgr2=0x7f8ac819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e9f0 tx=0x7f8ab400edf0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 shutdown_connections 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8aac0a2d00 0x7f8aac0a51c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ac8109770 0x7f8ac819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8104120 0x7f8ac819a650 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 --2- 172.21.15.18:0/1260315310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ac8103760 0x7f8ac819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.867+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 >> 172.21.15.18:0/1260315310 conn(0x7f8ac80ff230 msgr2=0x7f8ac80ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.868+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 shutdown_connections 2024-04-21T22:42:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:35.868+0000 7f8acca00640 1 -- 172.21.15.18:0/1260315310 wait complete. 2024-04-21T22:42:35.896 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:35 smithi018 ceph-mon[26614]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:35.896 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:35 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1115851900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:35.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:42:35.899 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:35 smithi081 ceph-mon[31692]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:35.899 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:35 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1115851900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:35.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:35 smithi047 ceph-mon[31561]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:35.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:35 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1115851900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:42:36.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 -- 172.21.15.18:0/3145270946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4100780 msgr2=0x7fdff41045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 --2- 172.21.15.18:0/3145270946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4100780 0x7fdff41045c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4007510 tx=0x7fdfe402c8f0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 -- 172.21.15.18:0/3145270946 shutdown_connections 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 --2- 172.21.15.18:0/3145270946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff4104cf0 0x7fdff410c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 --2- 172.21.15.18:0/3145270946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4100780 0x7fdff41045c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 --2- 172.21.15.18:0/3145270946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff40ffdd0 0x7fdff41001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.114+0000 7fdffc600640 1 -- 172.21.15.18:0/3145270946 >> 172.21.15.18:0/3145270946 conn(0x7fdff40754e0 msgr2=0x7fdff40758f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.115+0000 7fdffc600640 1 -- 172.21.15.18:0/3145270946 shutdown_connections 2024-04-21T22:42:36.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.115+0000 7fdffc600640 1 -- 172.21.15.18:0/3145270946 wait complete. 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 Processor -- start 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 -- start start 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 0x7fdff4195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff4196690 0x7fdff41a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdff410f8d0 con 0x7fdff4104cf0 2024-04-21T22:42:36.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdff410f750 con 0x7fdff4196690 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.116+0000 7fdffc600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdff410fa50 con 0x7fdff40ffdd0 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51316/0 (socket says 172.21.15.18:51316) 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 -- 172.21.15.18:0/2740599280 learned_addr learned my addr 172.21.15.18:0/2740599280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 0x7fdff4195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdffa600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff4196690 0x7fdff41a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 -- 172.21.15.18:0/2740599280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 msgr2=0x7fdff4195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 0x7fdff4195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 -- 172.21.15.18:0/2740599280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff4196690 msgr2=0x7fdff41a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff4196690 0x7fdff41a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9200640 1 -- 172.21.15.18:0/2740599280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff41a68d0 con 0x7fdff4104cf0 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.117+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 0x7fdff4195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdff9200640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4005ab0 tx=0x7fdfe4009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdff2000640 1 -- 172.21.15.18:0/2740599280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4040030 con 0x7fdff4104cf0 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdff2000640 1 -- 172.21.15.18:0/2740599280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe4004a50 con 0x7fdff4104cf0 2024-04-21T22:42:36.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff41a6b60 con 0x7fdff4104cf0 2024-04-21T22:42:36.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdff2000640 1 -- 172.21.15.18:0/2740599280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4037040 con 0x7fdff4104cf0 2024-04-21T22:42:36.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.118+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff41a7050 con 0x7fdff4104cf0 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.121+0000 7fdfff41c740 1 Processor -- start 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff2000640 1 -- 172.21.15.18:0/2740599280 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fdfe4043030 con 0x7fdff4104cf0 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 -- start start 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 0x55f050ebf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 0x55f050eca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f050e233a0 con 0x55f050ebf6a0 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f050dcb930 con 0x55f050ec8280 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdfff41c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f050e1f360 con 0x55f050ebed80 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff9200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 0x55f050eca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdffa600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 0x55f050ebf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51328/0 (socket says 172.21.15.18:51328) 2024-04-21T22:42:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff9c00640 1 -- 172.21.15.18:0/362175356 learned_addr learned my addr 172.21.15.18:0/362175356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.122+0000 7fdff9200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 0x55f050eca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39848/0 (socket says 172.21.15.18:39848) 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 -- 172.21.15.18:0/362175356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 msgr2=0x55f050eca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 0x55f050eca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 -- 172.21.15.18:0/362175356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 msgr2=0x55f050ec7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 -- 172.21.15.18:0/362175356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f050b373f0 con 0x55f050ebed80 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdffa600640 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 0x55f050ebf160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009f00 tx=0x7fdfec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd92b86c60ccab1a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdff2000640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 0x7fdfdc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdfe2a00640 1 -- 172.21.15.18:0/362175356 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec004d20 con 0x55f050ebed80 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdfe2a00640 1 -- 172.21.15.18:0/362175356 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec004050 con 0x55f050ebed80 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.123+0000 7fdfe2a00640 1 -- 172.21.15.18:0/362175356 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec005280 con 0x55f050ebed80 2024-04-21T22:42:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdff2000640 1 -- 172.21.15.18:0/2740599280 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fdfe40f0320 con 0x7fdff4104cf0 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 0x7fdfdc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 -- 172.21.15.18:0/362175356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 msgr2=0x55f050ebf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 0x55f050ebf160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009f00 tx=0x7fdfec011810 comp rx=0 tx=0).stop 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 0x7fdfdc0a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55f050ebe850 tx=0x7fdfe8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 -- 172.21.15.18:0/362175356 shutdown_connections 2024-04-21T22:42:36.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ec8280 0x55f050eca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.124+0000 7fdfff41c740 1 --2- 172.21.15.18:0/362175356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ebed80 0x55f050ebf160 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.125+0000 7fdfff41c740 1 -- 172.21.15.18:0/362175356 >> 172.21.15.18:0/362175356 conn(0x55f050eb94b0 msgr2=0x55f050eb9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.125+0000 7fdfff41c740 1 -- 172.21.15.18:0/362175356 shutdown_connections 2024-04-21T22:42:36.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.125+0000 7fdfff41c740 1 -- 172.21.15.18:0/362175356 wait complete. 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.125+0000 7fdfff41c740 1 -- start start 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.125+0000 7fdfff41c740 1 Processor -- start 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f050ecb070 con 0x55f050ebf6a0 2024-04-21T22:42:36.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f050dded80 con 0x55f050ebed80 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f050ecb1f0 con 0x55f050ec8280 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdfff41c740 10 client.0 _ll_register_callbacks cb 0x55f050e1b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39852/0 (socket says 172.21.15.18:39852) 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 -- 172.21.15.18:0/3878088198 learned_addr learned my addr 172.21.15.18:0/3878088198 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdffa600640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 -- 172.21.15.18:0/3878088198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 msgr2=0x55f050ec5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 -- 172.21.15.18:0/3878088198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 msgr2=0x55f050ec58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9c00640 1 -- 172.21.15.18:0/3878088198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f050c017d0 con 0x55f050ebed80 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.126+0000 7fdff9200640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdff9c00640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800f7c0 tx=0x7fdfe8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c340191ebd653715 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfd7400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:36.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011940 con 0x55f050ebed80 2024-04-21T22:42:36.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fdfe8011ae0 con 0x55f050ebed80 2024-04-21T22:42:36.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfec004050 con 0x55f050ebed80 2024-04-21T22:42:36.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdfe8011ce0 con 0x55f050ebed80 2024-04-21T22:42:36.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfff41c740 10 client.27620 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.127+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f050ed7430 con 0x55f050ebed80 2024-04-21T22:42:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfec004050 con 0x55f050ebed80 2024-04-21T22:42:36.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fdfe8027070 con 0x55f050ebed80 2024-04-21T22:42:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 10 client.27620 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 10 client.27620 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:42:36.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 20 client.27620 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050ed8940 0x55f050edadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 4 client.27620 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:36.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f050e308e0 con 0x55f050ed8940 2024-04-21T22:42:36.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.128+0000 7fdff9200640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050ed8940 0x55f050edadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.129+0000 7fdff9200640 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050ed8940 0x55f050edadb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=85fc4428d1cec22f server_cookie=a7bfbe4f1bd22918 in_seq=0 out_seq=0 2024-04-21T22:42:36.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.129+0000 7fdfd7400640 10 client.27620 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:36.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfd7400640 1 -- 172.21.15.18:0/3878088198 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f050e308e0 con 0x55f050ed8940 2024-04-21T22:42:36.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfd7400640 10 client.27620 handle_command_reply: tid=0 2024-04-21T22:42:36.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 client.27620 shutdown 2024-04-21T22:42:36.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 msgr2=0x55f050ec5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800f7c0 tx=0x7fdfe8004730 comp rx=0 tx=0).stop 2024-04-21T22:42:36.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 shutdown_connections 2024-04-21T22:42:36.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050ed8940 0x55f050edadb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 --2- 172.21.15.18:0/3878088198 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ec5370 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 >> 172.21.15.18:0/3878088198 conn(0x55f050eb94b0 msgr2=0x55f050ebb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfd7400640 0 client.27620 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:36.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 shutdown_connections 2024-04-21T22:42:36.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 1 -- 172.21.15.18:0/3878088198 wait complete. 2024-04-21T22:42:36.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.130+0000 7fdfff41c740 20 client.27620 trim_cache size 0 max 16384 2024-04-21T22:42:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 Processor -- start 2024-04-21T22:42:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 -- start start 2024-04-21T22:42:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ed3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ee0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41af790 con 0x55f050ebf6a0 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41b12d0 con 0x55f050ebed80 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdfff41c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41afe60 con 0x55f050ec8280 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.145+0000 7fdff9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51352/0 (socket says 172.21.15.18:51352) 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 -- 172.21.15.18:0/2230993430 learned_addr learned my addr 172.21.15.18:0/2230993430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdffa600640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ee0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ed3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 -- 172.21.15.18:0/2230993430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 msgr2=0x55f050ee0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ee0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 -- 172.21.15.18:0/2230993430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 msgr2=0x55f050ed3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ed3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 -- 172.21.15.18:0/2230993430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f050ebf4d0 con 0x55f050ebf6a0 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9c00640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ed3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdff9200640 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4007fd0 tx=0x7fdfe40f2830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8581161ba5a2caef server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.146+0000 7fdfe2000640 1 -- 172.21.15.18:0/2230993430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe404a040 con 0x55f050ebf6a0 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfe2000640 1 -- 172.21.15.18:0/2230993430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe40bc8c0 con 0x55f050ebf6a0 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfe2000640 1 -- 172.21.15.18:0/2230993430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40babc0 con 0x55f050ebf6a0 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 -- 172.21.15.18:0/2230993430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 msgr2=0x55f050ec5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4007fd0 tx=0x7fdfe40f2830 comp rx=0 tx=0).stop 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 -- 172.21.15.18:0/2230993430 shutdown_connections 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ee0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebf6a0 0x55f050ec5c10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 --2- 172.21.15.18:0/2230993430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebed80 0x55f050ed3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 -- 172.21.15.18:0/2230993430 >> 172.21.15.18:0/2230993430 conn(0x55f050eb94b0 msgr2=0x55f050eb8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 -- 172.21.15.18:0/2230993430 shutdown_connections 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.147+0000 7fdfff41c740 1 -- 172.21.15.18:0/2230993430 wait complete. 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 -- start start 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 Processor -- start 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebf6a0 0x55f050ec25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41b0c00 con 0x55f050ebed80 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41b0530 con 0x55f050ebf6a0 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdff41ad790 con 0x55f050ec8280 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.148+0000 7fdfff41c740 10 client.0 _ll_register_callbacks cb 0x7fdfe8012050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51360/0 (socket says 172.21.15.18:51360) 2024-04-21T22:42:36.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 -- 172.21.15.18:0/4153446172 learned_addr learned my addr 172.21.15.18:0/4153446172 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9200640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebf6a0 0x55f050ec25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdffa600640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 -- 172.21.15.18:0/4153446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 msgr2=0x55f050ec2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 -- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebf6a0 msgr2=0x55f050ec25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebf6a0 0x55f050ec25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 -- 172.21.15.18:0/4153446172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f050f3df70 con 0x55f050ebed80 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdffa600640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdff9c00640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8000c00 tx=0x7fdfe801fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831158f3438a613a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.149+0000 7fdfd7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011e80 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fdfe8011810 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe40bc8c0 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdfe803f050 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfff41c740 10 client.17547 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f050f3f250 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe40bc8c0 con 0x55f050ebed80 2024-04-21T22:42:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.150+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fdfe8037020 con 0x55f050ebed80 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 10 client.17547 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 10 client.17547 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 20 client.17547 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050f3f9f0 0x55f050f41e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 4 client.17547 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f050e2ac30 con 0x55f050f3f9f0 2024-04-21T22:42:36.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdff9200640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050f3f9f0 0x55f050f41e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdff9200640 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050f3f9f0 0x55f050f41e10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7fa51148dd912547 server_cookie=d3ae00213a6097ce in_seq=0 out_seq=0 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.151+0000 7fdfd7400640 10 client.17547 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfd7400640 1 -- 172.21.15.18:0/4153446172 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f050e2ac30 con 0x55f050f3f9f0 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfd7400640 10 client.17547 handle_command_reply: tid=0 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 client.17547 shutdown 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 msgr2=0x55f050ec2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8000c00 tx=0x7fdfe801fa10 comp rx=0 tx=0).stop 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 shutdown_connections 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55f050f3f9f0 0x55f050f41e10 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f050ec8280 0x55f050ec2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f050ebf6a0 0x55f050ec25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 --2- 172.21.15.18:0/4153446172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f050ebed80 0x55f050ec2080 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfd7400640 0 client.17547 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:42:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 >> 172.21.15.18:0/4153446172 conn(0x55f050eb94b0 msgr2=0x55f050eb7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 shutdown_connections 2024-04-21T22:42:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 1 -- 172.21.15.18:0/4153446172 wait complete. 2024-04-21T22:42:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.152+0000 7fdfff41c740 20 client.17547 trim_cache size 0 max 16384 2024-04-21T22:42:36.177 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:36.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 msgr2=0x7fdfdc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 0x7fdfdc0a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55f050ebe850 tx=0x7fdfe8005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:36.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 msgr2=0x7fdff4196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4005ab0 tx=0x7fdfe4009fb0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 shutdown_connections 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fdfdc0a2d30 0x7fdfdc0a51f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff4196690 0x7fdff41a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff4104cf0 0x7fdff4196150 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 --2- 172.21.15.18:0/2740599280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdff40ffdd0 0x7fdff4195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 >> 172.21.15.18:0/2740599280 conn(0x7fdff40754e0 msgr2=0x7fdff40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 shutdown_connections 2024-04-21T22:42:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.153+0000 7fdffc600640 1 -- 172.21.15.18:0/2740599280 wait complete. 2024-04-21T22:42:36.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:42:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 -- 172.21.15.18:0/949285090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc107600 msgr2=0x7f3acc1079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 --2- 172.21.15.18:0/949285090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc107600 0x7f3acc1079e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009930 tx=0x7f3abc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:36.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 -- 172.21.15.18:0/949285090 shutdown_connections 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 --2- 172.21.15.18:0/949285090 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc101f00 0x7f3acc10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 --2- 172.21.15.18:0/949285090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101540 0x7f3acc1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 --2- 172.21.15.18:0/949285090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc107600 0x7f3acc1079e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 -- 172.21.15.18:0/949285090 >> 172.21.15.18:0/949285090 conn(0x7f3acc0fd010 msgr2=0x7f3acc0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 -- 172.21.15.18:0/949285090 shutdown_connections 2024-04-21T22:42:36.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.397+0000 7f3acbe00640 1 -- 172.21.15.18:0/949285090 wait complete. 2024-04-21T22:42:36.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.398+0000 7f3acbe00640 1 Processor -- start 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 -- start start 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc101540 0x7f3acc073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101f00 0x7f3acc073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc111910 con 0x7f3acc101f00 2024-04-21T22:42:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc111790 con 0x7f3acc107600 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc111a90 con 0x7f3acc101540 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3aca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101f00 0x7f3acc073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39900/0 (socket says 172.21.15.18:39900) 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.399+0000 7f3acb400640 1 -- 172.21.15.18:0/1039260151 learned_addr learned my addr 172.21.15.18:0/1039260151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acaa00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc101540 0x7f3acc073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 -- 172.21.15.18:0/1039260151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc101540 msgr2=0x7f3acc073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc101540 0x7f3acc073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 -- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101f00 msgr2=0x7f3acc073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101f00 0x7f3acc073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 -- 172.21.15.18:0/1039260151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc1a6350 con 0x7f3acc107600 2024-04-21T22:42:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acb400640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400efd0 tx=0x7f3ac400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3ac3400640 1 -- 172.21.15.18:0/1039260151 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4003b70 con 0x7f3acc107600 2024-04-21T22:42:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3ac3400640 1 -- 172.21.15.18:0/1039260151 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ac4003d10 con 0x7f3acc107600 2024-04-21T22:42:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.400+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc1a6640 con 0x7f3acc107600 2024-04-21T22:42:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.401+0000 7f3ac3400640 1 -- 172.21.15.18:0/1039260151 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40109f0 con 0x7f3acc107600 2024-04-21T22:42:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.401+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc1a6b40 con 0x7f3acc107600 2024-04-21T22:42:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.405+0000 7f3ad4578740 1 Processor -- start 2024-04-21T22:42:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.405+0000 7f3ac3400640 1 -- 172.21.15.18:0/1039260151 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3ac4004020 con 0x7f3acc107600 2024-04-21T22:42:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.405+0000 7f3ad4578740 1 -- start start 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 0x55c86459ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8644fb3a0 con 0x55c864596f70 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8644a3930 con 0x55c864597890 2024-04-21T22:42:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3ad4578740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8644f7360 con 0x55c8645a0470 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51396/0 (socket says 172.21.15.18:51396) 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 -- 172.21.15.18:0/2221067506 learned_addr learned my addr 172.21.15.18:0/2221067506 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 0x55c86459ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 -- 172.21.15.18:0/2221067506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 msgr2=0x55c8645a2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645a2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 -- 172.21.15.18:0/2221067506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 msgr2=0x55c86459ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 0x55c86459ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3aca000640 1 -- 172.21.15.18:0/2221067506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86420f3f0 con 0x55c864596f70 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.406+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 0x55c86459ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3aca000640 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80135a0 tx=0x7f3ab8009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88437f25edbfda5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3ab7e00640 1 -- 172.21.15.18:0/2221067506 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004050 con 0x55c864596f70 2024-04-21T22:42:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3ab7e00640 1 -- 172.21.15.18:0/2221067506 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab80041f0 con 0x55c864596f70 2024-04-21T22:42:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3ab7e00640 1 -- 172.21.15.18:0/2221067506 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800f7e0 con 0x55c864596f70 2024-04-21T22:42:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3ac3400640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 0x7f3ab00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.407+0000 7f3ac3400640 1 -- 172.21.15.18:0/1039260151 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f3ac40cf880 con 0x7f3acc107600 2024-04-21T22:42:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3acaa00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 0x7f3ab00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 -- 172.21.15.18:0/2221067506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 msgr2=0x55c864597350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80135a0 tx=0x7f3ab8009850 comp rx=0 tx=0).stop 2024-04-21T22:42:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 -- 172.21.15.18:0/2221067506 shutdown_connections 2024-04-21T22:42:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864597890 0x55c86459ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2221067506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c864597350 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 -- 172.21.15.18:0/2221067506 >> 172.21.15.18:0/2221067506 conn(0x55c8645916a0 msgr2=0x55c864591a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 -- 172.21.15.18:0/2221067506 shutdown_connections 2024-04-21T22:42:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.408+0000 7f3ad4578740 1 -- 172.21.15.18:0/2221067506 wait complete. 2024-04-21T22:42:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3acaa00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 0x7f3ab00a51c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009900 tx=0x7f3abc02df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 -- start start 2024-04-21T22:42:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 Processor -- start 2024-04-21T22:42:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c86459d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c86459ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c8645a3200 con 0x55c864597890 2024-04-21T22:42:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c8644b6d80 con 0x55c8645a0470 2024-04-21T22:42:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c8645a3380 con 0x55c864596f70 2024-04-21T22:42:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.409+0000 7f3ad4578740 10 client.0 _ll_register_callbacks cb 0x55c8644f32b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3aca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c86459d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59508/0 (socket says 172.21.15.18:59508) 2024-04-21T22:42:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 -- 172.21.15.18:0/2526279053 learned_addr learned my addr 172.21.15.18:0/2526279053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acb400640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c86459ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 -- 172.21.15.18:0/2526279053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 msgr2=0x55c86459ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c86459ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 -- 172.21.15.18:0/2526279053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 msgr2=0x55c86459d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c86459d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 -- 172.21.15.18:0/2526279053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8642d97d0 con 0x55c864596f70 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.410+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3abc02cb00 tx=0x7f3abc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc2a849cc639714 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc045070 con 0x55c864596f70 2024-04-21T22:42:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ab80041f0 con 0x55c864596f70 2024-04-21T22:42:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f3abc0046c0 con 0x55c864596f70 2024-04-21T22:42:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3abc0048c0 con 0x55c864596f70 2024-04-21T22:42:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ad4578740 10 client.27697 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.411+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8645af450 con 0x55c864596f70 2024-04-21T22:42:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab80041f0 con 0x55c864596f70 2024-04-21T22:42:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3abc0035f0 con 0x55c864596f70 2024-04-21T22:42:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 10 client.27697 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 10 client.27697 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:42:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 20 client.27697 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8645b0910 0x55c8645b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 4 client.27697 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8645088e0 con 0x55c8645b0910 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.412+0000 7f3aca000640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8645b0910 0x55c8645b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.413+0000 7f3aca000640 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8645b0910 0x55c8645b2dd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9a09408342d9d7f server_cookie=c4db396d15c7cec in_seq=0 out_seq=0 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.413+0000 7f3ab4c00640 10 client.27697 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ab4c00640 1 -- 172.21.15.18:0/2526279053 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c8645088e0 con 0x55c8645b0910 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ab4c00640 10 client.27697 handle_command_reply: tid=0 2024-04-21T22:42:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 client.27697 shutdown 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 msgr2=0x55c86459d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3abc02cb00 tx=0x7f3abc009260 comp rx=0 tx=0).stop 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 shutdown_connections 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8645b0910 0x55c8645b2dd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c86459ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c86459d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2526279053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864596f70 0x55c86459d450 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 >> 172.21.15.18:0/2526279053 conn(0x55c8645916a0 msgr2=0x55c8645933f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ab4c00640 0 client.27697 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 shutdown_connections 2024-04-21T22:42:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 1 -- 172.21.15.18:0/2526279053 wait complete. 2024-04-21T22:42:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.414+0000 7f3ad4578740 20 client.27697 trim_cache size 0 max 16384 2024-04-21T22:42:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 Processor -- start 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 -- start start 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c8645b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1af650 con 0x55c864597890 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1b1190 con 0x55c864596f70 2024-04-21T22:42:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.429+0000 7f3ad4578740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1afd20 con 0x55c8645a0470 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3aca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c8645b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39912/0 (socket says 172.21.15.18:39912) 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 -- 172.21.15.18:0/2445127931 learned_addr learned my addr 172.21.15.18:0/2445127931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acb400640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 -- 172.21.15.18:0/2445127931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 msgr2=0x55c8645b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 -- 172.21.15.18:0/2445127931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 msgr2=0x55c8645b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c8645b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acaa00640 1 -- 172.21.15.18:0/2445127931 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8645976c0 con 0x55c864596f70 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3acb400640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.430+0000 7f3aca000640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c8645b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.431+0000 7f3acaa00640 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3abc003a60 tx=0x7f3abc004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff7771c1f7dcf3f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.431+0000 7f3ab7400640 1 -- 172.21.15.18:0/2445127931 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc003cd0 con 0x55c864596f70 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.431+0000 7f3ab7400640 1 -- 172.21.15.18:0/2445127931 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3abc003e70 con 0x55c864596f70 2024-04-21T22:42:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.431+0000 7f3ab7400640 1 -- 172.21.15.18:0/2445127931 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0053c0 con 0x55c864596f70 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- 172.21.15.18:0/2445127931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 msgr2=0x55c8645ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3abc003a60 tx=0x7f3abc004610 comp rx=0 tx=0).stop 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- 172.21.15.18:0/2445127931 shutdown_connections 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c8645a0470 0x55c8645b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864597890 0x55c8645b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 --2- 172.21.15.18:0/2445127931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c864596f70 0x55c8645ac0c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- 172.21.15.18:0/2445127931 >> 172.21.15.18:0/2445127931 conn(0x55c8645916a0 msgr2=0x55c864590690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- 172.21.15.18:0/2445127931 shutdown_connections 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- 172.21.15.18:0/2445127931 wait complete. 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 -- start start 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.432+0000 7f3ad4578740 1 Processor -- start 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c8645a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864597890 0x55c8645a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1b0ac0 con 0x55c864596f70 2024-04-21T22:42:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1b03f0 con 0x55c8645a0470 2024-04-21T22:42:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc1ad650 con 0x55c864597890 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3ad4578740 10 client.0 _ll_register_callbacks cb 0x7f3ac40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c8645a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3acb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3acaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c8645a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51424/0 (socket says 172.21.15.18:51424) 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3acb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:39922/0 (socket says 172.21.15.18:39922) 2024-04-21T22:42:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3acaa00640 1 -- 172.21.15.18:0/3388080749 learned_addr learned my addr 172.21.15.18:0/3388080749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.433+0000 7f3aca000640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864597890 0x55c8645a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 -- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864597890 msgr2=0x55c8645a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864597890 0x55c8645a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 -- 172.21.15.18:0/3388080749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 msgr2=0x55c8645a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c8645a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 -- 172.21.15.18:0/3388080749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c864615fa0 con 0x55c8645a0470 2024-04-21T22:42:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3acb400640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ccf40 tx=0x7f3ac40098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5559d31122fa140f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40b8030 con 0x55c8645a0470 2024-04-21T22:42:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3abc003e70 con 0x55c8645a0470 2024-04-21T22:42:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f3ac4004310 con 0x55c8645a0470 2024-04-21T22:42:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3ac40a00c0 con 0x55c8645a0470 2024-04-21T22:42:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.434+0000 7f3ad4578740 10 client.27644 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c8646172d0 con 0x55c8645a0470 2024-04-21T22:42:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3abc003e70 con 0x55c8645a0470 2024-04-21T22:42:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3ac401f020 con 0x55c8645a0470 2024-04-21T22:42:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 10 client.27644 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 10 client.27644 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:42:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 20 client.27644 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8646179f0 0x55c864619e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 4 client.27644 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c864502c30 con 0x55c8646179f0 2024-04-21T22:42:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.435+0000 7f3acaa00640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8646179f0 0x55c864619e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3acaa00640 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8646179f0 0x55c864619e10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff84729222edee15 server_cookie=1d1f73d0835b8b4b in_seq=0 out_seq=0 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ab4c00640 10 client.27644 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ab4c00640 1 -- 172.21.15.18:0/3388080749 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c864502c30 con 0x55c8646179f0 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ab4c00640 10 client.27644 handle_command_reply: tid=0 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 client.27644 shutdown 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 msgr2=0x55c8645a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ccf40 tx=0x7f3ac40098e0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 shutdown_connections 2024-04-21T22:42:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55c8646179f0 0x55c864619e10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c8645a0470 0x55c8645a6b10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c864597890 0x55c8645a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ab4c00640 0 client.27644 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:42:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 --2- 172.21.15.18:0/3388080749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c864596f70 0x55c8645a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.436+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 >> 172.21.15.18:0/3388080749 conn(0x55c8645916a0 msgr2=0x55c8645928d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 shutdown_connections 2024-04-21T22:42:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3ad4578740 1 -- 172.21.15.18:0/3388080749 wait complete. 2024-04-21T22:42:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3ad4578740 20 client.27644 trim_cache size 0 max 16384 2024-04-21T22:42:36.451 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 msgr2=0x7f3ab00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 0x7f3ab00a51c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009900 tx=0x7f3abc02df90 comp rx=0 tx=0).stop 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 msgr2=0x7f3acc0744c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400efd0 tx=0x7f3ac400c6a0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 shutdown_connections 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f3ab00a2d00 0x7f3ab00a51c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3acc107600 0x7f3acc0744c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3acc101f00 0x7f3acc073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 --2- 172.21.15.18:0/1039260151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3acc101540 0x7f3acc073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.437+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 >> 172.21.15.18:0/1039260151 conn(0x7f3acc0fd010 msgr2=0x7f3acc0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.438+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 shutdown_connections 2024-04-21T22:42:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.438+0000 7f3acbe00640 1 -- 172.21.15.18:0/1039260151 wait complete. 2024-04-21T22:42:36.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:42:36.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 -- 172.21.15.18:0/1022190821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8109770 msgr2=0x7f7bf8109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 --2- 172.21.15.18:0/1022190821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8109770 0x7f7bf8109b50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009930 tx=0x7f7be802bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 -- 172.21.15.18:0/1022190821 shutdown_connections 2024-04-21T22:42:36.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 --2- 172.21.15.18:0/1022190821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8104120 0x7f7bf8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 --2- 172.21.15.18:0/1022190821 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 0x7f7bf8103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 --2- 172.21.15.18:0/1022190821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8109770 0x7f7bf8109b50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 -- 172.21.15.18:0/1022190821 >> 172.21.15.18:0/1022190821 conn(0x7f7bf80ff230 msgr2=0x7f7bf8101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 -- 172.21.15.18:0/1022190821 shutdown_connections 2024-04-21T22:42:36.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.656+0000 7f7bf7200640 1 -- 172.21.15.18:0/1022190821 wait complete. 2024-04-21T22:42:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.657+0000 7f7bf7200640 1 Processor -- start 2024-04-21T22:42:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.657+0000 7f7bf7200640 1 -- start start 2024-04-21T22:42:36.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 0x7f7bf819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8113bd0 con 0x7f7bf8104120 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8113a50 con 0x7f7bf8103760 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8113d50 con 0x7f7bf8109770 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59536/0 (socket says 172.21.15.18:59536) 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf6800640 1 -- 172.21.15.18:0/2293589911 learned_addr learned my addr 172.21.15.18:0/2293589911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51436/0 (socket says 172.21.15.18:51436) 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.658+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 0x7f7bf819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 -- 172.21.15.18:0/2293589911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 msgr2=0x7f7bf819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 0x7f7bf819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 -- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 msgr2=0x7f7bf819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 -- 172.21.15.18:0/2293589911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf819f090 con 0x7f7bf8109770 2024-04-21T22:42:36.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf5400640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf6800640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000eb10 tx=0x7f7bf000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7beea00640 1 -- 172.21.15.18:0/2293589911 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0004b20 con 0x7f7bf8109770 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7beea00640 1 -- 172.21.15.18:0/2293589911 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bf0004cc0 con 0x7f7bf8109770 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7beea00640 1 -- 172.21.15.18:0/2293589911 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0010760 con 0x7f7bf8109770 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.659+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf819f380 con 0x7f7bf8109770 2024-04-21T22:42:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.660+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf81a6c10 con 0x7f7bf8109770 2024-04-21T22:42:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7beea00640 1 -- 172.21.15.18:0/2293589911 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7bf0005020 con 0x7f7bf8109770 2024-04-21T22:42:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 Processor -- start 2024-04-21T22:42:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 -- start start 2024-04-21T22:42:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82da350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b3d823e3a0 con 0x55b3d82e3470 2024-04-21T22:42:36.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b3d81e6930 con 0x55b3d82d9f70 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.663+0000 7f7bff77a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3d823a360 con 0x55b3d82da890 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59540/0 (socket says 172.21.15.18:59540) 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 -- 172.21.15.18:0/1447185473 learned_addr learned my addr 172.21.15.18:0/1447185473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5400640 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82da350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5400640 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 -- 172.21.15.18:0/1447185473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 msgr2=0x55b3d82da350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82da350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 -- 172.21.15.18:0/1447185473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 msgr2=0x55b3d82e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82e5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7bf5e00640 1 -- 172.21.15.18:0/1447185473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3d7f523f0 con 0x55b3d82da890 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.664+0000 7f7beea00640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 0x7f7bdc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7be8000c00 tx=0x7f7be80095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f389e121f75a9a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7beea00640 1 -- 172.21.15.18:0/2293589911 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f7bf00cfb10 con 0x7f7bf8109770 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7bf5400640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 0x7f7bdc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7be3000640 1 -- 172.21.15.18:0/1447185473 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8045070 con 0x55b3d82da890 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7be3000640 1 -- 172.21.15.18:0/1447185473 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be802c880 con 0x55b3d82da890 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.665+0000 7f7be3000640 1 -- 172.21.15.18:0/1447185473 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8004c20 con 0x55b3d82da890 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- 172.21.15.18:0/1447185473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 msgr2=0x55b3d82e2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7be8000c00 tx=0x7f7be80095e0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bf5400640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 0x7f7bdc0a51c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55b3d82d5830 tx=0x7f7be400b410 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- 172.21.15.18:0/1447185473 shutdown_connections 2024-04-21T22:42:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e2f30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1447185473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82da350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- 172.21.15.18:0/1447185473 >> 172.21.15.18:0/1447185473 conn(0x55b3d82d46a0 msgr2=0x55b3d82d4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- 172.21.15.18:0/1447185473 shutdown_connections 2024-04-21T22:42:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- 172.21.15.18:0/1447185473 wait complete. 2024-04-21T22:42:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.666+0000 7f7bff77a740 1 -- start start 2024-04-21T22:42:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 Processor -- start 2024-04-21T22:42:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 0x55b3d82e0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82e3470 0x55b3d82e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b3d82e6200 con 0x55b3d82da890 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b3d81f9d80 con 0x55b3d82e3470 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b3d82e6380 con 0x55b3d82d9f70 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bff77a740 10 client.0 _ll_register_callbacks cb 0x55b3d82362b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.667+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51452/0 (socket says 172.21.15.18:51452) 2024-04-21T22:42:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5400640 1 -- 172.21.15.18:0/2460073600 learned_addr learned my addr 172.21.15.18:0/2460073600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 0x55b3d82e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf6800640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82e3470 0x55b3d82e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 -- 172.21.15.18:0/2460073600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82e3470 msgr2=0x55b3d82e0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82e3470 0x55b3d82e0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 -- 172.21.15.18:0/2460073600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 msgr2=0x55b3d82e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 -- 172.21.15.18:0/2460073600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3d801c7d0 con 0x55b3d82d9f70 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 0x55b3d82e0510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7be802c240 tx=0x7f7be80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b49881583e5baf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.668+0000 7f7bd7400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8045040 con 0x55b3d82d9f70 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be802c880 con 0x55b3d82d9f70 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f7be80052f0 con 0x55b3d82d9f70 2024-04-21T22:42:36.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7be805b050 con 0x55b3d82d9f70 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bff77a740 10 client.27715 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b3d82e6250 con 0x55b3d82d9f70 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.669+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be802c880 con 0x55b3d82d9f70 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f7be804ab50 con 0x55b3d82d9f70 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 10 client.27715 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 10 client.27715 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:42:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 20 client.27715 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d82f3680 0x55b3d82f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 4 client.27715 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3d824b8e0 con 0x55b3d82f3680 2024-04-21T22:42:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.670+0000 7f7bf5400640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d82f3680 0x55b3d82f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.671+0000 7f7bf5400640 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d82f3680 0x55b3d82f5a70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e405429c9ab8b7a server_cookie=2960a7f0ebe18c68 in_seq=0 out_seq=0 2024-04-21T22:42:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.671+0000 7f7bd7400640 10 client.27715 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bd7400640 1 -- 172.21.15.18:0/2460073600 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b3d824b8e0 con 0x55b3d82f3680 2024-04-21T22:42:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bd7400640 10 client.27715 handle_command_reply: tid=0 2024-04-21T22:42:36.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 client.27715 shutdown 2024-04-21T22:42:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 msgr2=0x55b3d82e0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 0x55b3d82e0510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7be802c240 tx=0x7f7be80046c0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 shutdown_connections 2024-04-21T22:42:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d82f3680 0x55b3d82f5a70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82e3470 0x55b3d82e0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 --2- 172.21.15.18:0/2460073600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82d9f70 0x55b3d82e0510 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bd7400640 0 client.27715 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 >> 172.21.15.18:0/2460073600 conn(0x55b3d82d46a0 msgr2=0x55b3d82d63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 shutdown_connections 2024-04-21T22:42:36.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 1 -- 172.21.15.18:0/2460073600 wait complete. 2024-04-21T22:42:36.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.672+0000 7f7bff77a740 20 client.27715 trim_cache size 0 max 16384 2024-04-21T22:42:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.687+0000 7f7bff77a740 1 Processor -- start 2024-04-21T22:42:36.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 -- start start 2024-04-21T22:42:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81af670 con 0x55b3d82e3470 2024-04-21T22:42:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81b11b0 con 0x55b3d82d9f70 2024-04-21T22:42:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bff77a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81afd40 con 0x55b3d82da890 2024-04-21T22:42:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bf6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bf6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51462/0 (socket says 172.21.15.18:51462) 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bf6800640 1 -- 172.21.15.18:0/3426185765 learned_addr learned my addr 172.21.15.18:0/3426185765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.688+0000 7f7bf5400640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 -- 172.21.15.18:0/3426185765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 msgr2=0x55b3d82e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 -- 172.21.15.18:0/3426185765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 msgr2=0x55b3d82ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 -- 172.21.15.18:0/3426185765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3d82dea60 con 0x55b3d82e3470 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7bf6800640 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7bf009bf30 tx=0x7f7bf009bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e88ad31242480e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7be2600640 1 -- 172.21.15.18:0/3426185765 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf009bfa0 con 0x55b3d82e3470 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7be2600640 1 -- 172.21.15.18:0/3426185765 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bf00a0350 con 0x55b3d82e3470 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.689+0000 7f7be2600640 1 -- 172.21.15.18:0/3426185765 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00a4780 con 0x55b3d82e3470 2024-04-21T22:42:36.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- 172.21.15.18:0/3426185765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 msgr2=0x55b3d82d3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7bf009bf30 tx=0x7f7bf009bae0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- 172.21.15.18:0/3426185765 shutdown_connections 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82e3470 0x55b3d82d3510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82da890 0x55b3d82e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 --2- 172.21.15.18:0/3426185765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- 172.21.15.18:0/3426185765 >> 172.21.15.18:0/3426185765 conn(0x55b3d82d46a0 msgr2=0x55b3d82d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- 172.21.15.18:0/3426185765 shutdown_connections 2024-04-21T22:42:36.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- 172.21.15.18:0/3426185765 wait complete. 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.690+0000 7f7bff77a740 1 -- start start 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 Processor -- start 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82e3470 0x55b3d82e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81b0ae0 con 0x55b3d82da890 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81b0410 con 0x55b3d82d9f70 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81ad670 con 0x55b3d82e3470 2024-04-21T22:42:36.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bff77a740 10 client.0 _ll_register_callbacks cb 0x7f7be400be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.691+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82e3470 0x55b3d82e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51472/0 (socket says 172.21.15.18:51472) 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 -- 172.21.15.18:0/1231848478 learned_addr learned my addr 172.21.15.18:0/1231848478 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 -- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82e3470 msgr2=0x55b3d82e7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82e3470 0x55b3d82e7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 -- 172.21.15.18:0/1231848478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 msgr2=0x55b3d82e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 -- 172.21.15.18:0/1231848478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3d8358bc0 con 0x55b3d82da890 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bf5400640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7be4005fd0 tx=0x7f7be4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6c6282a1c0a573 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.692+0000 7f7bd7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be402d770 con 0x55b3d82da890 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7f7be4021410 con 0x55b3d82da890 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bf00a0350 con 0x55b3d82da890 2024-04-21T22:42:36.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7be402d910 con 0x55b3d82da890 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bff77a740 10 client.17583 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b3d8359f10 con 0x55b3d82da890 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bf00a0350 con 0x55b3d82da890 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.693+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f7be403e7a0 con 0x55b3d82da890 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 10 client.17583 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 10 client.17583 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 20 client.17583 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d835a690 0x55b3d835cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 4 client.17583 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3d8245c30 con 0x55b3d835a690 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d835a690 0x55b3d835cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bf5e00640 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d835a690 0x55b3d835cab0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=358c4562420e3033 server_cookie=b106d222a983283f in_seq=0 out_seq=0 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.694+0000 7f7bd7400640 10 client.17583 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bd7400640 1 -- 172.21.15.18:0/1231848478 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3d8245c30 con 0x55b3d835a690 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bd7400640 10 client.17583 handle_command_reply: tid=0 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 client.17583 shutdown 2024-04-21T22:42:36.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 msgr2=0x55b3d82e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7be4005fd0 tx=0x7f7be4004730 comp rx=0 tx=0).stop 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 shutdown_connections 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55b3d835a690 0x55b3d835cab0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b3d82e3470 0x55b3d82e7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b3d82da890 0x55b3d82e7660 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 --2- 172.21.15.18:0/1231848478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b3d82d9f70 0x55b3d82e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bd7400640 0 client.17583 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:42:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 >> 172.21.15.18:0/1231848478 conn(0x55b3d82d46a0 msgr2=0x55b3d82d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 shutdown_connections 2024-04-21T22:42:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 1 -- 172.21.15.18:0/1231848478 wait complete. 2024-04-21T22:42:36.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.695+0000 7f7bff77a740 20 client.17583 trim_cache size 0 max 16384 2024-04-21T22:42:36.709 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 msgr2=0x7f7bdc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 0x7f7bdc0a51c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55b3d82d5830 tx=0x7f7be400b410 comp rx=0 tx=0).stop 2024-04-21T22:42:36.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 msgr2=0x7f7bf819e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000eb10 tx=0x7f7bf000c2d0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 shutdown_connections 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bdc0a2d00 0x7f7bdc0a51c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bf8109770 0x7f7bf819e960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bf8104120 0x7f7bf819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 --2- 172.21.15.18:0/2293589911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bf8103760 0x7f7bf819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 >> 172.21.15.18:0/2293589911 conn(0x7f7bf80ff230 msgr2=0x7f7bf80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 shutdown_connections 2024-04-21T22:42:36.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.696+0000 7f7bf7200640 1 -- 172.21.15.18:0/2293589911 wait complete. 2024-04-21T22:42:36.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:42:36.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 -- 172.21.15.18:0/1606368989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 msgr2=0x7fb8981149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 --2- 172.21.15.18:0/1606368989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981149b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb890009cd0 tx=0x7fb89002c0e0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 -- 172.21.15.18:0/1606368989 shutdown_connections 2024-04-21T22:42:36.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 --2- 172.21.15.18:0/1606368989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981149b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 --2- 172.21.15.18:0/1606368989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898076590 0x7fb898112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 --2- 172.21.15.18:0/1606368989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898075c70 0x7fb898076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 -- 172.21.15.18:0/1606368989 >> 172.21.15.18:0/1606368989 conn(0x7fb8980ff3b0 msgr2=0x7fb8981017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 -- 172.21.15.18:0/1606368989 shutdown_connections 2024-04-21T22:42:36.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.928+0000 7fb89d400640 1 -- 172.21.15.18:0/1606368989 wait complete. 2024-04-21T22:42:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.929+0000 7fb89d400640 1 Processor -- start 2024-04-21T22:42:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.929+0000 7fb89d400640 1 -- start start 2024-04-21T22:42:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898075c70 0x7fb89819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb898118100 con 0x7fb898075c70 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb898117f80 con 0x7fb898076590 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb89d400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb898118280 con 0x7fb8981125c0 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb896800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898075c70 0x7fb89819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb897200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40026/0 (socket says 172.21.15.18:40026) 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 -- 172.21.15.18:0/4217277477 learned_addr learned my addr 172.21.15.18:0/4217277477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 -- 172.21.15.18:0/4217277477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 msgr2=0x7fb8981a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 -- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898075c70 msgr2=0x7fb89819e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.930+0000 7fb895e00640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898075c70 0x7fb89819e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb895e00640 1 -- 172.21.15.18:0/4217277477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8981a35c0 con 0x7fb898076590 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb897200640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb895e00640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c920 tx=0x7fb88400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb88f400640 1 -- 172.21.15.18:0/4217277477 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884007c70 con 0x7fb898076590 2024-04-21T22:42:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8981a38b0 con 0x7fb898076590 2024-04-21T22:42:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb88f400640 1 -- 172.21.15.18:0/4217277477 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb884007e10 con 0x7fb898076590 2024-04-21T22:42:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb88f400640 1 -- 172.21.15.18:0/4217277477 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884018890 con 0x7fb898076590 2024-04-21T22:42:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.931+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981ab140 con 0x7fb898076590 2024-04-21T22:42:36.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.934+0000 7fb8a004f740 1 Processor -- start 2024-04-21T22:42:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb88f400640 1 -- 172.21.15.18:0/4217277477 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb884018a70 con 0x7fb898076590 2024-04-21T22:42:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 -- start start 2024-04-21T22:42:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d18d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d1b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560756c743a0 con 0x560756d0fd80 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560756c1c930 con 0x560756d19280 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb8a004f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560756c70360 con 0x560756d106a0 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb897200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb895e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb897200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51494/0 (socket says 172.21.15.18:51494) 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb897200640 1 -- 172.21.15.18:0/3323957069 learned_addr learned my addr 172.21.15.18:0/3323957069 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.935+0000 7fb896800640 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d18d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 -- 172.21.15.18:0/3323957069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 msgr2=0x560756d18d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d18d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 -- 172.21.15.18:0/3323957069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 msgr2=0x560756d1b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d1b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 -- 172.21.15.18:0/3323957069 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607569883f0 con 0x560756d0fd80 2024-04-21T22:42:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb897200640 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb89806aab0 tx=0x7fb8900323d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef5d818e0a9097a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.936+0000 7fb88f400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 0x7fb87c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb883400640 1 -- 172.21.15.18:0/3323957069 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890043070 con 0x560756d0fd80 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb88f400640 1 -- 172.21.15.18:0/4217277477 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fb8840cf500 con 0x7fb898076590 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb883400640 1 -- 172.21.15.18:0/3323957069 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8900098e0 con 0x560756d0fd80 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb883400640 1 -- 172.21.15.18:0/3323957069 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890039040 con 0x560756d0fd80 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb896800640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 0x7fb87c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb896800640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 0x7fb87c0a51c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560756d0f850 tx=0x7fb888005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb8a004f740 1 -- 172.21.15.18:0/3323957069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 msgr2=0x560756d10160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.937+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb89806aab0 tx=0x7fb8900323d0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 -- 172.21.15.18:0/3323957069 shutdown_connections 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d1b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d18d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3323957069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d10160 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 -- 172.21.15.18:0/3323957069 >> 172.21.15.18:0/3323957069 conn(0x560756d0a4b0 msgr2=0x560756d0a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 -- 172.21.15.18:0/3323957069 shutdown_connections 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 -- 172.21.15.18:0/3323957069 wait complete. 2024-04-21T22:42:36.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 -- start start 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.938+0000 7fb8a004f740 1 Processor -- start 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d168e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d16e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560756d1c010 con 0x560756d0fd80 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560756c2fd80 con 0x560756d19280 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560756d1c190 con 0x560756d106a0 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb8a004f740 10 client.0 _ll_register_callbacks cb 0x560756c6c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb896800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb896800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51506/0 (socket says 172.21.15.18:51506) 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb897200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d16e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb895e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.939+0000 7fb896800640 1 -- 172.21.15.18:0/3377975994 learned_addr learned my addr 172.21.15.18:0/3377975994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 -- 172.21.15.18:0/3377975994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 msgr2=0x560756d168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d168e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 -- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 msgr2=0x560756d16e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d16e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 -- 172.21.15.18:0/3377975994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560756a527d0 con 0x560756d0fd80 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb896800640 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb8880045e0 tx=0x7fb888004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a3a5a881146729 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb877e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888009e60 con 0x560756d0fd80 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fb88801e680 con 0x560756d0fd80 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.940+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8900098e0 con 0x560756d0fd80 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb88801e880 con 0x560756d0fd80 2024-04-21T22:42:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 10 client.17592 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560756d28400 con 0x560756d0fd80 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8900098e0 con 0x560756d0fd80 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb888027070 con 0x560756d0fd80 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 10 client.17592 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 20 client.17592 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d298c0 0x560756d2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 4 client.17592 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:36.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.941+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560756c818e0 con 0x560756d298c0 2024-04-21T22:42:36.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.942+0000 7fb895e00640 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d298c0 0x560756d2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.942+0000 7fb895e00640 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d298c0 0x560756d2bcf0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0e43913cb4c61b server_cookie=5949a0ccfc92c471 in_seq=0 out_seq=0 2024-04-21T22:42:36.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.942+0000 7fb877e00640 10 client.17592 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:36.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.943+0000 7fb877e00640 1 -- 172.21.15.18:0/3377975994 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560756c818e0 con 0x560756d298c0 2024-04-21T22:42:36.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.943+0000 7fb877e00640 10 client.17592 handle_command_reply: tid=0 2024-04-21T22:42:36.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.943+0000 7fb8a004f740 1 client.17592 shutdown 2024-04-21T22:42:36.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 msgr2=0x560756d163a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb8880045e0 tx=0x7fb888004730 comp rx=0 tx=0).stop 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 shutdown_connections 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d16e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d298c0 0x560756d2bcf0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d106a0 0x560756d168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3377975994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d163a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb877e00640 0 client.17592 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 >> 172.21.15.18:0/3377975994 conn(0x560756d0a4b0 msgr2=0x560756d0c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 shutdown_connections 2024-04-21T22:42:36.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 1 -- 172.21.15.18:0/3377975994 wait complete. 2024-04-21T22:42:36.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.944+0000 7fb8a004f740 20 client.17592 trim_cache size 0 max 16384 2024-04-21T22:42:36.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 Processor -- start 2024-04-21T22:42:36.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 -- start start 2024-04-21T22:42:36.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 0x560756d24ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d106a0 0x560756d16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d09510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b3b60 con 0x560756d106a0 2024-04-21T22:42:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b56a0 con 0x560756d19280 2024-04-21T22:42:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.959+0000 7fb8a004f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b4230 con 0x560756d0fd80 2024-04-21T22:42:36.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb896800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 0x560756d24ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb895e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d106a0 0x560756d16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb896800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 0x560756d24ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59608/0 (socket says 172.21.15.18:59608) 2024-04-21T22:42:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb896800640 1 -- 172.21.15.18:0/368084897 learned_addr learned my addr 172.21.15.18:0/368084897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d09510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 -- 172.21.15.18:0/368084897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 msgr2=0x560756d24ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 0x560756d24ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 -- 172.21.15.18:0/368084897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d106a0 msgr2=0x560756d16c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d106a0 0x560756d16c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 -- 172.21.15.18:0/368084897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560756d2c370 con 0x560756d19280 2024-04-21T22:42:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.960+0000 7fb897200640 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d09510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb890009ca0 tx=0x7fb890004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f34bd59da23f23b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb882a00640 1 -- 172.21.15.18:0/368084897 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890039040 con 0x560756d19280 2024-04-21T22:42:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb882a00640 1 -- 172.21.15.18:0/368084897 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8900098e0 con 0x560756d19280 2024-04-21T22:42:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb882a00640 1 -- 172.21.15.18:0/368084897 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890043040 con 0x560756d19280 2024-04-21T22:42:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 -- 172.21.15.18:0/368084897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 msgr2=0x560756d09510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d09510 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb890009ca0 tx=0x7fb890004300 comp rx=0 tx=0).stop 2024-04-21T22:42:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 -- 172.21.15.18:0/368084897 shutdown_connections 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d19280 0x560756d09510 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d106a0 0x560756d16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 --2- 172.21.15.18:0/368084897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d0fd80 0x560756d24ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 -- 172.21.15.18:0/368084897 >> 172.21.15.18:0/368084897 conn(0x560756d0a4b0 msgr2=0x560756d08e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.961+0000 7fb8a004f740 1 -- 172.21.15.18:0/368084897 shutdown_connections 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.962+0000 7fb8a004f740 1 -- 172.21.15.18:0/368084897 wait complete. 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.962+0000 7fb8a004f740 1 -- start start 2024-04-21T22:42:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.962+0000 7fb8a004f740 1 Processor -- start 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.962+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d106a0 0x560756d137e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d19280 0x560756d13d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b4fd0 con 0x560756d0fd80 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b4900 con 0x560756d106a0 2024-04-21T22:42:36.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8981b1b60 con 0x560756d19280 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb8a004f740 10 client.0 _ll_register_callbacks cb 0x7fb888009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51528/0 (socket says 172.21.15.18:51528) 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 -- 172.21.15.18:0/3611208459 learned_addr learned my addr 172.21.15.18:0/3611208459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb895e00640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d106a0 0x560756d137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb897200640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d19280 0x560756d13d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 -- 172.21.15.18:0/3611208459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d19280 msgr2=0x560756d13d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d19280 0x560756d13d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 -- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d106a0 msgr2=0x560756d137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d106a0 0x560756d137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.963+0000 7fb896800640 1 -- 172.21.15.18:0/3611208459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560756d8f030 con 0x560756d0fd80 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb896800640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb888029da0 tx=0x7fb88801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72750ffa7d058b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb877e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8880043d0 con 0x560756d0fd80 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fb88801e680 con 0x560756d0fd80 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8900098e0 con 0x560756d0fd80 2024-04-21T22:42:36.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb888009e60 con 0x560756d0fd80 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb8a004f740 10 client.17598 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.964+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560756d90310 con 0x560756d0fd80 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8900098e0 con 0x560756d0fd80 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb888041070 con 0x560756d0fd80 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 10 client.17598 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:36.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 20 client.17598 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d90a90 0x560756d92eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 4 client.17598 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560756c7bc30 con 0x560756d90a90 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.965+0000 7fb895e00640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d90a90 0x560756d92eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb895e00640 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d90a90 0x560756d92eb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a7b67220dace9b server_cookie=bee4bbe33a468b43 in_seq=0 out_seq=0 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb877e00640 10 client.17598 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb877e00640 1 -- 172.21.15.18:0/3611208459 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560756c7bc30 con 0x560756d90a90 2024-04-21T22:42:36.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb877e00640 10 client.17598 handle_command_reply: tid=0 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 client.17598 shutdown 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 msgr2=0x560756d132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb888029da0 tx=0x7fb88801ec50 comp rx=0 tx=0).stop 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 shutdown_connections 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560756d90a90 0x560756d92eb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560756d19280 0x560756d13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560756d106a0 0x560756d137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 --2- 172.21.15.18:0/3611208459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560756d0fd80 0x560756d132a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 >> 172.21.15.18:0/3611208459 conn(0x560756d0a4b0 msgr2=0x560756d09690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.966+0000 7fb877e00640 0 client.17598 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 shutdown_connections 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb8a004f740 1 -- 172.21.15.18:0/3611208459 wait complete. 2024-04-21T22:42:36.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb8a004f740 20 client.17598 trim_cache size 0 max 16384 2024-04-21T22:42:36.979 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:42:36.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 msgr2=0x7fb87c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 0x7fb87c0a51c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x560756d0f850 tx=0x7fb888005f90 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 msgr2=0x7fb89819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.967+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c920 tx=0x7fb88400cde0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 shutdown_connections 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb87c0a2d00 0x7fb87c0a51c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8981125c0 0x7fb8981a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb898076590 0x7fb89819eb60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 --2- 172.21.15.18:0/4217277477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb898075c70 0x7fb89819e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:36.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 >> 172.21.15.18:0/4217277477 conn(0x7fb8980ff3b0 msgr2=0x7fb8981017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:36.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 shutdown_connections 2024-04-21T22:42:36.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:36.968+0000 7fb89d400640 1 -- 172.21.15.18:0/4217277477 wait complete. 2024-04-21T22:42:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:37 smithi081 ceph-mon[31692]: pgmap v264: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:37.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:37 smithi047 ceph-mon[31561]: pgmap v264: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:37.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:42:37.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:42:37.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:42:38.071 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:37 smithi018 ceph-mon[26614]: pgmap v264: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:38.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 -- 172.21.15.18:0/421499822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed84107c80 msgr2=0x7fed84108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 --2- 172.21.15.18:0/421499822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed84107c80 0x7fed84108100 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fed70009930 tx=0x7fed7002bc30 comp rx=0 tx=0).stop 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 -- 172.21.15.18:0/421499822 shutdown_connections 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 --2- 172.21.15.18:0/421499822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed841149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 --2- 172.21.15.18:0/421499822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed84107c80 0x7fed84108100 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 --2- 172.21.15.18:0/421499822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed8410dc00 0x7fed8410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 -- 172.21.15.18:0/421499822 >> 172.21.15.18:0/421499822 conn(0x7fed84077550 msgr2=0x7fed84106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 -- 172.21.15.18:0/421499822 shutdown_connections 2024-04-21T22:42:38.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.219+0000 7fed8a600640 1 -- 172.21.15.18:0/421499822 wait complete. 2024-04-21T22:42:38.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.220+0000 7fed8a600640 1 Processor -- start 2024-04-21T22:42:38.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 -- start start 2024-04-21T22:42:38.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed8419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 0x7fed841a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed84117f50 con 0x7fed84107c80 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed84117dd0 con 0x7fed84108640 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.221+0000 7fed8a600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed841180d0 con 0x7fed8410dc00 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51552/0 (socket says 172.21.15.18:51552) 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89200640 1 -- 172.21.15.18:0/2258838914 learned_addr learned my addr 172.21.15.18:0/2258838914 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed83e00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed8419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 0x7fed841a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 -- 172.21.15.18:0/2258838914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 msgr2=0x7fed8419e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed8419e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 -- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 msgr2=0x7fed8419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89c00640 1 -- 172.21.15.18:0/2258838914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed841a33e0 con 0x7fed8410dc00 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed83e00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed8419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.222+0000 7fed89200640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed89c00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 0x7fed841a2cb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00da10 tx=0x7fed7c00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed81600640 1 -- 172.21.15.18:0/2258838914 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00bd70 con 0x7fed8410dc00 2024-04-21T22:42:38.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed81600640 1 -- 172.21.15.18:0/2258838914 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed7c003e50 con 0x7fed8410dc00 2024-04-21T22:42:38.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed841a36d0 con 0x7fed8410dc00 2024-04-21T22:42:38.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed81600640 1 -- 172.21.15.18:0/2258838914 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c0106a0 con 0x7fed8410dc00 2024-04-21T22:42:38.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.223+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed841aaf60 con 0x7fed8410dc00 2024-04-21T22:42:38.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.226+0000 7fed8e975740 1 Processor -- start 2024-04-21T22:42:38.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed81600640 1 -- 172.21.15.18:0/2258838914 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fed7c003970 con 0x7fed8410dc00 2024-04-21T22:42:38.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 -- start start 2024-04-21T22:42:38.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589616001d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558961552df0 con 0x5589615fdde0 2024-04-21T22:42:38.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558961558040 con 0x5589615f5200 2024-04-21T22:42:38.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.227+0000 7fed8e975740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5589615008c0 con 0x5589615f48e0 2024-04-21T22:42:38.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed83e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40070/0 (socket says 172.21.15.18:40070) 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 -- 172.21.15.18:0/3396884445 learned_addr learned my addr 172.21.15.18:0/3396884445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed83e00640 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589616001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 -- 172.21.15.18:0/3396884445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 msgr2=0x5589615f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 -- 172.21.15.18:0/3396884445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 msgr2=0x5589616001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589616001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed89200640 1 -- 172.21.15.18:0/3396884445 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589613347e0 con 0x5589615f5200 2024-04-21T22:42:38.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.228+0000 7fed83e00640 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589616001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed89200640 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed78010580 tx=0x7fed78010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5efd6e4324e87e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed81600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 0x7fed6c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed81600640 1 -- 172.21.15.18:0/2258838914 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fed7c0cf8b0 con 0x7fed8410dc00 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed76000640 1 -- 172.21.15.18:0/3396884445 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7800e7d0 con 0x5589615f5200 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed76000640 1 -- 172.21.15.18:0/3396884445 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed7800ee50 con 0x5589615f5200 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed76000640 1 -- 172.21.15.18:0/3396884445 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed780193d0 con 0x5589615f5200 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.229+0000 7fed83e00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 0x7fed6c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- 172.21.15.18:0/3396884445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 msgr2=0x5589615fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fed78010580 tx=0x7fed78010a40 comp rx=0 tx=0).stop 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- 172.21.15.18:0/3396884445 shutdown_connections 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589616001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615fd8a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 --2- 172.21.15.18:0/3396884445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- 172.21.15.18:0/3396884445 >> 172.21.15.18:0/3396884445 conn(0x5589615ef010 msgr2=0x5589615ef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- 172.21.15.18:0/3396884445 shutdown_connections 2024-04-21T22:42:38.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed83e00640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 0x7fed6c0a5240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed70009900 tx=0x7fed7002df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- 172.21.15.18:0/3396884445 wait complete. 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.230+0000 7fed8e975740 1 -- start start 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 Processor -- start 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f5200 0x5589615fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558961513d20 con 0x5589615fdde0 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558961554000 con 0x5589615f48e0 2024-04-21T22:42:38.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558961600bd0 con 0x5589615f5200 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed8e975740 10 client.0 _ll_register_callbacks cb 0x55896154f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed89200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40084/0 (socket says 172.21.15.18:40084) 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.231+0000 7fed89200640 1 -- 172.21.15.18:0/3673442734 learned_addr learned my addr 172.21.15.18:0/3673442734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed83e00640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f5200 0x5589615fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 -- 172.21.15.18:0/3673442734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f5200 msgr2=0x5589615fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f5200 0x5589615fb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 -- 172.21.15.18:0/3673442734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 msgr2=0x5589615fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 -- 172.21.15.18:0/3673442734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558961394f70 con 0x5589615f48e0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed89200640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed78006010 tx=0x7fed7800be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a63484abeb151565 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.232+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78011440 con 0x5589615f48e0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fed780115e0 con 0x5589615f48e0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed7800ee50 con 0x5589615f48e0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fed78031050 con 0x5589615f48e0 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed8e975740 10 client.27692 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55896122c170 con 0x5589615f48e0 2024-04-21T22:42:38.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.233+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed7800ee50 con 0x5589615f48e0 2024-04-21T22:42:38.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fed7800e5d0 con 0x5589615f48e0 2024-04-21T22:42:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 10 client.27692 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 10 client.27692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 20 client.27692 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:38.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55896160e010 0x558961610400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 4 client.27692 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558961565580 con 0x55896160e010 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.234+0000 7fed83e00640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55896160e010 0x558961610400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.235+0000 7fed83e00640 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55896160e010 0x558961610400 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbdc30b89a9f504 server_cookie=f0dccaee9bae7da4 in_seq=0 out_seq=0 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.235+0000 7fed6aa00640 10 client.27692 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.235+0000 7fed6aa00640 1 -- 172.21.15.18:0/3673442734 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558961565580 con 0x55896160e010 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.235+0000 7fed6aa00640 10 client.27692 handle_command_reply: tid=0 2024-04-21T22:42:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 client.27692 shutdown 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 msgr2=0x5589615faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fed78006010 tx=0x7fed7800be50 comp rx=0 tx=0).stop 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 shutdown_connections 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55896160e010 0x558961610400 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f5200 0x5589615fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 --2- 172.21.15.18:0/3673442734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f48e0 0x5589615faea0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed6aa00640 0 client.27692 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 >> 172.21.15.18:0/3673442734 conn(0x5589615ef010 msgr2=0x5589615f0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 shutdown_connections 2024-04-21T22:42:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 1 -- 172.21.15.18:0/3673442734 wait complete. 2024-04-21T22:42:38.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.236+0000 7fed8e975740 20 client.27692 trim_cache size 0 max 16384 2024-04-21T22:42:38.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.256+0000 7fed8e975740 1 Processor -- start 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.256+0000 7fed8e975740 1 -- start start 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x558961609910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b39c0 con 0x5589615fdde0 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b5500 con 0x5589615f5200 2024-04-21T22:42:38.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed8e975740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b4090 con 0x5589615f48e0 2024-04-21T22:42:38.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51580/0 (socket says 172.21.15.18:51580) 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed89c00640 1 -- 172.21.15.18:0/1120578171 learned_addr learned my addr 172.21.15.18:0/1120578171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed83e00640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x558961609910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed89200640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed83e00640 1 -- 172.21.15.18:0/1120578171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 msgr2=0x5589615fd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed83e00640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615fd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed83e00640 1 -- 172.21.15.18:0/1120578171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 msgr2=0x5589615fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.257+0000 7fed83e00640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed83e00640 1 -- 172.21.15.18:0/1120578171 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589615ed490 con 0x5589615f5200 2024-04-21T22:42:38.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed89c00640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:38.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed83e00640 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x558961609910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fed70036040 tx=0x7fed7003e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb104eb96b29b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed75600640 1 -- 172.21.15.18:0/1120578171 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7005d070 con 0x5589615f5200 2024-04-21T22:42:38.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed75600640 1 -- 172.21.15.18:0/1120578171 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed70004480 con 0x5589615f5200 2024-04-21T22:42:38.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.258+0000 7fed75600640 1 -- 172.21.15.18:0/1120578171 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70003b80 con 0x5589615f5200 2024-04-21T22:42:38.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 -- 172.21.15.18:0/1120578171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 msgr2=0x558961609910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x558961609910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fed70036040 tx=0x7fed7003e000 comp rx=0 tx=0).stop 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 -- 172.21.15.18:0/1120578171 shutdown_connections 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x558961609910 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 --2- 172.21.15.18:0/1120578171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615fd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 -- 172.21.15.18:0/1120578171 >> 172.21.15.18:0/1120578171 conn(0x5589615ef010 msgr2=0x5589615fae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 -- 172.21.15.18:0/1120578171 shutdown_connections 2024-04-21T22:42:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.259+0000 7fed8e975740 1 -- 172.21.15.18:0/1120578171 wait complete. 2024-04-21T22:42:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 -- start start 2024-04-21T22:42:38.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 Processor -- start 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b4e30 con 0x5589615fdde0 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b4760 con 0x5589615f5200 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed841b19c0 con 0x5589615f48e0 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed8e975740 10 client.0 _ll_register_callbacks cb 0x7fed780103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:38.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.260+0000 7fed89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51584/0 (socket says 172.21.15.18:51584) 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 -- 172.21.15.18:0/927638635 learned_addr learned my addr 172.21.15.18:0/927638635 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89200640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed83e00640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 -- 172.21.15.18:0/927638635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 msgr2=0x5589615f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 -- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 msgr2=0x5589615f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 -- 172.21.15.18:0/927638635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558961673470 con 0x5589615fdde0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89200640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed89c00640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fed7c09bcd0 tx=0x7fed7c09c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6d63969d987f31 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed6aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.261+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c003c60 con 0x5589615fdde0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed70004480 con 0x5589615fdde0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7fed7c0983b0 con 0x5589615fdde0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fed7c081050 con 0x5589615fdde0 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 10 client.17616 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5589616747d0 con 0x5589615fdde0 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed70004480 con 0x5589615fdde0 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fed7c024060 con 0x5589615fdde0 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 10 client.17616 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 20 client.17616 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558961674f20 0x558961677340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 4 client.17616 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.262+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55896155f8d0 con 0x558961674f20 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.263+0000 7fed89200640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558961674f20 0x558961677340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.263+0000 7fed89200640 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558961674f20 0x558961677340 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83109c36e2bf5d3c server_cookie=4def31f4edb6265c in_seq=0 out_seq=0 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.263+0000 7fed6aa00640 10 client.17616 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.264+0000 7fed6aa00640 1 -- 172.21.15.18:0/927638635 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55896155f8d0 con 0x558961674f20 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.264+0000 7fed6aa00640 10 client.17616 handle_command_reply: tid=0 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.264+0000 7fed8e975740 1 client.17616 shutdown 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 msgr2=0x5589615f8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fed7c09bcd0 tx=0x7fed7c09c580 comp rx=0 tx=0).stop 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 shutdown_connections 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589615fdde0 0x5589615f8800 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5589615f5200 0x5589615f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558961674f20 0x558961677340 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 --2- 172.21.15.18:0/927638635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589615f48e0 0x5589615f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed6aa00640 0 client.17616 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 >> 172.21.15.18:0/927638635 conn(0x5589615ef010 msgr2=0x5589615ee080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 shutdown_connections 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 1 -- 172.21.15.18:0/927638635 wait complete. 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.265+0000 7fed8e975740 20 client.17616 trim_cache size 0 max 16384 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:42:38.273 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "a215b5a5-e06f-4348-8d77-95775cb09888", 2024-04-21T22:42:38.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:42:38.274 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 msgr2=0x7fed6c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 0x7fed6c0a5240 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed70009900 tx=0x7fed7002df90 comp rx=0 tx=0).stop 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 msgr2=0x7fed841a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 0x7fed841a2cb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00da10 tx=0x7fed7c00ded0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 shutdown_connections 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fed6c0a2d80 0x7fed6c0a5240 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8410dc00 0x7fed841a2cb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed84108640 0x7fed8419e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 --2- 172.21.15.18:0/2258838914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed84107c80 0x7fed8419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 >> 172.21.15.18:0/2258838914 conn(0x7fed84077550 msgr2=0x7fed840785d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 shutdown_connections 2024-04-21T22:42:38.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.266+0000 7fed8a600640 1 -- 172.21.15.18:0/2258838914 wait complete. 2024-04-21T22:42:38.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:42:38.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 -- 172.21.15.18:0/3386361542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac073b70 msgr2=0x7ff7ac073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/3386361542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac073b70 0x7ff7ac073f50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009900 tx=0x7ff79c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 -- 172.21.15.18:0/3386361542 shutdown_connections 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/3386361542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac10df40 0x7ff7ac110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/3386361542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/3386361542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac073b70 0x7ff7ac073f50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.522+0000 7ff7b0c00640 1 -- 172.21.15.18:0/3386361542 >> 172.21.15.18:0/3386361542 conn(0x7ff7ac0fd1f0 msgr2=0x7ff7ac0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.523+0000 7ff7b0c00640 1 -- 172.21.15.18:0/3386361542 shutdown_connections 2024-04-21T22:42:38.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.523+0000 7ff7b0c00640 1 -- 172.21.15.18:0/3386361542 wait complete. 2024-04-21T22:42:38.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 Processor -- start 2024-04-21T22:42:38.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 -- start start 2024-04-21T22:42:38.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 0x7ff7ac19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac113d30 con 0x7ff7ac074490 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac113bb0 con 0x7ff7ac10df40 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7b0c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac113eb0 con 0x7ff7ac073b70 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7a9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7a9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59698/0 (socket says 172.21.15.18:59698) 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.524+0000 7ff7a9e00640 1 -- 172.21.15.18:0/930515487 learned_addr learned my addr 172.21.15.18:0/930515487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7aa800640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 0x7ff7ac19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9400640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9e00640 1 -- 172.21.15.18:0/930515487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 msgr2=0x7ff7ac19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9e00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 0x7ff7ac19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9e00640 1 -- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 msgr2=0x7ff7ac19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9e00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9e00640 1 -- 172.21.15.18:0/930515487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac19f210 con 0x7ff7ac073b70 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7a9400640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.525+0000 7ff7aa800640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 0x7ff7ac19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:42:38.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7a9e00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff79c000c00 tx=0x7ff79c0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7a2a00640 1 -- 172.21.15.18:0/930515487 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c042020 con 0x7ff7ac073b70 2024-04-21T22:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7a2a00640 1 -- 172.21.15.18:0/930515487 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79c005000 con 0x7ff7ac073b70 2024-04-21T22:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7a2a00640 1 -- 172.21.15.18:0/930515487 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c003b00 con 0x7ff7ac073b70 2024-04-21T22:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac19f4a0 con 0x7ff7ac073b70 2024-04-21T22:42:38.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.526+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac1a6d90 con 0x7ff7ac073b70 2024-04-21T22:42:38.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.530+0000 7ff7a2a00640 1 -- 172.21.15.18:0/930515487 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff79c045020 con 0x7ff7ac073b70 2024-04-21T22:42:38.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.531+0000 7ff7b384d740 1 Processor -- start 2024-04-21T22:42:38.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.531+0000 7ff7b384d740 1 -- start start 2024-04-21T22:42:38.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.531+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.531+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a31e0 0x559e827ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 0x559e827ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7b384d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e82706410 con 0x559e827abdc0 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7b384d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e826ae7e0 con 0x559e827a31e0 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7b384d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559e827023d0 con 0x559e827a28c0 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7a9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a31e0 0x559e827ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59706/0 (socket says 172.21.15.18:59706) 2024-04-21T22:42:38.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 -- 172.21.15.18:0/951823302 learned_addr learned my addr 172.21.15.18:0/951823302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 -- 172.21.15.18:0/951823302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a31e0 msgr2=0x559e827ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a31e0 0x559e827ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 -- 172.21.15.18:0/951823302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 msgr2=0x559e827ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7a9400640 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 0x559e827ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.532+0000 7ff7aa800640 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 0x559e827ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff7aa800640 1 -- 172.21.15.18:0/951823302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e824e47d0 con 0x559e827a28c0 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff7a9400640 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 0x559e827ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff7aa800640 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4011790 tx=0x7ff7a4011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724a202cf7e6533 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff7a2a00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 0x7ff7900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff797000640 1 -- 172.21.15.18:0/951823302 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4003c30 con 0x559e827a28c0 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff797000640 1 -- 172.21.15.18:0/951823302 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a400fe80 con 0x559e827a28c0 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff797000640 1 -- 172.21.15.18:0/951823302 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40193e0 con 0x559e827a28c0 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.533+0000 7ff7a2a00640 1 -- 172.21.15.18:0/930515487 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ff79c0f1110 con 0x7ff7ac073b70 2024-04-21T22:42:38.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.534+0000 7ff7a9e00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 0x7ff7900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.534+0000 7ff7b384d740 1 -- 172.21.15.18:0/951823302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 msgr2=0x559e827a2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.534+0000 7ff7b384d740 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4011790 tx=0x7ff7a4011c50 comp rx=0 tx=0).stop 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.534+0000 7ff7a9e00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 0x7ff7900a5240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x559e827a2390 tx=0x7ff79c0f4c00 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 -- 172.21.15.18:0/951823302 shutdown_connections 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827abdc0 0x559e827ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a31e0 0x559e827ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 --2- 172.21.15.18:0/951823302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a2ca0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 -- 172.21.15.18:0/951823302 >> 172.21.15.18:0/951823302 conn(0x559e8279cff0 msgr2=0x559e8279d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 -- 172.21.15.18:0/951823302 shutdown_connections 2024-04-21T22:42:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 -- 172.21.15.18:0/951823302 wait complete. 2024-04-21T22:42:38.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.535+0000 7ff7b384d740 1 -- start start 2024-04-21T22:42:38.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.536+0000 7ff7b384d740 1 Processor -- start 2024-04-21T22:42:38.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.536+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.536+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e827a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7b384d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559e827aebb0 con 0x559e827a31e0 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7b384d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x559e826c1c40 con 0x559e827abdc0 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7b384d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559e827aed30 con 0x559e827a28c0 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7b384d740 10 client.0 _ll_register_callbacks cb 0x559e826c1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:38.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:59716/0 (socket says 172.21.15.18:59716) 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7a9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7aa800640 1 -- 172.21.15.18:0/2725671656 learned_addr learned my addr 172.21.15.18:0/2725671656 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.537+0000 7ff7aa800640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e827a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 -- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 msgr2=0x559e827a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e827a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 -- 172.21.15.18:0/2725671656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 msgr2=0x559e827a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 -- 172.21.15.18:0/2725671656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8241a3f0 con 0x559e827a28c0 2024-04-21T22:42:38.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7aa800640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40046c0 tx=0x7ff7a4004520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680822cebc2b6e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff78b400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4011260 con 0x559e827a28c0 2024-04-21T22:42:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ff7a4004a40 con 0x559e827a28c0 2024-04-21T22:42:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.538+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e82719c40 con 0x559e827a28c0 2024-04-21T22:42:38.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff7a4004c40 con 0x559e827a28c0 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 10 client.27769 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559e823da0f0 con 0x559e827a28c0 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559e82719c40 con 0x559e827a28c0 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff7a4018070 con 0x559e827a28c0 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 10 client.27769 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 10 client.27769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 20 client.27769 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e827bbfe0 0x559e827be3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 4 client.27769 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:42:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.539+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e82713950 con 0x559e827bbfe0 2024-04-21T22:42:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.540+0000 7ff7a9400640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e827bbfe0 0x559e827be3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.540+0000 7ff7a9400640 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e827bbfe0 0x559e827be3d0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beec90e8be8bef62 server_cookie=57c7890cfad0a565 in_seq=0 out_seq=0 2024-04-21T22:42:38.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.540+0000 7ff78b400640 10 client.27769 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.541+0000 7ff78b400640 1 -- 172.21.15.18:0/2725671656 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e82713950 con 0x559e827bbfe0 2024-04-21T22:42:38.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.541+0000 7ff78b400640 10 client.27769 handle_command_reply: tid=0 2024-04-21T22:42:38.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 client.27769 shutdown 2024-04-21T22:42:38.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 msgr2=0x559e827a8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40046c0 tx=0x7ff7a4004520 comp rx=0 tx=0).stop 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 shutdown_connections 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e827a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e827bbfe0 0x559e827be3d0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 --2- 172.21.15.18:0/2725671656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827a8e60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 >> 172.21.15.18:0/2725671656 conn(0x559e8279cff0 msgr2=0x559e8279ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.542+0000 7ff78b400640 0 client.27769 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.543+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 shutdown_connections 2024-04-21T22:42:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.543+0000 7ff7b384d740 1 -- 172.21.15.18:0/2725671656 wait complete. 2024-04-21T22:42:38.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.543+0000 7ff7b384d740 20 client.27769 trim_cache size 0 max 16384 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.567+0000 7ff7b384d740 1 Processor -- start 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 -- start start 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827abdc0 0x559e827a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1af860 con 0x559e827a31e0 2024-04-21T22:42:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b13a0 con 0x559e827a28c0 2024-04-21T22:42:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7b384d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1aff30 con 0x559e827abdc0 2024-04-21T22:42:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40146/0 (socket says 172.21.15.18:40146) 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7aa800640 1 -- 172.21.15.18:0/635908224 learned_addr learned my addr 172.21.15.18:0/635908224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.568+0000 7ff7aa800640 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827abdc0 0x559e827a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7a9400640 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 -- 172.21.15.18:0/635908224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827abdc0 msgr2=0x559e827a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827abdc0 0x559e827a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 -- 172.21.15.18:0/635908224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 msgr2=0x559e827b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 -- 172.21.15.18:0/635908224 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8279cb20 con 0x559e827a28c0 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff7aa800640 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400f810 tx=0x7ff7a4014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3ed74ed2712b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.569+0000 7ff796600640 1 -- 172.21.15.18:0/635908224 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4004940 con 0x559e827a28c0 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.570+0000 7ff796600640 1 -- 172.21.15.18:0/635908224 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a4011260 con 0x559e827a28c0 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.570+0000 7ff796600640 1 -- 172.21.15.18:0/635908224 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4003bd0 con 0x559e827a28c0 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.570+0000 7ff7b384d740 1 -- 172.21.15.18:0/635908224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 msgr2=0x559e827a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.570+0000 7ff7b384d740 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400f810 tx=0x7ff7a4014040 comp rx=0 tx=0).stop 2024-04-21T22:42:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.570+0000 7ff7b384d740 1 -- 172.21.15.18:0/635908224 shutdown_connections 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827abdc0 0x559e827a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 --2- 172.21.15.18:0/635908224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827a28c0 0x559e827a7da0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 -- 172.21.15.18:0/635908224 >> 172.21.15.18:0/635908224 conn(0x559e8279cff0 msgr2=0x559e8279eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 -- 172.21.15.18:0/635908224 shutdown_connections 2024-04-21T22:42:38.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 -- 172.21.15.18:0/635908224 wait complete. 2024-04-21T22:42:38.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.571+0000 7ff7b384d740 1 -- start start 2024-04-21T22:42:38.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 Processor -- start 2024-04-21T22:42:38.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827af160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e82828bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b0cd0 con 0x559e827a31e0 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1b0600 con 0x559e827abdc0 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.572+0000 7ff7b384d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac1ad860 con 0x559e827a28c0 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7b384d740 10 client.0 _ll_register_callbacks cb 0x7ff7a400fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7a9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7a9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51632/0 (socket says 172.21.15.18:51632) 2024-04-21T22:42:38.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7a9400640 1 -- 172.21.15.18:0/3611087088 learned_addr learned my addr 172.21.15.18:0/3611087088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e82828bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 -- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 msgr2=0x559e82828bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e82828bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 -- 172.21.15.18:0/3611087088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 msgr2=0x559e827af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.573+0000 7ff7aa800640 1 -- 172.21.15.18:0/3611087088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e82829140 con 0x559e827a28c0 2024-04-21T22:42:38.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff7aa800640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827af160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff7a401d040 tx=0x7ff7a4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9e7d6dd60152d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff78b400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4004940 con 0x559e827a28c0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8571+0+0 (secure 0 0 0) 0x7ff7a4003970 con 0x559e827a28c0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7a4011260 con 0x559e827a28c0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff7a4003b70 con 0x559e827a28c0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff7b384d740 10 client.27775 fetch_fsmap learned FSMap version 38 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.574+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x559e8282a450 con 0x559e827a28c0 2024-04-21T22:42:38.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a4011260 con 0x559e827a28c0 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff7a4018070 con 0x559e827a28c0 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 10 client.27775 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 10 client.27775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 20 client.27775 populate_metadata read hostname 'smithi018' 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e8282aa80 0x559e8282cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 4 client.27775 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e8270dca0 con 0x559e8282aa80 2024-04-21T22:42:38.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.575+0000 7ff7a9400640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e8282aa80 0x559e8282cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.576+0000 7ff7a9400640 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e8282aa80 0x559e8282cea0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d797044198d82d10 server_cookie=9445de4d1cf60ce4 in_seq=0 out_seq=0 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.576+0000 7ff78b400640 10 client.27775 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.576+0000 7ff78b400640 1 -- 172.21.15.18:0/3611087088 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559e8270dca0 con 0x559e8282aa80 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.576+0000 7ff78b400640 10 client.27775 handle_command_reply: tid=0 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.576+0000 7ff7b384d740 1 client.27775 shutdown 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 msgr2=0x559e827af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827af160 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff7a401d040 tx=0x7ff7a4009f90 comp rx=0 tx=0).stop 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 shutdown_connections 2024-04-21T22:42:38.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x559e827abdc0 0x559e82828bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559e827a31e0 0x559e827af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x559e8282aa80 0x559e8282cea0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 --2- 172.21.15.18:0/3611087088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559e827a28c0 0x559e827af160 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 >> 172.21.15.18:0/3611087088 conn(0x559e8279cff0 msgr2=0x559e8279e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff78b400640 0 client.27775 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 shutdown_connections 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 1 -- 172.21.15.18:0/3611087088 wait complete. 2024-04-21T22:42:38.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.577+0000 7ff7b384d740 20 client.27775 trim_cache size 0 max 16384 2024-04-21T22:42:38.584 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:42:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:42:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:42:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "a215b5a5-e06f-4348-8d77-95775cb09888": { 2024-04-21T22:42:38.584 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:42:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "a215b5a5-e06f-4348-8d77-95775cb09888", 2024-04-21T22:42:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:42:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:42:38.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:42:38.585 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:42:38.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 msgr2=0x7ff7900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 0x7ff7900a5240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x559e827a2390 tx=0x7ff79c0f4c00 comp rx=0 tx=0).stop 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 msgr2=0x7ff7ac19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff79c000c00 tx=0x7ff79c0043c0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 shutdown_connections 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff7900a2d80 0x7ff7900a5240 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7ac10df40 0x7ff7ac19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7ac074490 0x7ff7ac19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 --2- 172.21.15.18:0/930515487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac073b70 0x7ff7ac19a270 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:42:38.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 >> 172.21.15.18:0/930515487 conn(0x7ff7ac0fd1f0 msgr2=0x7ff7ac0fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:42:38.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 shutdown_connections 2024-04-21T22:42:38.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:42:38.578+0000 7ff7b0c00640 1 -- 172.21.15.18:0/930515487 wait complete. 2024-04-21T22:42:38.600 INFO:tasks.cephfs.filesystem:scrub status for tag:a215b5a5-e06f-4348-8d77-95775cb09888 - {'path': '/', 'tag': 'a215b5a5-e06f-4348-8d77-95775cb09888', 'options': 'recursive,force'} 2024-04-21T22:42:38.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:38 smithi047 ceph-mon[31561]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:39.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:38 smithi018 ceph-mon[26614]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:39.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:38 smithi081 ceph-mon[31692]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:39.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:42:39.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:42:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:39.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:39 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:42:40.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.097 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.098 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.099 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:39 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:39 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:42:40.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:40 smithi047 ceph-mon[31561]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:41.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:40 smithi018 ceph-mon[26614]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:41.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:40 smithi081 ceph-mon[31692]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:43.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:43 smithi018 ceph-mon[26614]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:43.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:43 smithi081 ceph-mon[31692]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:43.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:43 smithi047 ceph-mon[31561]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:45.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:45 smithi018 ceph-mon[26614]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:45.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:45 smithi081 ceph-mon[31692]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:45.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:45 smithi047 ceph-mon[31561]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:47.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:47 smithi018 ceph-mon[26614]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:47.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:47 smithi081 ceph-mon[31692]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:47 smithi047 ceph-mon[31561]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:49.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:49 smithi018 ceph-mon[26614]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:49.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:49 smithi081 ceph-mon[31692]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:49.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:49 smithi047 ceph-mon[31561]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:51.595 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:51 smithi018 ceph-mon[26614]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:51.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:51 smithi081 ceph-mon[31692]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:51.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:51 smithi047 ceph-mon[31561]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:53 smithi081 ceph-mon[31692]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:53.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:53 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:53 smithi047 ceph-mon[31561]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:53.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:53 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:53.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:53 smithi018 ceph-mon[26614]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:42:53.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:53.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:53.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:53 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:54.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:54 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:54.639 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:54 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:42:54.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:54 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:54.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:54 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:42:54.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:54 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:54.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:54 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:42:55.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:55 smithi081 ceph-mon[31692]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:55.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:55 smithi047 ceph-mon[31561]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:55 smithi018 ceph-mon[26614]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:42:57.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:57 smithi081 ceph-mon[31692]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:57.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:57 smithi047 ceph-mon[31561]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:57 smithi018 ceph-mon[26614]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:42:59.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:42:59 smithi081 ceph-mon[31692]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:59.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:42:59 smithi047 ceph-mon[31561]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:42:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:42:59 smithi018 ceph-mon[26614]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:01.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:01 smithi081 ceph-mon[31692]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:01.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:01 smithi047 ceph-mon[31561]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:01 smithi018 ceph-mon[26614]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:03.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:03 smithi081 ceph-mon[31692]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:03.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:03 smithi047 ceph-mon[31561]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:03.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:03 smithi018 ceph-mon[26614]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:05.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:05 smithi047 ceph-mon[31561]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:43:05.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:05 smithi018 ceph-mon[26614]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:43:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:05 smithi081 ceph-mon[31692]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:43:07.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:07 smithi047 ceph-mon[31561]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:43:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:07 smithi018 ceph-mon[26614]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:43:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:07 smithi081 ceph-mon[31692]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:43:08.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:43:08.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:43:08.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 -- 172.21.15.18:0/2324217007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4073ae0 msgr2=0x7f7be4073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 --2- 172.21.15.18:0/2324217007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4073ae0 0x7f7be4073ec0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009900 tx=0x7f7bd402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 -- 172.21.15.18:0/2324217007 shutdown_connections 2024-04-21T22:43:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 --2- 172.21.15.18:0/2324217007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4112520 0x7f7be4114910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 --2- 172.21.15.18:0/2324217007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4074400 0x7f7be4111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 --2- 172.21.15.18:0/2324217007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4073ae0 0x7f7be4073ec0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 -- 172.21.15.18:0/2324217007 >> 172.21.15.18:0/2324217007 conn(0x7f7be40fd020 msgr2=0x7f7be40ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.813+0000 7f7be3e00640 1 -- 172.21.15.18:0/2324217007 shutdown_connections 2024-04-21T22:43:08.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.814+0000 7f7be3e00640 1 -- 172.21.15.18:0/2324217007 wait complete. 2024-04-21T22:43:08.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 Processor -- start 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 -- start start 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4112520 0x7f7be41a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4117f20 con 0x7f7be4074400 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4117da0 con 0x7f7be4073ae0 2024-04-21T22:43:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41180a0 con 0x7f7be4112520 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7bda000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7bda000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47644/0 (socket says 172.21.15.18:47644) 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7bda000640 1 -- 172.21.15.18:0/196131755 learned_addr learned my addr 172.21.15.18:0/196131755 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.815+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52126/0 (socket says 172.21.15.18:52126) 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7be3400640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4112520 0x7f7be41a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 -- 172.21.15.18:0/196131755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4112520 msgr2=0x7f7be41a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4112520 0x7f7be41a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 -- 172.21.15.18:0/196131755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 msgr2=0x7f7be419e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 -- 172.21.15.18:0/196131755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be41a3460 con 0x7f7be4074400 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7be2a00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bda000640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9f0 tx=0x7f7bcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.816+0000 7f7bdbe00640 1 -- 172.21.15.18:0/196131755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00cd80 con 0x7f7be4074400 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.817+0000 7f7bdbe00640 1 -- 172.21.15.18:0/196131755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc005500 con 0x7f7be4074400 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.817+0000 7f7bdbe00640 1 -- 172.21.15.18:0/196131755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc010690 con 0x7f7be4074400 2024-04-21T22:43:08.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.817+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be41a3750 con 0x7f7be4074400 2024-04-21T22:43:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.817+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be41aafe0 con 0x7f7be4074400 2024-04-21T22:43:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.820+0000 7f7bec809740 1 Processor -- start 2024-04-21T22:43:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.820+0000 7f7bdbe00640 1 -- 172.21.15.18:0/196131755 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f7bcc0046c0 con 0x7f7be4074400 2024-04-21T22:43:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.820+0000 7f7bec809740 1 -- start start 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75abfb0 0x5641d75ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641d7506410 con 0x5641d75abfb0 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641d74ae7e0 con 0x5641d75a33d0 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bec809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641d75023d0 con 0x5641d75a2ab0 2024-04-21T22:43:08.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7bda000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75abfb0 0x5641d75ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7be3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52132/0 (socket says 172.21.15.18:52132) 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.821+0000 7f7be2a00640 1 -- 172.21.15.18:0/3646999222 learned_addr learned my addr 172.21.15.18:0/3646999222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 -- 172.21.15.18:0/3646999222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 msgr2=0x5641d75a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 -- 172.21.15.18:0/3646999222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75abfb0 msgr2=0x5641d75ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75abfb0 0x5641d75ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 -- 172.21.15.18:0/3646999222 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d72e47d0 con 0x5641d75a33d0 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7be2a00640 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bd402c210 tx=0x7f7bd4009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19202eb8bb6a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7bdbe00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 0x7f7bc80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7bdbe00640 1 -- 172.21.15.18:0/196131755 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f7bcc0cf890 con 0x7f7be4074400 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.822+0000 7f7bd3e00640 1 -- 172.21.15.18:0/3646999222 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4042070 con 0x5641d75a33d0 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.823+0000 7f7be3400640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 0x7f7bc80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.823+0000 7f7bd3e00640 1 -- 172.21.15.18:0/3646999222 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4004a70 con 0x5641d75a33d0 2024-04-21T22:43:08.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.823+0000 7f7bd3e00640 1 -- 172.21.15.18:0/3646999222 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4005190 con 0x5641d75a33d0 2024-04-21T22:43:08.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- 172.21.15.18:0/3646999222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 msgr2=0x5641d75aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7be3400640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 0x7f7bc80a5240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7be406ac80 tx=0x7f7bdc009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bd402c210 tx=0x7f7bd4009650 comp rx=0 tx=0).stop 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- 172.21.15.18:0/3646999222 shutdown_connections 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75abfb0 0x5641d75ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a33d0 0x5641d75aba70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 --2- 172.21.15.18:0/3646999222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- 172.21.15.18:0/3646999222 >> 172.21.15.18:0/3646999222 conn(0x5641d759d1e0 msgr2=0x5641d759d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- 172.21.15.18:0/3646999222 shutdown_connections 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- 172.21.15.18:0/3646999222 wait complete. 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 -- start start 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.824+0000 7f7bec809740 1 Processor -- start 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a2ab0 0x5641d75a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75abfb0 0x5641d75a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5641d75aed40 con 0x5641d75a33d0 2024-04-21T22:43:08.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5641d74c1c40 con 0x5641d75a2ab0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5641d75aeec0 con 0x5641d75abfb0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bec809740 10 client.0 _ll_register_callbacks cb 0x5641d74c1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bda000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bda000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47668/0 (socket says 172.21.15.18:47668) 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a2ab0 0x5641d75a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7bda000640 1 -- 172.21.15.18:0/1970379700 learned_addr learned my addr 172.21.15.18:0/1970379700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.825+0000 7f7be3400640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75abfb0 0x5641d75a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 -- 172.21.15.18:0/1970379700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75abfb0 msgr2=0x5641d75a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75abfb0 0x5641d75a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 -- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a2ab0 msgr2=0x5641d75a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a2ab0 0x5641d75a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 -- 172.21.15.18:0/1970379700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d721a3f0 con 0x5641d75a33d0 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bda000640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c6a0 tx=0x7f7bcc005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694914acd4b5f39a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc09b650 con 0x5641d75a33d0 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f7bcc0a46d0 con 0x5641d75a33d0 2024-04-21T22:43:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.826+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd4004a70 con 0x5641d75a33d0 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc0b9050 con 0x5641d75a33d0 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 10 client.17643 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5641d71da0f0 con 0x5641d75a33d0 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4004a70 con 0x5641d75a33d0 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f7bcc0b3030 con 0x5641d75a33d0 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 10 client.17643 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 10 client.17643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 20 client.17643 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75bc360 0x5641d75be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 4 client.17643 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.827+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d7519c40 con 0x5641d75bc360 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.828+0000 7f7be2a00640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75bc360 0x5641d75be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.828+0000 7f7be2a00640 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75bc360 0x5641d75be7d0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597178bb6b963b0b server_cookie=ac2c331162eb755b in_seq=0 out_seq=0 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.828+0000 7f7bd0c00640 10 client.17643 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bd0c00640 1 -- 172.21.15.18:0/1970379700 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5641d7519c40 con 0x5641d75bc360 2024-04-21T22:43:08.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bd0c00640 10 client.17643 handle_command_reply: tid=0 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 client.17643 shutdown 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 msgr2=0x5641d75a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c6a0 tx=0x7f7bcc005730 comp rx=0 tx=0).stop 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 shutdown_connections 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75bc360 0x5641d75be7d0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75abfb0 0x5641d75a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75a9580 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 --2- 172.21.15.18:0/1970379700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d75a2ab0 0x5641d75a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bd0c00640 0 client.17643 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 >> 172.21.15.18:0/1970379700 conn(0x5641d759d1e0 msgr2=0x5641d759ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 shutdown_connections 2024-04-21T22:43:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 1 -- 172.21.15.18:0/1970379700 wait complete. 2024-04-21T22:43:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.829+0000 7f7bec809740 20 client.17643 trim_cache size 0 max 16384 2024-04-21T22:43:08.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 Processor -- start 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 -- start start 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b3a10 con 0x5641d75a33d0 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b5550 con 0x5641d759d1e0 2024-04-21T22:43:08.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.849+0000 7f7bec809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b40e0 con 0x5641d75a2ab0 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7be3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7be2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42622/0 (socket says 172.21.15.18:42622) 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 -- 172.21.15.18:0/3288701512 learned_addr learned my addr 172.21.15.18:0/3288701512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 -- 172.21.15.18:0/3288701512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 msgr2=0x5641d75ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 -- 172.21.15.18:0/3288701512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 msgr2=0x5641d75c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 -- 172.21.15.18:0/3288701512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d75a3200 con 0x5641d75a2ab0 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.850+0000 7f7bda000640 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00cfd0 tx=0x7f7bcc09b1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a412b7a7018aaae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.851+0000 7f7bd3400640 1 -- 172.21.15.18:0/3288701512 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0cd3b0 con 0x5641d75a2ab0 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.851+0000 7f7bd3400640 1 -- 172.21.15.18:0/3288701512 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc09c3f0 con 0x5641d75a2ab0 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.851+0000 7f7bd3400640 1 -- 172.21.15.18:0/3288701512 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0a44d0 con 0x5641d75a2ab0 2024-04-21T22:43:08.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.851+0000 7f7bec809740 1 -- 172.21.15.18:0/3288701512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 msgr2=0x5641d75b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.851+0000 7f7bec809740 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00cfd0 tx=0x7f7bcc09b1e0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 -- 172.21.15.18:0/3288701512 shutdown_connections 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b7c30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 --2- 172.21.15.18:0/3288701512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 -- 172.21.15.18:0/3288701512 >> 172.21.15.18:0/3288701512 conn(0x5641d75a7c80 msgr2=0x5641d759c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 -- 172.21.15.18:0/3288701512 shutdown_connections 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 -- 172.21.15.18:0/3288701512 wait complete. 2024-04-21T22:43:08.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 -- start start 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.852+0000 7f7bec809740 1 Processor -- start 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b4e80 con 0x5641d75a33d0 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b47b0 con 0x5641d759d1e0 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7be41b1a10 con 0x5641d75a2ab0 2024-04-21T22:43:08.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bec809740 10 client.0 _ll_register_callbacks cb 0x7f7bcc009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42636/0 (socket says 172.21.15.18:42636) 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 -- 172.21.15.18:0/194121656 learned_addr learned my addr 172.21.15.18:0/194121656 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7be2a00640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7be3400640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 -- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 msgr2=0x5641d75b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 -- 172.21.15.18:0/194121656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 msgr2=0x5641d75b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.853+0000 7f7bda000640 1 -- 172.21.15.18:0/194121656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d75b1ac0 con 0x5641d75a2ab0 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bda000640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc09b160 tx=0x7f7bcc0cfbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30adcaa880f18370 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0cd3b0 con 0x5641d75a2ab0 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f7bcc097a40 con 0x5641d75a2ab0 2024-04-21T22:43:08.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bcc09c3f0 con 0x5641d75a2ab0 2024-04-21T22:43:08.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc09b650 con 0x5641d75a2ab0 2024-04-21T22:43:08.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bec809740 10 client.27793 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:08.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5641d76234b0 con 0x5641d75a2ab0 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.854+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc09c3f0 con 0x5641d75a2ab0 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f7bcc0b3070 con 0x5641d75a2ab0 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 10 client.27793 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 10 client.27793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 20 client.27793 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75abfb0 0x5641d76259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 4 client.27793 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:43:08.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641d7513950 con 0x5641d75abfb0 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7be2a00640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75abfb0 0x5641d76259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7be2a00640 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75abfb0 0x5641d76259c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df42fd5c510707bd server_cookie=9fce2a4bb13f8d6f in_seq=0 out_seq=0 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.855+0000 7f7bd0c00640 10 client.27793 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bd0c00640 1 -- 172.21.15.18:0/194121656 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5641d7513950 con 0x5641d75abfb0 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bd0c00640 10 client.27793 handle_command_reply: tid=0 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 client.27793 shutdown 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 msgr2=0x5641d75b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc09b160 tx=0x7f7bcc0cfbd0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 shutdown_connections 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641d75a33d0 0x5641d75b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5641d75abfb0 0x5641d76259c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d75a2ab0 0x5641d75b4680 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 --2- 172.21.15.18:0/194121656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5641d759d1e0 0x5641d75b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bd0c00640 0 client.27793 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 >> 172.21.15.18:0/194121656 conn(0x5641d75a7c80 msgr2=0x5641d759e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 shutdown_connections 2024-04-21T22:43:08.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 1 -- 172.21.15.18:0/194121656 wait complete. 2024-04-21T22:43:08.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.856+0000 7f7bec809740 20 client.27793 trim_cache size 0 max 16384 2024-04-21T22:43:08.865 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:08.865 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:43:08.865 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:43:08.865 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 msgr2=0x7f7bc80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 0x7f7bc80a5240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7be406ac80 tx=0x7f7bdc009500 comp rx=0 tx=0).stop 2024-04-21T22:43:08.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 msgr2=0x7f7be419ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9f0 tx=0x7f7bcc00edf0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 shutdown_connections 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f7bc80a2d80 0x7f7bc80a5240 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be4112520 0x7f7be41a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be4074400 0x7f7be419ea00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 --2- 172.21.15.18:0/196131755 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be4073ae0 0x7f7be419e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:08.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 >> 172.21.15.18:0/196131755 conn(0x7f7be40fd020 msgr2=0x7f7be40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:08.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 shutdown_connections 2024-04-21T22:43:08.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:08.857+0000 7f7be3e00640 1 -- 172.21.15.18:0/196131755 wait complete. 2024-04-21T22:43:08.877 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:43:08.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:43:09.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.093+0000 7fa713c00640 1 -- 172.21.15.18:0/2319906023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c067d60 msgr2=0x7fa70c0ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.093+0000 7fa713c00640 1 --2- 172.21.15.18:0/2319906023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c067d60 0x7fa70c0ff970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009900 tx=0x7fa6f402bcd0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 -- 172.21.15.18:0/2319906023 shutdown_connections 2024-04-21T22:43:09.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 --2- 172.21.15.18:0/2319906023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c100590 0x7fa70c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 --2- 172.21.15.18:0/2319906023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c1050e0 0x7fa70c0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 --2- 172.21.15.18:0/2319906023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c067d60 0x7fa70c0ff970 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 -- 172.21.15.18:0/2319906023 >> 172.21.15.18:0/2319906023 conn(0x7fa70c0fbaa0 msgr2=0x7fa70c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 -- 172.21.15.18:0/2319906023 shutdown_connections 2024-04-21T22:43:09.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.094+0000 7fa713c00640 1 -- 172.21.15.18:0/2319906023 wait complete. 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.095+0000 7fa713c00640 1 Processor -- start 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.095+0000 7fa713c00640 1 -- start start 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 0x7fa70c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c19eab0 0x7fa70c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c10f960 con 0x7fa70c067d60 2024-04-21T22:43:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c10f7e0 con 0x7fa70c1050e0 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa713c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c10fae0 con 0x7fa70c19eab0 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa711200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa703e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 0x7fa70c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa711200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47700/0 (socket says 172.21.15.18:47700) 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa711200640 1 -- 172.21.15.18:0/3086967444 learned_addr learned my addr 172.21.15.18:0/3086967444 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.096+0000 7fa711c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c19eab0 0x7fa70c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 -- 172.21.15.18:0/3086967444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c19eab0 msgr2=0x7fa70c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c19eab0 0x7fa70c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 -- 172.21.15.18:0/3086967444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 msgr2=0x7fa70c19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 0x7fa70c19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 -- 172.21.15.18:0/3086967444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70c19f5a0 con 0x7fa70c067d60 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa703e00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 0x7fa70c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa711200640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4042020 con 0x7fa70c067d60 2024-04-21T22:43:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70c19f830 con 0x7fa70c067d60 2024-04-21T22:43:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6f40054e0 con 0x7fa70c067d60 2024-04-21T22:43:09.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.097+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4003b20 con 0x7fa70c067d60 2024-04-21T22:43:09.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.098+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70c1a7080 con 0x7fa70c067d60 2024-04-21T22:43:09.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.099+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa70c068a40 con 0x7fa70c067d60 2024-04-21T22:43:09.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.101+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa6f4045020 con 0x7fa70c067d60 2024-04-21T22:43:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.102+0000 7fa70a000640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 0x7fa6ec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.103+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7fa6f40f0fe0 con 0x7fa70c067d60 2024-04-21T22:43:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.103+0000 7fa703e00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 0x7fa6ec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.104+0000 7fa703e00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 0x7fa6ec0a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa70c10add0 tx=0x7fa6fc010040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.107+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fa6f404c020 con 0x7fa70c067d60 2024-04-21T22:43:09.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.357+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa70c1005f0 con 0x7fa70c067d60 2024-04-21T22:43:09.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.358+0000 7fa70a000640 1 -- 172.21.15.18:0/3086967444 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7fa6f40dd030 con 0x7fa70c067d60 2024-04-21T22:43:09.359 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:43:09.359 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:43:09.359 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:43:09.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.361+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 msgr2=0x7fa6ec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.361+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 0x7fa6ec0a51c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa70c10add0 tx=0x7fa6fc010040 comp rx=0 tx=0).stop 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.361+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 msgr2=0x7fa70c19a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.361+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004360 comp rx=0 tx=0).stop 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 shutdown_connections 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa6ec0a2d00 0x7fa6ec0a51c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa70c19eab0 0x7fa70c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa70c1050e0 0x7fa70c19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 --2- 172.21.15.18:0/3086967444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa70c067d60 0x7fa70c19a1f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 >> 172.21.15.18:0/3086967444 conn(0x7fa70c0fbaa0 msgr2=0x7fa70c10b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 shutdown_connections 2024-04-21T22:43:09.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.362+0000 7fa713c00640 1 -- 172.21.15.18:0/3086967444 wait complete. 2024-04-21T22:43:09.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:43:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 -- 172.21.15.18:0/727601880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 msgr2=0x7f4ce81149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 --2- 172.21.15.18:0/727601880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81149a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009cd0 tx=0x7f4ce002c0e0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 -- 172.21.15.18:0/727601880 shutdown_connections 2024-04-21T22:43:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 --2- 172.21.15.18:0/727601880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81149a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 --2- 172.21.15.18:0/727601880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce8112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 --2- 172.21.15.18:0/727601880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 0x7f4ce8076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.591+0000 7f4cee000640 1 -- 172.21.15.18:0/727601880 >> 172.21.15.18:0/727601880 conn(0x7f4ce80ff400 msgr2=0x7f4ce8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.592+0000 7f4cee000640 1 -- 172.21.15.18:0/727601880 shutdown_connections 2024-04-21T22:43:09.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.592+0000 7f4cee000640 1 -- 172.21.15.18:0/727601880 wait complete. 2024-04-21T22:43:09.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.593+0000 7f4cee000640 1 Processor -- start 2024-04-21T22:43:09.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.593+0000 7f4cee000640 1 -- start start 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 0x7f4ce819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81180f0 con 0x7f4ce8075c70 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8117f70 con 0x7f4ce8076590 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4cee000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8118270 con 0x7f4ce81125b0 2024-04-21T22:43:09.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 0x7f4ce819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52188/0 (socket says 172.21.15.18:52188) 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4ce6a00640 1 -- 172.21.15.18:0/357908231 learned_addr learned my addr 172.21.15.18:0/357908231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.594+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 -- 172.21.15.18:0/357908231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 msgr2=0x7f4ce81a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 -- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 msgr2=0x7f4ce819e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 0x7f4ce819e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 -- 172.21.15.18:0/357908231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce81a3660 con 0x7f4ce8076590 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400e9f0 tx=0x7f4cd400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4cdfe00640 1 -- 172.21.15.18:0/357908231 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400cd80 con 0x7f4ce8076590 2024-04-21T22:43:09.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4cdfe00640 1 -- 172.21.15.18:0/357908231 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cd4005500 con 0x7f4ce8076590 2024-04-21T22:43:09.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4cdfe00640 1 -- 172.21.15.18:0/357908231 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4010690 con 0x7f4ce8076590 2024-04-21T22:43:09.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.595+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce81a3950 con 0x7f4ce8076590 2024-04-21T22:43:09.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.596+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce81ab1e0 con 0x7f4ce8076590 2024-04-21T22:43:09.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.599+0000 7f4cf0d7a740 1 Processor -- start 2024-04-21T22:43:09.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.599+0000 7f4cf0d7a740 1 -- start start 2024-04-21T22:43:09.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cdfe00640 1 -- 172.21.15.18:0/357908231 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4cd40046c0 con 0x7f4ce8076590 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a31d9983a0 con 0x55a31da3d280 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a31d940930 con 0x55a31da346a0 2024-04-21T22:43:09.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a31d994360 con 0x55a31da33d80 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42686/0 (socket says 172.21.15.18:42686) 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 -- 172.21.15.18:0/361529957 learned_addr learned my addr 172.21.15.18:0/361529957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7400640 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 -- 172.21.15.18:0/361529957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 msgr2=0x55a31da3cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 -- 172.21.15.18:0/361529957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 msgr2=0x55a31da3f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.600+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4ce7e00640 1 -- 172.21.15.18:0/361529957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31d6ac3f0 con 0x55a31da33d80 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005cc0 tx=0x7f4ce00098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9293468a3bada56e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4cd3e00640 1 -- 172.21.15.18:0/361529957 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0043070 con 0x55a31da33d80 2024-04-21T22:43:09.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4cd3e00640 1 -- 172.21.15.18:0/361529957 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce0003e50 con 0x55a31da33d80 2024-04-21T22:43:09.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4cd3e00640 1 -- 172.21.15.18:0/361529957 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0039040 con 0x55a31da33d80 2024-04-21T22:43:09.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.601+0000 7f4cdfe00640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 0x7f4ccc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cdfe00640 1 -- 172.21.15.18:0/357908231 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f4cd40cf8c0 con 0x7f4ce8076590 2024-04-21T22:43:09.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4ce7400640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 0x7f4ccc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/361529957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 msgr2=0x55a31da34160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005cc0 tx=0x7f4ce00098c0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/361529957 shutdown_connections 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/361529957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da33d80 0x55a31da34160 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/361529957 >> 172.21.15.18:0/361529957 conn(0x55a31da2e4b0 msgr2=0x55a31da2e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/361529957 shutdown_connections 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.602+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/361529957 wait complete. 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.603+0000 7f4ce7400640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 0x7f4ccc0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a31da33850 tx=0x7f4cd8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.603+0000 7f4cf0d7a740 1 -- start start 2024-04-21T22:43:09.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.603+0000 7f4cf0d7a740 1 Processor -- start 2024-04-21T22:43:09.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da3a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a31da40010 con 0x55a31da3d280 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55a31d953d80 con 0x55a31da33d80 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a31da40190 con 0x55a31da346a0 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4cf0d7a740 10 client.0 _ll_register_callbacks cb 0x55a31d9902b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52196/0 (socket says 172.21.15.18:52196) 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da3a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.604+0000 7f4ce7400640 1 -- 172.21.15.18:0/1807523263 learned_addr learned my addr 172.21.15.18:0/1807523263 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 -- 172.21.15.18:0/1807523263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 msgr2=0x55a31da3a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da3a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 -- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 msgr2=0x55a31da3ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 -- 172.21.15.18:0/1807523263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a31d7767d0 con 0x55a31da33d80 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da3a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4ce7400640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4cd801e9d0 tx=0x7f4cd8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a4de15a94e2fb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd802e060 con 0x55a31da33d80 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce0003e50 con 0x55a31da33d80 2024-04-21T22:43:09.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.605+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f4cd8018030 con 0x55a31da33d80 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4cd8029420 con 0x55a31da33d80 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 10 client.27752 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a31da4c360 con 0x55a31da33d80 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce0003e50 con 0x55a31da33d80 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4cd800f5f0 con 0x55a31da33d80 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 10 client.27752 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 10 client.27752 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:43:09.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 20 client.27752 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31da4d820 0x55a31da4fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 4 client.27752 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.606+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a31d9a58e0 con 0x55a31da4d820 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.607+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31da4d820 0x55a31da4fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.607+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31da4d820 0x55a31da4fc70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89364c36f2b48530 server_cookie=df5c3c2a43769963 in_seq=0 out_seq=0 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.607+0000 7f4cd0c00640 10 client.27752 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cd0c00640 1 -- 172.21.15.18:0/1807523263 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a31d9a58e0 con 0x55a31da4d820 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cd0c00640 10 client.27752 handle_command_reply: tid=0 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 client.27752 shutdown 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 msgr2=0x55a31da3a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4cd801e9d0 tx=0x7f4cd8004730 comp rx=0 tx=0).stop 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 shutdown_connections 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31da4d820 0x55a31da4fc70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da3d280 0x55a31da3ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cd0c00640 0 client.27752 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da3a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/1807523263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da33d80 0x55a31da3a2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.608+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 >> 172.21.15.18:0/1807523263 conn(0x55a31da2e4b0 msgr2=0x55a31da30200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.609+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 shutdown_connections 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.609+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/1807523263 wait complete. 2024-04-21T22:43:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.609+0000 7f4cf0d7a740 20 client.27752 trim_cache size 0 max 16384 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 Processor -- start 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 -- start start 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da48ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da3d280 0x55a31da2d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b3c60 con 0x55a31da33d80 2024-04-21T22:43:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b57a0 con 0x55a31da346a0 2024-04-21T22:43:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.625+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b4330 con 0x55a31da3d280 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da3d280 0x55a31da2d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52208/0 (socket says 172.21.15.18:52208) 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 -- 172.21.15.18:0/531108825 learned_addr learned my addr 172.21.15.18:0/531108825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce7400640 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da48ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 -- 172.21.15.18:0/531108825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da3d280 msgr2=0x55a31da2d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da3d280 0x55a31da2d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 -- 172.21.15.18:0/531108825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 msgr2=0x55a31da48ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da48ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce6a00640 1 -- 172.21.15.18:0/531108825 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31da502f0 con 0x55a31da346a0 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.626+0000 7f4ce7400640 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da48ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cd409ba20 tx=0x7f4cd40d5530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcbf986b9a65289d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4cd3400640 1 -- 172.21.15.18:0/531108825 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40d5020 con 0x55a31da346a0 2024-04-21T22:43:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4cd3400640 1 -- 172.21.15.18:0/531108825 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cd409c420 con 0x55a31da346a0 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4cd3400640 1 -- 172.21.15.18:0/531108825 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40cd1d0 con 0x55a31da346a0 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/531108825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 msgr2=0x55a31da3ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.627+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4cd409ba20 tx=0x7f4cd40d5530 comp rx=0 tx=0).stop 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/531108825 shutdown_connections 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da3d280 0x55a31da2d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da346a0 0x55a31da3ab90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/531108825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da48ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/531108825 >> 172.21.15.18:0/531108825 conn(0x55a31da2e4b0 msgr2=0x55a31da2ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/531108825 shutdown_connections 2024-04-21T22:43:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/531108825 wait complete. 2024-04-21T22:43:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 -- start start 2024-04-21T22:43:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.628+0000 7f4cf0d7a740 1 Processor -- start 2024-04-21T22:43:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da40bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da3d280 0x55a31da41200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b50d0 con 0x55a31da33d80 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b4a00 con 0x55a31da3d280 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b1c60 con 0x55a31da346a0 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4cf0d7a740 10 client.0 _ll_register_callbacks cb 0x7f4cd8009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47772/0 (socket says 172.21.15.18:47772) 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce7400640 1 -- 172.21.15.18:0/2432671327 learned_addr learned my addr 172.21.15.18:0/2432671327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da40bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce7e00640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da3d280 0x55a31da41200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2432671327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da3d280 msgr2=0x55a31da41200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.629+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da3d280 0x55a31da41200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 msgr2=0x55a31da45880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4ce6a00640 1 -- 172.21.15.18:0/2432671327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a31da419d0 con 0x55a31da346a0 2024-04-21T22:43:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4ce7400640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4ce6a00640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da40bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4cd409ba20 tx=0x7f4cd40ccef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d18031fb28a54af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40d5020 con 0x55a31da346a0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f4cd40cd1d0 con 0x55a31da346a0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cd409c420 con 0x55a31da346a0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4cd409b680 con 0x55a31da346a0 2024-04-21T22:43:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cf0d7a740 10 client.27817 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.630+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a31dab3e80 con 0x55a31da346a0 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cd409c420 con 0x55a31da346a0 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4cd40a4be0 con 0x55a31da346a0 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 10 client.27817 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 10 client.27817 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 20 client.27817 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:09.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31dab46a0 0x55a31dab6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 4 client.27817 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a31d99fc30 con 0x55a31dab46a0 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.631+0000 7f4ce7400640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31dab46a0 0x55a31dab6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4ce7400640 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31dab46a0 0x55a31dab6a90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a6e15aaf8ea27c9 server_cookie=4c591ee2ac9229e2 in_seq=0 out_seq=0 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cd0c00640 10 client.27817 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cd0c00640 1 -- 172.21.15.18:0/2432671327 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a31d99fc30 con 0x55a31dab46a0 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cd0c00640 10 client.27817 handle_command_reply: tid=0 2024-04-21T22:43:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 client.27817 shutdown 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 msgr2=0x55a31da40bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da40bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4cd409ba20 tx=0x7f4cd40ccef0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 shutdown_connections 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x55a31dab46a0 0x55a31dab6a90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55a31da3d280 0x55a31da41200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a31da346a0 0x55a31da40bf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cd0c00640 0 client.27817 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:09.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 --2- 172.21.15.18:0/2432671327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a31da33d80 0x55a31da45880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 >> 172.21.15.18:0/2432671327 conn(0x55a31da2e4b0 msgr2=0x55a31da2f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 shutdown_connections 2024-04-21T22:43:09.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.632+0000 7f4cf0d7a740 1 -- 172.21.15.18:0/2432671327 wait complete. 2024-04-21T22:43:09.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cf0d7a740 20 client.27817 trim_cache size 0 max 16384 2024-04-21T22:43:09.642 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:09.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 msgr2=0x7f4ccc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 0x7f4ccc0a51c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55a31da33850 tx=0x7f4cd8005f90 comp rx=0 tx=0).stop 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 msgr2=0x7f4ce819ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400e9f0 tx=0x7f4cd400edf0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 shutdown_connections 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f4ccc0a2d00 0x7f4ccc0a51c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ce81125b0 0x7f4ce81a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ce8076590 0x7f4ce819ebb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 --2- 172.21.15.18:0/357908231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ce8075c70 0x7f4ce819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.633+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 >> 172.21.15.18:0/357908231 conn(0x7f4ce80ff400 msgr2=0x7f4ce81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.634+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 shutdown_connections 2024-04-21T22:43:09.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.634+0000 7f4cee000640 1 -- 172.21.15.18:0/357908231 wait complete. 2024-04-21T22:43:09.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:09 smithi018 ceph-mon[26614]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:43:09.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:09 smithi018 ceph-mon[26614]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T22:43:09.650 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3086967444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:09.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:43:09.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:09 smithi047 ceph-mon[31561]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:43:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:09 smithi047 ceph-mon[31561]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T22:43:09.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:09 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3086967444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:09.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 -- 172.21.15.18:0/475287386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c1075f0 msgr2=0x7fa72c1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 --2- 172.21.15.18:0/475287386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c1075f0 0x7fa72c1079d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa720009890 tx=0x7fa72002bb70 comp rx=0 tx=0).stop 2024-04-21T22:43:09.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 -- 172.21.15.18:0/475287386 shutdown_connections 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 --2- 172.21.15.18:0/475287386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c101ef0 0x7fa72c10e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 --2- 172.21.15.18:0/475287386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 --2- 172.21.15.18:0/475287386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c1075f0 0x7fa72c1079d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 -- 172.21.15.18:0/475287386 >> 172.21.15.18:0/475287386 conn(0x7fa72c0fd020 msgr2=0x7fa72c0ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 -- 172.21.15.18:0/475287386 shutdown_connections 2024-04-21T22:43:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.867+0000 7fa732e00640 1 -- 172.21.15.18:0/475287386 wait complete. 2024-04-21T22:43:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.868+0000 7fa732e00640 1 Processor -- start 2024-04-21T22:43:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.868+0000 7fa732e00640 1 -- start start 2024-04-21T22:43:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 0x7fa72c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c1075f0 0x7fa72c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1118d0 con 0x7fa72c101530 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c111750 con 0x7fa72c1075f0 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c111a50 con 0x7fa72c101ef0 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47800/0 (socket says 172.21.15.18:47800) 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 0x7fa72c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731a00640 1 -- 172.21.15.18:0/1836722613 learned_addr learned my addr 172.21.15.18:0/1836722613 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa732400640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c1075f0 0x7fa72c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 -- 172.21.15.18:0/1836722613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c1075f0 msgr2=0x7fa72c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c1075f0 0x7fa72c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 -- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 msgr2=0x7fa72c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731000640 1 -- 172.21.15.18:0/1836722613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c19cda0 con 0x7fa72c101ef0 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.869+0000 7fa731a00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa731000640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 0x7fa72c1982f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00e790 tx=0x7fa71c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa72a000640 1 -- 172.21.15.18:0/1836722613 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00eea0 con 0x7fa72c101ef0 2024-04-21T22:43:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa72a000640 1 -- 172.21.15.18:0/1836722613 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa71c00ccc0 con 0x7fa72c101ef0 2024-04-21T22:43:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa72a000640 1 -- 172.21.15.18:0/1836722613 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c018780 con 0x7fa72c101ef0 2024-04-21T22:43:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c19d090 con 0x7fa72c101ef0 2024-04-21T22:43:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.870+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c1a4920 con 0x7fa72c101ef0 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 Processor -- start 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa72a000640 1 -- 172.21.15.18:0/1836722613 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa71c010430 con 0x7fa72c101ef0 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 -- start start 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55616400d3a0 con 0x5561640adca0 2024-04-21T22:43:09.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556163fb5930 con 0x5561640b6880 2024-04-21T22:43:09.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa737205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556164009360 con 0x5561640ad380 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa731a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa732400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa731a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47808/0 (socket says 172.21.15.18:47808) 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa732400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42752/0 (socket says 172.21.15.18:42752) 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.874+0000 7fa731a00640 1 -- 172.21.15.18:0/3150253923 learned_addr learned my addr 172.21.15.18:0/3150253923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731000640 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 -- 172.21.15.18:0/3150253923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 msgr2=0x5561640ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 -- 172.21.15.18:0/3150253923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 msgr2=0x5561640b8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640b8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 -- 172.21.15.18:0/3150253923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556163d213f0 con 0x5561640adca0 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa732400640 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa731a00640 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa720035ef0 tx=0x7fa7200056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bce43239614128 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.875+0000 7fa72a000640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 0x7fa7140a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa72a000640 1 -- 172.21.15.18:0/1836722613 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7fa71c0cf5f0 con 0x7fa72c101ef0 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa71aa00640 1 -- 172.21.15.18:0/3150253923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720044020 con 0x5561640adca0 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa71aa00640 1 -- 172.21.15.18:0/3150253923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa720004240 con 0x5561640adca0 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa71aa00640 1 -- 172.21.15.18:0/3150253923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720039040 con 0x5561640adca0 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa732400640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 0x7fa7140a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa737205740 1 -- 172.21.15.18:0/3150253923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 msgr2=0x5561640b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa737205740 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa720035ef0 tx=0x7fa7200056d0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.876+0000 7fa732400640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 0x7fa7140a5240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa724009fd0 tx=0x7fa724009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 -- 172.21.15.18:0/3150253923 shutdown_connections 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640b8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b6340 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 --2- 172.21.15.18:0/3150253923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 -- 172.21.15.18:0/3150253923 >> 172.21.15.18:0/3150253923 conn(0x5561640a7ab0 msgr2=0x5561640a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 -- 172.21.15.18:0/3150253923 shutdown_connections 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 -- 172.21.15.18:0/3150253923 wait complete. 2024-04-21T22:43:09.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 -- start start 2024-04-21T22:43:09.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.877+0000 7fa737205740 1 Processor -- start 2024-04-21T22:43:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640b6880 0x5561640b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5561640b9610 con 0x5561640adca0 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556163fc8d80 con 0x5561640ad380 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5561640b9790 con 0x5561640b6880 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa737205740 10 client.0 _ll_register_callbacks cb 0x5561640052b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52260/0 (socket says 172.21.15.18:52260) 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 -- 172.21.15.18:0/3958067584 learned_addr learned my addr 172.21.15.18:0/3958067584 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa732400640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640b6880 0x5561640b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 -- 172.21.15.18:0/3958067584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640b6880 msgr2=0x5561640b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640b6880 0x5561640b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 -- 172.21.15.18:0/3958067584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 msgr2=0x5561640b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.878+0000 7fa731a00640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa731a00640 1 -- 172.21.15.18:0/3958067584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556163deb7d0 con 0x5561640ad380 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa731a00640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa720005e00 tx=0x7fa72002c690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6448f98254c754b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa70f400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720050070 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa720004240 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.879+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7fa720034440 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa72005c050 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 10 client.27770 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5561640c5850 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa720004240 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa7200035f0 con 0x5561640ad380 2024-04-21T22:43:09.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 10 client.27770 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 10 client.27770 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 20 client.27770 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5561640c6ba0 0x5561640c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 4 client.27770 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.880+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55616401a8e0 con 0x5561640c6ba0 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.881+0000 7fa731000640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5561640c6ba0 0x5561640c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.881+0000 7fa731000640 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5561640c6ba0 0x5561640c8f90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=95efbd6c053d6a8f server_cookie=420fbf5b277a2baa in_seq=0 out_seq=0 2024-04-21T22:43:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.881+0000 7fa70f400640 10 client.27770 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa70f400640 1 -- 172.21.15.18:0/3958067584 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55616401a8e0 con 0x5561640c6ba0 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa70f400640 10 client.27770 handle_command_reply: tid=0 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 client.27770 shutdown 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 msgr2=0x5561640b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa720005e00 tx=0x7fa72002c690 comp rx=0 tx=0).stop 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 shutdown_connections 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5561640c6ba0 0x5561640c8f90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640b6880 0x5561640b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 --2- 172.21.15.18:0/3958067584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640b3850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 >> 172.21.15.18:0/3958067584 conn(0x5561640a7ab0 msgr2=0x5561640a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa70f400640 0 client.27770 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 shutdown_connections 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.882+0000 7fa737205740 1 -- 172.21.15.18:0/3958067584 wait complete. 2024-04-21T22:43:09.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.883+0000 7fa737205740 20 client.27770 trim_cache size 0 max 16384 2024-04-21T22:43:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:09 smithi081 ceph-mon[31692]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-04-21T22:43:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:09 smithi081 ceph-mon[31692]: osdmap e93: 12 total, 12 up, 12 in 2024-04-21T22:43:09.891 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:09 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3086967444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.897+0000 7fa737205740 1 Processor -- start 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 -- start start 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1ab1f0 con 0x5561640adca0 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1acd30 con 0x5561640b6880 2024-04-21T22:43:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa737205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1ab8c0 con 0x5561640ad380 2024-04-21T22:43:09.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa731000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa731a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa731000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47824/0 (socket says 172.21.15.18:47824) 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa731000640 1 -- 172.21.15.18:0/4200909966 learned_addr learned my addr 172.21.15.18:0/4200909966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.898+0000 7fa732400640 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 -- 172.21.15.18:0/4200909966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 msgr2=0x5561640a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640a28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 -- 172.21.15.18:0/4200909966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 msgr2=0x5561640c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 -- 172.21.15.18:0/4200909966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55616409dae0 con 0x5561640ad380 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa731a00640 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640b5f80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa720035fd0 tx=0x7fa72002bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8e19ec845832d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa71a000640 1 -- 172.21.15.18:0/4200909966 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720050040 con 0x5561640ad380 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa71a000640 1 -- 172.21.15.18:0/4200909966 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa72002cbc0 con 0x5561640ad380 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.899+0000 7fa71a000640 1 -- 172.21.15.18:0/4200909966 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720039040 con 0x5561640ad380 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- 172.21.15.18:0/4200909966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 msgr2=0x5561640b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640b5f80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa720035fd0 tx=0x7fa72002bb70 comp rx=0 tx=0).stop 2024-04-21T22:43:09.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- 172.21.15.18:0/4200909966 shutdown_connections 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640b6880 0x5561640a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640adca0 0x5561640c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 --2- 172.21.15.18:0/4200909966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640ad380 0x5561640b5f80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- 172.21.15.18:0/4200909966 >> 172.21.15.18:0/4200909966 conn(0x5561640a7ab0 msgr2=0x5561640a9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- 172.21.15.18:0/4200909966 shutdown_connections 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- 172.21.15.18:0/4200909966 wait complete. 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.900+0000 7fa737205740 1 -- start start 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 Processor -- start 2024-04-21T22:43:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 0x5561640ba830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1ac660 con 0x5561640b6880 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1abf90 con 0x5561640ad380 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c1a91f0 con 0x5561640adca0 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa737205740 10 client.0 _ll_register_callbacks cb 0x7fa71c0d5060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa732400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa731000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 0x5561640ba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa732400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47832/0 (socket says 172.21.15.18:47832) 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.901+0000 7fa732400640 1 -- 172.21.15.18:0/702041409 learned_addr learned my addr 172.21.15.18:0/702041409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731a00640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 -- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 msgr2=0x5561640ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 -- 172.21.15.18:0/702041409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 msgr2=0x5561640bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 -- 172.21.15.18:0/702041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55616412bda0 con 0x5561640adca0 2024-04-21T22:43:09.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa732400640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa731000640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 0x5561640ba830 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c6a0 tx=0x7fa71c0d5110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7767eca8b226a694 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa70f400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c09b640 con 0x5561640adca0 2024-04-21T22:43:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7fa71c010720 con 0x5561640adca0 2024-04-21T22:43:09.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.902+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa72002cbc0 con 0x5561640adca0 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa71c0b9050 con 0x5561640adca0 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 10 client.27835 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55616412cfe0 con 0x5561640adca0 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa72002cbc0 con 0x5561640adca0 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa71c0ccf00 con 0x5561640adca0 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 10 client.27835 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 10 client.27835 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:43:09.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 20 client.27835 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55616412d710 0x55616412fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 4 client.27835 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556164014c30 con 0x55616412d710 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.903+0000 7fa731a00640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55616412d710 0x55616412fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa731a00640 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55616412d710 0x55616412fb30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4cdb063a4b82dd7 server_cookie=71514d105bf174c0 in_seq=0 out_seq=0 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa70f400640 10 client.27835 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa70f400640 1 -- 172.21.15.18:0/702041409 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556164014c30 con 0x55616412d710 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa70f400640 10 client.27835 handle_command_reply: tid=0 2024-04-21T22:43:09.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa737205740 1 client.27835 shutdown 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 msgr2=0x5561640ba830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 0x5561640ba830 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c6a0 tx=0x7fa71c0d5110 comp rx=0 tx=0).stop 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 shutdown_connections 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.904+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55616412d710 0x55616412fb30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5561640b6880 0x5561640bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5561640adca0 0x5561640ba830 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 --2- 172.21.15.18:0/702041409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5561640ad380 0x5561640ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa70f400640 0 client.27835 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:09.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 >> 172.21.15.18:0/702041409 conn(0x5561640a7ab0 msgr2=0x5561640b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 shutdown_connections 2024-04-21T22:43:09.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 1 -- 172.21.15.18:0/702041409 wait complete. 2024-04-21T22:43:09.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa737205740 20 client.27835 trim_cache size 0 max 16384 2024-04-21T22:43:09.913 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:09.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 msgr2=0x7fa7140a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 0x7fa7140a5240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa724009fd0 tx=0x7fa724009500 comp rx=0 tx=0).stop 2024-04-21T22:43:09.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 msgr2=0x7fa72c1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:09.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 0x7fa72c1982f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00e790 tx=0x7fa71c00ec50 comp rx=0 tx=0).stop 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 shutdown_connections 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa7140a2d80 0x7fa7140a5240 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa72c1075f0 0x7fa72c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c101ef0 0x7fa72c1982f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.905+0000 7fa732e00640 1 --2- 172.21.15.18:0/1836722613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa72c101530 0x7fa72c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.906+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 >> 172.21.15.18:0/1836722613 conn(0x7fa72c0fd020 msgr2=0x7fa72c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.906+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 shutdown_connections 2024-04-21T22:43:09.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:09.906+0000 7fa732e00640 1 -- 172.21.15.18:0/1836722613 wait complete. 2024-04-21T22:43:09.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:43:10.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 -- 172.21.15.18:0/1219523697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 msgr2=0x7f35ec108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 --2- 172.21.15.18:0/1219523697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec108100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009930 tx=0x7f35d402bc30 comp rx=0 tx=0).stop 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 -- 172.21.15.18:0/1219523697 shutdown_connections 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 --2- 172.21.15.18:0/1219523697 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec108640 0x7f35ec1149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 --2- 172.21.15.18:0/1219523697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec108100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 --2- 172.21.15.18:0/1219523697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec10dc00 0x7f35ec10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 -- 172.21.15.18:0/1219523697 >> 172.21.15.18:0/1219523697 conn(0x7f35ec077550 msgr2=0x7f35ec106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 -- 172.21.15.18:0/1219523697 shutdown_connections 2024-04-21T22:43:10.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.143+0000 7f35f2600640 1 -- 172.21.15.18:0/1219523697 wait complete. 2024-04-21T22:43:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.144+0000 7f35f2600640 1 Processor -- start 2024-04-21T22:43:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 -- start start 2024-04-21T22:43:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 0x7f35ec1a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec117f50 con 0x7f35ec108640 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec117dd0 con 0x7f35ec10dc00 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35f2600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1180d0 con 0x7f35ec107c80 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.145+0000 7f35ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47844/0 (socket says 172.21.15.18:47844) 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 -- 172.21.15.18:0/1518111654 learned_addr learned my addr 172.21.15.18:0/1518111654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35f1200640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 0x7f35ec1a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 -- 172.21.15.18:0/1518111654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 msgr2=0x7f35ec19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec19e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 -- 172.21.15.18:0/1518111654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 msgr2=0x7f35ec1a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 0x7f35ec1a2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 -- 172.21.15.18:0/1518111654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec1a33e0 con 0x7f35ec108640 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35f1200640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 0x7f35ec1a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.146+0000 7f35ebe00640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009900 tx=0x7f35d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.147+0000 7f35e9600640 1 -- 172.21.15.18:0/1518111654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4043020 con 0x7f35ec108640 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.147+0000 7f35e9600640 1 -- 172.21.15.18:0/1518111654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35d40054e0 con 0x7f35ec108640 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.147+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec1a3670 con 0x7f35ec108640 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.147+0000 7f35e9600640 1 -- 172.21.15.18:0/1518111654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4003b80 con 0x7f35ec108640 2024-04-21T22:43:10.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.147+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec1aaf60 con 0x7f35ec108640 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.150+0000 7f35f6804740 1 Processor -- start 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.150+0000 7f35e9600640 1 -- 172.21.15.18:0/1518111654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f35d4046020 con 0x7f35ec108640 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.150+0000 7f35f6804740 1 -- start start 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd5890 0x55e570fddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fe0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e570f393a0 con 0x55e570fd5890 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e570ee1930 con 0x55e570fde470 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f6804740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e570f35360 con 0x55e570fd4f70 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42834/0 (socket says 172.21.15.18:42834) 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f1c00640 1 -- 172.21.15.18:0/1201574981 learned_addr learned my addr 172.21.15.18:0/1201574981 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35ebe00640 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fe0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.151+0000 7f35f1200640 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd5890 0x55e570fddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 -- 172.21.15.18:0/1201574981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 msgr2=0x55e570fe0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fe0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 -- 172.21.15.18:0/1201574981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd5890 msgr2=0x55e570fddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd5890 0x55e570fddf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 -- 172.21.15.18:0/1201574981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e570c4d3f0 con 0x55e570fd4f70 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f35e4010480 tx=0x7f35e4010940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa3a31ff1c6c052a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35e9600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 0x7f35d00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35e2000640 1 -- 172.21.15.18:0/1201574981 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4011760 con 0x55e570fd4f70 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35e2000640 1 -- 172.21.15.18:0/1201574981 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e4011de0 con 0x55e570fd4f70 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35e2000640 1 -- 172.21.15.18:0/1201574981 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e400e430 con 0x55e570fd4f70 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35e9600640 1 -- 172.21.15.18:0/1518111654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f35d40f14c0 con 0x7f35ec108640 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.152+0000 7f35f1200640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 0x7f35d00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 -- 172.21.15.18:0/1201574981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 msgr2=0x55e570fd5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f35e4010480 tx=0x7f35e4010940 comp rx=0 tx=0).stop 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 -- 172.21.15.18:0/1201574981 shutdown_connections 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fe0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd5890 0x55e570fddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 --2- 172.21.15.18:0/1201574981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd4f70 0x55e570fd5350 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 -- 172.21.15.18:0/1201574981 >> 172.21.15.18:0/1201574981 conn(0x55e570fcf6a0 msgr2=0x55e570fcfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 -- 172.21.15.18:0/1201574981 shutdown_connections 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f1200640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 0x7f35d00a51c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e570fd4a40 tx=0x7f35dc009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.153+0000 7f35f6804740 1 -- 172.21.15.18:0/1201574981 wait complete. 2024-04-21T22:43:10.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 -- start start 2024-04-21T22:43:10.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 Processor -- start 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fdb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fdba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fdbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e570fe1260 con 0x55e570fd4f70 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55e570ef4d80 con 0x55e570fd5890 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e570fe13e0 con 0x55e570fde470 2024-04-21T22:43:10.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.154+0000 7f35f6804740 10 client.0 _ll_register_callbacks cb 0x55e570f312b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fdb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fdb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47866/0 (socket says 172.21.15.18:47866) 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fdbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1200640 1 -- 172.21.15.18:0/1845865350 learned_addr learned my addr 172.21.15.18:0/1845865350 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35ebe00640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fdba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 -- 172.21.15.18:0/1845865350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 msgr2=0x55e570fdba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fdba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 -- 172.21.15.18:0/1845865350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 msgr2=0x55e570fdb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fdb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 -- 172.21.15.18:0/1845865350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e570d177d0 con 0x55e570fde470 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35f1c00640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fdbf40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f35e4010480 tx=0x7f35e401cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7af777422d91471a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.155+0000 7f35daa00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e400bc80 con 0x55e570fde470 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f35e4004030 con 0x55e570fde470 2024-04-21T22:43:10.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35e4011de0 con 0x55e570fde470 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f35e4004230 con 0x55e570fde470 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 10 client.27847 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e570fed550 con 0x55e570fde470 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e4011de0 con 0x55e570fde470 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f35e4011830 con 0x55e570fde470 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 10 client.27847 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 10 client.27847 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:43:10.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.156+0000 7f35f6804740 20 client.27847 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.157+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e570fee9b0 0x55e570ff0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.157+0000 7f35f6804740 4 client.27847 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.157+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e570f468e0 con 0x55e570fee9b0 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.157+0000 7f35f1200640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e570fee9b0 0x55e570ff0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.158+0000 7f35f1200640 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e570fee9b0 0x55e570ff0da0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9fa0a23e577750d9 server_cookie=d1e1f94a4de696d0 in_seq=0 out_seq=0 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.158+0000 7f35daa00640 10 client.27847 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:10.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.158+0000 7f35daa00640 1 -- 172.21.15.18:0/1845865350 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e570f468e0 con 0x55e570fee9b0 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.158+0000 7f35daa00640 10 client.27847 handle_command_reply: tid=0 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.158+0000 7f35f6804740 1 client.27847 shutdown 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 msgr2=0x55e570fdbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fdbf40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f35e4010480 tx=0x7f35e401cf60 comp rx=0 tx=0).stop 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 shutdown_connections 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e570fee9b0 0x55e570ff0da0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fdbf40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fdba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 --2- 172.21.15.18:0/1845865350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fdb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35daa00640 0 client.27847 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 >> 172.21.15.18:0/1845865350 conn(0x55e570fcf6a0 msgr2=0x55e570fd13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 shutdown_connections 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 1 -- 172.21.15.18:0/1845865350 wait complete. 2024-04-21T22:43:10.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.159+0000 7f35f6804740 20 client.27847 trim_cache size 0 max 16384 2024-04-21T22:43:10.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.174+0000 7f35f6804740 1 Processor -- start 2024-04-21T22:43:10.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.174+0000 7f35f6804740 1 -- start start 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd5890 0x55e570fea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fda620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b3a50 con 0x55e570fd4f70 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b5590 con 0x55e570fde470 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f6804740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b4120 con 0x55e570fd5890 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47876/0 (socket says 172.21.15.18:47876) 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f1200640 1 -- 172.21.15.18:0/389377327 learned_addr learned my addr 172.21.15.18:0/389377327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35f1c00640 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fda620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.175+0000 7f35ebe00640 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd5890 0x55e570fea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 -- 172.21.15.18:0/389377327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd5890 msgr2=0x55e570fea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd5890 0x55e570fea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 -- 172.21.15.18:0/389377327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 msgr2=0x55e570fda620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fda620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 -- 172.21.15.18:0/389377327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e570fd4060 con 0x55e570fd4f70 2024-04-21T22:43:10.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35f1200640 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55e570fe1530 tx=0x7f35dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682aa769f00155bc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35e1600640 1 -- 172.21.15.18:0/389377327 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc030070 con 0x55e570fd4f70 2024-04-21T22:43:10.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35e1600640 1 -- 172.21.15.18:0/389377327 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35dc02b910 con 0x55e570fd4f70 2024-04-21T22:43:10.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.176+0000 7f35e1600640 1 -- 172.21.15.18:0/389377327 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc004860 con 0x55e570fd4f70 2024-04-21T22:43:10.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 -- 172.21.15.18:0/389377327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 msgr2=0x55e570fddbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55e570fe1530 tx=0x7f35dc01a000 comp rx=0 tx=0).stop 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 -- 172.21.15.18:0/389377327 shutdown_connections 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fde470 0x55e570fda620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fd5890 0x55e570fea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 --2- 172.21.15.18:0/389377327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fddbf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 -- 172.21.15.18:0/389377327 >> 172.21.15.18:0/389377327 conn(0x55e570fcf6a0 msgr2=0x55e570fcde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 -- 172.21.15.18:0/389377327 shutdown_connections 2024-04-21T22:43:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.177+0000 7f35f6804740 1 -- 172.21.15.18:0/389377327 wait complete. 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 -- start start 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 Processor -- start 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fd7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fd8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b4ec0 con 0x55e570fd4f70 2024-04-21T22:43:10.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b47f0 con 0x55e570fd5890 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1b1a50 con 0x55e570fde470 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.178+0000 7f35f6804740 10 client.0 _ll_register_callbacks cb 0x7f35dc009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fd7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35f1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47880/0 (socket says 172.21.15.18:47880) 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35f1200640 1 -- 172.21.15.18:0/3914493133 learned_addr learned my addr 172.21.15.18:0/3914493133 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35f1c00640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fd8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 -- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 msgr2=0x55e570fd8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fd8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 -- 172.21.15.18:0/3914493133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 msgr2=0x55e570fe6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 -- 172.21.15.18:0/3914493133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e570fd8c40 con 0x55e570fd5890 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35f1200640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35ebe00640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fd7ed0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f35d40eec60 tx=0x7f35d40f4f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd25d23a87868a36 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.179+0000 7f35daa00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d40bd570 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f35d40eedd0 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc02b910 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f35d40db050 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 10 client.27794 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e571054c70 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35dc02b910 con 0x55e570fd5890 2024-04-21T22:43:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f35d40dc240 con 0x55e570fd5890 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 10 client.27794 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 10 client.27794 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 20 client.27794 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.180+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e5710553c0 0x55e5710577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.181+0000 7f35f6804740 4 client.27794 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.181+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e570f40c30 con 0x55e5710553c0 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.181+0000 7f35f1200640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e5710553c0 0x55e5710577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.181+0000 7f35f1200640 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e5710553c0 0x55e5710577e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97fa7b111b63ad59 server_cookie=2278e5dd54932f8a in_seq=0 out_seq=0 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.181+0000 7f35daa00640 10 client.27794 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35daa00640 1 -- 172.21.15.18:0/3914493133 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e570f40c30 con 0x55e5710553c0 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35daa00640 10 client.27794 handle_command_reply: tid=0 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 client.27794 shutdown 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 msgr2=0x55e570fd7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fd7ed0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f35d40eec60 tx=0x7f35d40f4f70 comp rx=0 tx=0).stop 2024-04-21T22:43:10.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 shutdown_connections 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x55e5710553c0 0x55e5710577e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e570fde470 0x55e570fd8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e570fd5890 0x55e570fd7ed0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 --2- 172.21.15.18:0/3914493133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e570fd4f70 0x55e570fe6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35daa00640 0 client.27794 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 >> 172.21.15.18:0/3914493133 conn(0x55e570fcf6a0 msgr2=0x55e570fcde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 shutdown_connections 2024-04-21T22:43:10.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 1 -- 172.21.15.18:0/3914493133 wait complete. 2024-04-21T22:43:10.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.182+0000 7f35f6804740 20 client.27794 trim_cache size 0 max 16384 2024-04-21T22:43:10.192 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:10.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 msgr2=0x7f35d00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 0x7f35d00a51c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e570fd4a40 tx=0x7f35dc009500 comp rx=0 tx=0).stop 2024-04-21T22:43:10.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 msgr2=0x7f35ec19e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009900 tx=0x7f35d4004360 comp rx=0 tx=0).stop 2024-04-21T22:43:10.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 shutdown_connections 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f35d00a2d00 0x7f35d00a51c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35ec10dc00 0x7f35ec1a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec108640 0x7f35ec19e930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 --2- 172.21.15.18:0/1518111654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35ec107c80 0x7f35ec19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 >> 172.21.15.18:0/1518111654 conn(0x7f35ec077550 msgr2=0x7f35ec0785d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 shutdown_connections 2024-04-21T22:43:10.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.183+0000 7f35f2600640 1 -- 172.21.15.18:0/1518111654 wait complete. 2024-04-21T22:43:10.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:43:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 -- 172.21.15.18:0/2878007311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004108640 msgr2=0x7f60041149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 --2- 172.21.15.18:0/2878007311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004108640 0x7f60041149c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009ca0 tx=0x7f5ffc02c100 comp rx=0 tx=0).stop 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 -- 172.21.15.18:0/2878007311 shutdown_connections 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 --2- 172.21.15.18:0/2878007311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004108640 0x7f60041149c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 --2- 172.21.15.18:0/2878007311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6004107c80 0x7f6004108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 --2- 172.21.15.18:0/2878007311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f600410dc00 0x7f600410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 -- 172.21.15.18:0/2878007311 >> 172.21.15.18:0/2878007311 conn(0x7f6004077550 msgr2=0x7f6004106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 -- 172.21.15.18:0/2878007311 shutdown_connections 2024-04-21T22:43:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.401+0000 7f600ae00640 1 -- 172.21.15.18:0/2878007311 wait complete. 2024-04-21T22:43:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.402+0000 7f600ae00640 1 Processor -- start 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.402+0000 7f600ae00640 1 -- start start 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004107c80 0x7f600419e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600410dc00 0x7f60041a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6004117f40 con 0x7f6004107c80 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6004117dc0 con 0x7f6004108640 2024-04-21T22:43:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60041180c0 con 0x7f600410dc00 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004107c80 0x7f600419e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52356/0 (socket says 172.21.15.18:52356) 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 -- 172.21.15.18:0/2520579657 learned_addr learned my addr 172.21.15.18:0/2520579657 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f600a400640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600410dc00 0x7f60041a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 -- 172.21.15.18:0/2520579657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600410dc00 msgr2=0x7f60041a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600410dc00 0x7f60041a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.403+0000 7f6009000640 1 -- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004107c80 msgr2=0x7f600419e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6009000640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004107c80 0x7f600419e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6009000640 1 -- 172.21.15.18:0/2520579657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60041a3330 con 0x7f6004108640 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6009000640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e9f0 tx=0x7f5ff000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6002000640 1 -- 172.21.15.18:0/2520579657 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000cd80 con 0x7f6004108640 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6002000640 1 -- 172.21.15.18:0/2520579657 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff0005500 con 0x7f6004108640 2024-04-21T22:43:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60041a3620 con 0x7f6004108640 2024-04-21T22:43:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f6002000640 1 -- 172.21.15.18:0/2520579657 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0010690 con 0x7f6004108640 2024-04-21T22:43:10.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.404+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60041aaeb0 con 0x7f6004108640 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 Processor -- start 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 -- start start 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f6002000640 1 -- 172.21.15.18:0/2520579657 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5ff00046c0 con 0x7f6004108640 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647b21683a0 con 0x5647b220d470 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5647b2110930 con 0x5647b2203f70 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.408+0000 7f600f1c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647b2164360 con 0x5647b2204890 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f6009a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52362/0 (socket says 172.21.15.18:52362) 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 -- 172.21.15.18:0/1226058195 learned_addr learned my addr 172.21.15.18:0/1226058195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f6009000640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 -- 172.21.15.18:0/1226058195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 msgr2=0x5647b220cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 -- 172.21.15.18:0/1226058195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 msgr2=0x5647b220f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f600a400640 1 -- 172.21.15.18:0/1226058195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b1e7c3f0 con 0x5647b2203f70 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f6009a00640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.409+0000 7f6009000640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.410+0000 7f600a400640 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009ca0 tx=0x7f5ffc009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b531aaeccbe3c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.410+0000 7f6002000640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 0x7f5fec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.411+0000 7f6002000640 1 -- 172.21.15.18:0/2520579657 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5ff00cf930 con 0x7f6004108640 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.411+0000 7f6009a00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 0x7f5fec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.411+0000 7f5ff6a00640 1 -- 172.21.15.18:0/1226058195 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc045020 con 0x5647b2203f70 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.411+0000 7f5ff6a00640 1 -- 172.21.15.18:0/1226058195 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ffc03a040 con 0x5647b2203f70 2024-04-21T22:43:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.411+0000 7f5ff6a00640 1 -- 172.21.15.18:0/1226058195 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc039040 con 0x5647b2203f70 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f6009a00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 0x7f5fec0a51c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5647b2203a40 tx=0x7f5ff8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 -- 172.21.15.18:0/1226058195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 msgr2=0x5647b2204350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009ca0 tx=0x7f5ffc009900 comp rx=0 tx=0).stop 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 -- 172.21.15.18:0/1226058195 shutdown_connections 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1226058195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2204350 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 -- 172.21.15.18:0/1226058195 >> 172.21.15.18:0/1226058195 conn(0x5647b21fe6a0 msgr2=0x5647b21fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 -- 172.21.15.18:0/1226058195 shutdown_connections 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.412+0000 7f600f1c1740 1 -- 172.21.15.18:0/1226058195 wait complete. 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 -- start start 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 Processor -- start 2024-04-21T22:43:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b220a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5647b2210200 con 0x5647b220d470 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5647b2123d80 con 0x5647b2203f70 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5647b2210380 con 0x5647b2204890 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600f1c1740 10 client.0 _ll_register_callbacks cb 0x5647b21602b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.413+0000 7f600a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f6009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b220a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f6009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b220a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52366/0 (socket says 172.21.15.18:52366) 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f6009a00640 1 -- 172.21.15.18:0/1947300936 learned_addr learned my addr 172.21.15.18:0/1947300936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f6009000640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 -- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 msgr2=0x5647b220aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 -- 172.21.15.18:0/1947300936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 msgr2=0x5647b220a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b220a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 -- 172.21.15.18:0/1947300936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b1f467d0 con 0x5647b220d470 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f600a400640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220af80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc02c710 tx=0x7f5ffc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7011cdb6816b9574 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.414+0000 7f5feb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc045030 con 0x5647b220d470 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5ffc032790 con 0x5647b220d470 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ffc03a040 con 0x5647b220d470 2024-04-21T22:43:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5ffc039070 con 0x5647b220d470 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f600f1c1740 10 client.17721 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5647b221c560 con 0x5647b220d470 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ffc03a040 con 0x5647b220d470 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.415+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5ffc041430 con 0x5647b220d470 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 10 client.17721 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 10 client.17721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:43:10.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 20 client.17721 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b221d8b0 0x5647b221fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 4 client.17721 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647b21758e0 con 0x5647b221d8b0 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.416+0000 7f6009a00640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b221d8b0 0x5647b221fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.417+0000 7f6009a00640 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b221d8b0 0x5647b221fca0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18c91d5694261994 server_cookie=9342a509abb9f3d7 in_seq=0 out_seq=0 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.417+0000 7f5feb400640 10 client.17721 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.417+0000 7f5feb400640 1 -- 172.21.15.18:0/1947300936 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5647b21758e0 con 0x5647b221d8b0 2024-04-21T22:43:10.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.417+0000 7f5feb400640 10 client.17721 handle_command_reply: tid=0 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 client.17721 shutdown 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 msgr2=0x5647b220af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220af80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc02c710 tx=0x7f5ffc009800 comp rx=0 tx=0).stop 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 shutdown_connections 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b221d8b0 0x5647b221fca0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b220af80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b220aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f5feb400640 0 client.17721 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1947300936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b220a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 >> 172.21.15.18:0/1947300936 conn(0x5647b21fe6a0 msgr2=0x5647b22003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 shutdown_connections 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 1 -- 172.21.15.18:0/1947300936 wait complete. 2024-04-21T22:43:10.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.418+0000 7f600f1c1740 20 client.17721 trim_cache size 0 max 16384 2024-04-21T22:43:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.433+0000 7f600f1c1740 1 Processor -- start 2024-04-21T22:43:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.433+0000 7f600f1c1740 1 -- start start 2024-04-21T22:43:10.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2209440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2205c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b3890 con 0x5647b220d470 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b53d0 con 0x5647b2203f70 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600f1c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b3f60 con 0x5647b2204890 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f6009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f6009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52374/0 (socket says 172.21.15.18:52374) 2024-04-21T22:43:10.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f6009a00640 1 -- 172.21.15.18:0/1242309135 learned_addr learned my addr 172.21.15.18:0/1242309135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f600a400640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2205c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.434+0000 7f6009000640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2209440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 -- 172.21.15.18:0/1242309135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 msgr2=0x5647b2209440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2209440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 -- 172.21.15.18:0/1242309135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 msgr2=0x5647b2205c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2205c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 -- 172.21.15.18:0/1242309135 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647b21fefe0 con 0x5647b2203f70 2024-04-21T22:43:10.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f600a400640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2205c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f6009a00640 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8012cb0 tx=0x7f5ff801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99925428c55fb7ec server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f5ff6000640 1 -- 172.21.15.18:0/1242309135 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003e10 con 0x5647b2203f70 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f5ff6000640 1 -- 172.21.15.18:0/1242309135 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff802b900 con 0x5647b2203f70 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.435+0000 7f5ff6000640 1 -- 172.21.15.18:0/1242309135 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004890 con 0x5647b2203f70 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 -- 172.21.15.18:0/1242309135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 msgr2=0x5647b2219120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8012cb0 tx=0x7f5ff801b000 comp rx=0 tx=0).stop 2024-04-21T22:43:10.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 -- 172.21.15.18:0/1242309135 shutdown_connections 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2205c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2209440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 --2- 172.21.15.18:0/1242309135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2219120 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 -- 172.21.15.18:0/1242309135 >> 172.21.15.18:0/1242309135 conn(0x5647b21fe6a0 msgr2=0x5647b21fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 -- 172.21.15.18:0/1242309135 shutdown_connections 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.436+0000 7f600f1c1740 1 -- 172.21.15.18:0/1242309135 wait complete. 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 -- start start 2024-04-21T22:43:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 Processor -- start 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2215550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2215a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b4d00 con 0x5647b220d470 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b4630 con 0x5647b2203f70 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60041b1890 con 0x5647b2204890 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.437+0000 7f600f1c1740 10 client.0 _ll_register_callbacks cb 0x7f5ff80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f600a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2215a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2215550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f600a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47932/0 (socket says 172.21.15.18:47932) 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f600a400640 1 -- 172.21.15.18:0/895629814 learned_addr learned my addr 172.21.15.18:0/895629814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 -- 172.21.15.18:0/895629814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 msgr2=0x5647b2215550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2215550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 -- 172.21.15.18:0/895629814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 msgr2=0x5647b2210a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f6009000640 1 -- 172.21.15.18:0/895629814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647b2211270 con 0x5647b2204890 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.438+0000 7f600a400640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f6009000640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2215a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ccfc0 tx=0x7f5ff009b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84a7b37da9556e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f5feb400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00d5020 con 0x5647b2204890 2024-04-21T22:43:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5ff00a4770 con 0x5647b2204890 2024-04-21T22:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ff802b900 con 0x5647b2204890 2024-04-21T22:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5ff00d1e60 con 0x5647b2204890 2024-04-21T22:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f600f1c1740 10 client.27871 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5647b2283670 con 0x5647b2204890 2024-04-21T22:43:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.439+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff802b900 con 0x5647b2204890 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5ff009ac50 con 0x5647b2204890 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 10 client.27871 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 10 client.27871 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 20 client.27871 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b2283e10 0x5647b2286230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 4 client.27871 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647b216fc30 con 0x5647b2283e10 2024-04-21T22:43:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.440+0000 7f6009a00640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b2283e10 0x5647b2286230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f6009a00640 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b2283e10 0x5647b2286230 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65e0d64680a5b4a0 server_cookie=65f2efefc9029a8c in_seq=0 out_seq=0 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f5feb400640 10 client.27871 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f5feb400640 1 -- 172.21.15.18:0/895629814 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647b216fc30 con 0x5647b2283e10 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f5feb400640 10 client.27871 handle_command_reply: tid=0 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 client.27871 shutdown 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 msgr2=0x5647b2215a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2215a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ccfc0 tx=0x7f5ff009b8d0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 shutdown_connections 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5647b2283e10 0x5647b2286230 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5647b220d470 0x5647b2210a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5647b2204890 0x5647b2215a90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 --2- 172.21.15.18:0/895629814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5647b2203f70 0x5647b2215550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 >> 172.21.15.18:0/895629814 conn(0x5647b21fe6a0 msgr2=0x5647b21ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f5feb400640 0 client.27871 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 shutdown_connections 2024-04-21T22:43:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 1 -- 172.21.15.18:0/895629814 wait complete. 2024-04-21T22:43:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.441+0000 7f600f1c1740 20 client.27871 trim_cache size 0 max 16384 2024-04-21T22:43:10.451 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 msgr2=0x7f5fec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 0x7f5fec0a51c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5647b2203a40 tx=0x7f5ff8005f90 comp rx=0 tx=0).stop 2024-04-21T22:43:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 msgr2=0x7f600419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e9f0 tx=0x7f5ff000edf0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 shutdown_connections 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5fec0a2d00 0x7f5fec0a51c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600410dc00 0x7f60041a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6004108640 0x7f600419e880 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 --2- 172.21.15.18:0/2520579657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6004107c80 0x7f600419e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 >> 172.21.15.18:0/2520579657 conn(0x7f6004077550 msgr2=0x7f6004078660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 shutdown_connections 2024-04-21T22:43:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.442+0000 7f600ae00640 1 -- 172.21.15.18:0/2520579657 wait complete. 2024-04-21T22:43:10.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 -- 172.21.15.18:0/3039317834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 msgr2=0x7f5ca4109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/3039317834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca4109b40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009890 tx=0x7f5c9402bb70 comp rx=0 tx=0).stop 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 -- 172.21.15.18:0/3039317834 shutdown_connections 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/3039317834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4104110 0x7f5ca4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/3039317834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4103750 0x7f5ca4103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/3039317834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca4109b40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.669+0000 7f5ca8a00640 1 -- 172.21.15.18:0/3039317834 >> 172.21.15.18:0/3039317834 conn(0x7f5ca40ff220 msgr2=0x7f5ca4101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.670+0000 7f5ca8a00640 1 -- 172.21.15.18:0/3039317834 shutdown_connections 2024-04-21T22:43:10.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.670+0000 7f5ca8a00640 1 -- 172.21.15.18:0/3039317834 wait complete. 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 Processor -- start 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 -- start start 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4104110 0x7f5ca419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4113b70 con 0x7f5ca4103750 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41139f0 con 0x7f5ca4104110 2024-04-21T22:43:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.671+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4113cf0 con 0x7f5ca4109760 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47950/0 (socket says 172.21.15.18:47950) 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 -- 172.21.15.18:0/264130522 learned_addr learned my addr 172.21.15.18:0/264130522 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4104110 0x7f5ca419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 -- 172.21.15.18:0/264130522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 msgr2=0x7f5ca419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 -- 172.21.15.18:0/264130522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4104110 msgr2=0x7f5ca419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4104110 0x7f5ca419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 -- 172.21.15.18:0/264130522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca419f0a0 con 0x7f5ca4103750 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.672+0000 7f5ca3400640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5c940057c0 tx=0x7f5c940045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.673+0000 7f5c9be00640 1 -- 172.21.15.18:0/264130522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94041020 con 0x7f5ca4103750 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.673+0000 7f5c9be00640 1 -- 172.21.15.18:0/264130522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9402c9f0 con 0x7f5ca4103750 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.673+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca419f330 con 0x7f5ca4103750 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.673+0000 7f5c9be00640 1 -- 172.21.15.18:0/264130522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94039040 con 0x7f5ca4103750 2024-04-21T22:43:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.673+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41a6c20 con 0x7f5ca4103750 2024-04-21T22:43:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.676+0000 7f5cacd7b740 1 Processor -- start 2024-04-21T22:43:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.676+0000 7f5cacd7b740 1 -- start start 2024-04-21T22:43:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.676+0000 7f5c9be00640 1 -- 172.21.15.18:0/264130522 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5c94044020 con 0x7f5ca4103750 2024-04-21T22:43:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563887f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5585637e33a0 con 0x55856387f890 2024-04-21T22:43:10.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55856378b930 con 0x55856387ef70 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5585637df360 con 0x558563888470 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563887f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563887f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47958/0 (socket says 172.21.15.18:47958) 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52402/0 (socket says 172.21.15.18:52402) 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca3400640 1 -- 172.21.15.18:0/737861155 learned_addr learned my addr 172.21.15.18:0/737861155 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.677+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 -- 172.21.15.18:0/737861155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 msgr2=0x55856388a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 -- 172.21.15.18:0/737861155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 msgr2=0x558563887f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563887f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 -- 172.21.15.18:0/737861155 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585634f73f0 con 0x55856387ef70 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005bd0 tx=0x7f5c9c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f9916c87907d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5c9be00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 0x7f5c880a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5c9be00640 1 -- 172.21.15.18:0/264130522 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5c940f0b40 con 0x7f5ca4103750 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5c8fe00640 1 -- 172.21.15.18:0/737861155 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c004b20 con 0x55856387ef70 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5ca3400640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 0x7f5c880a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5c8fe00640 1 -- 172.21.15.18:0/737861155 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9c003e50 con 0x55856387ef70 2024-04-21T22:43:10.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.678+0000 7f5c8fe00640 1 -- 172.21.15.18:0/737861155 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c004020 con 0x55856387ef70 2024-04-21T22:43:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 -- 172.21.15.18:0/737861155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 msgr2=0x55856387f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005bd0 tx=0x7f5c9c0095c0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5ca3400640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 0x7f5c880a5240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c940b9570 tx=0x7f5c940dd040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 -- 172.21.15.18:0/737861155 shutdown_connections 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563887f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/737861155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856387f350 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 -- 172.21.15.18:0/737861155 >> 172.21.15.18:0/737861155 conn(0x5585638796a0 msgr2=0x558563879a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.679+0000 7f5cacd7b740 1 -- 172.21.15.18:0/737861155 shutdown_connections 2024-04-21T22:43:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.680+0000 7f5cacd7b740 1 -- 172.21.15.18:0/737861155 wait complete. 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.680+0000 7f5cacd7b740 1 -- start start 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.680+0000 7f5cacd7b740 1 Processor -- start 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563885a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x558563885f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55856388b260 con 0x55856387f890 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55856379ed80 con 0x55856387ef70 2024-04-21T22:43:10.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55856388b3e0 con 0x558563888470 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5cacd7b740 10 client.0 _ll_register_callbacks cb 0x5585637db2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563885a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52410/0 (socket says 172.21.15.18:52410) 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca3e00640 1 -- 172.21.15.18:0/483919165 learned_addr learned my addr 172.21.15.18:0/483919165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x558563885f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca2a00640 1 -- 172.21.15.18:0/483919165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 msgr2=0x558563885f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x558563885f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca2a00640 1 -- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 msgr2=0x558563885510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.681+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5ca2a00640 1 -- 172.21.15.18:0/483919165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585635c17d0 con 0x55856387f890 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563885a50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5ca41018c0 tx=0x7f5c90012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3b8a4ae0fd28f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5c8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004020 con 0x55856387f890 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5c900041c0 con 0x55856387f890 2024-04-21T22:43:10.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c9c003e50 con 0x55856387f890 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.682+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5c900043c0 con 0x55856387f890 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 10 client.17739 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5585638975f0 con 0x55856387f890 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9c003e50 con 0x55856387f890 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5c90003bb0 con 0x55856387f890 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 10 client.17739 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 20 client.17739 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558563898ab0 0x55856389aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 4 client.17739 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.683+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585637f08e0 con 0x558563898ab0 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.684+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558563898ab0 0x55856389aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.684+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558563898ab0 0x55856389aea0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58aff7582e712aa7 server_cookie=41c3b7aa29905f32 in_seq=0 out_seq=0 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.684+0000 7f5c8cc00640 10 client.17739 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5c8cc00640 1 -- 172.21.15.18:0/483919165 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5585637f08e0 con 0x558563898ab0 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5c8cc00640 10 client.17739 handle_command_reply: tid=0 2024-04-21T22:43:10.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 client.17739 shutdown 2024-04-21T22:43:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 msgr2=0x558563885a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563885a50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5ca41018c0 tx=0x7f5c90012b60 comp rx=0 tx=0).stop 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 shutdown_connections 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558563898ab0 0x55856389aea0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x558563885f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x558563885a50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/483919165 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x558563885510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5c8cc00640 0 client.17739 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 >> 172.21.15.18:0/483919165 conn(0x5585638796a0 msgr2=0x55856387b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 shutdown_connections 2024-04-21T22:43:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.685+0000 7f5cacd7b740 1 -- 172.21.15.18:0/483919165 wait complete. 2024-04-21T22:43:10.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.686+0000 7f5cacd7b740 20 client.17739 trim_cache size 0 max 16384 2024-04-21T22:43:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 Processor -- start 2024-04-21T22:43:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 -- start start 2024-04-21T22:43:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 0x558563894150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558563888470 0x558563878510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41af690 con 0x558563888470 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41b11d0 con 0x55856387f890 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.701+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41afd60 con 0x55856387ef70 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:42986/0 (socket says 172.21.15.18:42986) 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca3e00640 1 -- 172.21.15.18:0/1735488558 learned_addr learned my addr 172.21.15.18:0/1735488558 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 0x558563894150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558563888470 0x558563878510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1735488558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 msgr2=0x558563887c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1735488558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558563888470 msgr2=0x558563878510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558563888470 0x558563878510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1735488558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558563873ae0 con 0x55856387f890 2024-04-21T22:43:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.702+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 0x558563894150 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd63d3801419583a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5c8f400640 1 -- 172.21.15.18:0/1735488558 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900056f0 con 0x55856387f890 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5c8f400640 1 -- 172.21.15.18:0/1735488558 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9000fe00 con 0x55856387f890 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5c8f400640 1 -- 172.21.15.18:0/1735488558 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90003d40 con 0x55856387f890 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1735488558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 msgr2=0x558563894150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 0x558563894150 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000f810 comp rx=0 tx=0).stop 2024-04-21T22:43:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1735488558 shutdown_connections 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558563888470 0x558563878510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387f890 0x558563894150 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1735488558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55856387ef70 0x558563887c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1735488558 >> 172.21.15.18:0/1735488558 conn(0x5585638796a0 msgr2=0x558563877e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1735488558 shutdown_connections 2024-04-21T22:43:10.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.703+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1735488558 wait complete. 2024-04-21T22:43:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.704+0000 7f5cacd7b740 1 -- start start 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.704+0000 7f5cacd7b740 1 Processor -- start 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.704+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856388c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.704+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5cacd7b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41b0b00 con 0x55856387f890 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41b0430 con 0x55856387ef70 2024-04-21T22:43:10.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5cacd7b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41ad690 con 0x558563888470 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5cacd7b740 10 client.0 _ll_register_callbacks cb 0x7f5c90009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47978/0 (socket says 172.21.15.18:47978) 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1121357911 learned_addr learned my addr 172.21.15.18:0/1121357911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856388c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1121357911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 msgr2=0x55856388ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 msgr2=0x55856388c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856388c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.705+0000 7f5ca2a00640 1 -- 172.21.15.18:0/1121357911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585638fe220 con 0x55856387f890 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5ca2a00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5c90012ba0 tx=0x7f5c900042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b7a0a0124a1e7b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5c8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90003ac0 con 0x55856387f890 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7f5c90003c60 con 0x55856387f890 2024-04-21T22:43:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c9000fe00 con 0x55856387f890 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5c9000f920 con 0x55856387f890 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5cacd7b740 10 client.17745 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.706+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5585638ff4c0 con 0x55856387f890 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c9000fe00 con 0x55856387f890 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5c90010430 con 0x55856387f890 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 10 client.17745 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 20 client.17745 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:10.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5585638ffb30 0x558563901f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 4 client.17745 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585637eac30 con 0x5585638ffb30 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.707+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5585638ffb30 0x558563901f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5ca3e00640 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5585638ffb30 0x558563901f50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ca030cbbf48eb2c server_cookie=7bf36928e32e283d in_seq=0 out_seq=0 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5c8cc00640 10 client.17745 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5c8cc00640 1 -- 172.21.15.18:0/1121357911 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585637eac30 con 0x5585638ffb30 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5c8cc00640 10 client.17745 handle_command_reply: tid=0 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 client.17745 shutdown 2024-04-21T22:43:10.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 msgr2=0x55856388c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5c90012ba0 tx=0x7f5c900042d0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 shutdown_connections 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5585638ffb30 0x558563901f50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558563888470 0x55856388ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55856387f890 0x55856388c770 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 --2- 172.21.15.18:0/1121357911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55856387ef70 0x55856388c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 >> 172.21.15.18:0/1121357911 conn(0x5585638796a0 msgr2=0x5585638854d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5c8cc00640 0 client.17745 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 shutdown_connections 2024-04-21T22:43:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.708+0000 7f5cacd7b740 1 -- 172.21.15.18:0/1121357911 wait complete. 2024-04-21T22:43:10.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5cacd7b740 20 client.17745 trim_cache size 0 max 16384 2024-04-21T22:43:10.718 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 msgr2=0x7f5c880a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 0x7f5c880a5240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c940b9570 tx=0x7f5c940dd040 comp rx=0 tx=0).stop 2024-04-21T22:43:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 msgr2=0x7f5ca419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5c940057c0 tx=0x7f5c940045d0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 shutdown_connections 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5c880a2d80 0x7f5c880a5240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ca4109760 0x7f5ca419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ca4104110 0x7f5ca419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 --2- 172.21.15.18:0/264130522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca4103750 0x7f5ca419a0b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.709+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 >> 172.21.15.18:0/264130522 conn(0x7f5ca40ff220 msgr2=0x7f5ca40ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.710+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 shutdown_connections 2024-04-21T22:43:10.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:10.710+0000 7f5ca8a00640 1 -- 172.21.15.18:0/264130522 wait complete. 2024-04-21T22:43:11.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:11 smithi047 ceph-mon[31561]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:11.727 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:43:11.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:43:11.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:43:11.812 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:11 smithi018 ceph-mon[26614]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:11 smithi081 ceph-mon[31692]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 -- 172.21.15.18:0/1639742914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8073ae0 msgr2=0x7ff2c8073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 --2- 172.21.15.18:0/1639742914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8073ae0 0x7ff2c8073ec0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009900 tx=0x7ff2b802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 -- 172.21.15.18:0/1639742914 shutdown_connections 2024-04-21T22:43:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 --2- 172.21.15.18:0/1639742914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8112710 0x7ff2c8114b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 --2- 172.21.15.18:0/1639742914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8074400 0x7ff2c81121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 --2- 172.21.15.18:0/1639742914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8073ae0 0x7ff2c8073ec0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 -- 172.21.15.18:0/1639742914 >> 172.21.15.18:0/1639742914 conn(0x7ff2c80fd1f0 msgr2=0x7ff2c80ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 -- 172.21.15.18:0/1639742914 shutdown_connections 2024-04-21T22:43:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.956+0000 7ff2cca00640 1 -- 172.21.15.18:0/1639742914 wait complete. 2024-04-21T22:43:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 Processor -- start 2024-04-21T22:43:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 -- start start 2024-04-21T22:43:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 0x7ff2c81a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8118150 con 0x7ff2c8112710 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8117fd0 con 0x7ff2c8073ae0 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.957+0000 7ff2cca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81182d0 con 0x7ff2c8074400 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 0x7ff2c81a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52456/0 (socket says 172.21.15.18:52456) 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c5e00640 1 -- 172.21.15.18:0/106396576 learned_addr learned my addr 172.21.15.18:0/106396576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:43024/0 (socket says 172.21.15.18:43024) 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 -- 172.21.15.18:0/106396576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 msgr2=0x7ff2c819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 -- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 msgr2=0x7ff2c81a2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 0x7ff2c81a2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2bd400640 1 -- 172.21.15.18:0/106396576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c81a3680 con 0x7ff2c8074400 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.958+0000 7ff2c6800640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 0x7ff2c81a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2bd400640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2bf400640 1 -- 172.21.15.18:0/106396576 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000ccc0 con 0x7ff2c8074400 2024-04-21T22:43:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2bf400640 1 -- 172.21.15.18:0/106396576 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2b0010910 con 0x7ff2c8074400 2024-04-21T22:43:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2bf400640 1 -- 172.21.15.18:0/106396576 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0018960 con 0x7ff2c8074400 2024-04-21T22:43:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c81a3970 con 0x7ff2c8074400 2024-04-21T22:43:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.959+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c81ab200 con 0x7ff2c8074400 2024-04-21T22:43:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.962+0000 7ff2cf791740 1 Processor -- start 2024-04-21T22:43:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.962+0000 7ff2cf791740 1 -- start start 2024-04-21T22:43:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.962+0000 7ff2bf400640 1 -- 172.21.15.18:0/106396576 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff2b0010ac0 con 0x7ff2c8074400 2024-04-21T22:43:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29c2c20 0x55c5a29c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5a2917df0 con 0x55c5a29ba040 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c5a291d040 con 0x55c5a29b9720 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2cf791740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5a28c58c0 con 0x55c5a29c2c20 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2c6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2c6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52464/0 (socket says 172.21.15.18:52464) 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2c6800640 1 -- 172.21.15.18:0/3585421495 learned_addr learned my addr 172.21.15.18:0/3585421495 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29c2c20 0x55c5a29c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.963+0000 7ff2c6800640 1 -- 172.21.15.18:0/3585421495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29c2c20 msgr2=0x55c5a29c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29c2c20 0x55c5a29c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c6800640 1 -- 172.21.15.18:0/3585421495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 msgr2=0x55c5a29c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c6800640 1 -- 172.21.15.18:0/3585421495 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a26f97e0 con 0x55c5a29b9720 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00106c0 tx=0x7ff2c0010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04e8fdd4a5702a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2b7000640 1 -- 172.21.15.18:0/3585421495 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000e8d0 con 0x55c5a29b9720 2024-04-21T22:43:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2b7000640 1 -- 172.21.15.18:0/3585421495 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c0012450 con 0x55c5a29b9720 2024-04-21T22:43:11.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2b7000640 1 -- 172.21.15.18:0/3585421495 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c001c670 con 0x55c5a29b9720 2024-04-21T22:43:11.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.964+0000 7ff2bf400640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 0x7ff2ac0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2bf400640 1 -- 172.21.15.18:0/106396576 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7ff2b00cf820 con 0x7ff2c8074400 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 0x7ff2ac0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 -- 172.21.15.18:0/3585421495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 msgr2=0x55c5a29b9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00106c0 tx=0x7ff2c0010b80 comp rx=0 tx=0).stop 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 -- 172.21.15.18:0/3585421495 shutdown_connections 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29c2c20 0x55c5a29c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3585421495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29b9720 0x55c5a29b9b00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 -- 172.21.15.18:0/3585421495 >> 172.21.15.18:0/3585421495 conn(0x55c5a29b3e50 msgr2=0x55c5a29b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.965+0000 7ff2cf791740 1 -- 172.21.15.18:0/3585421495 shutdown_connections 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.966+0000 7ff2cf791740 1 -- 172.21.15.18:0/3585421495 wait complete. 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.966+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 0x7ff2ac0a5240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80096c0 tx=0x7ff2b802e040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.966+0000 7ff2cf791740 1 -- start start 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.966+0000 7ff2cf791740 1 Processor -- start 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 0x55c5a29bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c5a28d8d20 con 0x55c5a29ba040 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55c5a2919000 con 0x55c5a29c2c20 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5a29c5a10 con 0x55c5a29b9720 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2cf791740 10 client.0 _ll_register_callbacks cb 0x55c5a29140a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 0x55c5a29bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48000/0 (socket says 172.21.15.18:48000) 2024-04-21T22:43:11.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2bd400640 1 -- 172.21.15.18:0/1385632607 learned_addr learned my addr 172.21.15.18:0/1385632607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2c6800640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.967+0000 7ff2c5e00640 1 -- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 msgr2=0x55c5a29c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c5e00640 1 -- 172.21.15.18:0/1385632607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 msgr2=0x55c5a29c01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c5e00640 1 -- 172.21.15.18:0/1385632607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a2759f70 con 0x55c5a29b9720 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c6800640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 0x55c5a29bfc90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8005ab0 tx=0x7ff2b802bcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb6fd0f2e66324b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2ab400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8046070 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7ff2b8005150 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.968+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2c0012450 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff2b805b050 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 10 client.27901 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c5a25f1170 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c0012450 con 0x55c5a29b9720 2024-04-21T22:43:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff2b804d470 con 0x55c5a29b9720 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 10 client.27901 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 10 client.27901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 20 client.27901 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a29d2f40 0x55c5a29d5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 4 client.27901 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.969+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5a292a580 con 0x55c5a29d2f40 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.970+0000 7ff2bd400640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a29d2f40 0x55c5a29d5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.970+0000 7ff2bd400640 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a29d2f40 0x55c5a29d5370 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f325fcd7b96169fc server_cookie=37be4c20fdf7a104 in_seq=0 out_seq=0 2024-04-21T22:43:11.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.970+0000 7ff2ab400640 10 client.27901 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.971+0000 7ff2ab400640 1 -- 172.21.15.18:0/1385632607 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c5a292a580 con 0x55c5a29d2f40 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.971+0000 7ff2ab400640 10 client.27901 handle_command_reply: tid=0 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.971+0000 7ff2cf791740 1 client.27901 shutdown 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.971+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 msgr2=0x55c5a29bfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.971+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 0x55c5a29bfc90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8005ab0 tx=0x7ff2b802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 shutdown_connections 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29ba040 0x55c5a29c01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a29d2f40 0x55c5a29d5370 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 --2- 172.21.15.18:0/1385632607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29b9720 0x55c5a29bfc90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 >> 172.21.15.18:0/1385632607 conn(0x55c5a29b3e50 msgr2=0x55c5a29b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2ab400640 0 client.27901 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 shutdown_connections 2024-04-21T22:43:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 1 -- 172.21.15.18:0/1385632607 wait complete. 2024-04-21T22:43:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.972+0000 7ff2cf791740 20 client.27901 trim_cache size 0 max 16384 2024-04-21T22:43:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.991+0000 7ff2cf791740 1 Processor -- start 2024-04-21T22:43:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 -- start start 2024-04-21T22:43:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29beb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b3c20 con 0x55c5a29b9720 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b5760 con 0x55c5a29c2c20 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2cf791740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b42f0 con 0x55c5a29ba040 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48006/0 (socket says 172.21.15.18:48006) 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2c5e00640 1 -- 172.21.15.18:0/3837964176 learned_addr learned my addr 172.21.15.18:0/3837964176 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.992+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 -- 172.21.15.18:0/3837964176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 msgr2=0x55c5a29ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 -- 172.21.15.18:0/3837964176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 msgr2=0x55c5a29beb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:11.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29beb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 -- 172.21.15.18:0/3837964176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a29b22a0 con 0x55c5a29b9720 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8036040 tx=0x7ff2b8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5e31011a5173ee server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.993+0000 7ff2b6600640 1 -- 172.21.15.18:0/3837964176 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8063070 con 0x55c5a29b9720 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2b6600640 1 -- 172.21.15.18:0/3837964176 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2b8052070 con 0x55c5a29b9720 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2b6600640 1 -- 172.21.15.18:0/3837964176 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8046040 con 0x55c5a29b9720 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 -- 172.21.15.18:0/3837964176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 msgr2=0x55c5a29c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8036040 tx=0x7ff2b8005a20 comp rx=0 tx=0).stop 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 -- 172.21.15.18:0/3837964176 shutdown_connections 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29beb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3837964176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29c23c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 -- 172.21.15.18:0/3837964176 >> 172.21.15.18:0/3837964176 conn(0x55c5a29b3e50 msgr2=0x55c5a29be450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 -- 172.21.15.18:0/3837964176 shutdown_connections 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.994+0000 7ff2cf791740 1 -- 172.21.15.18:0/3837964176 wait complete. 2024-04-21T22:43:11.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.995+0000 7ff2cf791740 1 -- start start 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.995+0000 7ff2cf791740 1 Processor -- start 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b5090 con 0x55c5a29b9720 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b49c0 con 0x55c5a29c2c20 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c81b1c20 con 0x55c5a29ba040 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2cf791740 10 client.0 _ll_register_callbacks cb 0x7ff2b8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:12.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2c5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48010/0 (socket says 172.21.15.18:48010) 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2c5e00640 1 -- 172.21.15.18:0/3725095229 learned_addr learned my addr 172.21.15.18:0/3725095229 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 -- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 msgr2=0x55c5a29c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 -- 172.21.15.18:0/3725095229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 msgr2=0x55c5a29cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2bd400640 1 -- 172.21.15.18:0/3725095229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a29c8490 con 0x55c5a29ba040 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.996+0000 7ff2c6800640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2bd400640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29cb1d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c6a0 tx=0x7ff2b000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70c9d24060ef8415 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00a48f0 con 0x55c5a29ba040 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b8052070 con 0x55c5a29ba040 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7ff2b00983a0 con 0x55c5a29ba040 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00cd130 con 0x55c5a29ba040 2024-04-21T22:43:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2cf791740 10 client.27907 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c5a2a3a040 con 0x55c5a29ba040 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2b8052070 con 0x55c5a29ba040 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.997+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ff2b00b4070 con 0x55c5a29ba040 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 10 client.27907 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 10 client.27907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 20 client.27907 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a2a3a710 0x55c5a2a3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 4 client.27907 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:43:12.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c5a29248d0 con 0x55c5a2a3a710 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.998+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a2a3a710 0x55c5a2a3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.999+0000 7ff2c5e00640 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a2a3a710 0x55c5a2a3cb00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cd02f021c3c9fe7 server_cookie=b1e2173d9d41f3ee in_seq=0 out_seq=0 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:11.999+0000 7ff2ab400640 10 client.27907 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2ab400640 1 -- 172.21.15.18:0/3725095229 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c5a29248d0 con 0x55c5a2a3a710 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2ab400640 10 client.27907 handle_command_reply: tid=0 2024-04-21T22:43:12.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 client.27907 shutdown 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 msgr2=0x55c5a29cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29cb1d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c6a0 tx=0x7ff2b000cf60 comp rx=0 tx=0).stop 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 shutdown_connections 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c5a29c2c20 0x55c5a29c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55c5a2a3a710 0x55c5a2a3cb00 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c5a29ba040 0x55c5a29cb1d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 --2- 172.21.15.18:0/3725095229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c5a29b9720 0x55c5a29cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 >> 172.21.15.18:0/3725095229 conn(0x55c5a29b3e50 msgr2=0x55c5a29bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2ab400640 0 client.27907 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 shutdown_connections 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 1 -- 172.21.15.18:0/3725095229 wait complete. 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.000+0000 7ff2cf791740 20 client.27907 trim_cache size 0 max 16384 2024-04-21T22:43:12.007 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:12.008 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:43:12.008 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "753faf5e-2c18-4260-8888-9e54de854b05", 2024-04-21T22:43:12.008 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:43:12.008 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 msgr2=0x7ff2ac0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 0x7ff2ac0a5240 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80096c0 tx=0x7ff2b802e040 comp rx=0 tx=0).stop 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 msgr2=0x7ff2c819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 shutdown_connections 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff2ac0a2d80 0x7ff2ac0a5240 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2c8112710 0x7ff2c81a2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c8074400 0x7ff2c819ebd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 --2- 172.21.15.18:0/106396576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2c8073ae0 0x7ff2c819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 >> 172.21.15.18:0/106396576 conn(0x7ff2c80fd1f0 msgr2=0x7ff2c80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 shutdown_connections 2024-04-21T22:43:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.001+0000 7ff2cca00640 1 -- 172.21.15.18:0/106396576 wait complete. 2024-04-21T22:43:12.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:43:12.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:43:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 -- 172.21.15.18:0/2997737109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100a30 msgr2=0x7feb0410e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 --2- 172.21.15.18:0/2997737109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100a30 0x7feb0410e710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feafc009930 tx=0x7feafc02bc20 comp rx=0 tx=0).stop 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 -- 172.21.15.18:0/2997737109 shutdown_connections 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 --2- 172.21.15.18:0/2997737109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100a30 0x7feb0410e710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 --2- 172.21.15.18:0/2997737109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04100070 0x7feb041004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 --2- 172.21.15.18:0/2997737109 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04106870 0x7feb04106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 -- 172.21.15.18:0/2997737109 >> 172.21.15.18:0/2997737109 conn(0x7feb040758c0 msgr2=0x7feb04075cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 -- 172.21.15.18:0/2997737109 shutdown_connections 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.260+0000 7feb0a200640 1 -- 172.21.15.18:0/2997737109 wait complete. 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.261+0000 7feb0a200640 1 Processor -- start 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.261+0000 7feb0a200640 1 -- start start 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 0x7feb0419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04106870 0x7feb0419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb04111c80 con 0x7feb04106870 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb04111b00 con 0x7feb04100a30 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb0a200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb04111e00 con 0x7feb04100070 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:43076/0 (socket says 172.21.15.18:43076) 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb03400640 1 -- 172.21.15.18:0/1648993882 learned_addr learned my addr 172.21.15.18:0/1648993882 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb03e00640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04106870 0x7feb0419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.262+0000 7feb02a00640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 0x7feb0419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 -- 172.21.15.18:0/1648993882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 msgr2=0x7feb0419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 0x7feb0419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 -- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04106870 msgr2=0x7feb0419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04106870 0x7feb0419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 -- 172.21.15.18:0/1648993882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0419f240 con 0x7feb04100070 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb02a00640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 0x7feb0419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb03400640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feaf400ebc0 tx=0x7feaf400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feafbe00640 1 -- 172.21.15.18:0/1648993882 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4010630 con 0x7feb04100070 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feafbe00640 1 -- 172.21.15.18:0/1648993882 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf4010cb0 con 0x7feb04100070 2024-04-21T22:43:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feafbe00640 1 -- 172.21.15.18:0/1648993882 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4018bd0 con 0x7feb04100070 2024-04-21T22:43:12.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.263+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0419f530 con 0x7feb04100070 2024-04-21T22:43:12.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.264+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb041a6dc0 con 0x7feb04100070 2024-04-21T22:43:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.269+0000 7feafbe00640 1 -- 172.21.15.18:0/1648993882 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7feaf40107d0 con 0x7feb04100070 2024-04-21T22:43:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.269+0000 7feb0d005740 1 Processor -- start 2024-04-21T22:43:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.269+0000 7feb0d005740 1 -- start start 2024-04-21T22:43:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 0x55b1bc82d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc788410 con 0x55b1bc8251e0 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc7307e0 con 0x55b1bc82ddc0 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb0d005740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc7843d0 con 0x55b1bc8248c0 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb03e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb03e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:43082/0 (socket says 172.21.15.18:43082) 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb03e00640 1 -- 172.21.15.18:0/3974335322 learned_addr learned my addr 172.21.15.18:0/3974335322 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb02a00640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.270+0000 7feb03400640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 0x55b1bc82d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 -- 172.21.15.18:0/3974335322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 msgr2=0x55b1bc8301b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8301b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 -- 172.21.15.18:0/3974335322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 msgr2=0x55b1bc82d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 0x55b1bc82d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 -- 172.21.15.18:0/3974335322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bc5667d0 con 0x55b1bc8248c0 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb02a00640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03400640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 0x55b1bc82d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:12.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feafbe00640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 0x7feae80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feb03e00640 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feafc009900 tx=0x7feafc005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52f4a21b29decef server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.271+0000 7feafbe00640 1 -- 172.21.15.18:0/1648993882 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7feaf40cfac0 con 0x7feb04100070 2024-04-21T22:43:12.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.272+0000 7feb03400640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 0x7feae80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.272+0000 7feaf3e00640 1 -- 172.21.15.18:0/3974335322 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc045070 con 0x55b1bc8248c0 2024-04-21T22:43:12.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.272+0000 7feaf3e00640 1 -- 172.21.15.18:0/3974335322 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feafc02c5c0 con 0x55b1bc8248c0 2024-04-21T22:43:12.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.272+0000 7feaf3e00640 1 -- 172.21.15.18:0/3974335322 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc0049b0 con 0x55b1bc8248c0 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 -- 172.21.15.18:0/3974335322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 msgr2=0x55b1bc824ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feafc009900 tx=0x7feafc005be0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb03400640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 0x7feae80a5240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaf40cd260 tx=0x7feaf400cf90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 -- 172.21.15.18:0/3974335322 shutdown_connections 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8251e0 0x55b1bc82d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 --2- 172.21.15.18:0/3974335322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc824ca0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 -- 172.21.15.18:0/3974335322 >> 172.21.15.18:0/3974335322 conn(0x55b1bc81eff0 msgr2=0x55b1bc81f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 -- 172.21.15.18:0/3974335322 shutdown_connections 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.273+0000 7feb0d005740 1 -- 172.21.15.18:0/3974335322 wait complete. 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.274+0000 7feb0d005740 1 -- start start 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.274+0000 7feb0d005740 1 Processor -- start 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc82b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc830b50 con 0x55b1bc8248c0 2024-04-21T22:43:12.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc743c40 con 0x55b1bc82ddc0 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1bc830cd0 con 0x55b1bc8251e0 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb0d005740 10 client.0 _ll_register_callbacks cb 0x55b1bc743630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb02a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb02a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:43084/0 (socket says 172.21.15.18:43084) 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb02a00640 1 -- 172.21.15.18:0/973330423 learned_addr learned my addr 172.21.15.18:0/973330423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.275+0000 7feb03e00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 -- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 msgr2=0x55b1bc82b900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc82b900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 -- 172.21.15.18:0/973330423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 msgr2=0x55b1bc82ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 -- 172.21.15.18:0/973330423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bc49c3f0 con 0x55b1bc8251e0 2024-04-21T22:43:12.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb03e00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:12.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feb02a00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7feaec013710 tx=0x7feaec009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68094404d07da9c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.276+0000 7feaf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec004030 con 0x55b1bc8251e0 2024-04-21T22:43:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7feaec0041d0 con 0x55b1bc8251e0 2024-04-21T22:43:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feafc02c5c0 con 0x55b1bc8251e0 2024-04-21T22:43:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7feaec0043d0 con 0x55b1bc8251e0 2024-04-21T22:43:12.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feb0d005740 10 client.27919 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.277+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b1bc45c0f0 con 0x55b1bc8251e0 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feafc02c5c0 con 0x55b1bc8251e0 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7feaec01a070 con 0x55b1bc8251e0 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 10 client.27919 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 10 client.27919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 20 client.27919 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8469d0 0x55b1bc848e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 4 client.27919 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1bc79bc40 con 0x55b1bc8469d0 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.278+0000 7feb03e00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8469d0 0x55b1bc848e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.279+0000 7feb03e00640 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8469d0 0x55b1bc848e50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716ba41ede1b0a8c server_cookie=66810b672a24b229 in_seq=0 out_seq=0 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.279+0000 7feaf0c00640 10 client.27919 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feaf0c00640 1 -- 172.21.15.18:0/973330423 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b1bc79bc40 con 0x55b1bc8469d0 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feaf0c00640 10 client.27919 handle_command_reply: tid=0 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 client.27919 shutdown 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 msgr2=0x55b1bc82b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7feaec013710 tx=0x7feaec009f90 comp rx=0 tx=0).stop 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 shutdown_connections 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc82b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8469d0 0x55b1bc848e50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc82b3c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 --2- 172.21.15.18:0/973330423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 >> 172.21.15.18:0/973330423 conn(0x55b1bc81eff0 msgr2=0x55b1bc820d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feaf0c00640 0 client.27919 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 shutdown_connections 2024-04-21T22:43:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.280+0000 7feb0d005740 1 -- 172.21.15.18:0/973330423 wait complete. 2024-04-21T22:43:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.281+0000 7feb0d005740 20 client.27919 trim_cache size 0 max 16384 2024-04-21T22:43:12.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.305+0000 7feb0d005740 1 Processor -- start 2024-04-21T22:43:12.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.305+0000 7feb0d005740 1 -- start start 2024-04-21T22:43:12.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.305+0000 7feb0d005740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.305+0000 7feb0d005740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb0d005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb0d005740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb041ab3e0 con 0x55b1bc8248c0 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb0d005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb041acf20 con 0x55b1bc82ddc0 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb0d005740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb041abab0 con 0x55b1bc8251e0 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:43096/0 (socket says 172.21.15.18:43096) 2024-04-21T22:43:12.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 -- 172.21.15.18:0/156111501 learned_addr learned my addr 172.21.15.18:0/156111501 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 -- 172.21.15.18:0/156111501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 msgr2=0x55b1bc8489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb03e00640 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 -- 172.21.15.18:0/156111501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 msgr2=0x55b1bc82d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb02a00640 1 -- 172.21.15.18:0/156111501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bc829e30 con 0x55b1bc8251e0 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.306+0000 7feb03e00640 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.307+0000 7feb02a00640 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feaec01b810 tx=0x7feaec009d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e1cb49864b7a4b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.307+0000 7feaf3400640 1 -- 172.21.15.18:0/156111501 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec030070 con 0x55b1bc8251e0 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.307+0000 7feaf3400640 1 -- 172.21.15.18:0/156111501 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaec01b3f0 con 0x55b1bc8251e0 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.307+0000 7feaf3400640 1 -- 172.21.15.18:0/156111501 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec027080 con 0x55b1bc8251e0 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 -- 172.21.15.18:0/156111501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 msgr2=0x55b1bc839a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feaec01b810 tx=0x7feaec009d50 comp rx=0 tx=0).stop 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 -- 172.21.15.18:0/156111501 shutdown_connections 2024-04-21T22:43:12.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc82ddc0 0x55b1bc8489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8251e0 0x55b1bc839a10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 --2- 172.21.15.18:0/156111501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc8248c0 0x55b1bc82d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 -- 172.21.15.18:0/156111501 >> 172.21.15.18:0/156111501 conn(0x55b1bc81eff0 msgr2=0x55b1bc82ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 -- 172.21.15.18:0/156111501 shutdown_connections 2024-04-21T22:43:12.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.308+0000 7feb0d005740 1 -- 172.21.15.18:0/156111501 wait complete. 2024-04-21T22:43:12.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.309+0000 7feb0d005740 1 -- start start 2024-04-21T22:43:12.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.309+0000 7feb0d005740 1 Processor -- start 2024-04-21T22:43:12.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.309+0000 7feb0d005740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc831900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.309+0000 7feb0d005740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb0d005740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 0x55b1bc832380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb0d005740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb041ac850 con 0x55b1bc82ddc0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb0d005740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb041ac180 con 0x55b1bc8251e0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb0d005740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb041a9420 con 0x55b1bc8248c0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb0d005740 10 client.0 _ll_register_callbacks cb 0x7feaec009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb03e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc831900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:52540/0 (socket says 172.21.15.18:52540) 2024-04-21T22:43:12.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 -- 172.21.15.18:0/4121952429 learned_addr learned my addr 172.21.15.18:0/4121952429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb03e00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 0x55b1bc832380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 -- 172.21.15.18:0/4121952429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 msgr2=0x55b1bc831900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc831900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 -- 172.21.15.18:0/4121952429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 msgr2=0x55b1bc832380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 0x55b1bc832380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb02a00640 1 -- 172.21.15.18:0/4121952429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bc8abf90 con 0x55b1bc8251e0 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.310+0000 7feb03e00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 0x55b1bc832380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:12.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feb02a00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feaec02e040 tx=0x7feaec01bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae72fb6543e41a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feaf0c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec030040 con 0x55b1bc8251e0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaec01b3f0 con 0x55b1bc8251e0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8615+0+0 (secure 0 0 0) 0x7feaec02b660 con 0x55b1bc8251e0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7feaec042050 con 0x55b1bc8251e0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feb0d005740 10 client.27860 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.311+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b1bc8ad170 con 0x55b1bc8251e0 2024-04-21T22:43:12.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaec01b3f0 con 0x55b1bc8251e0 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7feaec033050 con 0x55b1bc8251e0 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 10 client.27860 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 10 client.27860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 20 client.27860 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8ad820 0x55b1bc8afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 4 client.27860 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:43:12.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.312+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1bc795950 con 0x55b1bc8ad820 2024-04-21T22:43:12.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.313+0000 7feb03e00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8ad820 0x55b1bc8afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.313+0000 7feb03e00640 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8ad820 0x55b1bc8afc40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc2669bfab3af1c0 server_cookie=dcebeddf96efd5da in_seq=0 out_seq=0 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.313+0000 7feaf0c00640 10 client.27860 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.313+0000 7feaf0c00640 1 -- 172.21.15.18:0/4121952429 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b1bc795950 con 0x55b1bc8ad820 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.313+0000 7feaf0c00640 10 client.27860 handle_command_reply: tid=0 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 client.27860 shutdown 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 msgr2=0x55b1bc831e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feaec02e040 tx=0x7feaec01bc30 comp rx=0 tx=0).stop 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 shutdown_connections 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1bc82ddc0 0x55b1bc832380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55b1bc8251e0 0x55b1bc831e40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55b1bc8ad820 0x55b1bc8afc40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 --2- 172.21.15.18:0/4121952429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1bc8248c0 0x55b1bc831900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 >> 172.21.15.18:0/4121952429 conn(0x55b1bc81eff0 msgr2=0x55b1bc82b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feaf0c00640 0 client.27860 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 shutdown_connections 2024-04-21T22:43:12.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 1 -- 172.21.15.18:0/4121952429 wait complete. 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.314+0000 7feb0d005740 20 client.27860 trim_cache size 0 max 16384 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stdout: "753faf5e-2c18-4260-8888-9e54de854b05": { 2024-04-21T22:43:12.320 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:43:12.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "753faf5e-2c18-4260-8888-9e54de854b05", 2024-04-21T22:43:12.321 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:43:12.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:43:12.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:43:12.321 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 msgr2=0x7feae80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 0x7feae80a5240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaf40cd260 tx=0x7feaf400cf90 comp rx=0 tx=0).stop 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 msgr2=0x7feb0419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feaf400ebc0 tx=0x7feaf400c6a0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 shutdown_connections 2024-04-21T22:43:12.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feae80a2d80 0x7feae80a5240 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb04106870 0x7feb0419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb04100a30 0x7feb0419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 --2- 172.21.15.18:0/1648993882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb04100070 0x7feb0419a250 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 >> 172.21.15.18:0/1648993882 conn(0x7feb040758c0 msgr2=0x7feb041044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 shutdown_connections 2024-04-21T22:43:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:12.315+0000 7feb0a200640 1 -- 172.21.15.18:0/1648993882 wait complete. 2024-04-21T22:43:12.337 INFO:tasks.cephfs.filesystem:scrub status for tag:753faf5e-2c18-4260-8888-9e54de854b05 - {'path': '/', 'tag': '753faf5e-2c18-4260-8888-9e54de854b05', 'options': 'recursive,force'} 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:12.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:12.696 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:12 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:12.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:12.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:12 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:12.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:12.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:12 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:13 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:13.874 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.874 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:13.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:13.875 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:13 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:13.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:13.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:43:13.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:13 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:15.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:15 smithi047 ceph-mon[31561]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:15.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:15 smithi018 ceph-mon[26614]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:15 smithi081 ceph-mon[31692]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:17.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:17 smithi047 ceph-mon[31561]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:17.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:17 smithi018 ceph-mon[26614]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:17 smithi081 ceph-mon[31692]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:43:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:19 smithi047 ceph-mon[31561]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:19.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:19 smithi047 ceph-mon[31561]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T22:43:19.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:19 smithi018 ceph-mon[26614]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:19.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:19 smithi018 ceph-mon[26614]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T22:43:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:19 smithi081 ceph-mon[31692]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:19 smithi081 ceph-mon[31692]: osdmap e94: 12 total, 12 up, 12 in 2024-04-21T22:43:21.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:21 smithi047 ceph-mon[31561]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:21.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:21 smithi018 ceph-mon[26614]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:21.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:21 smithi081 ceph-mon[31692]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:23 smithi018 ceph-mon[26614]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:23.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:23 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:23 smithi081 ceph-mon[31692]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:23.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:23.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:23 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:23 smithi047 ceph-mon[31561]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-21T22:43:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:23.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:23 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:24.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:24 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:24.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:24 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:24.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:24 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:24.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:24 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:24.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:24 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:24.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:24 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:25.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:25 smithi018 ceph-mon[26614]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:25.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:25 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:43:25.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:25 smithi081 ceph-mon[31692]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:25.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:25 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:43:25.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:25 smithi047 ceph-mon[31561]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:25.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:25 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:43:26.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:26 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:43:26.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:26 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:43:26.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:26 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:43:26.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:26 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:43:26.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:26 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:43:26.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:26 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:43:26.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:26 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:43:26.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:26 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:43:26.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:26 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:43:27.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:27 smithi018 ceph-mon[26614]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:27 smithi081 ceph-mon[31692]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:27.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:27 smithi047 ceph-mon[31561]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-21T22:43:29.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:29 smithi018 ceph-mon[26614]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:43:29.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:29 smithi081 ceph-mon[31692]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:43:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:29 smithi047 ceph-mon[31561]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:43:31.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:31 smithi018 ceph-mon[26614]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:31 smithi081 ceph-mon[31692]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:31.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:31 smithi047 ceph-mon[31561]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:33.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:33 smithi018 ceph-mon[26614]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:33.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:33 smithi081 ceph-mon[31692]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:33.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:33 smithi047 ceph-mon[31561]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:35 smithi018 ceph-mon[26614]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:35 smithi081 ceph-mon[31692]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:35.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:35 smithi047 ceph-mon[31561]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:37.747 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:37 smithi047 ceph-mon[31561]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:37 smithi018 ceph-mon[26614]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:37 smithi081 ceph-mon[31692]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:39.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:39 smithi018 ceph-mon[26614]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:39 smithi081 ceph-mon[31692]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:39.951 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:39 smithi047 ceph-mon[31561]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:41 smithi018 ceph-mon[26614]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:41 smithi081 ceph-mon[31692]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:41.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:41 smithi047 ceph-mon[31561]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:42.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:43:42.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:43:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.566+0000 7fb45f200640 1 -- 172.21.15.18:0/3613449113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb46010bb40 msgr2=0x7fb46010dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.566+0000 7fb45f200640 1 --2- 172.21.15.18:0/3613449113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb46010bb40 0x7fb46010dfb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb458009900 tx=0x7fb45802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 -- 172.21.15.18:0/3613449113 shutdown_connections 2024-04-21T22:43:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 --2- 172.21.15.18:0/3613449113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb46010bb40 0x7fb46010dfb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 --2- 172.21.15.18:0/3613449113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb460103040 0x7fb46010b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 --2- 172.21.15.18:0/3613449113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460102720 0x7fb460102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 -- 172.21.15.18:0/3613449113 >> 172.21.15.18:0/3613449113 conn(0x7fb4600771f0 msgr2=0x7fb4600fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 -- 172.21.15.18:0/3613449113 shutdown_connections 2024-04-21T22:43:42.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.567+0000 7fb45f200640 1 -- 172.21.15.18:0/3613449113 wait complete. 2024-04-21T22:43:42.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.568+0000 7fb45f200640 1 Processor -- start 2024-04-21T22:43:42.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.568+0000 7fb45f200640 1 -- start start 2024-04-21T22:43:42.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.568+0000 7fb45f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 0x7fb46019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb46010bb40 0x7fb46019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb460111940 con 0x7fb46010bb40 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601117c0 con 0x7fb460103040 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb460111ac0 con 0x7fb460102720 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46200/0 (socket says 172.21.15.18:46200) 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 -- 172.21.15.18:0/2521224992 learned_addr learned my addr 172.21.15.18:0/2521224992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb46010bb40 0x7fb46019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45d400640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 0x7fb46019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 -- 172.21.15.18:0/2521224992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 msgr2=0x7fb46019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 0x7fb46019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 -- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb46010bb40 msgr2=0x7fb46019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb46010bb40 0x7fb46019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45de00640 1 -- 172.21.15.18:0/2521224992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46019f070 con 0x7fb460102720 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.569+0000 7fb45d400640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 0x7fb46019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:42.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb45de00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb45000eb90 tx=0x7fb45000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb456a00640 1 -- 172.21.15.18:0/2521224992 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450004d20 con 0x7fb460102720 2024-04-21T22:43:42.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb456a00640 1 -- 172.21.15.18:0/2521224992 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb45000ee90 con 0x7fb460102720 2024-04-21T22:43:42.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46019f360 con 0x7fb460102720 2024-04-21T22:43:42.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb456a00640 1 -- 172.21.15.18:0/2521224992 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450010830 con 0x7fb460102720 2024-04-21T22:43:42.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.570+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4601a6bf0 con 0x7fb460102720 2024-04-21T22:43:42.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.573+0000 7fb456a00640 1 -- 172.21.15.18:0/2521224992 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb450005020 con 0x7fb460102720 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.573+0000 7fb467fff740 1 Processor -- start 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 -- start start 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151093a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x5621510963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562150fee410 con 0x56215108aab0 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562150f967e0 con 0x56215108b3d0 2024-04-21T22:43:42.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb467fff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562150fea3d0 con 0x562151093fb0 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb45de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151093a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44290/0 (socket says 172.21.15.18:44290) 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb45e800640 1 -- 172.21.15.18:0/3611413139 learned_addr learned my addr 172.21.15.18:0/3611413139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.574+0000 7fb45d400640 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x5621510963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 -- 172.21.15.18:0/3611413139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 msgr2=0x5621510963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x5621510963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 -- 172.21.15.18:0/3611413139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 msgr2=0x562151093a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151093a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 -- 172.21.15.18:0/3611413139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562150dcc7d0 con 0x56215108aab0 2024-04-21T22:43:42.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45d400640 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x5621510963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:42.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb456a00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 0x7fb4440a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45e800640 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb45802c2d0 tx=0x7fb458005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6075efea3bddc2d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb456a00640 1 -- 172.21.15.18:0/2521224992 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fb4500cfbc0 con 0x7fb460102720 2024-04-21T22:43:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb44b400640 1 -- 172.21.15.18:0/3611413139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458043070 con 0x56215108aab0 2024-04-21T22:43:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb45de00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 0x7fb4440a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb44b400640 1 -- 172.21.15.18:0/3611413139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb45802c720 con 0x56215108aab0 2024-04-21T22:43:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.575+0000 7fb44b400640 1 -- 172.21.15.18:0/3611413139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580049b0 con 0x56215108aab0 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 -- 172.21.15.18:0/3611413139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 msgr2=0x56215108ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb45802c2d0 tx=0x7fb458005e70 comp rx=0 tx=0).stop 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb45de00640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 0x7fb4440a51c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56215108a580 tx=0x7fb4500d3670 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 -- 172.21.15.18:0/3611413139 shutdown_connections 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x5621510963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151093a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 --2- 172.21.15.18:0/3611413139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x56215108ae90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 -- 172.21.15.18:0/3611413139 >> 172.21.15.18:0/3611413139 conn(0x5621510851e0 msgr2=0x5621510855c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.576+0000 7fb467fff740 1 -- 172.21.15.18:0/3611413139 shutdown_connections 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.577+0000 7fb467fff740 1 -- 172.21.15.18:0/3611413139 wait complete. 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.577+0000 7fb467fff740 1 -- start start 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.577+0000 7fb467fff740 1 Processor -- start 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151091500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x562151091a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562151096d40 con 0x56215108aab0 2024-04-21T22:43:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x562150fa9c40 con 0x56215108b3d0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562151096ec0 con 0x562151093fb0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb467fff740 10 client.0 _ll_register_callbacks cb 0x562150fa9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151091500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44294/0 (socket says 172.21.15.18:44294) 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 -- 172.21.15.18:0/299340935 learned_addr learned my addr 172.21.15.18:0/299340935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x562151091a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 -- 172.21.15.18:0/299340935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 msgr2=0x562151091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x562151091a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 -- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 msgr2=0x562151091500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.578+0000 7fb45e800640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151091500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb45e800640 1 -- 172.21.15.18:0/299340935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562150d023f0 con 0x56215108aab0 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb45d400640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151091500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb45e800640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb45802cc60 tx=0x7fb45802ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7db4ddf9e59aba server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb43fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458053060 con 0x56215108aab0 2024-04-21T22:43:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fb4580051c0 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.579+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562151001c40 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb458043050 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 10 client.17793 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562150cc20f0 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562151001c40 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb458048cd0 con 0x56215108aab0 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 10 client.17793 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 20 client.17793 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5621510a4140 0x5621510a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 4 client.17793 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.580+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562150ffb950 con 0x5621510a4140 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.581+0000 7fb45d400640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5621510a4140 0x5621510a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.581+0000 7fb45d400640 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5621510a4140 0x5621510a6530 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e93374e2bdb8935 server_cookie=2965a6b5fbb2005f in_seq=0 out_seq=0 2024-04-21T22:43:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.581+0000 7fb43fe00640 10 client.17793 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:42.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb43fe00640 1 -- 172.21.15.18:0/299340935 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562150ffb950 con 0x5621510a4140 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb43fe00640 10 client.17793 handle_command_reply: tid=0 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 client.17793 shutdown 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 msgr2=0x562151090fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb45802cc60 tx=0x7fb45802ce40 comp rx=0 tx=0).stop 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 shutdown_connections 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5621510a4140 0x5621510a6530 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x562151091a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x562151091500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 --2- 172.21.15.18:0/299340935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108aab0 0x562151090fc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb43fe00640 0 client.17793 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.582+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 >> 172.21.15.18:0/299340935 conn(0x5621510851e0 msgr2=0x562151084440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.583+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 shutdown_connections 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.583+0000 7fb467fff740 1 -- 172.21.15.18:0/299340935 wait complete. 2024-04-21T22:43:42.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.583+0000 7fb467fff740 20 client.17793 trim_cache size 0 max 16384 2024-04-21T22:43:42.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.602+0000 7fb467fff740 1 Processor -- start 2024-04-21T22:43:42.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.602+0000 7fb467fff740 1 -- start start 2024-04-21T22:43:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 0x5621510936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x56215108e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601af540 con 0x56215108b3d0 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b1080 con 0x56215108aab0 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb467fff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601afc10 con 0x562151093fb0 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 0x5621510936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 0x5621510936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57452/0 (socket says 172.21.15.18:57452) 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44306/0 (socket says 172.21.15.18:44306) 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45e800640 1 -- 172.21.15.18:0/2417265265 learned_addr learned my addr 172.21.15.18:0/2417265265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.603+0000 7fb45e800640 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x56215108e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 -- 172.21.15.18:0/2417265265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 msgr2=0x56215108e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x56215108e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 -- 172.21.15.18:0/2417265265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 msgr2=0x5621510936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 0x5621510936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 -- 172.21.15.18:0/2417265265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562151091f90 con 0x56215108b3d0 2024-04-21T22:43:42.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb45d400640 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x562151096ff0 tx=0x7fb44c0044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a852f4ef1e225f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb44aa00640 1 -- 172.21.15.18:0/2417265265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c020640 con 0x56215108b3d0 2024-04-21T22:43:42.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb44aa00640 1 -- 172.21.15.18:0/2417265265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44c0207e0 con 0x56215108b3d0 2024-04-21T22:43:42.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.604+0000 7fb44aa00640 1 -- 172.21.15.18:0/2417265265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011900 con 0x56215108b3d0 2024-04-21T22:43:42.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- 172.21.15.18:0/2417265265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 msgr2=0x562151090120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x562151096ff0 tx=0x7fb44c0044d0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- 172.21.15.18:0/2417265265 shutdown_connections 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562151093fb0 0x56215108e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56215108b3d0 0x562151090120 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 --2- 172.21.15.18:0/2417265265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108aab0 0x5621510936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- 172.21.15.18:0/2417265265 >> 172.21.15.18:0/2417265265 conn(0x5621510851e0 msgr2=0x56215108b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- 172.21.15.18:0/2417265265 shutdown_connections 2024-04-21T22:43:42.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- 172.21.15.18:0/2417265265 wait complete. 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.605+0000 7fb467fff740 1 -- start start 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 Processor -- start 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56215108aab0 0x5621510a6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x5621510a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b09b0 con 0x562151093fb0 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601b02e0 con 0x56215108b3d0 2024-04-21T22:43:42.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4601ad540 con 0x56215108aab0 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb467fff740 10 client.0 _ll_register_callbacks cb 0x7fb458009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.606+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x5621510a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44310/0 (socket says 172.21.15.18:44310) 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45e800640 1 -- 172.21.15.18:0/1563676125 learned_addr learned my addr 172.21.15.18:0/1563676125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45e800640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56215108aab0 0x5621510a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 -- 172.21.15.18:0/1563676125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56215108aab0 msgr2=0x5621510a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56215108aab0 0x5621510a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 -- 172.21.15.18:0/1563676125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 msgr2=0x562151108310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 -- 172.21.15.18:0/1563676125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621510a7340 con 0x56215108b3d0 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45e800640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb45d400640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x5621510a6a70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb44c011480 tx=0x7fb44c009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32b63d25ea20543 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.607+0000 7fb43fe00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c005040 con 0x56215108b3d0 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb44c0207e0 con 0x56215108b3d0 2024-04-21T22:43:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fb44c0051e0 con 0x56215108b3d0 2024-04-21T22:43:42.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb44c005420 con 0x56215108b3d0 2024-04-21T22:43:42.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb467fff740 10 client.27878 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:42.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562151109960 con 0x56215108b3d0 2024-04-21T22:43:42.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb44c0207e0 con 0x56215108b3d0 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.608+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fb44c0038c0 con 0x56215108b3d0 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 10 client.27878 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 10 client.27878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 20 client.27878 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562151109f70 0x56215110c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 4 client.27878 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:43:42.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562150ff5ca0 con 0x562151109f70 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb45e800640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562151109f70 0x56215110c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb45e800640 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562151109f70 0x56215110c390 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a15668a7da8dff1 server_cookie=4f45e96130a370f3 in_seq=0 out_seq=0 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.609+0000 7fb43fe00640 10 client.27878 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb43fe00640 1 -- 172.21.15.18:0/1563676125 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562150ff5ca0 con 0x562151109f70 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb43fe00640 10 client.27878 handle_command_reply: tid=0 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 client.27878 shutdown 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 msgr2=0x5621510a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x5621510a6a70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb44c011480 tx=0x7fb44c009eb0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 shutdown_connections 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562151093fb0 0x562151108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56215108b3d0 0x5621510a6a70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x562151109f70 0x56215110c390 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 --2- 172.21.15.18:0/1563676125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56215108aab0 0x5621510a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 >> 172.21.15.18:0/1563676125 conn(0x5621510851e0 msgr2=0x562151090120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb43fe00640 0 client.27878 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 shutdown_connections 2024-04-21T22:43:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 1 -- 172.21.15.18:0/1563676125 wait complete. 2024-04-21T22:43:42.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.610+0000 7fb467fff740 20 client.27878 trim_cache size 0 max 16384 2024-04-21T22:43:42.619 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:43:42.619 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:43:42.619 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 msgr2=0x7fb4440a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 0x7fb4440a51c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56215108a580 tx=0x7fb4500d3670 comp rx=0 tx=0).stop 2024-04-21T22:43:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 msgr2=0x7fb46019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb45000eb90 tx=0x7fb45000c6a0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 shutdown_connections 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb4440a2d00 0x7fb4440a51c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb46010bb40 0x7fb46019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb460103040 0x7fb46019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 --2- 172.21.15.18:0/2521224992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb460102720 0x7fb46019a080 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 >> 172.21.15.18:0/2521224992 conn(0x7fb4600771f0 msgr2=0x7fb4601002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 shutdown_connections 2024-04-21T22:43:42.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.611+0000 7fb45f200640 1 -- 172.21.15.18:0/2521224992 wait complete. 2024-04-21T22:43:42.629 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:43:42.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:43:42.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 -- 172.21.15.18:0/659156852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc107ef0 msgr2=0x7fecdc1082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 --2- 172.21.15.18:0/659156852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc107ef0 0x7fecdc1082d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7feccc009900 tx=0x7feccc02bc30 comp rx=0 tx=0).stop 2024-04-21T22:43:42.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 -- 172.21.15.18:0/659156852 shutdown_connections 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 --2- 172.21.15.18:0/659156852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc10cf70 0x7fecdc114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 --2- 172.21.15.18:0/659156852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1088a0 0x7fecdc10c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 --2- 172.21.15.18:0/659156852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc107ef0 0x7fecdc1082d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 -- 172.21.15.18:0/659156852 >> 172.21.15.18:0/659156852 conn(0x7fecdc077510 msgr2=0x7fecdc106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 -- 172.21.15.18:0/659156852 shutdown_connections 2024-04-21T22:43:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.839+0000 7fece1c00640 1 -- 172.21.15.18:0/659156852 wait complete. 2024-04-21T22:43:42.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.840+0000 7fece1c00640 1 Processor -- start 2024-04-21T22:43:42.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 -- start start 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc10cf70 0x7fecdc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 0x7fecdc1a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc118070 con 0x7fecdc1a2da0 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc117ef0 con 0x7fecdc107ef0 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc1181f0 con 0x7fecdc10cf70 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fecdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fecdb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc10cf70 0x7fecdc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fecdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57482/0 (socket says 172.21.15.18:57482) 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fecdbe00640 1 -- 172.21.15.18:0/3141855298 learned_addr learned my addr 172.21.15.18:0/3141855298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.841+0000 7fece1200640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 0x7fecdc1a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 -- 172.21.15.18:0/3141855298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc10cf70 msgr2=0x7fecdc19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc10cf70 0x7fecdc19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 -- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 msgr2=0x7fecdc1a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 0x7fecdc1a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 -- 172.21.15.18:0/3141855298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc1a3890 con 0x7fecdc107ef0 2024-04-21T22:43:42.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fece1200640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 0x7fecdc1a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecdbe00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feccc02c240 tx=0x7feccc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.842+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc043020 con 0x7fecdc107ef0 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.843+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feccc0054e0 con 0x7fecdc107ef0 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.843+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc003b50 con 0x7fecdc107ef0 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.843+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc1a3b20 con 0x7fecdc107ef0 2024-04-21T22:43:42.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.843+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc1ab2f0 con 0x7fecdc107ef0 2024-04-21T22:43:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.844+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc04f570 con 0x7fecdc107ef0 2024-04-21T22:43:42.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.846+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7feccc046020 con 0x7fecdc107ef0 2024-04-21T22:43:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.847+0000 7fecd8c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 0x7fecc00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.847+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7feccc0f1570 con 0x7fecdc107ef0 2024-04-21T22:43:42.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.848+0000 7fecdb400640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 0x7fecc00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:42.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.848+0000 7fecdb400640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 0x7fecc00a5230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fecdc10e3c0 tx=0x7fecc8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:42.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:42.850+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7feccc04d020 con 0x7fecdc107ef0 2024-04-21T22:43:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.094+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecdc110170 con 0x7fecdc107ef0 2024-04-21T22:43:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.095+0000 7fecd8c00640 1 -- 172.21.15.18:0/3141855298 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7feccc0be210 con 0x7fecdc107ef0 2024-04-21T22:43:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:43:43.097 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:43:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:43:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.097+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 msgr2=0x7fecc00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.097+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 0x7fecc00a5230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fecdc10e3c0 tx=0x7fecc8005f90 comp rx=0 tx=0).stop 2024-04-21T22:43:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.097+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 msgr2=0x7fecdc19e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.097+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feccc02c240 tx=0x7feccc0042f0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 shutdown_connections 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fecc00a2d70 0x7fecc00a5230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecdc1a2da0 0x7fecdc1a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc10cf70 0x7fecdc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 --2- 172.21.15.18:0/3141855298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecdc107ef0 0x7fecdc19e530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 >> 172.21.15.18:0/3141855298 conn(0x7fecdc077510 msgr2=0x7fecdc0790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 shutdown_connections 2024-04-21T22:43:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.098+0000 7fece1c00640 1 -- 172.21.15.18:0/3141855298 wait complete. 2024-04-21T22:43:43.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:43:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 -- 172.21.15.18:0/2810885581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c074430 msgr2=0x7fae3c10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 --2- 172.21.15.18:0/2810885581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c074430 0x7fae3c10d8a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fae28009900 tx=0x7fae2802bcc0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 -- 172.21.15.18:0/2810885581 shutdown_connections 2024-04-21T22:43:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 --2- 172.21.15.18:0/2810885581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 --2- 172.21.15.18:0/2810885581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c074430 0x7fae3c10d8a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 --2- 172.21.15.18:0/2810885581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c073b10 0x7fae3c073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 -- 172.21.15.18:0/2810885581 >> 172.21.15.18:0/2810885581 conn(0x7fae3c0fd090 msgr2=0x7fae3c0ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 -- 172.21.15.18:0/2810885581 shutdown_connections 2024-04-21T22:43:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.329+0000 7fae3b200640 1 -- 172.21.15.18:0/2810885581 wait complete. 2024-04-21T22:43:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.330+0000 7fae3b200640 1 Processor -- start 2024-04-21T22:43:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.330+0000 7fae3b200640 1 -- start start 2024-04-21T22:43:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 0x7fae3c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c113b60 con 0x7fae3c074430 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1139e0 con 0x7fae3c073b10 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c113ce0 con 0x7fae3c10dde0 2024-04-21T22:43:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44344/0 (socket says 172.21.15.18:44344) 2024-04-21T22:43:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae39e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 0x7fae3c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae39400640 1 -- 172.21.15.18:0/3888299620 learned_addr learned my addr 172.21.15.18:0/3888299620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.331+0000 7fae3a800640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 -- 172.21.15.18:0/3888299620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 msgr2=0x7fae3c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 -- 172.21.15.18:0/3888299620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 msgr2=0x7fae3c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 0x7fae3c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 -- 172.21.15.18:0/3888299620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c19f0b0 con 0x7fae3c074430 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39e00640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 0x7fae3c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae3a800640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae39400640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fae28036040 tx=0x7fae2802cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae32a00640 1 -- 172.21.15.18:0/3888299620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28043020 con 0x7fae3c074430 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae32a00640 1 -- 172.21.15.18:0/3888299620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae280054e0 con 0x7fae3c074430 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c19f340 con 0x7fae3c074430 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae32a00640 1 -- 172.21.15.18:0/3888299620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28003c20 con 0x7fae3c074430 2024-04-21T22:43:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.332+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c1a6c30 con 0x7fae3c074430 2024-04-21T22:43:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.336+0000 7fae43f9a740 1 Processor -- start 2024-04-21T22:43:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.336+0000 7fae43f9a740 1 -- start start 2024-04-21T22:43:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae32a00640 1 -- 172.21.15.18:0/3888299620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fae28046020 con 0x7fae3c074430 2024-04-21T22:43:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2daa470 0x561df2dac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561df2d053a0 con 0x561df2da1890 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561df2cad930 con 0x561df2daa470 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae43f9a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561df2d01360 con 0x561df2da0f70 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae39e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae3a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae39400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2daa470 0x561df2dac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae39e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44354/0 (socket says 172.21.15.18:44354) 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae3a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46294/0 (socket says 172.21.15.18:46294) 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae39e00640 1 -- 172.21.15.18:0/2909606960 learned_addr learned my addr 172.21.15.18:0/2909606960 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae3a800640 1 -- 172.21.15.18:0/2909606960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2daa470 msgr2=0x561df2dac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.337+0000 7fae3a800640 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2daa470 0x561df2dac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae3a800640 1 -- 172.21.15.18:0/2909606960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 msgr2=0x561df2da9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae3a800640 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae3a800640 1 -- 172.21.15.18:0/2909606960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df2a193f0 con 0x561df2da0f70 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae39e00640 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae3a800640 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fae3c074a60 tx=0x7fae34011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cba11fcc4ff726 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae27400640 1 -- 172.21.15.18:0/2909606960 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34004310 con 0x561df2da0f70 2024-04-21T22:43:43.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae27400640 1 -- 172.21.15.18:0/2909606960 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae340044b0 con 0x561df2da0f70 2024-04-21T22:43:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae27400640 1 -- 172.21.15.18:0/2909606960 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340035f0 con 0x561df2da0f70 2024-04-21T22:43:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.338+0000 7fae32a00640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 0x7fae200a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae32a00640 1 -- 172.21.15.18:0/3888299620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fae280f1380 con 0x7fae3c074430 2024-04-21T22:43:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae39e00640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 0x7fae200a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 -- 172.21.15.18:0/2909606960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 msgr2=0x561df2da1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fae3c074a60 tx=0x7fae34011810 comp rx=0 tx=0).stop 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 -- 172.21.15.18:0/2909606960 shutdown_connections 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2daa470 0x561df2dac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da1890 0x561df2da9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2909606960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da1350 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 -- 172.21.15.18:0/2909606960 >> 172.21.15.18:0/2909606960 conn(0x561df2d9b6a0 msgr2=0x561df2d9ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae39e00640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 0x7fae200a5240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x561df2da0a40 tx=0x7fae2c009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.339+0000 7fae43f9a740 1 -- 172.21.15.18:0/2909606960 shutdown_connections 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.340+0000 7fae43f9a740 1 -- 172.21.15.18:0/2909606960 wait complete. 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.340+0000 7fae43f9a740 1 -- start start 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.340+0000 7fae43f9a740 1 Processor -- start 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da0f70 0x561df2da74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2da7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561df2dad260 con 0x561df2da0f70 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x561df2cc0d80 con 0x561df2da1890 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561df2dad3e0 con 0x561df2daa470 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae43f9a740 10 client.0 _ll_register_callbacks cb 0x561df2cfd2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae39e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da0f70 0x561df2da74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46310/0 (socket says 172.21.15.18:46310) 2024-04-21T22:43:43.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 -- 172.21.15.18:0/2080665734 learned_addr learned my addr 172.21.15.18:0/2080665734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae39400640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2da7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 -- 172.21.15.18:0/2080665734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 msgr2=0x561df2da7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2da7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 -- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da0f70 msgr2=0x561df2da74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da0f70 0x561df2da74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.341+0000 7fae3a800640 1 -- 172.21.15.18:0/2080665734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df2ae37d0 con 0x561df2daa470 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae3a800640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fae34005bc0 tx=0x7fae34004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65dfe044027b5066 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae1be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:43.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34029070 con 0x561df2daa470 2024-04-21T22:43:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae340044b0 con 0x561df2daa470 2024-04-21T22:43:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fae34003a00 con 0x561df2daa470 2024-04-21T22:43:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae34035050 con 0x561df2daa470 2024-04-21T22:43:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae43f9a740 10 client.27961 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.342+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561df2db95a0 con 0x561df2daa470 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae340044b0 con 0x561df2daa470 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fae34023430 con 0x561df2daa470 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 10 client.27961 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 10 client.27961 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 20 client.27961 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2dba950 0x561df2dbcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 4 client.27961 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561df2d128e0 con 0x561df2dba950 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.343+0000 7fae39e00640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2dba950 0x561df2dbcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.344+0000 7fae39e00640 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2dba950 0x561df2dbcd40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e4474db0796182d0 server_cookie=5362cdeb29f0230f in_seq=0 out_seq=0 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.344+0000 7fae1be00640 10 client.27961 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae1be00640 1 -- 172.21.15.18:0/2080665734 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561df2d128e0 con 0x561df2dba950 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae1be00640 10 client.27961 handle_command_reply: tid=0 2024-04-21T22:43:43.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 client.27961 shutdown 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 msgr2=0x561df2da7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fae34005bc0 tx=0x7fae34004970 comp rx=0 tx=0).stop 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 shutdown_connections 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2dba950 0x561df2dbcd40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2daa470 0x561df2da7f40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2da7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae1be00640 0 client.27961 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2080665734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2da0f70 0x561df2da74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 >> 172.21.15.18:0/2080665734 conn(0x561df2d9b6a0 msgr2=0x561df2d9d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 shutdown_connections 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 1 -- 172.21.15.18:0/2080665734 wait complete. 2024-04-21T22:43:43.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.345+0000 7fae43f9a740 20 client.27961 trim_cache size 0 max 16384 2024-04-21T22:43:43.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 Processor -- start 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 -- start start 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2db6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2dc24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1af630 con 0x561df2daa470 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1b1170 con 0x561df2da1890 2024-04-21T22:43:43.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.360+0000 7fae43f9a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1afd00 con 0x561df2da0f70 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46314/0 (socket says 172.21.15.18:46314) 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 -- 172.21.15.18:0/1337027645 learned_addr learned my addr 172.21.15.18:0/1337027645 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39400640 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2db6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae3a800640 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2dc24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 -- 172.21.15.18:0/1337027645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 msgr2=0x561df2db6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2db6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 -- 172.21.15.18:0/1337027645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 msgr2=0x561df2dc24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2dc24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 -- 172.21.15.18:0/1337027645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df2dac860 con 0x561df2da0f70 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.361+0000 7fae39e00640 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x561df2dbd450 tx=0x7fae2c01b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c2184b288997aab server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.362+0000 7fae26a00640 1 -- 172.21.15.18:0/1337027645 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c004540 con 0x561df2da0f70 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.362+0000 7fae26a00640 1 -- 172.21.15.18:0/1337027645 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae2c02b890 con 0x561df2da0f70 2024-04-21T22:43:43.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.362+0000 7fae26a00640 1 -- 172.21.15.18:0/1337027645 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c02ab90 con 0x561df2da0f70 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.362+0000 7fae43f9a740 1 -- 172.21.15.18:0/1337027645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 msgr2=0x561df2da9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.362+0000 7fae43f9a740 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x561df2dbd450 tx=0x7fae2c01b000 comp rx=0 tx=0).stop 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 -- 172.21.15.18:0/1337027645 shutdown_connections 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2dc24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da1890 0x561df2db6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 --2- 172.21.15.18:0/1337027645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da0f70 0x561df2da9bf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 -- 172.21.15.18:0/1337027645 >> 172.21.15.18:0/1337027645 conn(0x561df2d9b6a0 msgr2=0x561df2da64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 -- 172.21.15.18:0/1337027645 shutdown_connections 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 -- 172.21.15.18:0/1337027645 wait complete. 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 -- start start 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.363+0000 7fae43f9a740 1 Processor -- start 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 0x561df2db2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 0x561df2db2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1b0aa0 con 0x561df2daa470 2024-04-21T22:43:43.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1b03d0 con 0x561df2da0f70 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1ad630 con 0x561df2da1890 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae43f9a740 10 client.0 _ll_register_callbacks cb 0x7fae2c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae3a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae39400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 0x561df2db2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae3a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44372/0 (socket says 172.21.15.18:44372) 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae3a800640 1 -- 172.21.15.18:0/2816654981 learned_addr learned my addr 172.21.15.18:0/2816654981 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.364+0000 7fae39e00640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 0x561df2db2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 -- 172.21.15.18:0/2816654981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 msgr2=0x561df2db2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 0x561df2db2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 -- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 msgr2=0x561df2da3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 -- 172.21.15.18:0/2816654981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df2da44e0 con 0x561df2da1890 2024-04-21T22:43:43.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae3a800640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39e00640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 0x561df2db2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae39400640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 0x561df2db2ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fae280eeb50 tx=0x7fae280035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9fdfe4e3c907a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae1be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280bd460 con 0x561df2da1890 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7fae280b9f90 con 0x561df2da1890 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae2c02b890 con 0x561df2da1890 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae280bd280 con 0x561df2da1890 2024-04-21T22:43:43.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.365+0000 7fae43f9a740 10 client.27967 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561df2e209b0 con 0x561df2da1890 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae2c02b890 con 0x561df2da1890 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fae280eecc0 con 0x561df2da1890 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 10 client.27967 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 10 client.27967 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:43:43.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 20 client.27967 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2e21130 0x561df2e23550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 4 client.27967 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561df2d0cc30 con 0x561df2e21130 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.366+0000 7fae39e00640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2e21130 0x561df2e23550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae39e00640 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2e21130 0x561df2e23550 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ef19ab614021f46e server_cookie=a4888c2e6f3706e7 in_seq=0 out_seq=0 2024-04-21T22:43:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae1be00640 10 client.27967 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae1be00640 1 -- 172.21.15.18:0/2816654981 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561df2d0cc30 con 0x561df2e21130 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae1be00640 10 client.27967 handle_command_reply: tid=0 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 client.27967 shutdown 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 msgr2=0x561df2db2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 0x561df2db2ba0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fae280eeb50 tx=0x7fae280035f0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 shutdown_connections 2024-04-21T22:43:43.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x561df2e21130 0x561df2e23550 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561df2daa470 0x561df2da3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561df2da1890 0x561df2db2ba0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae1be00640 0 client.27967 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 --2- 172.21.15.18:0/2816654981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x561df2da0f70 0x561df2db2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.367+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 >> 172.21.15.18:0/2816654981 conn(0x561df2d9b6a0 msgr2=0x561df2da5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 shutdown_connections 2024-04-21T22:43:43.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae43f9a740 1 -- 172.21.15.18:0/2816654981 wait complete. 2024-04-21T22:43:43.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae43f9a740 20 client.27967 trim_cache size 0 max 16384 2024-04-21T22:43:43.381 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 msgr2=0x7fae200a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 0x7fae200a5240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x561df2da0a40 tx=0x7fae2c009500 comp rx=0 tx=0).stop 2024-04-21T22:43:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 msgr2=0x7fae3c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fae28036040 tx=0x7fae2802cbc0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 shutdown_connections 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae200a2d80 0x7fae200a5240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3c10dde0 0x7fae3c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae3c074430 0x7fae3c19a600 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 --2- 172.21.15.18:0/3888299620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae3c073b10 0x7fae3c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.368+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 >> 172.21.15.18:0/3888299620 conn(0x7fae3c0fd090 msgr2=0x7fae3c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.369+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 shutdown_connections 2024-04-21T22:43:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.369+0000 7fae3b200640 1 -- 172.21.15.18:0/3888299620 wait complete. 2024-04-21T22:43:43.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:43:43.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 -- 172.21.15.18:0/1510969940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 msgr2=0x7f40b010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 --2- 172.21.15.18:0/1510969940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b010dfe0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009930 tx=0x7f40a002bc20 comp rx=0 tx=0).stop 2024-04-21T22:43:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 -- 172.21.15.18:0/1510969940 shutdown_connections 2024-04-21T22:43:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 --2- 172.21.15.18:0/1510969940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0108640 0x7f40b01149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 --2- 172.21.15.18:0/1510969940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0107c80 0x7f40b0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 --2- 172.21.15.18:0/1510969940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b010dfe0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 -- 172.21.15.18:0/1510969940 >> 172.21.15.18:0/1510969940 conn(0x7f40b0077550 msgr2=0x7f40b0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 -- 172.21.15.18:0/1510969940 shutdown_connections 2024-04-21T22:43:43.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.608+0000 7f40afe00640 1 -- 172.21.15.18:0/1510969940 wait complete. 2024-04-21T22:43:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 Processor -- start 2024-04-21T22:43:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 -- start start 2024-04-21T22:43:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 0x7f40b019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b01a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0117f50 con 0x7f40b0108640 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0117dd0 con 0x7f40b010dc00 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.609+0000 7f40afe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01180d0 con 0x7f40b0107c80 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 0x7f40b019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44384/0 (socket says 172.21.15.18:44384) 2024-04-21T22:43:43.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40a7e00640 1 -- 172.21.15.18:0/3610127480 learned_addr learned my addr 172.21.15.18:0/3610127480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40af400640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b01a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 -- 172.21.15.18:0/3610127480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 msgr2=0x7f40b01a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b01a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 -- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 msgr2=0x7f40b019e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 -- 172.21.15.18:0/3610127480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b01a33d0 con 0x7f40b0107c80 2024-04-21T22:43:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.610+0000 7f40aea00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 0x7f40b019e430 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40a0036040 tx=0x7f40a0004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.611+0000 7f40a7400640 1 -- 172.21.15.18:0/3610127480 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0043020 con 0x7f40b0107c80 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.611+0000 7f40a7400640 1 -- 172.21.15.18:0/3610127480 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a0005000 con 0x7f40b0107c80 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.611+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b01a3660 con 0x7f40b0107c80 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.611+0000 7f40a7400640 1 -- 172.21.15.18:0/3610127480 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0003a50 con 0x7f40b0107c80 2024-04-21T22:43:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.611+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b01aaf50 con 0x7f40b0107c80 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.614+0000 7f40b83f2740 1 Processor -- start 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.614+0000 7f40a7400640 1 -- 172.21.15.18:0/3610127480 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f40a0046020 con 0x7f40b0107c80 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.614+0000 7f40b83f2740 1 -- start start 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28baf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 0x5621c28bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5621c28163a0 con 0x5621c28b2890 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5621c27be930 con 0x5621c28bb470 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40b83f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5621c2812360 con 0x5621c28b1f70 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40aea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28baf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 0x5621c28bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40aea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28baf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44388/0 (socket says 172.21.15.18:44388) 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40aea00640 1 -- 172.21.15.18:0/3519525848 learned_addr learned my addr 172.21.15.18:0/3519525848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.615+0000 7f40af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 -- 172.21.15.18:0/3519525848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 msgr2=0x5621c28b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 -- 172.21.15.18:0/3519525848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 msgr2=0x5621c28baf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28baf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 -- 172.21.15.18:0/3519525848 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c252a3f0 con 0x5621c28bb470 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 0x5621c28bd860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40980114c0 tx=0x7f4098011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea4d8d3169af6aa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7400640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 0x7f40940a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f409fe00640 1 -- 172.21.15.18:0/3519525848 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098004030 con 0x5621c28bb470 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f409fe00640 1 -- 172.21.15.18:0/3519525848 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40980041d0 con 0x5621c28bb470 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f409fe00640 1 -- 172.21.15.18:0/3519525848 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409800f960 con 0x5621c28bb470 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.616+0000 7f40a7400640 1 -- 172.21.15.18:0/3610127480 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f40a00f11a0 con 0x7f40b0107c80 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40af400640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 0x7f40940a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 -- 172.21.15.18:0/3519525848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 msgr2=0x5621c28bd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 0x5621c28bd860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40980114c0 tx=0x7f4098011980 comp rx=0 tx=0).stop 2024-04-21T22:43:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 -- 172.21.15.18:0/3519525848 shutdown_connections 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28bb470 0x5621c28bd860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28baf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3519525848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 -- 172.21.15.18:0/3519525848 >> 172.21.15.18:0/3519525848 conn(0x5621c28ac6a0 msgr2=0x5621c28aca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 -- 172.21.15.18:0/3519525848 shutdown_connections 2024-04-21T22:43:43.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40af400640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 0x7f40940a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f40a8005fd0 tx=0x7f40a8009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.617+0000 7f40b83f2740 1 -- 172.21.15.18:0/3519525848 wait complete. 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.618+0000 7f40b83f2740 1 -- start start 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.618+0000 7f40b83f2740 1 Processor -- start 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.618+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.618+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.618+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40b83f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5621c28be260 con 0x5621c28bb470 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40b83f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5621c27d1d80 con 0x5621c28b2890 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40b83f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5621c28be3e0 con 0x5621c28b1f70 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40b83f2740 10 client.0 _ll_register_callbacks cb 0x5621c280e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40aea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57554/0 (socket says 172.21.15.18:57554) 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 -- 172.21.15.18:0/38027014 learned_addr learned my addr 172.21.15.18:0/38027014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 -- 172.21.15.18:0/38027014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 msgr2=0x5621c28b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 -- 172.21.15.18:0/38027014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 msgr2=0x5621c28b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.619+0000 7f40a7e00640 1 -- 172.21.15.18:0/38027014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c25f47d0 con 0x5621c28b2890 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f40a7e00640 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4098009620 tx=0x7f4098005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68ae5e937d928 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f409cc00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098027070 con 0x5621c28b2890 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40980041d0 con 0x5621c28b2890 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f4098004380 con 0x5621c28b2890 2024-04-21T22:43:43.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4098033050 con 0x5621c28b2890 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f40b83f2740 10 client.27914 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5621c28ca550 con 0x5621c28b2890 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.620+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40980041d0 con 0x5621c28b2890 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4098004a50 con 0x5621c28b2890 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 10 client.27914 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 10 client.27914 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:43:43.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 20 client.27914 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c28cb960 0x5621c28cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 4 client.27914 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621c28238e0 con 0x5621c28cb960 2024-04-21T22:43:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.621+0000 7f40aea00640 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c28cb960 0x5621c28cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.622+0000 7f40aea00640 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c28cb960 0x5621c28cdd50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=71a997aba3a456e8 server_cookie=3be7ae29df1896e3 in_seq=0 out_seq=0 2024-04-21T22:43:43.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.622+0000 7f409cc00640 10 client.27914 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:43.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f409cc00640 1 -- 172.21.15.18:0/38027014 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621c28238e0 con 0x5621c28cb960 2024-04-21T22:43:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f409cc00640 10 client.27914 handle_command_reply: tid=0 2024-04-21T22:43:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 client.27914 shutdown 2024-04-21T22:43:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 msgr2=0x5621c28b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4098009620 tx=0x7f4098005c50 comp rx=0 tx=0).stop 2024-04-21T22:43:43.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 shutdown_connections 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c28cb960 0x5621c28cdd50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c28b89e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 --2- 172.21.15.18:0/38027014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c28b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f409cc00640 0 client.27914 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 >> 172.21.15.18:0/38027014 conn(0x5621c28ac6a0 msgr2=0x5621c28ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 shutdown_connections 2024-04-21T22:43:43.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 1 -- 172.21.15.18:0/38027014 wait complete. 2024-04-21T22:43:43.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.623+0000 7f40b83f2740 20 client.27914 trim_cache size 0 max 16384 2024-04-21T22:43:43.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.638+0000 7f40b83f2740 1 Processor -- start 2024-04-21T22:43:43.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.638+0000 7f40b83f2740 1 -- start start 2024-04-21T22:43:43.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.638+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b1f70 0x5621c28babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.638+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.638+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28bb470 0x5621c28ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40b83f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b3940 con 0x5621c28b2890 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40b83f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b5480 con 0x5621c28b1f70 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40b83f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b4010 con 0x5621c28bb470 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40af400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28bb470 0x5621c28ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44410/0 (socket says 172.21.15.18:44410) 2024-04-21T22:43:43.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 -- 172.21.15.18:0/3552741969 learned_addr learned my addr 172.21.15.18:0/3552741969 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40aea00640 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b1f70 0x5621c28babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 -- 172.21.15.18:0/3552741969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28bb470 msgr2=0x5621c28ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28bb470 0x5621c28ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 -- 172.21.15.18:0/3552741969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b1f70 msgr2=0x5621c28babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b1f70 0x5621c28babd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 -- 172.21.15.18:0/3552741969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621c28b26c0 con 0x5621c28b2890 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.639+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4098004e50 tx=0x7f4098001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7decd6f99879dbae server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f409f400640 1 -- 172.21.15.18:0/3552741969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098027040 con 0x5621c28b2890 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f409f400640 1 -- 172.21.15.18:0/3552741969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4098003ad0 con 0x5621c28b2890 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f409f400640 1 -- 172.21.15.18:0/3552741969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098019450 con 0x5621c28b2890 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 -- 172.21.15.18:0/3552741969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 msgr2=0x5621c28c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4098004e50 tx=0x7f4098001e70 comp rx=0 tx=0).stop 2024-04-21T22:43:43.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 -- 172.21.15.18:0/3552741969 shutdown_connections 2024-04-21T22:43:43.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28bb470 0x5621c28ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28b2890 0x5621c28c7120 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3552741969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b1f70 0x5621c28babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.640+0000 7f40b83f2740 1 -- 172.21.15.18:0/3552741969 >> 172.21.15.18:0/3552741969 conn(0x5621c28ac6a0 msgr2=0x5621c28aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- 172.21.15.18:0/3552741969 shutdown_connections 2024-04-21T22:43:43.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- 172.21.15.18:0/3552741969 wait complete. 2024-04-21T22:43:43.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- start start 2024-04-21T22:43:43.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 Processor -- start 2024-04-21T22:43:43.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c292a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c292a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b4db0 con 0x5621c28bb470 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b46e0 con 0x5621c28b2890 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.641+0000 7f40b83f2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b1940 con 0x5621c28b1f70 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40b83f2740 10 client.0 _ll_register_callbacks cb 0x7f40a00f4bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c292a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c292a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40af400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44424/0 (socket says 172.21.15.18:44424) 2024-04-21T22:43:43.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40af400640 1 -- 172.21.15.18:0/3448877065 learned_addr learned my addr 172.21.15.18:0/3448877065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 -- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 msgr2=0x5621c292a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c292a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 -- 172.21.15.18:0/3448877065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 msgr2=0x5621c28be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40aea00640 1 -- 172.21.15.18:0/3448877065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621c28bee90 con 0x5621c28b1f70 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c292a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.642+0000 7f40af400640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f40aea00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c292a000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40a00eeec0 tx=0x7f40a00f3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9b885a25bf2d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00d5070 con 0x5621c28b1f70 2024-04-21T22:43:43.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f40a00f4d60 con 0x5621c28b1f70 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4098003ad0 con 0x5621c28b1f70 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f40a00bd2e0 con 0x5621c28b1f70 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f40b83f2740 10 client.27985 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5621c2931790 con 0x5621c28b1f70 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4098003ad0 con 0x5621c28b1f70 2024-04-21T22:43:43.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.643+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f40a00eeb40 con 0x5621c28b1f70 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 10 client.27985 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 10 client.27985 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 20 client.27985 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c2931e60 0x5621c2934280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 4 client.27985 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621c28b40a0 con 0x5621c2931e60 2024-04-21T22:43:43.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.644+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c2931e60 0x5621c2934280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40a7e00640 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c2931e60 0x5621c2934280 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3ce72304e1bc7037 server_cookie=fe683f2be2799dd0 in_seq=0 out_seq=0 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f409cc00640 10 client.27985 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f409cc00640 1 -- 172.21.15.18:0/3448877065 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621c28b40a0 con 0x5621c2931e60 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f409cc00640 10 client.27985 handle_command_reply: tid=0 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 client.27985 shutdown 2024-04-21T22:43:43.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 msgr2=0x5621c292a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c292a000 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f40a00eeec0 tx=0x7f40a00f3040 comp rx=0 tx=0).stop 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 shutdown_connections 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x5621c2931e60 0x5621c2934280 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621c28bb470 0x5621c28be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f409cc00640 0 client.27985 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5621c28b2890 0x5621c292a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 --2- 172.21.15.18:0/3448877065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5621c28b1f70 0x5621c292a000 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 >> 172.21.15.18:0/3448877065 conn(0x5621c28ac6a0 msgr2=0x5621c28b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 shutdown_connections 2024-04-21T22:43:43.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 1 -- 172.21.15.18:0/3448877065 wait complete. 2024-04-21T22:43:43.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.645+0000 7f40b83f2740 20 client.27985 trim_cache size 0 max 16384 2024-04-21T22:43:43.660 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:43.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 msgr2=0x7f40940a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 0x7f40940a51c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f40a8005fd0 tx=0x7f40a8009500 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 msgr2=0x7f40b019e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 0x7f40b019e430 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40a0036040 tx=0x7f40a0004250 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 shutdown_connections 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f40940a2d00 0x7f40940a51c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b010dc00 0x7f40b01a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40b0108640 0x7f40b019e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 --2- 172.21.15.18:0/3610127480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40b0107c80 0x7f40b019e430 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 >> 172.21.15.18:0/3610127480 conn(0x7f40b0077550 msgr2=0x7f40b0078660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 shutdown_connections 2024-04-21T22:43:43.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.646+0000 7f40afe00640 1 -- 172.21.15.18:0/3610127480 wait complete. 2024-04-21T22:43:43.663 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:43 smithi018 ceph-mon[26614]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:43.663 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:43 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3141855298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:43.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:43:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 -- 172.21.15.18:0/2493733864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 msgr2=0x7f218c102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 --2- 172.21.15.18:0/2493733864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c102d40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2180009900 tx=0x7f218002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 -- 172.21.15.18:0/2493733864 shutdown_connections 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 --2- 172.21.15.18:0/2493733864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c10bd30 0x7f218c10e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 --2- 172.21.15.18:0/2493733864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c103280 0x7f218c10b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 --2- 172.21.15.18:0/2493733864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c102d40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.875+0000 7f2194800640 1 -- 172.21.15.18:0/2493733864 >> 172.21.15.18:0/2493733864 conn(0x7f218c077820 msgr2=0x7f218c077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.876+0000 7f2194800640 1 -- 172.21.15.18:0/2493733864 shutdown_connections 2024-04-21T22:43:43.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.876+0000 7f2194800640 1 -- 172.21.15.18:0/2493733864 wait complete. 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.876+0000 7f2194800640 1 Processor -- start 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 -- start start 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c103280 0x7f218c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c10bd30 0x7f218c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c111b50 con 0x7f218c102960 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1119d0 con 0x7f218c103280 2024-04-21T22:43:43.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2194800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f218c111cd0 con 0x7f218c10bd30 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2191e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2191e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44440/0 (socket says 172.21.15.18:44440) 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2191e00640 1 -- 172.21.15.18:0/1230391200 learned_addr learned my addr 172.21.15.18:0/1230391200 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2191400640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c103280 0x7f218c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.877+0000 7f2192800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c10bd30 0x7f218c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 -- 172.21.15.18:0/1230391200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c10bd30 msgr2=0x7f218c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c10bd30 0x7f218c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 -- 172.21.15.18:0/1230391200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c103280 msgr2=0x7f218c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c103280 0x7f218c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 -- 172.21.15.18:0/1230391200 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c19f240 con 0x7f218c102960 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2191e00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2180000c00 tx=0x7f2180004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2186a00640 1 -- 172.21.15.18:0/1230391200 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180042020 con 0x7f218c102960 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2186a00640 1 -- 172.21.15.18:0/1230391200 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21800054e0 con 0x7f218c102960 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.878+0000 7f2186a00640 1 -- 172.21.15.18:0/1230391200 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180003c90 con 0x7f218c102960 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.879+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218c19f4d0 con 0x7f218c102960 2024-04-21T22:43:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.879+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218c1a6dc0 con 0x7f218c102960 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f21975e9740 1 Processor -- start 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f21975e9740 1 -- start start 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f2186a00640 1 -- 172.21.15.18:0/1230391200 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2180045020 con 0x7f218c102960 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f21975e9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72f9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f21975e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7301d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.883+0000 7f21975e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a7304670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f21975e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5558a725d3a0 con 0x5558a72f96a0 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f21975e9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5558a7205930 con 0x5558a72f8d80 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f21975e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5558a7259360 con 0x5558a7302280 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2191e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7301d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2191e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7301d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44444/0 (socket says 172.21.15.18:44444) 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2191e00640 1 -- 172.21.15.18:0/70843481 learned_addr learned my addr 172.21.15.18:0/70843481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2191400640 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a7304670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 -- 172.21.15.18:0/70843481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 msgr2=0x5558a7304670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a7304670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 -- 172.21.15.18:0/70843481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 msgr2=0x5558a7301d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7301d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.884+0000 7f2192800640 1 -- 172.21.15.18:0/70843481 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558a6f713f0 con 0x5558a72f8d80 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f2192800640 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72f9160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2188009ea0 tx=0x7f2188009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c2b5b2a142fdace server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f2186a00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 0x7f21740a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f217b000640 1 -- 172.21.15.18:0/70843481 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188003b70 con 0x5558a72f8d80 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f217b000640 1 -- 172.21.15.18:0/70843481 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2188015070 con 0x5558a72f8d80 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f217b000640 1 -- 172.21.15.18:0/70843481 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188011910 con 0x5558a72f8d80 2024-04-21T22:43:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f2186a00640 1 -- 172.21.15.18:0/1230391200 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f21800f1060 con 0x7f218c102960 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.885+0000 7f2191e00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 0x7f21740a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 -- 172.21.15.18:0/70843481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 msgr2=0x5558a72f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72f9160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2188009ea0 tx=0x7f2188009f90 comp rx=0 tx=0).stop 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f2191e00640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 0x7f21740a5240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f218002bd10 tx=0x7f21800f4bb0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 -- 172.21.15.18:0/70843481 shutdown_connections 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a7304670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7301d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 --2- 172.21.15.18:0/70843481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72f9160 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 -- 172.21.15.18:0/70843481 >> 172.21.15.18:0/70843481 conn(0x5558a72f34b0 msgr2=0x5558a72f3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 -- 172.21.15.18:0/70843481 shutdown_connections 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.886+0000 7f21975e9740 1 -- 172.21.15.18:0/70843481 wait complete. 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 -- start start 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 Processor -- start 2024-04-21T22:43:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a72ff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5558a7305070 con 0x5558a72f96a0 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5558a7218d80 con 0x5558a72f8d80 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5558a73051f0 con 0x5558a7302280 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.887+0000 7f21975e9740 10 client.0 _ll_register_callbacks cb 0x5558a72552b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2191400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a72ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46416/0 (socket says 172.21.15.18:46416) 2024-04-21T22:43:43.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 -- 172.21.15.18:0/3667790853 learned_addr learned my addr 172.21.15.18:0/3667790853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 -- 172.21.15.18:0/3667790853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 msgr2=0x5558a72ff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72ff3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 -- 172.21.15.18:0/3667790853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 msgr2=0x5558a72ff900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a72ff900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 -- 172.21.15.18:0/3667790853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558a703b7d0 con 0x5558a7302280 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2191400640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a72ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f2192800640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2188011a40 tx=0x7f2188009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=453fcaa82925da31 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.888+0000 7f216f400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188004c40 con 0x5558a7302280 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f2188004de0 con 0x5558a7302280 2024-04-21T22:43:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2188015070 con 0x5558a7302280 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2188003970 con 0x5558a7302280 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f21975e9740 10 client.27997 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5558a7311420 con 0x5558a7302280 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2188015070 con 0x5558a7302280 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f2188004fe0 con 0x5558a7302280 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f21975e9740 10 client.27997 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.889+0000 7f21975e9740 10 client.27997 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:43:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f21975e9740 20 client.27997 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a73127d0 0x5558a7314bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f21975e9740 4 client.27997 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558a726a8e0 con 0x5558a73127d0 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f2191400640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a73127d0 0x5558a7314bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f2191400640 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a73127d0 0x5558a7314bc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7d370df35e47d64 server_cookie=9eaa24f56e1abdc2 in_seq=0 out_seq=0 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.890+0000 7f216f400640 10 client.27997 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.891+0000 7f216f400640 1 -- 172.21.15.18:0/3667790853 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5558a726a8e0 con 0x5558a73127d0 2024-04-21T22:43:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.891+0000 7f216f400640 10 client.27997 handle_command_reply: tid=0 2024-04-21T22:43:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.891+0000 7f21975e9740 1 client.27997 shutdown 2024-04-21T22:43:43.901 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:43 smithi081 ceph-mon[31692]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:43.901 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:43 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3141855298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:43.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 msgr2=0x5558a72ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2188011a40 tx=0x7f2188009f90 comp rx=0 tx=0).stop 2024-04-21T22:43:43.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 shutdown_connections 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a73127d0 0x5558a7314bc0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a7302280 0x5558a72ffe40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f216f400640 0 client.27997 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a72ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 --2- 172.21.15.18:0/3667790853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a72f8d80 0x5558a72ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 >> 172.21.15.18:0/3667790853 conn(0x5558a72f34b0 msgr2=0x5558a72f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 shutdown_connections 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 1 -- 172.21.15.18:0/3667790853 wait complete. 2024-04-21T22:43:43.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.892+0000 7f21975e9740 20 client.27997 trim_cache size 0 max 16384 2024-04-21T22:43:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.907+0000 7f21975e9740 1 Processor -- start 2024-04-21T22:43:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.907+0000 7f21975e9740 1 -- start start 2024-04-21T22:43:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a7301af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a72f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1af860 con 0x5558a72f96a0 2024-04-21T22:43:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1b13a0 con 0x5558a7302280 2024-04-21T22:43:43.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f21975e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1aff30 con 0x5558a72f8d80 2024-04-21T22:43:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44464/0 (socket says 172.21.15.18:44464) 2024-04-21T22:43:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 -- 172.21.15.18:0/1913366957 learned_addr learned my addr 172.21.15.18:0/1913366957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2192800640 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a7301af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2192800640 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a72f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 -- 172.21.15.18:0/1913366957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 msgr2=0x5558a7301af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a7301af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 -- 172.21.15.18:0/1913366957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 msgr2=0x5558a72f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a72f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.908+0000 7f2191400640 1 -- 172.21.15.18:0/1913366957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558a72f8520 con 0x5558a72f96a0 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.909+0000 7f2191400640 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f217c00be50 tx=0x7f217c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1707257f5072ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.909+0000 7f217a600640 1 -- 172.21.15.18:0/1913366957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c004220 con 0x5558a72f96a0 2024-04-21T22:43:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.909+0000 7f217a600640 1 -- 172.21.15.18:0/1913366957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c024030 con 0x5558a72f96a0 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.909+0000 7f217a600640 1 -- 172.21.15.18:0/1913366957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c020220 con 0x5558a72f96a0 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- 172.21.15.18:0/1913366957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 msgr2=0x5558a730df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f217c00be50 tx=0x7f217c0118d0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- 172.21.15.18:0/1913366957 shutdown_connections 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a72f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a730df30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 --2- 172.21.15.18:0/1913366957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a7301af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- 172.21.15.18:0/1913366957 >> 172.21.15.18:0/1913366957 conn(0x5558a72f34b0 msgr2=0x5558a72fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- 172.21.15.18:0/1913366957 shutdown_connections 2024-04-21T22:43:43.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- 172.21.15.18:0/1913366957 wait complete. 2024-04-21T22:43:43.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.910+0000 7f21975e9740 1 -- start start 2024-04-21T22:43:43.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 Processor -- start 2024-04-21T22:43:43.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7305a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a7305f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1b0cd0 con 0x5558a72f96a0 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1b0600 con 0x5558a7302280 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f218c1ad860 con 0x5558a72f8d80 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f21975e9740 10 client.0 _ll_register_callbacks cb 0x7f21800f4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f2192800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f2192800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46444/0 (socket says 172.21.15.18:46444) 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f2192800640 1 -- 172.21.15.18:0/3242925035 learned_addr learned my addr 172.21.15.18:0/3242925035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f2191400640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7305a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.911+0000 7f2192800640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a7305f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 -- 172.21.15.18:0/3242925035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 msgr2=0x5558a7305f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a7305f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 -- 172.21.15.18:0/3242925035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 msgr2=0x5558a7305a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7305a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 -- 172.21.15.18:0/3242925035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558a7306670 con 0x5558a72f8d80 2024-04-21T22:43:43.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f2192800640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2188002230 tx=0x7f2188009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ecd3b2eec9d906d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f216f400640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188003b10 con 0x5558a72f8d80 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f217c024030 con 0x5558a72f8d80 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f2188003cb0 con 0x5558a72f8d80 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2188003eb0 con 0x5558a72f8d80 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f21975e9740 10 client.28003 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.912+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5558a7378ad0 con 0x5558a72f8d80 2024-04-21T22:43:43.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c024030 con 0x5558a72f8d80 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f2188004df0 con 0x5558a72f8d80 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 10 client.28003 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 10 client.28003 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 20 client.28003 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a7379170 0x5558a737b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 4 client.28003 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558a7264c30 con 0x5558a7379170 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.913+0000 7f2191400640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a7379170 0x5558a737b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:43.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f2191400640 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a7379170 0x5558a737b590 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47708027381a5026 server_cookie=7f05c9adade220d6 in_seq=0 out_seq=0 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f216f400640 10 client.28003 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f216f400640 1 -- 172.21.15.18:0/3242925035 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558a7264c30 con 0x5558a7379170 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f216f400640 10 client.28003 handle_command_reply: tid=0 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 client.28003 shutdown 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 msgr2=0x5558a730a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2188002230 tx=0x7f2188009f90 comp rx=0 tx=0).stop 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 shutdown_connections 2024-04-21T22:43:43.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x5558a7379170 0x5558a737b590 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558a7302280 0x5558a7305f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5558a72f96a0 0x5558a7305a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 --2- 172.21.15.18:0/3242925035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5558a72f8d80 0x5558a730a6d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f216f400640 0 client.28003 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.914+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 >> 172.21.15.18:0/3242925035 conn(0x5558a72f34b0 msgr2=0x5558a72ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 shutdown_connections 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f21975e9740 1 -- 172.21.15.18:0/3242925035 wait complete. 2024-04-21T22:43:43.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f21975e9740 20 client.28003 trim_cache size 0 max 16384 2024-04-21T22:43:43.924 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:43.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 msgr2=0x7f21740a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 0x7f21740a5240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f218002bd10 tx=0x7f21800f4bb0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 msgr2=0x7f218c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:43.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2180000c00 tx=0x7f2180004430 comp rx=0 tx=0).stop 2024-04-21T22:43:43.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 shutdown_connections 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f21740a2d80 0x7f21740a5240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f218c10bd30 0x7f218c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f218c103280 0x7f218c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.915+0000 7f2194800640 1 --2- 172.21.15.18:0/1230391200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f218c102960 0x7f218c19a250 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.916+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 >> 172.21.15.18:0/1230391200 conn(0x7f218c077820 msgr2=0x7f218c107bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.916+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 shutdown_connections 2024-04-21T22:43:43.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:43.916+0000 7f2194800640 1 -- 172.21.15.18:0/1230391200 wait complete. 2024-04-21T22:43:43.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:43:43.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:43 smithi047 ceph-mon[31561]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:43.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:43 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3141855298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:43:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 -- 172.21.15.18:0/3525227297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 msgr2=0x7f45d81101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 --2- 172.21.15.18:0/3525227297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d81101c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009ca0 tx=0x7f45d002c180 comp rx=0 tx=0).stop 2024-04-21T22:43:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 -- 172.21.15.18:0/3525227297 shutdown_connections 2024-04-21T22:43:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 --2- 172.21.15.18:0/3525227297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d81101c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 --2- 172.21.15.18:0/3525227297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 --2- 172.21.15.18:0/3525227297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.132+0000 7f45dca00640 1 -- 172.21.15.18:0/3525227297 >> 172.21.15.18:0/3525227297 conn(0x7f45d80fd020 msgr2=0x7f45d80ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.133+0000 7f45dca00640 1 -- 172.21.15.18:0/3525227297 shutdown_connections 2024-04-21T22:43:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.133+0000 7f45dca00640 1 -- 172.21.15.18:0/3525227297 wait complete. 2024-04-21T22:43:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 Processor -- start 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 -- start start 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45d8113af0 con 0x7f45d8074410 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.134+0000 7f45dca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45d8113970 con 0x7f45d8073af0 2024-04-21T22:43:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45dca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45d8113c70 con 0x7f45d810ddd0 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44488/0 (socket says 172.21.15.18:44488) 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45cde00640 1 -- 172.21.15.18:0/105657162 learned_addr learned my addr 172.21.15.18:0/105657162 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d7200640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 -- 172.21.15.18:0/105657162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 msgr2=0x7f45d819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 -- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 msgr2=0x7f45d819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d6800640 1 -- 172.21.15.18:0/105657162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d819f060 con 0x7f45d8073af0 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45d7200640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.135+0000 7f45cde00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45d6800640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d819a070 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f45c800e9f0 tx=0x7f45c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45cfe00640 1 -- 172.21.15.18:0/105657162 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c800ccc0 con 0x7f45d8073af0 2024-04-21T22:43:44.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45cfe00640 1 -- 172.21.15.18:0/105657162 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c8010910 con 0x7f45d8073af0 2024-04-21T22:43:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45cfe00640 1 -- 172.21.15.18:0/105657162 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8018960 con 0x7f45d8073af0 2024-04-21T22:43:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d819f350 con 0x7f45d8073af0 2024-04-21T22:43:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.136+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d81a6be0 con 0x7f45d8073af0 2024-04-21T22:43:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.140+0000 7f45e016b740 1 Processor -- start 2024-04-21T22:43:44.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 -- start start 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 0x55925fed9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fee1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55925fe3d3a0 con 0x55925fee2470 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55925fde5930 con 0x55925fed8f70 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45e016b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55925fe39360 con 0x55925fed9890 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45cfe00640 1 -- 172.21.15.18:0/105657162 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f45c8010ac0 con 0x7f45d8073af0 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.141+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44500/0 (socket says 172.21.15.18:44500) 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 -- 172.21.15.18:0/1610116805 learned_addr learned my addr 172.21.15.18:0/1610116805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45d7200640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 0x55925fed9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45d6800640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fee1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 -- 172.21.15.18:0/1610116805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 msgr2=0x55925fee1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fee1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 -- 172.21.15.18:0/1610116805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 msgr2=0x55925fed9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 0x55925fed9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 -- 172.21.15.18:0/1610116805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925fb513f0 con 0x55925fee2470 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45d6800640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fee1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45d7200640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 0x55925fed9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.142+0000 7f45cde00640 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45c00115f0 tx=0x7f45c0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34841318c429605 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45c7400640 1 -- 172.21.15.18:0/1610116805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c001e070 con 0x55925fee2470 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45c7400640 1 -- 172.21.15.18:0/1610116805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c000fbe0 con 0x55925fee2470 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45c7400640 1 -- 172.21.15.18:0/1610116805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0019c30 con 0x55925fee2470 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45cfe00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 0x7f45bc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45cfe00640 1 -- 172.21.15.18:0/105657162 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f45c80cf7f0 con 0x7f45d8073af0 2024-04-21T22:43:44.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45d7200640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 0x7f45bc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45e016b740 1 -- 172.21.15.18:0/1610116805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 msgr2=0x55925fee4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.143+0000 7f45e016b740 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45c00115f0 tx=0x7f45c0011ab0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 -- 172.21.15.18:0/1610116805 shutdown_connections 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fee2470 0x55925fee4860 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fee1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 --2- 172.21.15.18:0/1610116805 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed8f70 0x55925fed9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 -- 172.21.15.18:0/1610116805 >> 172.21.15.18:0/1610116805 conn(0x55925fed36a0 msgr2=0x55925fed3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 -- 172.21.15.18:0/1610116805 shutdown_connections 2024-04-21T22:43:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 -- 172.21.15.18:0/1610116805 wait complete. 2024-04-21T22:43:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45d7200640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 0x7f45bc0a5240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f45d0005e30 tx=0x7f45d0005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.144+0000 7f45e016b740 1 -- start start 2024-04-21T22:43:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 Processor -- start 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed9890 0x55925fedfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fee2470 0x55925fedff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55925fee5260 con 0x55925fed8f70 2024-04-21T22:43:44.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55925fdf8d80 con 0x55925fed9890 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55925fee53e0 con 0x55925fee2470 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.145+0000 7f45e016b740 10 client.0 _ll_register_callbacks cb 0x55925fe352b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44516/0 (socket says 172.21.15.18:44516) 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 -- 172.21.15.18:0/1508503850 learned_addr learned my addr 172.21.15.18:0/1508503850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d7200640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fee2470 0x55925fedff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45cde00640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed9890 0x55925fedfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 -- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fee2470 msgr2=0x55925fedff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fee2470 0x55925fedff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 -- 172.21.15.18:0/1508503850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed9890 msgr2=0x55925fedfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed9890 0x55925fedfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 -- 172.21.15.18:0/1508503850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925fc1b7d0 con 0x55925fed8f70 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45d6800640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f45c80ccf10 tx=0x7f45c809bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b878a72a106d9a8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c80cd340 con 0x55925fed8f70 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.146+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f45c80cfde0 con 0x55925fed8f70 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c000fbe0 con 0x55925fed8f70 2024-04-21T22:43:44.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f45c80b9050 con 0x55925fed8f70 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 10 client.17871 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55925fef1540 con 0x55925fed8f70 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c000fbe0 con 0x55925fed8f70 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f45c8018b00 con 0x55925fed8f70 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 10 client.17871 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 10 client.17871 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 20 client.17871 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925fef2a00 0x55925fef4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 4 client.17871 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.147+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55925fe4a8e0 con 0x55925fef2a00 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.148+0000 7f45cde00640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925fef2a00 0x55925fef4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.148+0000 7f45cde00640 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925fef2a00 0x55925fef4df0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43857a5a5232b7df server_cookie=372a7b14af440ef5 in_seq=0 out_seq=0 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.148+0000 7f45bbe00640 10 client.17871 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.149+0000 7f45bbe00640 1 -- 172.21.15.18:0/1508503850 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55925fe4a8e0 con 0x55925fef2a00 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.149+0000 7f45bbe00640 10 client.17871 handle_command_reply: tid=0 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.149+0000 7f45e016b740 1 client.17871 shutdown 2024-04-21T22:43:44.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.149+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 msgr2=0x55925fedf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.149+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f45c80ccf10 tx=0x7f45c809bd30 comp rx=0 tx=0).stop 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 shutdown_connections 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925fef2a00 0x55925fef4df0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fee2470 0x55925fedff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fed9890 0x55925fedfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45bbe00640 0 client.17871 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 --2- 172.21.15.18:0/1508503850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925fedf4e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 >> 172.21.15.18:0/1508503850 conn(0x55925fed36a0 msgr2=0x55925fed53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 shutdown_connections 2024-04-21T22:43:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 1 -- 172.21.15.18:0/1508503850 wait complete. 2024-04-21T22:43:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.150+0000 7f45e016b740 20 client.17871 trim_cache size 0 max 16384 2024-04-21T22:43:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 Processor -- start 2024-04-21T22:43:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 -- start start 2024-04-21T22:43:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fedfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fefa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81af690 con 0x55925fed8f70 2024-04-21T22:43:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81b11d0 con 0x55925fee2470 2024-04-21T22:43:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.165+0000 7f45e016b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81afd60 con 0x55925fed9890 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45cde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fedfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44524/0 (socket says 172.21.15.18:44524) 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 -- 172.21.15.18:0/167645775 learned_addr learned my addr 172.21.15.18:0/167645775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d7200640 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fefa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 -- 172.21.15.18:0/167645775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 msgr2=0x55925fedfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fedfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 -- 172.21.15.18:0/167645775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 msgr2=0x55925fefa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fefa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45d6800640 1 -- 172.21.15.18:0/167645775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925fed96c0 con 0x55925fed8f70 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.166+0000 7f45cde00640 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fedfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45d6800640 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f45c8098190 tx=0x7f45c809bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f7a433149ee838 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45c6a00640 1 -- 172.21.15.18:0/167645775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c809b870 con 0x55925fed8f70 2024-04-21T22:43:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45c6a00640 1 -- 172.21.15.18:0/167645775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c809b180 con 0x55925fed8f70 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45c6a00640 1 -- 172.21.15.18:0/167645775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8097d00 con 0x55925fed8f70 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 -- 172.21.15.18:0/167645775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 msgr2=0x55925feee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f45c8098190 tx=0x7f45c809bb20 comp rx=0 tx=0).stop 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 -- 172.21.15.18:0/167645775 shutdown_connections 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fefa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed9890 0x55925fedfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 --2- 172.21.15.18:0/167645775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed8f70 0x55925feee150 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.167+0000 7f45e016b740 1 -- 172.21.15.18:0/167645775 >> 172.21.15.18:0/167645775 conn(0x55925fed36a0 msgr2=0x55925fed2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.168+0000 7f45e016b740 1 -- 172.21.15.18:0/167645775 shutdown_connections 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.168+0000 7f45e016b740 1 -- 172.21.15.18:0/167645775 wait complete. 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.168+0000 7f45e016b740 1 -- start start 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.168+0000 7f45e016b740 1 Processor -- start 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 0x55925feea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fee6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81b0b00 con 0x55925fed9890 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81b0430 con 0x55925fee2470 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45d81ad690 con 0x55925fed8f70 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45e016b740 10 client.0 _ll_register_callbacks cb 0x7f45c8010eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:44.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45cde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44530/0 (socket says 172.21.15.18:44530) 2024-04-21T22:43:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45cde00640 1 -- 172.21.15.18:0/2695170440 learned_addr learned my addr 172.21.15.18:0/2695170440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45d6800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 0x55925feea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45d7200640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fee6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45cde00640 1 -- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 msgr2=0x55925feea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.169+0000 7f45cde00640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 0x55925feea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45cde00640 1 -- 172.21.15.18:0/2695170440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 msgr2=0x55925fee6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45cde00640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fee6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45cde00640 1 -- 172.21.15.18:0/2695170440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925fee67a0 con 0x55925fed9890 2024-04-21T22:43:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45d6800640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 0x55925feea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45cde00640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45c001c040 tx=0x7f45c0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b44ae66071edf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c002e060 con 0x55925fed9890 2024-04-21T22:43:44.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c809b180 con 0x55925fed9890 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f45c00093d0 con 0x55925fed9890 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f45c001e040 con 0x55925fed9890 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.170+0000 7f45e016b740 10 client.17877 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55925ff58d60 con 0x55925fed9890 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c809b180 con 0x55925fed9890 2024-04-21T22:43:44.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f45c0029250 con 0x55925fed9890 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 10 client.17877 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 10 client.17877 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 20 client.17877 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925ff592f0 0x55925ff5b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 4 client.17877 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:44.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55925fe44c30 con 0x55925ff592f0 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.171+0000 7f45d6800640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925ff592f0 0x55925ff5b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45d6800640 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925ff592f0 0x55925ff5b6e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0ee2823e3657d9e server_cookie=b41e232bfcb874aa in_seq=0 out_seq=0 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45bbe00640 10 client.17877 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45bbe00640 1 -- 172.21.15.18:0/2695170440 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55925fe44c30 con 0x55925ff592f0 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45bbe00640 10 client.17877 handle_command_reply: tid=0 2024-04-21T22:43:44.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 client.17877 shutdown 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 msgr2=0x55925fee5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45c001c040 tx=0x7f45c0019620 comp rx=0 tx=0).stop 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 shutdown_connections 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x55925ff592f0 0x55925ff5b6e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55925fee2470 0x55925fee6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55925fed9890 0x55925fee5c20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 --2- 172.21.15.18:0/2695170440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55925fed8f70 0x55925feea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 >> 172.21.15.18:0/2695170440 conn(0x55925fed36a0 msgr2=0x55925fed4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.172+0000 7f45bbe00640 0 client.17877 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:43:44.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 shutdown_connections 2024-04-21T22:43:44.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45e016b740 1 -- 172.21.15.18:0/2695170440 wait complete. 2024-04-21T22:43:44.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45e016b740 20 client.17877 trim_cache size 0 max 16384 2024-04-21T22:43:44.187 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:44.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 msgr2=0x7f45bc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 0x7f45bc0a5240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f45d0005e30 tx=0x7f45d0005d80 comp rx=0 tx=0).stop 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 msgr2=0x7f45d819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d819a070 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f45c800e9f0 tx=0x7f45c800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 shutdown_connections 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f45bc0a2d80 0x7f45bc0a5240 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d810ddd0 0x7f45d819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45d8074410 0x7f45d819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 --2- 172.21.15.18:0/105657162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d8073af0 0x7f45d819a070 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.173+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 >> 172.21.15.18:0/105657162 conn(0x7f45d80fd020 msgr2=0x7f45d80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.174+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 shutdown_connections 2024-04-21T22:43:44.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.174+0000 7f45dca00640 1 -- 172.21.15.18:0/105657162 wait complete. 2024-04-21T22:43:44.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.400+0000 7ffb26a00640 1 -- 172.21.15.18:0/3366915591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20076590 msgr2=0x7ffb20111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.400+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3366915591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20076590 0x7ffb20111e80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009930 tx=0x7ffb0c02bc20 comp rx=0 tx=0).stop 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 -- 172.21.15.18:0/3366915591 shutdown_connections 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3366915591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb201123c0 0x7ffb201147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3366915591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20076590 0x7ffb20111e80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3366915591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb20075c70 0x7ffb20076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 -- 172.21.15.18:0/3366915591 >> 172.21.15.18:0/3366915591 conn(0x7ffb200ff210 msgr2=0x7ffb20101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 -- 172.21.15.18:0/3366915591 shutdown_connections 2024-04-21T22:43:44.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.401+0000 7ffb26a00640 1 -- 172.21.15.18:0/3366915591 wait complete. 2024-04-21T22:43:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.402+0000 7ffb26a00640 1 Processor -- start 2024-04-21T22:43:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.402+0000 7ffb26a00640 1 -- start start 2024-04-21T22:43:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 0x7ffb2019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb201123c0 0x7ffb201a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20117f70 con 0x7ffb201123c0 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20117df0 con 0x7ffb20076590 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201180f0 con 0x7ffb20075c70 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb25600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 0x7ffb2019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb26000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb201123c0 0x7ffb201a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57696/0 (socket says 172.21.15.18:57696) 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.403+0000 7ffb24c00640 1 -- 172.21.15.18:0/3499060841 learned_addr learned my addr 172.21.15.18:0/3499060841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 -- 172.21.15.18:0/3499060841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 msgr2=0x7ffb2019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 0x7ffb2019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 -- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb201123c0 msgr2=0x7ffb201a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb201123c0 0x7ffb201a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 -- 172.21.15.18:0/3499060841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb201a3550 con 0x7ffb20076590 2024-04-21T22:43:44.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb25600640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 0x7ffb2019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb24c00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c005ab0 tx=0x7ffb0c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb1e000640 1 -- 172.21.15.18:0/3499060841 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c043020 con 0x7ffb20076590 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.404+0000 7ffb1e000640 1 -- 172.21.15.18:0/3499060841 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0c005000 con 0x7ffb20076590 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.405+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb201a37e0 con 0x7ffb20076590 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.405+0000 7ffb1e000640 1 -- 172.21.15.18:0/3499060841 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c003a80 con 0x7ffb20076590 2024-04-21T22:43:44.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.405+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201ab0d0 con 0x7ffb20076590 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 Processor -- start 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 -- start start 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb1e000640 1 -- 172.21.15.18:0/3499060841 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ffb0c046020 con 0x7ffb20076590 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf58f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 0x55681bf5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55681beb43a0 con 0x55681bf59470 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55681be5c930 con 0x55681bf50890 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.408+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55681beb0360 con 0x55681bf4ff70 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 0x55681bf5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb25600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf58f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46538/0 (socket says 172.21.15.18:46538) 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 -- 172.21.15.18:0/4186474238 learned_addr learned my addr 172.21.15.18:0/4186474238 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 -- 172.21.15.18:0/4186474238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 msgr2=0x55681bf58f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf58f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 -- 172.21.15.18:0/4186474238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 msgr2=0x55681bf5b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 0x55681bf5b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 -- 172.21.15.18:0/4186474238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681bbc83f0 con 0x55681bf4ff70 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb25600640 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb24c00640 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 0x55681bf5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.409+0000 7ffb26000640 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009f30 tx=0x7ffb180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0797765ab4d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb1e000640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb12600640 1 -- 172.21.15.18:0/4186474238 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004d20 con 0x55681bf4ff70 2024-04-21T22:43:44.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb12600640 1 -- 172.21.15.18:0/4186474238 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18004050 con 0x55681bf4ff70 2024-04-21T22:43:44.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb12600640 1 -- 172.21.15.18:0/4186474238 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18005260 con 0x55681bf4ff70 2024-04-21T22:43:44.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb1e000640 1 -- 172.21.15.18:0/3499060841 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7ffb0c0f1280 con 0x7ffb20076590 2024-04-21T22:43:44.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.410+0000 7ffb25600640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- 172.21.15.18:0/4186474238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 msgr2=0x55681bf50350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009f30 tx=0x7ffb180118d0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- 172.21.15.18:0/4186474238 shutdown_connections 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf59470 0x55681bf5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/4186474238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf50350 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- 172.21.15.18:0/4186474238 >> 172.21.15.18:0/4186474238 conn(0x55681bf4a6a0 msgr2=0x55681bf4aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb25600640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 0x7ffb080a5240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009fd0 tx=0x7ffb14005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- 172.21.15.18:0/4186474238 shutdown_connections 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- 172.21.15.18:0/4186474238 wait complete. 2024-04-21T22:43:44.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.411+0000 7ffb2ad93740 1 -- start start 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 Processor -- start 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf56520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf56a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf56fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55681bf5c260 con 0x55681bf4ff70 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55681be6fd80 con 0x55681bf50890 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55681bf5c3e0 con 0x55681bf59470 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb2ad93740 10 client.0 _ll_register_callbacks cb 0x55681beac2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:44.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb25600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf56520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf56a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb25600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf56520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44576/0 (socket says 172.21.15.18:44576) 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.412+0000 7ffb25600640 1 -- 172.21.15.18:0/2389878735 learned_addr learned my addr 172.21.15.18:0/2389878735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb26000640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf56fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 -- 172.21.15.18:0/2389878735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 msgr2=0x55681bf56fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf56fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 -- 172.21.15.18:0/2389878735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 msgr2=0x55681bf56520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf56520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 -- 172.21.15.18:0/2389878735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681bc927d0 con 0x55681bf50890 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb26000640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf56fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf56a60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0eeab0 tx=0x7ffb0c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8c16eb8e3d3c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb06a00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0bd3c0 con 0x55681bf50890 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7ffb0c0054e0 con 0x55681bf50890 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.413+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb18004050 con 0x55681bf50890 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c0bd1e0 con 0x55681bf50890 2024-04-21T22:43:44.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 10 client.27968 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55681bf68590 con 0x55681bf50890 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18004050 con 0x55681bf50890 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ffb0c0bdae0 con 0x55681bf50890 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 10 client.27968 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 10 client.27968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 20 client.27968 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bf698e0 0x55681bf6bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 4 client.27968 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.414+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681bec18e0 con 0x55681bf698e0 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.415+0000 7ffb25600640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bf698e0 0x55681bf6bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.415+0000 7ffb25600640 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bf698e0 0x55681bf6bcf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931c45a07dcfa456 server_cookie=1cbc88f4c89554f3 in_seq=0 out_seq=0 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.415+0000 7ffb06a00640 10 client.27968 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb06a00640 1 -- 172.21.15.18:0/2389878735 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55681bec18e0 con 0x55681bf698e0 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb06a00640 10 client.27968 handle_command_reply: tid=0 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 client.27968 shutdown 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 msgr2=0x55681bf56a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf56a60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0eeab0 tx=0x7ffb0c009260 comp rx=0 tx=0).stop 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 shutdown_connections 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bf698e0 0x55681bf6bcf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf56fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf56a60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2389878735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf56520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb06a00640 0 client.27968 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.416+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 >> 172.21.15.18:0/2389878735 conn(0x55681bf4a6a0 msgr2=0x55681bf4c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.417+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 shutdown_connections 2024-04-21T22:43:44.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.417+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2389878735 wait complete. 2024-04-21T22:43:44.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.417+0000 7ffb2ad93740 20 client.27968 trim_cache size 0 max 16384 2024-04-21T22:43:44.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.431+0000 7ffb2ad93740 1 Processor -- start 2024-04-21T22:43:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.431+0000 7ffb2ad93740 1 -- start start 2024-04-21T22:43:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b39e0 con 0x55681bf4ff70 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b5520 con 0x55681bf50890 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b40b0 con 0x55681bf59470 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44584/0 (socket says 172.21.15.18:44584) 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 -- 172.21.15.18:0/2743402152 learned_addr learned my addr 172.21.15.18:0/2743402152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb26000640 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 -- 172.21.15.18:0/2743402152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 msgr2=0x55681bf715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 -- 172.21.15.18:0/2743402152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 msgr2=0x55681bf65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.432+0000 7ffb25600640 1 -- 172.21.15.18:0/2743402152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681bf506c0 con 0x55681bf4ff70 2024-04-21T22:43:44.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.433+0000 7ffb25600640 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55681bf6c560 tx=0x7ffb1401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b372201bc56e615a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.433+0000 7ffb11c00640 1 -- 172.21.15.18:0/2743402152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14030070 con 0x55681bf4ff70 2024-04-21T22:43:44.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.433+0000 7ffb11c00640 1 -- 172.21.15.18:0/2743402152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb1402b470 con 0x55681bf4ff70 2024-04-21T22:43:44.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.433+0000 7ffb11c00640 1 -- 172.21.15.18:0/2743402152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140039e0 con 0x55681bf4ff70 2024-04-21T22:43:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2743402152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 msgr2=0x55681bf58c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x55681bf6c560 tx=0x7ffb1401a000 comp rx=0 tx=0).stop 2024-04-21T22:43:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2743402152 shutdown_connections 2024-04-21T22:43:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf59470 0x55681bf715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf50890 0x55681bf65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2743402152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf4ff70 0x55681bf58c50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2743402152 >> 172.21.15.18:0/2743402152 conn(0x55681bf4a6a0 msgr2=0x55681bf49690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2743402152 shutdown_connections 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2743402152 wait complete. 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.434+0000 7ffb2ad93740 1 -- start start 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 Processor -- start 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf61630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 0x55681bf61b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf59470 0x55681bf5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b4e50 con 0x55681bf50890 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b4780 con 0x55681bf59470 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201b19e0 con 0x55681bf4ff70 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb2ad93740 10 client.0 _ll_register_callbacks cb 0x7ffb0c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 0x55681bf61b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb25600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf61630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb24c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 0x55681bf61b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44592/0 (socket says 172.21.15.18:44592) 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb24c00640 1 -- 172.21.15.18:0/2219076975 learned_addr learned my addr 172.21.15.18:0/2219076975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.435+0000 7ffb26000640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf59470 0x55681bf5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 -- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf59470 msgr2=0x55681bf5e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf59470 0x55681bf5e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 -- 172.21.15.18:0/2219076975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 msgr2=0x55681bf61b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 0x55681bf61b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 -- 172.21.15.18:0/2219076975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681bf5ee00 con 0x55681bf4ff70 2024-04-21T22:43:44.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb25600640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf61630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffb14019040 tx=0x7ffb14005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84cec581b2d8afb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb06a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.436+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14039020 con 0x55681bf4ff70 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.437+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb1402b470 con 0x55681bf4ff70 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.437+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7ffb1402b820 con 0x55681bf4ff70 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.437+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffb14044050 con 0x55681bf4ff70 2024-04-21T22:43:44.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.437+0000 7ffb2ad93740 10 client.28036 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.437+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55681bfd0840 con 0x55681bf4ff70 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb1402b470 con 0x55681bf4ff70 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7ffb14035410 con 0x55681bf4ff70 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 10 client.28036 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 10 client.28036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 20 client.28036 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bfd0f00 0x55681bfd32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:44.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 4 client.28036 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55681bebbc30 con 0x55681bfd0f00 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.438+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bfd0f00 0x55681bfd32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb24c00640 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bfd0f00 0x55681bfd32f0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=434edae14ecdb3ad server_cookie=950a2d26ca0e66b2 in_seq=0 out_seq=0 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb06a00640 10 client.28036 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb06a00640 1 -- 172.21.15.18:0/2219076975 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55681bebbc30 con 0x55681bfd0f00 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb06a00640 10 client.28036 handle_command_reply: tid=0 2024-04-21T22:43:44.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 client.28036 shutdown 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 msgr2=0x55681bf61630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf61630 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffb14019040 tx=0x7ffb14005760 comp rx=0 tx=0).stop 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 shutdown_connections 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55681bf59470 0x55681bf5e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55681bf50890 0x55681bf61b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55681bfd0f00 0x55681bfd32f0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 --2- 172.21.15.18:0/2219076975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55681bf4ff70 0x55681bf61630 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb06a00640 0 client.28036 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.439+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 >> 172.21.15.18:0/2219076975 conn(0x55681bf4a6a0 msgr2=0x55681bf56310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 shutdown_connections 2024-04-21T22:43:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb2ad93740 1 -- 172.21.15.18:0/2219076975 wait complete. 2024-04-21T22:43:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb2ad93740 20 client.28036 trim_cache size 0 max 16384 2024-04-21T22:43:44.454 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:43:44.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 msgr2=0x7ffb080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 0x7ffb080a5240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009fd0 tx=0x7ffb14005f90 comp rx=0 tx=0).stop 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 msgr2=0x7ffb2019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c005ab0 tx=0x7ffb0c005e80 comp rx=0 tx=0).stop 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 shutdown_connections 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ffb080a2d80 0x7ffb080a5240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb201123c0 0x7ffb201a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb20076590 0x7ffb2019eaf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 --2- 172.21.15.18:0/3499060841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb20075c70 0x7ffb2019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.440+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 >> 172.21.15.18:0/3499060841 conn(0x7ffb200ff210 msgr2=0x7ffb20113b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.441+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 shutdown_connections 2024-04-21T22:43:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:44.441+0000 7ffb26a00640 1 -- 172.21.15.18:0/3499060841 wait complete. 2024-04-21T22:43:45.461 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-21T22:43:45.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:43:45.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-21T22:43:45.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 -- 172.21.15.18:0/2300748954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e4074410 msgr2=0x7f55e410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 --2- 172.21.15.18:0/2300748954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e4074410 0x7f55e410d8c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009900 tx=0x7f55d002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 -- 172.21.15.18:0/2300748954 shutdown_connections 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 --2- 172.21.15.18:0/2300748954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e410de00 0x7f55e41101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 --2- 172.21.15.18:0/2300748954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e4074410 0x7f55e410d8c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 --2- 172.21.15.18:0/2300748954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4073af0 0x7f55e4073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 -- 172.21.15.18:0/2300748954 >> 172.21.15.18:0/2300748954 conn(0x7f55e40fd090 msgr2=0x7f55e40ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 -- 172.21.15.18:0/2300748954 shutdown_connections 2024-04-21T22:43:45.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.693+0000 7f55e9a00640 1 -- 172.21.15.18:0/2300748954 wait complete. 2024-04-21T22:43:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.695+0000 7f55e9a00640 1 Processor -- start 2024-04-21T22:43:45.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.695+0000 7f55e9a00640 1 -- start start 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 0x7f55e419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4074410 0x7f55e419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 0x7f55e419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4113b70 con 0x7f55e4073af0 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41139f0 con 0x7f55e4074410 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4113cf0 con 0x7f55e410de00 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 0x7f55e419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 0x7f55e419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4074410 0x7f55e419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 0x7f55e419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44606/0 (socket says 172.21.15.18:44606) 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e3e00640 1 -- 172.21.15.18:0/1013928692 learned_addr learned my addr 172.21.15.18:0/1013928692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 -- 172.21.15.18:0/1013928692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4074410 msgr2=0x7f55e419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4074410 0x7f55e419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 -- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 msgr2=0x7f55e419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 0x7f55e419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.696+0000 7f55e9000640 1 -- 172.21.15.18:0/1013928692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419f040 con 0x7f55e410de00 2024-04-21T22:43:45.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e9000640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 0x7f55e419e910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009fd0 tx=0x7f55dc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e0c00640 1 -- 172.21.15.18:0/1013928692 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00ce20 con 0x7f55e410de00 2024-04-21T22:43:45.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e0c00640 1 -- 172.21.15.18:0/1013928692 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc005020 con 0x7f55e410de00 2024-04-21T22:43:45.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e0c00640 1 -- 172.21.15.18:0/1013928692 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc010720 con 0x7f55e410de00 2024-04-21T22:43:45.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419f330 con 0x7f55e410de00 2024-04-21T22:43:45.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.697+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a6bc0 con 0x7f55e410de00 2024-04-21T22:43:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.700+0000 7f55edc35740 1 Processor -- start 2024-04-21T22:43:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55e0c00640 1 -- 172.21.15.18:0/1013928692 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f55dc005540 con 0x7f55e410de00 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 -- start start 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x55600704ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x5560070578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556006facdf0 con 0x55600704e8e0 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556006fb2040 con 0x55600704f200 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55edc35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556006f5a8c0 con 0x556007057de0 2024-04-21T22:43:45.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.701+0000 7f55e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x55600704ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x55600704ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44618/0 (socket says 172.21.15.18:44618) 2024-04-21T22:43:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3400640 1 -- 172.21.15.18:0/265404056 learned_addr learned my addr 172.21.15.18:0/265404056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x5560070578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3400640 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 -- 172.21.15.18:0/265404056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 msgr2=0x55600705a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 -- 172.21.15.18:0/265404056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 msgr2=0x55600704ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x55600704ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 -- 172.21.15.18:0/265404056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556006d8e7e0 con 0x55600704f200 2024-04-21T22:43:45.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e0c00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 0x7f55c80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.702+0000 7f55e3e00640 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x5560070578a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009cf0 tx=0x7f55d4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ca047358b03017 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.703+0000 7f55e0c00640 1 -- 172.21.15.18:0/1013928692 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f55dc0cfb50 con 0x7f55e410de00 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.703+0000 7f55d9600640 1 -- 172.21.15.18:0/265404056 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4005020 con 0x55600704f200 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.703+0000 7f55e3400640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 0x7f55c80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.703+0000 7f55d9600640 1 -- 172.21.15.18:0/265404056 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d40047a0 con 0x55600704f200 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.703+0000 7f55d9600640 1 -- 172.21.15.18:0/265404056 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4019650 con 0x55600704f200 2024-04-21T22:43:45.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- 172.21.15.18:0/265404056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 msgr2=0x5560070578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x5560070578a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009cf0 tx=0x7f55d4011810 comp rx=0 tx=0).stop 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55e3400640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 0x7f55c80a51c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f55d002c8c0 tx=0x7f55d0005b50 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- 172.21.15.18:0/265404056 shutdown_connections 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x5560070578a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 --2- 172.21.15.18:0/265404056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x55600704ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- 172.21.15.18:0/265404056 >> 172.21.15.18:0/265404056 conn(0x556007049010 msgr2=0x5560070493f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- 172.21.15.18:0/265404056 shutdown_connections 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- 172.21.15.18:0/265404056 wait complete. 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.704+0000 7f55edc35740 1 -- start start 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 Processor -- start 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007054db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 0x5560070552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556006f6dd20 con 0x55600704f200 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x556006fae000 con 0x556007057de0 2024-04-21T22:43:45.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55600705abd0 con 0x55600704e8e0 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55edc35740 10 client.0 _ll_register_callbacks cb 0x556006fa90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 0x5560070552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55e9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55e9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:57766/0 (socket says 172.21.15.18:57766) 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55e9000640 1 -- 172.21.15.18:0/1432960285 learned_addr learned my addr 172.21.15.18:0/1432960285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.705+0000 7f55e3e00640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007054db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 -- 172.21.15.18:0/1432960285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 msgr2=0x556007054db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007054db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 -- 172.21.15.18:0/1432960285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 msgr2=0x5560070552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 0x5560070552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 -- 172.21.15.18:0/1432960285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556006deef70 con 0x556007057de0 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e3400640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 0x5560070552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55e9000640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0989b0 tx=0x7f55dc09bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7607cd2e1c6d748 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55ce000640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:43:45.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc098650 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f55dc0a47c0 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.706+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d40047a0 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55dc0987f0 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 10 client.27986 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556006c86170 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d40047a0 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f55dc09b4c0 con 0x556007057de0 2024-04-21T22:43:45.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 10 client.27986 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 10 client.27986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 20 client.27986 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556007068080 0x55600706a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 4 client.27986 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.707+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556006fbf580 con 0x556007068080 2024-04-21T22:43:45.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.708+0000 7f55e3e00640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556007068080 0x55600706a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.708+0000 7f55e3e00640 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556007068080 0x55600706a490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc376f8e461fff8a server_cookie=95f7d6b12c83492f in_seq=0 out_seq=0 2024-04-21T22:43:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.708+0000 7f55ce000640 10 client.27986 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55ce000640 1 -- 172.21.15.18:0/1432960285 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556006fbf580 con 0x556007068080 2024-04-21T22:43:45.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55ce000640 10 client.27986 handle_command_reply: tid=0 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 client.27986 shutdown 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 msgr2=0x556007055830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0989b0 tx=0x7f55dc09bfe0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 shutdown_connections 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x556007057de0 0x556007055830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704f200 0x5560070552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x556007068080 0x55600706a490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.709+0000 7f55edc35740 1 --2- 172.21.15.18:0/1432960285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007054db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.710+0000 7f55ce000640 0 client.27986 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.710+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 >> 172.21.15.18:0/1432960285 conn(0x556007049010 msgr2=0x55600704ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.710+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 shutdown_connections 2024-04-21T22:43:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.710+0000 7f55edc35740 1 -- 172.21.15.18:0/1432960285 wait complete. 2024-04-21T22:43:45.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.710+0000 7f55edc35740 20 client.27986 trim_cache size 0 max 16384 2024-04-21T22:43:45.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.729+0000 7f55edc35740 1 Processor -- start 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 -- start start 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007063910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x556007054690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41af580 con 0x556007057de0 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b10c0 con 0x55600704f200 2024-04-21T22:43:45.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55edc35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41afc50 con 0x55600704e8e0 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55e9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55e9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44642/0 (socket says 172.21.15.18:44642) 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55e9000640 1 -- 172.21.15.18:0/181475942 learned_addr learned my addr 172.21.15.18:0/181475942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55e3e00640 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007063910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.730+0000 7f55e3400640 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x556007054690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 -- 172.21.15.18:0/181475942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 msgr2=0x556007063910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007063910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 -- 172.21.15.18:0/181475942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 msgr2=0x556007054690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x556007054690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 -- 172.21.15.18:0/181475942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600705a540 con 0x556007057de0 2024-04-21T22:43:45.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55e9000640 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c760 tx=0x7f55dc005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef6121f3e73787 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55d8c00640 1 -- 172.21.15.18:0/181475942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc07e070 con 0x556007057de0 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55d8c00640 1 -- 172.21.15.18:0/181475942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc0051d0 con 0x556007057de0 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.731+0000 7f55d8c00640 1 -- 172.21.15.18:0/181475942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0a47c0 con 0x556007057de0 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 -- 172.21.15.18:0/181475942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 msgr2=0x55600706fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c760 tx=0x7f55dc005940 comp rx=0 tx=0).stop 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 -- 172.21.15.18:0/181475942 shutdown_connections 2024-04-21T22:43:45.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556007057de0 0x55600706fd30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x556007054690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 --2- 172.21.15.18:0/181475942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600704e8e0 0x556007063910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 -- 172.21.15.18:0/181475942 >> 172.21.15.18:0/181475942 conn(0x556007049010 msgr2=0x5560070477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 -- 172.21.15.18:0/181475942 shutdown_connections 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.732+0000 7f55edc35740 1 -- 172.21.15.18:0/181475942 wait complete. 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.733+0000 7f55edc35740 1 -- start start 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.733+0000 7f55edc35740 1 Processor -- start 2024-04-21T22:43:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.733+0000 7f55edc35740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.733+0000 7f55edc35740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x55600705b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55edc35740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55edc35740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b09f0 con 0x55600704e8e0 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55edc35740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b0320 con 0x55600704f200 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55edc35740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41ad580 con 0x556007057de0 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55edc35740 10 client.0 _ll_register_callbacks cb 0x7f55dc005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x55600705b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44654/0 (socket says 172.21.15.18:44654) 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 -- 172.21.15.18:0/3919392311 learned_addr learned my addr 172.21.15.18:0/3919392311 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 -- 172.21.15.18:0/3919392311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 msgr2=0x55600705b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 -- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 msgr2=0x55600705b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x55600705b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.734+0000 7f55e3e00640 1 -- 172.21.15.18:0/3919392311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55600705c050 con 0x55600704e8e0 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55e3e00640 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009cf0 tx=0x7f55d4009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccecd0d66b7fd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55ce000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d402cbd0 con 0x55600704e8e0 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f55d402cd70 con 0x55600704e8e0 2024-04-21T22:43:45.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55dc0051d0 con 0x55600704e8e0 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55d403e050 con 0x55600704e8e0 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55edc35740 10 client.17913 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5560070ce4a0 con 0x55600704e8e0 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.735+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc0051d0 con 0x55600704e8e0 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f55d4019710 con 0x55600704e8e0 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 10 client.17913 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:45.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 20 client.17913 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5560070ceae0 0x5560070d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 4 client.17913 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-21T22:43:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556006fb98d0 con 0x5560070ceae0 2024-04-21T22:43:45.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.736+0000 7f55e3400640 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5560070ceae0 0x5560070d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.737+0000 7f55e3400640 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5560070ceae0 0x5560070d0f00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f34c35e453b9f8b server_cookie=4ee154d91b8ee93c in_seq=0 out_seq=0 2024-04-21T22:43:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.737+0000 7f55ce000640 10 client.17913 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55ce000640 1 -- 172.21.15.18:0/3919392311 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556006fb98d0 con 0x5560070ceae0 2024-04-21T22:43:45.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55ce000640 10 client.17913 handle_command_reply: tid=0 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 client.17913 shutdown 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 msgr2=0x5560070600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009cf0 tx=0x7f55d4009530 comp rx=0 tx=0).stop 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 shutdown_connections 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x5560070ceae0 0x5560070d0f00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556007057de0 0x55600705b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55600704f200 0x55600705b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 --2- 172.21.15.18:0/3919392311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55600704e8e0 0x5560070600b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55ce000640 0 client.17913 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 >> 172.21.15.18:0/3919392311 conn(0x556007049010 msgr2=0x556007048080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.738+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 shutdown_connections 2024-04-21T22:43:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55edc35740 1 -- 172.21.15.18:0/3919392311 wait complete. 2024-04-21T22:43:45.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55edc35740 20 client.17913 trim_cache size 0 max 16384 2024-04-21T22:43:45.746 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-21T22:43:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "60b6c20a-aeb5-4aed-b923-4bbb62567a5f", 2024-04-21T22:43:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-21T22:43:45.747 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 msgr2=0x7f55c80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 0x7f55c80a51c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f55d002c8c0 tx=0x7f55d0005b50 comp rx=0 tx=0).stop 2024-04-21T22:43:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 msgr2=0x7f55e419e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:45.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 0x7f55e419e910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009fd0 tx=0x7f55dc00ef10 comp rx=0 tx=0).stop 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 shutdown_connections 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f55c80a2d00 0x7f55c80a51c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55e410de00 0x7f55e419e910 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4074410 0x7f55e419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 --2- 172.21.15.18:0/1013928692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55e4073af0 0x7f55e419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.739+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 >> 172.21.15.18:0/1013928692 conn(0x7f55e40fd090 msgr2=0x7f55e40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.740+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 shutdown_connections 2024-04-21T22:43:45.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:45.740+0000 7f55e9a00640 1 -- 172.21.15.18:0/1013928692 wait complete. 2024-04-21T22:43:45.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:43:45.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:43:45.829 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:45 smithi018 ceph-mon[26614]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:45 smithi081 ceph-mon[31692]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:45.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:45 smithi047 ceph-mon[31561]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:43:46.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 -- 172.21.15.18:0/3680810180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100e50 msgr2=0x7f5abc10dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 --2- 172.21.15.18:0/3680810180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100e50 0x7f5abc10dba0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009860 tx=0x7f5aa402bb70 comp rx=0 tx=0).stop 2024-04-21T22:43:46.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 -- 172.21.15.18:0/3680810180 shutdown_connections 2024-04-21T22:43:46.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 --2- 172.21.15.18:0/3680810180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc10e0e0 0x7f5abc1104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 --2- 172.21.15.18:0/3680810180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100e50 0x7f5abc10dba0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 --2- 172.21.15.18:0/3680810180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc100530 0x7f5abc100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 -- 172.21.15.18:0/3680810180 >> 172.21.15.18:0/3680810180 conn(0x7f5abc0777f0 msgr2=0x7f5abc077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 -- 172.21.15.18:0/3680810180 shutdown_connections 2024-04-21T22:43:46.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.006+0000 7f5ac1200640 1 -- 172.21.15.18:0/3680810180 wait complete. 2024-04-21T22:43:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.007+0000 7f5ac1200640 1 Processor -- start 2024-04-21T22:43:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.007+0000 7f5ac1200640 1 -- start start 2024-04-21T22:43:46.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100530 0x7f5abc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc10e0e0 0x7f5abc19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc113d10 con 0x7f5abc10e0e0 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc113b90 con 0x7f5abc100530 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ac1200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc113e90 con 0x7f5abc100e50 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33690/0 (socket says 172.21.15.18:33690) 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ab3e00640 1 -- 172.21.15.18:0/996488924 learned_addr learned my addr 172.21.15.18:0/996488924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:46.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100530 0x7f5abc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.008+0000 7f5aba800640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc10e0e0 0x7f5abc19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 -- 172.21.15.18:0/996488924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100530 msgr2=0x7f5abc19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100530 0x7f5abc19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 -- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc10e0e0 msgr2=0x7f5abc19ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc10e0e0 0x7f5abc19ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 -- 172.21.15.18:0/996488924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc19f1c0 con 0x7f5abc100e50 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.009+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4037040 tx=0x7f5aa40045b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.010+0000 7f5ab2a00640 1 -- 172.21.15.18:0/996488924 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4041020 con 0x7f5abc100e50 2024-04-21T22:43:46.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.010+0000 7f5ab2a00640 1 -- 172.21.15.18:0/996488924 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aa402c9f0 con 0x7f5abc100e50 2024-04-21T22:43:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.010+0000 7f5ab2a00640 1 -- 172.21.15.18:0/996488924 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4039040 con 0x7f5abc100e50 2024-04-21T22:43:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.010+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc19f450 con 0x7f5abc100e50 2024-04-21T22:43:46.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.010+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5abc1a6d40 con 0x7f5abc100e50 2024-04-21T22:43:46.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.014+0000 7f5ab2a00640 1 -- 172.21.15.18:0/996488924 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5aa4044020 con 0x7f5abc100e50 2024-04-21T22:43:46.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.014+0000 7f5ac3f82740 1 Processor -- start 2024-04-21T22:43:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.014+0000 7f5ac3f82740 1 -- start start 2024-04-21T22:43:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c5eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c67880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5bc2410 con 0x55f6f5c67dc0 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5b6a7e0 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5bbe3d0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c67880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c67880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:36064/0 (socket says 172.21.15.18:36064) 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ab9e00640 1 -- 172.21.15.18:0/910799461 learned_addr learned my addr 172.21.15.18:0/910799461 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:46.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5aba800640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c5eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.015+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 -- 172.21.15.18:0/910799461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 msgr2=0x55f6f5c67880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c67880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 -- 172.21.15.18:0/910799461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 msgr2=0x55f6f5c6a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 -- 172.21.15.18:0/910799461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f59a07d0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5ab2a00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 0x7f5aa00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.016+0000 7f5aba800640 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c5eca0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005fd0 tx=0x7f5ab40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cbdc8154c6661b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.017+0000 7f5ab2a00640 1 -- 172.21.15.18:0/996488924 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f5aa40f0ad0 con 0x7f5abc100e50 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.017+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 0x7f5aa00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.017+0000 7f5aab400640 1 -- 172.21.15.18:0/910799461 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4003b70 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.017+0000 7f5aab400640 1 -- 172.21.15.18:0/910799461 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab4003d10 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.017+0000 7f5aab400640 1 -- 172.21.15.18:0/910799461 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4004590 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 -- 172.21.15.18:0/910799461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 msgr2=0x55f6f5c5eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c5eca0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4005fd0 tx=0x7f5ab40095c0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 0x7f5aa00a5240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f6f5c5e390 tx=0x7f5aac005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 -- 172.21.15.18:0/910799461 shutdown_connections 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c67880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/910799461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c5eca0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 -- 172.21.15.18:0/910799461 >> 172.21.15.18:0/910799461 conn(0x55f6f5c58ff0 msgr2=0x55f6f5c593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 -- 172.21.15.18:0/910799461 shutdown_connections 2024-04-21T22:43:46.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.018+0000 7f5ac3f82740 1 -- 172.21.15.18:0/910799461 wait complete. 2024-04-21T22:43:46.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.019+0000 7f5ac3f82740 1 -- start start 2024-04-21T22:43:46.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.019+0000 7f5ac3f82740 1 Processor -- start 2024-04-21T22:43:46.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c64e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5c6abb0 con 0x55f6f5c67dc0 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5b7dc40 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f6f5c6ad30 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ac3f82740 10 client.0 _ll_register_callbacks cb 0x55f6f5b7d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33714/0 (socket says 172.21.15.18:33714) 2024-04-21T22:43:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c64e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 -- 172.21.15.18:0/3544068871 learned_addr learned my addr 172.21.15.18:0/3544068871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5aba800640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 -- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5e8c0 msgr2=0x55f6f5c64e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c64e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 -- 172.21.15.18:0/3544068871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 msgr2=0x55f6f5c658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.020+0000 7f5ab3e00640 1 -- 172.21.15.18:0/3544068871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f58d63f0 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5aa402c180 tx=0x7f5aa40095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d2a82c08f676ff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5a9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4034640 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f5aa40c1160 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ab4003d10 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5aa40bd7d0 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5ac3f82740 10 client.28066 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.021+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f6f58960f0 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab4003d10 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5aa403c030 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 10 client.28066 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:46.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 10 client.28066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:46.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 20 client.28066 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:46.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5c77ff0 0x55f6f5c7a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 4 client.28066 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:43:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.022+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f5bd5c40 con 0x55f6f5c77ff0 2024-04-21T22:43:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.023+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5c77ff0 0x55f6f5c7a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.023+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5c77ff0 0x55f6f5c7a420 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d2aa7c3a26cedb server_cookie=3606fca1b14ca78c in_seq=0 out_seq=0 2024-04-21T22:43:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.023+0000 7f5a9fe00640 10 client.28066 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.024+0000 7f5a9fe00640 1 -- 172.21.15.18:0/3544068871 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f6f5bd5c40 con 0x55f6f5c77ff0 2024-04-21T22:43:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.024+0000 7f5a9fe00640 10 client.28066 handle_command_reply: tid=0 2024-04-21T22:43:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.024+0000 7f5ac3f82740 1 client.28066 shutdown 2024-04-21T22:43:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.024+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 msgr2=0x55f6f5c653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.024+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5aa402c180 tx=0x7f5aa40095b0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 shutdown_connections 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5c77ff0 0x55f6f5c7a420 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c653a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/3544068871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c64e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5a9fe00640 0 client.28066 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 >> 172.21.15.18:0/3544068871 conn(0x55f6f5c58ff0 msgr2=0x55f6f5c5ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 shutdown_connections 2024-04-21T22:43:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 1 -- 172.21.15.18:0/3544068871 wait complete. 2024-04-21T22:43:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.025+0000 7f5ac3f82740 20 client.28066 trim_cache size 0 max 16384 2024-04-21T22:43:46.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 Processor -- start 2024-04-21T22:43:46.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 -- start start 2024-04-21T22:43:46.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c73a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c7fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1af740 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1b1280 con 0x55f6f5c67dc0 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.051+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1afe10 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33726/0 (socket says 172.21.15.18:33726) 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 -- 172.21.15.18:0/2453272893 learned_addr learned my addr 172.21.15.18:0/2453272893 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5aba800640 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c7fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 -- 172.21.15.18:0/2453272893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 msgr2=0x55f6f5c7fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c7fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 -- 172.21.15.18:0/2453272893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 msgr2=0x55f6f5c73a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c73a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.052+0000 7f5ab9e00640 1 -- 172.21.15.18:0/2453272893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f5c6a520 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.053+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55f6f5c7ac90 tx=0x7f5aac019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74f520313e80716 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.053+0000 7f5aaaa00640 1 -- 172.21.15.18:0/2453272893 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac031070 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.053+0000 7f5aaaa00640 1 -- 172.21.15.18:0/2453272893 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac01ddf0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.053+0000 7f5aaaa00640 1 -- 172.21.15.18:0/2453272893 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac02aae0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 -- 172.21.15.18:0/2453272893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 msgr2=0x55f6f5c67590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55f6f5c7ac90 tx=0x7f5aac019000 comp rx=0 tx=0).stop 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 -- 172.21.15.18:0/2453272893 shutdown_connections 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c7fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c73a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/2453272893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c67590 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 -- 172.21.15.18:0/2453272893 >> 172.21.15.18:0/2453272893 conn(0x55f6f5c58ff0 msgr2=0x55f6f5c593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 -- 172.21.15.18:0/2453272893 shutdown_connections 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.054+0000 7f5ac3f82740 1 -- 172.21.15.18:0/2453272893 wait complete. 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.055+0000 7f5ac3f82740 1 -- start start 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.055+0000 7f5ac3f82740 1 Processor -- start 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c6c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1b0bb0 con 0x55f6f5c5f1e0 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1b04e0 con 0x55f6f5c67dc0 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5abc1ad740 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ac3f82740 10 client.0 _ll_register_callbacks cb 0x7f5aa40326c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c6c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ab9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:33730/0 (socket says 172.21.15.18:33730) 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5ab9e00640 1 -- 172.21.15.18:0/363207700 learned_addr learned my addr 172.21.15.18:0/363207700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.056+0000 7f5aba800640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 -- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 msgr2=0x55f6f5c6c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 -- 172.21.15.18:0/363207700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 msgr2=0x55f6f5c6c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c6c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 -- 172.21.15.18:0/363207700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f5cdd6c0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c6c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5aba800640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ab9e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02f040 tx=0x7f5aac0098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2ab1d8c75be07c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:43:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5a9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac03a060 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aac01ddf0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.057+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8571+0+0 (secure 0 0 0) 0x7f5aac005240 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5aac031040 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 10 client.28072 fetch_fsmap learned FSMap version 38 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f6f5cde9b0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac01ddf0 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5aac034070 con 0x55f6f5c5e8c0 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 10 client.28072 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 10 client.28072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 20 client.28072 populate_metadata read hostname 'smithi018' 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5cdeff0 0x55f6f5ce1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 4 client.28072 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.058+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6f5bcf950 con 0x55f6f5cdeff0 2024-04-21T22:43:46.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.059+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5cdeff0 0x55f6f5ce1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:43:46.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.059+0000 7f5ab3e00640 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5cdeff0 0x55f6f5ce1410 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=284b2d3c1de173f9 server_cookie=5f016e94b2019e1f in_seq=0 out_seq=0 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.059+0000 7f5a9fe00640 10 client.28072 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.059+0000 7f5a9fe00640 1 -- 172.21.15.18:0/363207700 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f6f5bcf950 con 0x55f6f5cdeff0 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5a9fe00640 10 client.28072 handle_command_reply: tid=0 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 client.28072 shutdown 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 msgr2=0x55f6f5c6bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02f040 tx=0x7f5aac0098c0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 shutdown_connections 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55f6f5c67dc0 0x55f6f5c6c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f6f5c5f1e0 0x55f6f5c6c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x55f6f5cdeff0 0x55f6f5ce1410 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 --2- 172.21.15.18:0/363207700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6f5c5e8c0 0x55f6f5c6bb30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 >> 172.21.15.18:0/363207700 conn(0x55f6f5c58ff0 msgr2=0x55f6f5c57800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5a9fe00640 0 client.28072 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 shutdown_connections 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 1 -- 172.21.15.18:0/363207700 wait complete. 2024-04-21T22:43:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.060+0000 7f5ac3f82740 20 client.28072 trim_cache size 0 max 16384 2024-04-21T22:43:46.070 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:43:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-21T22:43:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-21T22:43:46.070 INFO:teuthology.orchestra.run.smithi018.stdout: "60b6c20a-aeb5-4aed-b923-4bbb62567a5f": { 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "60b6c20a-aeb5-4aed-b923-4bbb62567a5f", 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,force" 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:43:46.071 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 msgr2=0x7f5aa00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 0x7f5aa00a5240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f6f5c5e390 tx=0x7f5aac005f90 comp rx=0 tx=0).stop 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 msgr2=0x7f5abc19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4037040 tx=0x7f5aa40045b0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 shutdown_connections 2024-04-21T22:43:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5aa00a2d80 0x7f5aa00a5240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5abc10e0e0 0x7f5abc19ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5abc100e50 0x7f5abc19a710 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 --2- 172.21.15.18:0/996488924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5abc100530 0x7f5abc19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.061+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 >> 172.21.15.18:0/996488924 conn(0x7f5abc0777f0 msgr2=0x7f5abc10f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.062+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 shutdown_connections 2024-04-21T22:43:46.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:43:46.062+0000 7f5ac1200640 1 -- 172.21.15.18:0/996488924 wait complete. 2024-04-21T22:43:46.083 INFO:tasks.cephfs.filesystem:scrub status for tag:60b6c20a-aeb5-4aed-b923-4bbb62567a5f - {'path': '/', 'tag': '60b6c20a-aeb5-4aed-b923-4bbb62567a5f', 'options': 'recursive,force'} 2024-04-21T22:43:46.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub queued for path: / 2024-04-21T22:43:46.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:46.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:46.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:46.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:46.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:46 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub queued for path: / 2024-04-21T22:43:46.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:46 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub queued for path: / 2024-04-21T22:43:46.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:46.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:46 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:47 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:47.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:47 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:47 smithi018 ceph-mon[26614]: scrub summary: active paths [/] 2024-04-21T22:43:47.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:47 smithi018 ceph-mon[26614]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:47 smithi018 ceph-mon[26614]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:47 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:47 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:47 smithi081 ceph-mon[31692]: scrub summary: active paths [/] 2024-04-21T22:43:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:47 smithi081 ceph-mon[31692]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:47 smithi081 ceph-mon[31692]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:47.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:47 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:47.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:47 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:47 smithi047 ceph-mon[31561]: scrub summary: active paths [/] 2024-04-21T22:43:47.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:47 smithi047 ceph-mon[31561]: scrub summary: idle+waiting paths [/] 2024-04-21T22:43:47.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:47 smithi047 ceph-mon[31561]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:43:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:49 smithi018 ceph-mon[26614]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:49 smithi081 ceph-mon[31692]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:49.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:49 smithi047 ceph-mon[31561]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:51 smithi018 ceph-mon[26614]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:51.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:51 smithi081 ceph-mon[31692]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:51.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:51 smithi047 ceph-mon[31561]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:53.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:53 smithi018 ceph-mon[26614]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:53.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:53 smithi081 ceph-mon[31692]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:53.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:53 smithi047 ceph-mon[31561]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:55.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:55 smithi018 ceph-mon[26614]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:55.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:55 smithi081 ceph-mon[31692]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:55.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:55 smithi047 ceph-mon[31561]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:57.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:57 smithi018 ceph-mon[26614]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:57.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:57 smithi081 ceph-mon[31692]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:57.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:57 smithi047 ceph-mon[31561]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:43:58.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:58 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:58.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:58 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:58.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:58 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:58.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:58 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:58.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:58 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:58.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:58 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:58.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:58 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:58.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:58 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:58.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:58 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:59.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:59 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:59.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:59 smithi018 ceph-mon[26614]: scrub summary: idle 2024-04-21T22:43:59.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:43:59 smithi018 ceph-mon[26614]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:59.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:59 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:59.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:59 smithi081 ceph-mon[31692]: scrub summary: idle 2024-04-21T22:43:59.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:43:59 smithi081 ceph-mon[31692]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:43:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:59 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:59 smithi047 ceph-mon[31561]: scrub summary: idle 2024-04-21T22:43:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:43:59 smithi047 ceph-mon[31561]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-04-21T22:44:01.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:01 smithi018 ceph-mon[26614]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:01.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:01 smithi081 ceph-mon[31692]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:01.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:01 smithi047 ceph-mon[31561]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:03.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:03 smithi018 ceph-mon[26614]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:03 smithi081 ceph-mon[31692]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:03 smithi047 ceph-mon[31561]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:05.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:05 smithi018 ceph-mon[26614]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:05 smithi081 ceph-mon[31692]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:05 smithi047 ceph-mon[31561]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:07.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:07 smithi018 ceph-mon[26614]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:44:07.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:07 smithi081 ceph-mon[31692]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:44:07.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:07 smithi047 ceph-mon[31561]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:44:09.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:09 smithi081 ceph-mon[31692]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:09.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:09 smithi081 ceph-mon[31692]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T22:44:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:09 smithi047 ceph-mon[31561]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:09 smithi047 ceph-mon[31561]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T22:44:10.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:09 smithi018 ceph-mon[26614]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:44:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:09 smithi018 ceph-mon[26614]: osdmap e95: 12 total, 12 up, 12 in 2024-04-21T22:44:11.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:11 smithi081 ceph-mon[31692]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:11.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:11 smithi047 ceph-mon[31561]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:12.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:11 smithi018 ceph-mon[26614]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:13.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-21T22:44:13.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:13 smithi081 ceph-mon[31692]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:13.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:13 smithi047 ceph-mon[31561]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 -- 172.21.15.18:0/4167115003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c381097b0 msgr2=0x7f1c38109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/4167115003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c381097b0 0x7f1c38109b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009930 tx=0x7f1c2c02bc20 comp rx=0 tx=0).stop 2024-04-21T22:44:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 -- 172.21.15.18:0/4167115003 shutdown_connections 2024-04-21T22:44:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/4167115003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c38104160 0x7f1c38110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/4167115003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381037a0 0x7f1c38103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/4167115003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c381097b0 0x7f1c38109b90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 -- 172.21.15.18:0/4167115003 >> 172.21.15.18:0/4167115003 conn(0x7f1c380ff250 msgr2=0x7f1c38101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 -- 172.21.15.18:0/4167115003 shutdown_connections 2024-04-21T22:44:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.965+0000 7f1c3ec00640 1 -- 172.21.15.18:0/4167115003 wait complete. 2024-04-21T22:44:13.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 Processor -- start 2024-04-21T22:44:13.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 -- start start 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38104160 0x7f1c3819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 0x7f1c3819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38113c10 con 0x7f1c381037a0 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38113a90 con 0x7f1c381097b0 2024-04-21T22:44:13.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3ec00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38113d90 con 0x7f1c38104160 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.967+0000 7f1c3d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54808/0 (socket says 172.21.15.18:54808) 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 -- 172.21.15.18:0/807210551 learned_addr learned my addr 172.21.15.18:0/807210551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3e200640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 0x7f1c3819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3ce00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38104160 0x7f1c3819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 -- 172.21.15.18:0/807210551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38104160 msgr2=0x7f1c3819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38104160 0x7f1c3819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:13.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 -- 172.21.15.18:0/807210551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 msgr2=0x7f1c3819e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 0x7f1c3819e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 -- 172.21.15.18:0/807210551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3819f0d0 con 0x7f1c381037a0 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3e200640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 0x7f1c3819e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.968+0000 7f1c3d800640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005ab0 tx=0x7f1c2c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.969+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c043020 con 0x7f1c381037a0 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.969+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3819f360 con 0x7f1c381037a0 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.969+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c2c0054e0 con 0x7f1c381037a0 2024-04-21T22:44:13.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.969+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c381a6c50 con 0x7f1c381037a0 2024-04-21T22:44:13.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.969+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c003bf0 con 0x7f1c381037a0 2024-04-21T22:44:13.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.970+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38067fe0 con 0x7f1c381037a0 2024-04-21T22:44:13.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.972+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1c2c046020 con 0x7f1c381037a0 2024-04-21T22:44:13.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.974+0000 7f1c36000640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 0x7f1c200a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:13.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.974+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f1c2c0f1360 con 0x7f1c381037a0 2024-04-21T22:44:13.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.974+0000 7f1c3ce00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 0x7f1c200a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:13.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.975+0000 7f1c3ce00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 0x7f1c200a51a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c381018e0 tx=0x7f1c2400b390 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:13.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:13.979+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f1c2c04d020 con 0x7f1c381037a0 2024-04-21T22:44:14.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:13 smithi018 ceph-mon[26614]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-21T22:44:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.253+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f1c38061b80 con 0x7f1c200a2ce0 2024-04-21T22:44:14.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.268+0000 7f1c36000640 1 -- 172.21.15.18:0/807210551 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f1c38061b80 con 0x7f1c200a2ce0 2024-04-21T22:44:14.268 INFO:teuthology.orchestra.run.smithi018.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-21T00:00:00", "created": "2024-04-21T22:34:11", "first": "2024-04-21T22:35:00", "last": "2024-04-21T22:44:00", "last_pruned": "2024-04-21T22:44:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-21T22:44:14.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 msgr2=0x7f1c200a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 0x7f1c200a51a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c381018e0 tx=0x7f1c2400b390 comp rx=0 tx=0).stop 2024-04-21T22:44:14.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 msgr2=0x7f1c3819a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c005ab0 tx=0x7f1c2c0043b0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 shutdown_connections 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f1c200a2ce0 0x7f1c200a51a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c381097b0 0x7f1c3819e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c38104160 0x7f1c3819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 --2- 172.21.15.18:0/807210551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c381037a0 0x7f1c3819a130 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 >> 172.21.15.18:0/807210551 conn(0x7f1c380ff250 msgr2=0x7f1c380ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 shutdown_connections 2024-04-21T22:44:14.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.271+0000 7f1c3ec00640 1 -- 172.21.15.18:0/807210551 wait complete. 2024-04-21T22:44:14.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-21T22:44:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 -- 172.21.15.18:0/2884882382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 msgr2=0x7f615810e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 --2- 172.21.15.18:0/2884882382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f615810e040 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f614c009900 tx=0x7f614c02bcc0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 -- 172.21.15.18:0/2884882382 shutdown_connections 2024-04-21T22:44:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 --2- 172.21.15.18:0/2884882382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158108540 0x7f6158114a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 --2- 172.21.15.18:0/2884882382 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158107ba0 0x7f6158108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 --2- 172.21.15.18:0/2884882382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f615810e040 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.489+0000 7f615f200640 1 -- 172.21.15.18:0/2884882382 >> 172.21.15.18:0/2884882382 conn(0x7f61580772f0 msgr2=0x7f6158079710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.490+0000 7f615f200640 1 -- 172.21.15.18:0/2884882382 shutdown_connections 2024-04-21T22:44:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.490+0000 7f615f200640 1 -- 172.21.15.18:0/2884882382 wait complete. 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.491+0000 7f615f200640 1 Processor -- start 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.491+0000 7f615f200640 1 -- start start 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.491+0000 7f615f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 0x7f615819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.491+0000 7f615f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 0x7f615819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.491+0000 7f615f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6158117fd0 con 0x7f6158108540 2024-04-21T22:44:14.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6158117e50 con 0x7f6158107ba0 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6158118150 con 0x7f615810dc60 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 0x7f615819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 0x7f615819e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54818/0 (socket says 172.21.15.18:54818) 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:37750/0 (socket says 172.21.15.18:37750) 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615d400640 1 -- 172.21.15.18:0/3701109982 learned_addr learned my addr 172.21.15.18:0/3701109982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:14.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615de00640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 0x7f615819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 -- 172.21.15.18:0/3701109982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 msgr2=0x7f615819e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 0x7f615819e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 -- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 msgr2=0x7f615819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 0x7f615819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615e800640 1 -- 172.21.15.18:0/3701109982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61581a3380 con 0x7f615810dc60 2024-04-21T22:44:14.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.492+0000 7f615de00640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 0x7f615819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:14.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f615e800640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fd0 tx=0x7f615400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:14.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615400ce20 con 0x7f615810dc60 2024-04-21T22:44:14.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61581a3670 con 0x7f615810dc60 2024-04-21T22:44:14.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6154005020 con 0x7f615810dc60 2024-04-21T22:44:14.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154010720 con 0x7f615810dc60 2024-04-21T22:44:14.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.493+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61581aaf00 con 0x7f615810dc60 2024-04-21T22:44:14.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.494+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6158067fe0 con 0x7f615810dc60 2024-04-21T22:44:14.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.496+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6154005540 con 0x7f615810dc60 2024-04-21T22:44:14.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.498+0000 7f6152a00640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 0x7f61400a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:14.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.498+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f61540cfaa0 con 0x7f615810dc60 2024-04-21T22:44:14.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.498+0000 7f615de00640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 0x7f61400a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:14.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.499+0000 7f615de00640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 0x7f61400a5220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f614c005ab0 tx=0x7f614c005a20 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:14.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.502+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f615409c600 con 0x7f615810dc60 2024-04-21T22:44:14.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.730+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 --> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6158079060 con 0x7f61400a2d60 2024-04-21T22:44:14.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.742+0000 7f6152a00640 1 -- 172.21.15.18:0/3701109982 <== mgr.25309 v2:172.21.15.18:6800/325159611 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6158079060 con 0x7f61400a2d60 2024-04-21T22:44:14.742 INFO:teuthology.orchestra.run.smithi018.stdout:/ 1m 6m3h 2024-04-21T22:44:14.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 msgr2=0x7f61400a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 0x7f61400a5220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f614c005ab0 tx=0x7f614c005a20 comp rx=0 tx=0).stop 2024-04-21T22:44:14.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 msgr2=0x7f61581a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6154009fd0 tx=0x7f615400ef10 comp rx=0 tx=0).stop 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 shutdown_connections 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f61400a2d60 0x7f61400a5220 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615810dc60 0x7f61581a2c50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6158108540 0x7f615819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 --2- 172.21.15.18:0/3701109982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6158107ba0 0x7f615819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.744+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 >> 172.21.15.18:0/3701109982 conn(0x7f61580772f0 msgr2=0x7f6158078950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:14.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.745+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 shutdown_connections 2024-04-21T22:44:14.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:14.745+0000 7f615f200640 1 -- 172.21.15.18:0/3701109982 wait complete. 2024-04-21T22:44:14.764 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-21T22:44:14.775 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-21T22:44:15.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:15 smithi081 ceph-mon[31692]: from='client.17934 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:15.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:15 smithi081 ceph-mon[31692]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:15 smithi047 ceph-mon[31561]: from='client.17934 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:15.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:15 smithi047 ceph-mon[31561]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:16.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-21T22:44:16.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-21T22:44:16.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:15 smithi018 ceph-mon[26614]: from='client.17934 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:16.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:15 smithi018 ceph-mon[26614]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.306+0000 7f22a5200640 1 -- 172.21.15.18:0/2789008527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0107620 msgr2=0x7f22a0107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.306+0000 7f22a5200640 1 --2- 172.21.15.18:0/2789008527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0107620 0x7f22a0107a00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2290009ca0 tx=0x7f229002c100 comp rx=0 tx=0).stop 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 -- 172.21.15.18:0/2789008527 shutdown_connections 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 --2- 172.21.15.18:0/2789008527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0101f20 0x7f22a010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 --2- 172.21.15.18:0/2789008527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101560 0x7f22a01019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 --2- 172.21.15.18:0/2789008527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0107620 0x7f22a0107a00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 -- 172.21.15.18:0/2789008527 >> 172.21.15.18:0/2789008527 conn(0x7f22a00fd090 msgr2=0x7f22a00ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 -- 172.21.15.18:0/2789008527 shutdown_connections 2024-04-21T22:44:16.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.307+0000 7f22a5200640 1 -- 172.21.15.18:0/2789008527 wait complete. 2024-04-21T22:44:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.308+0000 7f22a5200640 1 Processor -- start 2024-04-21T22:44:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.308+0000 7f22a5200640 1 -- start start 2024-04-21T22:44:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0107620 0x7f22a019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0111900 con 0x7f22a0101560 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0111780 con 0x7f22a0107620 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f22a5200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0111a80 con 0x7f22a0101f20 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53210/0 (socket says 172.21.15.18:53210) 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 -- 172.21.15.18:0/2297926726 learned_addr learned my addr 172.21.15.18:0/2297926726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48804/0 (socket says 172.21.15.18:48804) 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229fe00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0107620 0x7f22a019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 -- 172.21.15.18:0/2297926726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0107620 msgr2=0x7f22a019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0107620 0x7f22a019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 -- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 msgr2=0x7f22a0199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229ea00640 1 -- 172.21.15.18:0/2297926726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a019efb0 con 0x7f22a0101f20 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.309+0000 7f229f400640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f229ea00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f228800d770 tx=0x7f228800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f2297e00640 1 -- 172.21.15.18:0/2297926726 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288017070 con 0x7f22a0101f20 2024-04-21T22:44:16.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a019f2a0 con 0x7f22a0101f20 2024-04-21T22:44:16.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f2297e00640 1 -- 172.21.15.18:0/2297926726 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2288005500 con 0x7f22a0101f20 2024-04-21T22:44:16.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f2297e00640 1 -- 172.21.15.18:0/2297926726 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288004e00 con 0x7f22a0101f20 2024-04-21T22:44:16.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.310+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a01a6b30 con 0x7f22a0101f20 2024-04-21T22:44:16.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 Processor -- start 2024-04-21T22:44:16.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f2297e00640 1 -- 172.21.15.18:0/2297926726 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2288004fa0 con 0x7f22a0101f20 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 -- start start 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bd6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560666b3a410 con 0x560666bd6ab0 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560666ae27e0 con 0x560666bd73d0 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.314+0000 7f22a95a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560666b363d0 con 0x560666bdffb0 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bd6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bd6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48820/0 (socket says 172.21.15.18:48820) 2024-04-21T22:44:16.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40458/0 (socket says 172.21.15.18:40458) 2024-04-21T22:44:16.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229fe00640 1 -- 172.21.15.18:0/2642095551 learned_addr learned my addr 172.21.15.18:0/2642095551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 -- 172.21.15.18:0/2642095551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 msgr2=0x560666be23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 -- 172.21.15.18:0/2642095551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 msgr2=0x560666bd6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bd6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f229f400640 1 -- 172.21.15.18:0/2642095551 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606669187d0 con 0x560666bd73d0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.315+0000 7f2297e00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 0x7f22840a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f229f400640 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f229002c640 tx=0x7f22900099a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776bfcb8c78b7b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f2297e00640 1 -- 172.21.15.18:0/2297926726 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f22880ceee0 con 0x7f22a0101f20 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f229fe00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 0x7f22840a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f2294c00640 1 -- 172.21.15.18:0/2642095551 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290045020 con 0x560666bd73d0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f2294c00640 1 -- 172.21.15.18:0/2642095551 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229003a040 con 0x560666bd73d0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.316+0000 7f2294c00640 1 -- 172.21.15.18:0/2642095551 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290039040 con 0x560666bd73d0 2024-04-21T22:44:16.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- 172.21.15.18:0/2642095551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 msgr2=0x560666bdfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f229002c640 tx=0x7f22900099a0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f229fe00640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 0x7f22840a51c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f229800b850 tx=0x7f229800b2e0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- 172.21.15.18:0/2642095551 shutdown_connections 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666bdfa70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 --2- 172.21.15.18:0/2642095551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bd6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- 172.21.15.18:0/2642095551 >> 172.21.15.18:0/2642095551 conn(0x560666bd11e0 msgr2=0x560666bd15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- 172.21.15.18:0/2642095551 shutdown_connections 2024-04-21T22:44:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- 172.21.15.18:0/2642095551 wait complete. 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.317+0000 7f22a95a9740 1 -- start start 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 Processor -- start 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bdd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bdffb0 0x560666bddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560666be2d40 con 0x560666bd6ab0 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x560666af5c40 con 0x560666bdffb0 2024-04-21T22:44:16.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560666be2ec0 con 0x560666bd73d0 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f22a95a9740 10 client.0 _ll_register_callbacks cb 0x560666af5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48824/0 (socket says 172.21.15.18:48824) 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.318+0000 7f229f400640 1 -- 172.21.15.18:0/3328142050 learned_addr learned my addr 172.21.15.18:0/3328142050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229ea00640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bdd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229fe00640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bdffb0 0x560666bddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 -- 172.21.15.18:0/3328142050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 msgr2=0x560666bdd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bdd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 -- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bdffb0 msgr2=0x560666bddaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bdffb0 0x560666bddaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 -- 172.21.15.18:0/3328142050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56066684e3f0 con 0x560666bd6ab0 2024-04-21T22:44:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f229f400640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2290037040 tx=0x7f2290032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2021f2dea97548 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.319+0000 7f228d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290050070 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229003a040 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f2290032790 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f229005b050 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f22a95a9740 10 client.17952 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56066680e0f0 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.320+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f229003a040 con 0x560666bd6ab0 2024-04-21T22:44:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f2290004280 con 0x560666bd6ab0 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 10 client.17952 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 20 client.17952 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666bf01b0 0x560666bf25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 4 client.17952 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560666b4dc40 con 0x560666bf01b0 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.321+0000 7f229ea00640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666bf01b0 0x560666bf25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.322+0000 7f229ea00640 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666bf01b0 0x560666bf25a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3c0ec4aeec7a2e server_cookie=f43e9940a2881ad0 in_seq=0 out_seq=0 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.322+0000 7f228d600640 10 client.17952 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.322+0000 7f228d600640 1 -- 172.21.15.18:0/3328142050 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560666b4dc40 con 0x560666bf01b0 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.322+0000 7f228d600640 10 client.17952 handle_command_reply: tid=0 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.322+0000 7f22a95a9740 1 client.17952 shutdown 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 msgr2=0x560666bdd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2290037040 tx=0x7f2290032f40 comp rx=0 tx=0).stop 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 shutdown_connections 2024-04-21T22:44:16.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bdffb0 0x560666bddaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666bf01b0 0x560666bf25a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bdd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3328142050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666bdd020 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f228d600640 0 client.17952 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 >> 172.21.15.18:0/3328142050 conn(0x560666bd11e0 msgr2=0x560666bd0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 shutdown_connections 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 1 -- 172.21.15.18:0/3328142050 wait complete. 2024-04-21T22:44:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.323+0000 7f22a95a9740 20 client.17952 trim_cache size 0 max 16384 2024-04-21T22:44:16.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.342+0000 7f22a95a9740 1 Processor -- start 2024-04-21T22:44:16.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.342+0000 7f22a95a9740 1 -- start start 2024-04-21T22:44:16.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 0x560666bdf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bebc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01af4e0 con 0x560666bdffb0 2024-04-21T22:44:16.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01b1020 con 0x560666bd6ab0 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f22a95a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01afbb0 con 0x560666bd73d0 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f229fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f229fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48836/0 (socket says 172.21.15.18:48836) 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f229ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bebc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f229fe00640 1 -- 172.21.15.18:0/3724321668 learned_addr learned my addr 172.21.15.18:0/3724321668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.343+0000 7f229f400640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 0x560666bdf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 -- 172.21.15.18:0/3724321668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 msgr2=0x560666bebc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bebc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 -- 172.21.15.18:0/3724321668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 msgr2=0x560666bdf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 0x560666bdf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 -- 172.21.15.18:0/3724321668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560666be26d0 con 0x560666bdffb0 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229f400640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 0x560666bdf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229ea00640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bebc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f229fe00640 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2298003f40 tx=0x7f2298019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e89ff32d19514d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f228fe00640 1 -- 172.21.15.18:0/3724321668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298029480 con 0x560666bdffb0 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f228fe00640 1 -- 172.21.15.18:0/3724321668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2298029b00 con 0x560666bdffb0 2024-04-21T22:44:16.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.344+0000 7f228fe00640 1 -- 172.21.15.18:0/3724321668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298011bb0 con 0x560666bdffb0 2024-04-21T22:44:16.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 -- 172.21.15.18:0/3724321668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 msgr2=0x560666bf7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2298003f40 tx=0x7f2298019000 comp rx=0 tx=0).stop 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 -- 172.21.15.18:0/3724321668 shutdown_connections 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bdffb0 0x560666bf7c30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bd73d0 0x560666bebc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3724321668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd6ab0 0x560666bdf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 -- 172.21.15.18:0/3724321668 >> 172.21.15.18:0/3724321668 conn(0x560666bd11e0 msgr2=0x560666bd0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 -- 172.21.15.18:0/3724321668 shutdown_connections 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.345+0000 7f22a95a9740 1 -- 172.21.15.18:0/3724321668 wait complete. 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 -- start start 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 Processor -- start 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666be4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01b0950 con 0x560666bd6ab0 2024-04-21T22:44:16.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01b0280 con 0x560666bd73d0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01ad4e0 con 0x560666bdffb0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f22a95a9740 10 client.0 _ll_register_callbacks cb 0x7f22900098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.346+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48838/0 (socket says 172.21.15.18:48838) 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 -- 172.21.15.18:0/3426149168 learned_addr learned my addr 172.21.15.18:0/3426149168 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229ea00640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666be4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229fe00640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 -- 172.21.15.18:0/3426149168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 msgr2=0x560666be45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 -- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 msgr2=0x560666be4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666be4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 -- 172.21.15.18:0/3426149168 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560666c554d0 con 0x560666bd6ab0 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229fe00640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f229f400640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2290002230 tx=0x7f2290009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa7eac2a1ae0f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.347+0000 7f228d600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290050040 con 0x560666bd6ab0 2024-04-21T22:44:16.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f2290032590 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2298029b00 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2290039040 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 10 client.17958 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560666c567a0 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2298029b00 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f2290060ca0 con 0x560666bd6ab0 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 10 client.17958 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:44:16.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 20 client.17958 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666c56f70 0x560666c59390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 4 client.17958 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.348+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560666b47950 con 0x560666c56f70 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f229ea00640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666c56f70 0x560666c59390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f229ea00640 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666c56f70 0x560666c59390 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a6148cd487e82 server_cookie=f7e0ff12c99444e4 in_seq=0 out_seq=0 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f228d600640 10 client.17958 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f228d600640 1 -- 172.21.15.18:0/3426149168 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560666b47950 con 0x560666c56f70 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f228d600640 10 client.17958 handle_command_reply: tid=0 2024-04-21T22:44:16.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.349+0000 7f22a95a9740 1 client.17958 shutdown 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 msgr2=0x560666be3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2290002230 tx=0x7f2290009b90 comp rx=0 tx=0).stop 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 shutdown_connections 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x560666c56f70 0x560666c59390 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560666bdffb0 0x560666be45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560666bd73d0 0x560666be4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 --2- 172.21.15.18:0/3426149168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560666bd6ab0 0x560666be3b40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f228d600640 0 client.17958 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:16.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 >> 172.21.15.18:0/3426149168 conn(0x560666bd11e0 msgr2=0x560666bcfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 shutdown_connections 2024-04-21T22:44:16.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 1 -- 172.21.15.18:0/3426149168 wait complete. 2024-04-21T22:44:16.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.350+0000 7f22a95a9740 20 client.17958 trim_cache size 0 max 16384 2024-04-21T22:44:16.358 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:16.358 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-21T22:44:16.359 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-21T22:44:16.359 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:16.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 msgr2=0x7f22840a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 0x7f22840a51c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f229800b850 tx=0x7f229800b2e0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 msgr2=0x7f22a019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f228800d770 tx=0x7f228800dc30 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 shutdown_connections 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f22840a2d00 0x7f22840a51c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22a0107620 0x7f22a019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22a0101f20 0x7f22a019a500 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 --2- 172.21.15.18:0/2297926726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a0101560 0x7f22a0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 >> 172.21.15.18:0/2297926726 conn(0x7f22a00fd090 msgr2=0x7f22a00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 shutdown_connections 2024-04-21T22:44:16.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.351+0000 7f22a5200640 1 -- 172.21.15.18:0/2297926726 wait complete. 2024-04-21T22:44:16.369 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-21T22:44:16.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:44:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 -- 172.21.15.18:0/3147538047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c109910 msgr2=0x7fc05c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 --2- 172.21.15.18:0/3147538047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c109910 0x7fc05c109cf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009ca0 tx=0x7fc04c02c100 comp rx=0 tx=0).stop 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 -- 172.21.15.18:0/3147538047 shutdown_connections 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 --2- 172.21.15.18:0/3147538047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c1042c0 0x7fc05c1107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 --2- 172.21.15.18:0/3147538047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c103900 0x7fc05c103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 --2- 172.21.15.18:0/3147538047 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c109910 0x7fc05c109cf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 -- 172.21.15.18:0/3147538047 >> 172.21.15.18:0/3147538047 conn(0x7fc05c0ff3f0 msgr2=0x7fc05c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.636+0000 7fc061800640 1 -- 172.21.15.18:0/3147538047 shutdown_connections 2024-04-21T22:44:16.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.637+0000 7fc061800640 1 -- 172.21.15.18:0/3147538047 wait complete. 2024-04-21T22:44:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.638+0000 7fc061800640 1 Processor -- start 2024-04-21T22:44:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.638+0000 7fc061800640 1 -- start start 2024-04-21T22:44:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c109910 0x7fc05c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c113d20 con 0x7fc05c103900 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c113ba0 con 0x7fc05c1042c0 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc061800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c113ea0 con 0x7fc05c109910 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc05aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc052000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc05aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48842/0 (socket says 172.21.15.18:48842) 2024-04-21T22:44:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc052000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40508/0 (socket says 172.21.15.18:40508) 2024-04-21T22:44:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc05aa00640 1 -- 172.21.15.18:0/1841992655 learned_addr learned my addr 172.21.15.18:0/1841992655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.639+0000 7fc05b400640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c109910 0x7fc05c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 -- 172.21.15.18:0/1841992655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c109910 msgr2=0x7fc05c19eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c109910 0x7fc05c19eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 -- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 msgr2=0x7fc05c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 -- 172.21.15.18:0/1841992655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c19f1f0 con 0x7fc05c1042c0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc05aa00640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc052000640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9f0 tx=0x7fc04400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04400ccc0 con 0x7fc05c1042c0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c19f4e0 con 0x7fc05c1042c0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc044005020 con 0x7fc05c1042c0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.640+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044004a00 con 0x7fc05c1042c0 2024-04-21T22:44:16.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.641+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c1a6d70 con 0x7fc05c1042c0 2024-04-21T22:44:16.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.642+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c068a40 con 0x7fc05c1042c0 2024-04-21T22:44:16.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.644+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc0440051d0 con 0x7fc05c1042c0 2024-04-21T22:44:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.645+0000 7fc053e00640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 0x7fc0400a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.645+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fc0440cf3d0 con 0x7fc05c1042c0 2024-04-21T22:44:16.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.645+0000 7fc05aa00640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 0x7fc0400a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:16.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.646+0000 7fc05aa00640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 0x7fc0400a5240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009a60 tx=0x7fc04c005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:16.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.650+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc04409bf30 con 0x7fc05c1042c0 2024-04-21T22:44:16.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:16 smithi018 ceph-mon[26614]: from='client.28084 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:16.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:16 smithi081 ceph-mon[31692]: from='client.28084 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:16.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.896+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc05c02d170 con 0x7fc05c1042c0 2024-04-21T22:44:16.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.897+0000 7fc053e00640 1 -- 172.21.15.18:0/1841992655 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7fc04409b830 con 0x7fc05c1042c0 2024-04-21T22:44:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:44:16.897 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:44:16.898 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:44:16.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 msgr2=0x7fc0400a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 0x7fc0400a5240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009a60 tx=0x7fc04c005d80 comp rx=0 tx=0).stop 2024-04-21T22:44:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 msgr2=0x7fc05c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:16.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9f0 tx=0x7fc04400edf0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 shutdown_connections 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc0400a2d80 0x7fc0400a5240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc05c109910 0x7fc05c19eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc05c1042c0 0x7fc05c19a740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 --2- 172.21.15.18:0/1841992655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c103900 0x7fc05c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 >> 172.21.15.18:0/1841992655 conn(0x7fc05c0ff3f0 msgr2=0x7fc05c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 shutdown_connections 2024-04-21T22:44:16.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:16.900+0000 7fc061800640 1 -- 172.21.15.18:0/1841992655 wait complete. 2024-04-21T22:44:16.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-21T22:44:16.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:16 smithi047 ceph-mon[31561]: from='client.28084 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-21T22:44:17.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.138+0000 7fec07200640 1 -- 172.21.15.18:0/353697761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08107640 msgr2=0x7fec08107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.138+0000 7fec07200640 1 --2- 172.21.15.18:0/353697761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08107640 0x7fec08107a20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7febf8009930 tx=0x7febf802bc30 comp rx=0 tx=0).stop 2024-04-21T22:44:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 -- 172.21.15.18:0/353697761 shutdown_connections 2024-04-21T22:44:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 --2- 172.21.15.18:0/353697761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101f40 0x7fec0810e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 --2- 172.21.15.18:0/353697761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08101580 0x7fec08101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 --2- 172.21.15.18:0/353697761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08107640 0x7fec08107a20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 -- 172.21.15.18:0/353697761 >> 172.21.15.18:0/353697761 conn(0x7fec080fd050 msgr2=0x7fec080ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 -- 172.21.15.18:0/353697761 shutdown_connections 2024-04-21T22:44:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.139+0000 7fec07200640 1 -- 172.21.15.18:0/353697761 wait complete. 2024-04-21T22:44:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.140+0000 7fec07200640 1 Processor -- start 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.140+0000 7fec07200640 1 -- start start 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 0x7fec08197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08101f40 0x7fec08198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 0x7fec0819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec08111900 con 0x7fec08101580 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec08111780 con 0x7fec08107640 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec07200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec08111a80 con 0x7fec08101f40 2024-04-21T22:44:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec05e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 0x7fec08197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7febffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08101f40 0x7fec08198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec05e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 0x7fec08197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48852/0 (socket says 172.21.15.18:48852) 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec05e00640 1 -- 172.21.15.18:0/173657557 learned_addr learned my addr 172.21.15.18:0/173657557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.141+0000 7fec06800640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 0x7fec0819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 -- 172.21.15.18:0/173657557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08101f40 msgr2=0x7fec08198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08101f40 0x7fec08198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 -- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 msgr2=0x7fec08197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 0x7fec08197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 -- 172.21.15.18:0/173657557 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0819cdf0 con 0x7fec08107640 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec06800640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 0x7fec0819c6c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fec00009fd0 tx=0x7fec0000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7febfea00640 1 -- 172.21.15.18:0/173657557 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0000ce20 con 0x7fec08107640 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0819d0e0 con 0x7fec08107640 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7febfea00640 1 -- 172.21.15.18:0/173657557 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00005020 con 0x7fec08107640 2024-04-21T22:44:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7febfea00640 1 -- 172.21.15.18:0/173657557 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00010720 con 0x7fec08107640 2024-04-21T22:44:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.142+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec081a4970 con 0x7fec08107640 2024-04-21T22:44:17.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.145+0000 7fec0ffd4740 1 Processor -- start 2024-04-21T22:44:17.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7febfea00640 1 -- 172.21.15.18:0/173657557 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fec00005540 con 0x7fec08107640 2024-04-21T22:44:17.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 -- start start 2024-04-21T22:44:17.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb88d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb898c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555bcb7ed3a0 con 0x555bcb88d380 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555bcb795930 con 0x555bcb896880 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.146+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555bcb7e9360 con 0x555bcb88dca0 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7febffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb88d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53290/0 (socket says 172.21.15.18:53290) 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 -- 172.21.15.18:0/3868537875 learned_addr learned my addr 172.21.15.18:0/3868537875 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7febffe00640 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb898c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 -- 172.21.15.18:0/3868537875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 msgr2=0x555bcb898c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb898c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 -- 172.21.15.18:0/3868537875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 msgr2=0x555bcb88d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb88d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7fec05e00640 1 -- 172.21.15.18:0/3868537875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bcb5013f0 con 0x555bcb88dca0 2024-04-21T22:44:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.147+0000 7febffe00640 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb88d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:44:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7fec05e00640 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7febf8009230 tx=0x7febf8005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d0849da2249eb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febf7400640 1 -- 172.21.15.18:0/3868537875 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8042070 con 0x555bcb88dca0 2024-04-21T22:44:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febf7400640 1 -- 172.21.15.18:0/3868537875 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf802c690 con 0x555bcb88dca0 2024-04-21T22:44:17.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febf7400640 1 -- 172.21.15.18:0/3868537875 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8004b90 con 0x555bcb88dca0 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febfea00640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 0x7febec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febfea00640 1 -- 172.21.15.18:0/173657557 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fec000cfc20 con 0x7fec08107640 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7febffe00640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 0x7febec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7fec0ffd4740 1 -- 172.21.15.18:0/3868537875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 msgr2=0x555bcb896340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.148+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7febf8009230 tx=0x7febf8005e00 comp rx=0 tx=0).stop 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 -- 172.21.15.18:0/3868537875 shutdown_connections 2024-04-21T22:44:17.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb898c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb896340 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/3868537875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb88d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 -- 172.21.15.18:0/3868537875 >> 172.21.15.18:0/3868537875 conn(0x555bcb887ab0 msgr2=0x555bcb887e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 -- 172.21.15.18:0/3868537875 shutdown_connections 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 -- 172.21.15.18:0/3868537875 wait complete. 2024-04-21T22:44:17.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7febffe00640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 0x7febec0a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x555bcb888c40 tx=0x7febf00096c0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.149+0000 7fec0ffd4740 1 -- start start 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 Processor -- start 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb893e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb8943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555bcb899610 con 0x555bcb88d380 2024-04-21T22:44:17.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x555bcb7a8d80 con 0x555bcb896880 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555bcb899790 con 0x555bcb88dca0 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec0ffd4740 10 client.0 _ll_register_callbacks cb 0x555bcb7e52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec05e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7febffe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb893e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec05e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48878/0 (socket says 172.21.15.18:48878) 2024-04-21T22:44:17.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec05e00640 1 -- 172.21.15.18:0/4217266664 learned_addr learned my addr 172.21.15.18:0/4217266664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.150+0000 7fec06800640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb8943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 -- 172.21.15.18:0/4217266664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 msgr2=0x555bcb893e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb893e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 -- 172.21.15.18:0/4217266664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 msgr2=0x555bcb8943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb8943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 -- 172.21.15.18:0/4217266664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bcb5cb7d0 con 0x555bcb88d380 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec05e00640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7febf802cfd0 tx=0x7febf802cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2edcb2349fac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7febebe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf804b070 con 0x555bcb88d380 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7febf8004440 con 0x555bcb88d380 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.151+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555bcb7fa8e0 con 0x555bcb88d380 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7febf8057050 con 0x555bcb88d380 2024-04-21T22:44:17.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 10 client.17976 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555bcb8a5940 con 0x555bcb88d380 2024-04-21T22:44:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555bcb7fa8e0 con 0x555bcb88d380 2024-04-21T22:44:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7febf8003990 con 0x555bcb88d380 2024-04-21T22:44:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 10 client.17976 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 10 client.17976 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:44:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 20 client.17976 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb8a6c90 0x555bcb8a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 4 client.17976 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:17.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.152+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bcb7f4c30 con 0x555bcb8a6c90 2024-04-21T22:44:17.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.153+0000 7febffe00640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb8a6c90 0x555bcb8a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.153+0000 7febffe00640 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb8a6c90 0x555bcb8a9080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=23625e6f90c30253 server_cookie=1a5cc75b18d5cfa5 in_seq=0 out_seq=0 2024-04-21T22:44:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.153+0000 7febebe00640 10 client.17976 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:44:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7febebe00640 1 -- 172.21.15.18:0/4217266664 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555bcb7f4c30 con 0x555bcb8a6c90 2024-04-21T22:44:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7febebe00640 10 client.17976 handle_command_reply: tid=0 2024-04-21T22:44:17.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 client.17976 shutdown 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 msgr2=0x555bcb893950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7febf802cfd0 tx=0x7febf802cb30 comp rx=0 tx=0).stop 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 shutdown_connections 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb8a6c90 0x555bcb8a9080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.154+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb8943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88dca0 0x555bcb893e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/4217266664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88d380 0x555bcb893950 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7febebe00640 0 client.17976 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:44:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 >> 172.21.15.18:0/4217266664 conn(0x555bcb887ab0 msgr2=0x555bcb889800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 shutdown_connections 2024-04-21T22:44:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 1 -- 172.21.15.18:0/4217266664 wait complete. 2024-04-21T22:44:17.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.155+0000 7fec0ffd4740 20 client.17976 trim_cache size 0 max 16384 2024-04-21T22:44:17.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 Processor -- start 2024-04-21T22:44:17.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 -- start start 2024-04-21T22:44:17.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88d380 0x555bcb8a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb894020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec081ab160 con 0x555bcb88dca0 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec081acca0 con 0x555bcb896880 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.170+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec081ab830 con 0x555bcb88d380 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7febffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb894020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7febffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48890/0 (socket says 172.21.15.18:48890) 2024-04-21T22:44:17.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7febffe00640 1 -- 172.21.15.18:0/2887093734 learned_addr learned my addr 172.21.15.18:0/2887093734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec05e00640 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88d380 0x555bcb8a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 -- 172.21.15.18:0/2887093734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88d380 msgr2=0x555bcb8a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88d380 0x555bcb8a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 -- 172.21.15.18:0/2887093734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 msgr2=0x555bcb896010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7fec06800640 1 -- 172.21.15.18:0/2887093734 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bcb88d1b0 con 0x555bcb896880 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.171+0000 7febffe00640 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7fec06800640 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb894020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fec000cd2b0 tx=0x7fec00005940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6663e44336aff5a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7febf6a00640 1 -- 172.21.15.18:0/2887093734 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0009a380 con 0x555bcb896880 2024-04-21T22:44:17.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7febf6a00640 1 -- 172.21.15.18:0/2887093734 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec000051d0 con 0x555bcb896880 2024-04-21T22:44:17.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7febf6a00640 1 -- 172.21.15.18:0/2887093734 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000a4860 con 0x555bcb896880 2024-04-21T22:44:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7fec0ffd4740 1 -- 172.21.15.18:0/2887093734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 msgr2=0x555bcb894020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.172+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb894020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fec000cd2b0 tx=0x7fec00005940 comp rx=0 tx=0).stop 2024-04-21T22:44:17.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 -- 172.21.15.18:0/2887093734 shutdown_connections 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb896880 0x555bcb894020 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb896010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/2887093734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb88d380 0x555bcb8a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 -- 172.21.15.18:0/2887093734 >> 172.21.15.18:0/2887093734 conn(0x555bcb887ab0 msgr2=0x555bcb893910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 -- 172.21.15.18:0/2887093734 shutdown_connections 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 -- 172.21.15.18:0/2887093734 wait complete. 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 -- start start 2024-04-21T22:44:17.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.173+0000 7fec0ffd4740 1 Processor -- start 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb88d380 0x555bcb89ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 0x555bcb89a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec081ac5d0 con 0x555bcb88dca0 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec081abf00 con 0x555bcb88d380 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec081a9160 con 0x555bcb896880 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec0ffd4740 10 client.0 _ll_register_callbacks cb 0x7febf8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48898/0 (socket says 172.21.15.18:48898) 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 -- 172.21.15.18:0/1663597631 learned_addr learned my addr 172.21.15.18:0/1663597631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec06800640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 0x555bcb89a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7fec05e00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb88d380 0x555bcb89ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 -- 172.21.15.18:0/1663597631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 msgr2=0x555bcb89a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 0x555bcb89a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 -- 172.21.15.18:0/1663597631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb88d380 msgr2=0x555bcb89ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb88d380 0x555bcb89ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.174+0000 7febffe00640 1 -- 172.21.15.18:0/1663597631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bcb89ace0 con 0x555bcb88dca0 2024-04-21T22:44:17.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7fec06800640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 0x555bcb89a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7febffe00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7febf0009730 tx=0x7febf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e8302e4dc928f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7febebe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0003cc0 con 0x555bcb88dca0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7febf002e380 con 0x555bcb88dca0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec000051d0 con 0x555bcb88dca0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7febf0003e60 con 0x555bcb88dca0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7fec0ffd4740 10 client.17982 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.175+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555bcb90ce50 con 0x555bcb88dca0 2024-04-21T22:44:17.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec000051d0 con 0x555bcb88dca0 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7febf0023b80 con 0x555bcb88dca0 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 10 client.17982 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 10 client.17982 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.j 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 20 client.17982 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb90d680 0x555bcb90faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 4 client.17982 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 --> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555bcb7725a0 con 0x555bcb90d680 2024-04-21T22:44:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.176+0000 7fec05e00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb90d680 0x555bcb90faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7fec05e00640 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb90d680 0x555bcb90faa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6898b9c8e33942a3 server_cookie=54636bef44fd746 in_seq=0 out_seq=0 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7febebe00640 10 client.17982 ms_handle_connect on v2:172.21.15.18:6834/1168118848 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7febebe00640 1 -- 172.21.15.18:0/1663597631 <== mds.4 v2:172.21.15.18:6834/1168118848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555bcb7725a0 con 0x555bcb90d680 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7febebe00640 10 client.17982 handle_command_reply: tid=0 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7fec0ffd4740 1 client.17982 shutdown 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 msgr2=0x555bcb89a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.177+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7febf0009730 tx=0x7febf0004730 comp rx=0 tx=0).stop 2024-04-21T22:44:17.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 shutdown_connections 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:6834/1168118848,v1:172.21.15.18:6835/1168118848] conn(0x555bcb90d680 0x555bcb90faa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7febebe00640 0 client.17982 ms_handle_reset on v2:172.21.15.18:6834/1168118848 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555bcb896880 0x555bcb89a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555bcb88dca0 0x555bcb89a060 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 --2- 172.21.15.18:0/1663597631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555bcb88d380 0x555bcb89ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 >> 172.21.15.18:0/1663597631 conn(0x555bcb887ab0 msgr2=0x555bcb882690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 shutdown_connections 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 1 -- 172.21.15.18:0/1663597631 wait complete. 2024-04-21T22:44:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.178+0000 7fec0ffd4740 20 client.17982 trim_cache size 0 max 16384 2024-04-21T22:44:17.186 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:44:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 msgr2=0x7febec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 0x7febec0a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x555bcb888c40 tx=0x7febf00096c0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 msgr2=0x7fec0819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 0x7fec0819c6c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fec00009fd0 tx=0x7fec0000ef10 comp rx=0 tx=0).stop 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 shutdown_connections 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7febec0a2d00 0x7febec0a51c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec08107640 0x7fec0819c6c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08101f40 0x7fec08198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 --2- 172.21.15.18:0/173657557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec08101580 0x7fec08197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 >> 172.21.15.18:0/173657557 conn(0x7fec080fd050 msgr2=0x7fec080fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 shutdown_connections 2024-04-21T22:44:17.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.179+0000 7fec07200640 1 -- 172.21.15.18:0/173657557 wait complete. 2024-04-21T22:44:17.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-21T22:44:17.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 -- 172.21.15.18:0/3579944339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 msgr2=0x7f596410e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 --2- 172.21.15.18:0/3579944339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596410e400 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f595c009be0 tx=0x7f595c02bef0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 -- 172.21.15.18:0/3579944339 shutdown_connections 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 --2- 172.21.15.18:0/3579944339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596410e400 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 --2- 172.21.15.18:0/3579944339 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f59640ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 --2- 172.21.15.18:0/3579944339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f5964106950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 -- 172.21.15.18:0/3579944339 >> 172.21.15.18:0/3579944339 conn(0x7f59640775b0 msgr2=0x7f59640fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 -- 172.21.15.18:0/3579944339 shutdown_connections 2024-04-21T22:44:17.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.413+0000 7f5963e00640 1 -- 172.21.15.18:0/3579944339 wait complete. 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 Processor -- start 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 -- start start 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f5964199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59641119f0 con 0x7f5964106570 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5964111870 con 0x7f59640ff5e0 2024-04-21T22:44:17.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.415+0000 7f5963e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5964111b70 con 0x7f59640fffa0 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5962000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48918/0 (socket says 172.21.15.18:48918) 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 -- 172.21.15.18:0/2430749087 learned_addr learned my addr 172.21.15.18:0/2430749087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5962a00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f5964199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 -- 172.21.15.18:0/2430749087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 msgr2=0x7f596419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 -- 172.21.15.18:0/2430749087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 msgr2=0x7f5964199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f5964199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5963400640 1 -- 172.21.15.18:0/2430749087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596419efb0 con 0x7f5964106570 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5962a00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f5964199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.416+0000 7f5962000640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f5963400640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f595c033420 tx=0x7f595c033720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f595b400640 1 -- 172.21.15.18:0/2430749087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c043020 con 0x7f5964106570 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596419f240 con 0x7f5964106570 2024-04-21T22:44:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f595b400640 1 -- 172.21.15.18:0/2430749087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c003e50 con 0x7f5964106570 2024-04-21T22:44:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f595b400640 1 -- 172.21.15.18:0/2430749087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c03e6b0 con 0x7f5964106570 2024-04-21T22:44:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.417+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59641a6b30 con 0x7f5964106570 2024-04-21T22:44:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.420+0000 7f596c974740 1 Processor -- start 2024-04-21T22:44:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f595b400640 1 -- 172.21.15.18:0/2430749087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f595c046020 con 0x7f5964106570 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 -- start start 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf8980740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf8980c80 0x55bbf8983070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bbf88d33a0 con 0x55bbf8980c80 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bbf887b930 con 0x55bbf896ed80 2024-04-21T22:44:17.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.421+0000 7f596c974740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bbf88cf360 con 0x55bbf896f730 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40584/0 (socket says 172.21.15.18:40584) 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 -- 172.21.15.18:0/1992431457 learned_addr learned my addr 172.21.15.18:0/1992431457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf8980c80 0x55bbf8983070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962a00640 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf8980740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 -- 172.21.15.18:0/1992431457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 msgr2=0x55bbf8980740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf8980740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 -- 172.21.15.18:0/1992431457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf8980c80 msgr2=0x55bbf8983070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf8980c80 0x55bbf8983070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 -- 172.21.15.18:0/1992431457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf85e73f0 con 0x55bbf896ed80 2024-04-21T22:44:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f5962000640 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5950012b80 tx=0x7f595000bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd1a2bd7ae365dc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.422+0000 7f595b400640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 0x7f59480a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.423+0000 7f594fe00640 1 -- 172.21.15.18:0/1992431457 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950012c70 con 0x55bbf896ed80 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.423+0000 7f594fe00640 1 -- 172.21.15.18:0/1992431457 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950012e10 con 0x55bbf896ed80 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.423+0000 7f594fe00640 1 -- 172.21.15.18:0/1992431457 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950003b10 con 0x55bbf896ed80 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.423+0000 7f595b400640 1 -- 172.21.15.18:0/2430749087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f595c0f16d0 con 0x7f5964106570 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.423+0000 7f5962a00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 0x7f59480a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- 172.21.15.18:0/1992431457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 msgr2=0x55bbf896f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f5962a00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 0x7f59480a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55bbf896a930 tx=0x7f5954009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5950012b80 tx=0x7f595000bb90 comp rx=0 tx=0).stop 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- 172.21.15.18:0/1992431457 shutdown_connections 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf8980c80 0x55bbf8983070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf8980740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 --2- 172.21.15.18:0/1992431457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf896f160 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- 172.21.15.18:0/1992431457 >> 172.21.15.18:0/1992431457 conn(0x55bbf89696a0 msgr2=0x55bbf8969a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- 172.21.15.18:0/1992431457 shutdown_connections 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- 172.21.15.18:0/1992431457 wait complete. 2024-04-21T22:44:17.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.424+0000 7f596c974740 1 -- start start 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 Processor -- start 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf897e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 0x55bbf897e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8983a40 con 0x55bbf896ed80 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55bbf888ed80 con 0x55bbf8980c80 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bbf8983bc0 con 0x55bbf896f730 2024-04-21T22:44:17.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f596c974740 10 client.0 _ll_register_callbacks cb 0x55bbf88cb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f5962a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f5962a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48942/0 (socket says 172.21.15.18:48942) 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f5962a00640 1 -- 172.21.15.18:0/1088331511 learned_addr learned my addr 172.21.15.18:0/1088331511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.425+0000 7f5963400640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 0x55bbf897e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962000640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf897e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 -- 172.21.15.18:0/1088331511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 msgr2=0x55bbf897e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf897e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 -- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 msgr2=0x55bbf897e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 0x55bbf897e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 -- 172.21.15.18:0/1088331511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf86b17d0 con 0x55bbf896ed80 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5963400640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 0x55bbf897e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f5962a00640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5954003730 tx=0x7f5954004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee83d63868db554 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f594cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.426+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595400f8e0 con 0x55bbf896ed80 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f595400fa80 con 0x55bbf896ed80 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5950012e10 con 0x55bbf896ed80 2024-04-21T22:44:17.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f595400fc80 con 0x55bbf896ed80 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 10 client.17994 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bbf898fea0 con 0x55bbf896ed80 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950012e10 con 0x55bbf896ed80 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5954027020 con 0x55bbf896ed80 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 10 client.17994 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 10 client.17994 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 20 client.17994 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.427+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf8991360 0x55bbf8993770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.428+0000 7f596c974740 4 client.17994 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.428+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbf88e08e0 con 0x55bbf8991360 2024-04-21T22:44:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.428+0000 7f5962000640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf8991360 0x55bbf8993770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.429+0000 7f5962000640 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf8991360 0x55bbf8993770 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8bc89c73100e6d2b server_cookie=ed7092eabdbc3cf9 in_seq=0 out_seq=0 2024-04-21T22:44:17.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.429+0000 7f594cc00640 10 client.17994 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:44:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.429+0000 7f594cc00640 1 -- 172.21.15.18:0/1088331511 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bbf88e08e0 con 0x55bbf8991360 2024-04-21T22:44:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.429+0000 7f594cc00640 10 client.17994 handle_command_reply: tid=0 2024-04-21T22:44:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.429+0000 7f596c974740 1 client.17994 shutdown 2024-04-21T22:44:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 msgr2=0x55bbf897dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5954003730 tx=0x7f5954004730 comp rx=0 tx=0).stop 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 shutdown_connections 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf8991360 0x55bbf8993770 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf8980c80 0x55bbf897e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf896f730 0x55bbf897e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f594cc00640 0 client.17994 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 --2- 172.21.15.18:0/1088331511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896ed80 0x55bbf897dda0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 >> 172.21.15.18:0/1088331511 conn(0x55bbf89696a0 msgr2=0x55bbf896b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 shutdown_connections 2024-04-21T22:44:17.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 1 -- 172.21.15.18:0/1088331511 wait complete. 2024-04-21T22:44:17.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.430+0000 7f596c974740 20 client.17994 trim_cache size 0 max 16384 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.445+0000 7f596c974740 1 Processor -- start 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.445+0000 7f596c974740 1 -- start start 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.445+0000 7f596c974740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf89804d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f596c974740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f596c974740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf898c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f596c974740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59641ab1e0 con 0x55bbf896f730 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f596c974740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59641acd20 con 0x55bbf896ed80 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f596c974740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59641ab8b0 con 0x55bbf8980c80 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48946/0 (socket says 172.21.15.18:48946) 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 -- 172.21.15.18:0/432273776 learned_addr learned my addr 172.21.15.18:0/432273776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962a00640 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf89804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5963400640 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf898c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 -- 172.21.15.18:0/432273776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 msgr2=0x55bbf898c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf898c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 -- 172.21.15.18:0/432273776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 msgr2=0x55bbf89804d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf89804d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.446+0000 7f5962000640 1 -- 172.21.15.18:0/432273776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf8978b40 con 0x55bbf896f730 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f5962000640 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f595000b3d0 tx=0x7f59500035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8959841d027d5fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f594f400640 1 -- 172.21.15.18:0/432273776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595002a460 con 0x55bbf896f730 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f594f400640 1 -- 172.21.15.18:0/432273776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950016040 con 0x55bbf896f730 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f594f400640 1 -- 172.21.15.18:0/432273776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950005040 con 0x55bbf896f730 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f596c974740 1 -- 172.21.15.18:0/432273776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 msgr2=0x55bbf8993750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.447+0000 7f596c974740 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f595000b3d0 tx=0x7f59500035f0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 -- 172.21.15.18:0/432273776 shutdown_connections 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf898c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8993750 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 --2- 172.21.15.18:0/432273776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf89804d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 -- 172.21.15.18:0/432273776 >> 172.21.15.18:0/432273776 conn(0x55bbf89696a0 msgr2=0x55bbf8967e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 -- 172.21.15.18:0/432273776 shutdown_connections 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 -- 172.21.15.18:0/432273776 wait complete. 2024-04-21T22:44:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 -- start start 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.448+0000 7f596c974740 1 Processor -- start 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf8989180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf8984a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f59641ac650 con 0x55bbf896f730 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59641abf80 con 0x55bbf896ed80 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59641a9200 con 0x55bbf8980c80 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f596c974740 10 client.0 _ll_register_callbacks cb 0x7f59540035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48960/0 (socket says 172.21.15.18:48960) 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 -- 172.21.15.18:0/533957709 learned_addr learned my addr 172.21.15.18:0/533957709 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5963400640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf8984a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962a00640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf8989180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 -- 172.21.15.18:0/533957709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 msgr2=0x55bbf8984a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf8984a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 -- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 msgr2=0x55bbf8989180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.449+0000 7f5962000640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf8989180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f5962000640 1 -- 172.21.15.18:0/533957709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf8985260 con 0x55bbf896f730 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f5963400640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf8984a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f5962a00640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf8989180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f5962000640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c00 tx=0x7f5950005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd48d63a1cb0fdd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f594cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950031070 con 0x55bbf896f730 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f5950010bd0 con 0x55bbf896f730 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5950016040 con 0x55bbf896f730 2024-04-21T22:44:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5950010df0 con 0x55bbf896f730 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f596c974740 10 client.18000 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.450+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55bbf89f7830 con 0x55bbf896f730 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950016040 con 0x55bbf896f730 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f5950005310 con 0x55bbf896f730 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 10 client.18000 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 10 client.18000 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 20 client.18000 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf89f7d30 0x55bbf89fa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 4 client.18000 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.451+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 --> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbf88dac30 con 0x55bbf89f7d30 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f5962a00640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf89f7d30 0x55bbf89fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f5962a00640 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf89f7d30 0x55bbf89fa150 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f19cd02b15f3404 server_cookie=eaa435695ad02fd1 in_seq=0 out_seq=0 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f594cc00640 10 client.18000 ms_handle_connect on v2:172.21.15.47:6834/877045007 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f594cc00640 1 -- 172.21.15.18:0/533957709 <== mds.3 v2:172.21.15.47:6834/877045007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbf88dac30 con 0x55bbf89f7d30 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f594cc00640 10 client.18000 handle_command_reply: tid=0 2024-04-21T22:44:17.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f596c974740 1 client.18000 shutdown 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 msgr2=0x55bbf8984520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.452+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5950000c00 tx=0x7f5950005f30 comp rx=0 tx=0).stop 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 shutdown_connections 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:6834/877045007,v1:172.21.15.47:6835/877045007] conn(0x55bbf89f7d30 0x55bbf89fa150 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bbf8980c80 0x55bbf8984a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f594cc00640 0 client.18000 ms_handle_reset on v2:172.21.15.47:6834/877045007 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bbf896f730 0x55bbf8984520 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 --2- 172.21.15.18:0/533957709 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55bbf896ed80 0x55bbf8989180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 >> 172.21.15.18:0/533957709 conn(0x55bbf89696a0 msgr2=0x55bbf897e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 shutdown_connections 2024-04-21T22:44:17.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 1 -- 172.21.15.18:0/533957709 wait complete. 2024-04-21T22:44:17.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.453+0000 7f596c974740 20 client.18000 trim_cache size 0 max 16384 2024-04-21T22:44:17.461 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:44:17.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 msgr2=0x7f59480a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 0x7f59480a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55bbf896a930 tx=0x7f5954009260 comp rx=0 tx=0).stop 2024-04-21T22:44:17.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 msgr2=0x7f596419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f595c033420 tx=0x7f595c033720 comp rx=0 tx=0).stop 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 shutdown_connections 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f59480a2d00 0x7f59480a51c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5964106570 0x7f596419e880 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59640fffa0 0x7f596419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 --2- 172.21.15.18:0/2430749087 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59640ff5e0 0x7f5964199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 >> 172.21.15.18:0/2430749087 conn(0x7f59640775b0 msgr2=0x7f5964104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 shutdown_connections 2024-04-21T22:44:17.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.454+0000 7f5963e00640 1 -- 172.21.15.18:0/2430749087 wait complete. 2024-04-21T22:44:17.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-21T22:44:17.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 -- 172.21.15.18:0/882978596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24104110 msgr2=0x7fae24110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 --2- 172.21.15.18:0/882978596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24104110 0x7fae24110620 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009cd0 tx=0x7fae1c02c0e0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 -- 172.21.15.18:0/882978596 shutdown_connections 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 --2- 172.21.15.18:0/882978596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24104110 0x7fae24110620 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 --2- 172.21.15.18:0/882978596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24103750 0x7fae24103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 --2- 172.21.15.18:0/882978596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24109760 0x7fae24109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 -- 172.21.15.18:0/882978596 >> 172.21.15.18:0/882978596 conn(0x7fae240ff220 msgr2=0x7fae24101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 -- 172.21.15.18:0/882978596 shutdown_connections 2024-04-21T22:44:17.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.696+0000 7fae2a000640 1 -- 172.21.15.18:0/882978596 wait complete. 2024-04-21T22:44:17.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.697+0000 7fae2a000640 1 Processor -- start 2024-04-21T22:44:17.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 -- start start 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24103750 0x7fae2419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24104110 0x7fae2419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae24113b70 con 0x7fae24109760 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae241139f0 con 0x7fae24103750 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae2a000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae24113cf0 con 0x7fae24104110 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae29600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae29600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48976/0 (socket says 172.21.15.18:48976) 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae29600640 1 -- 172.21.15.18:0/1549302468 learned_addr learned my addr 172.21.15.18:0/1549302468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae28c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24103750 0x7fae2419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.698+0000 7fae23e00640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24104110 0x7fae2419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 -- 172.21.15.18:0/1549302468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24104110 msgr2=0x7fae2419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24104110 0x7fae2419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 -- 172.21.15.18:0/1549302468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24103750 msgr2=0x7fae2419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24103750 0x7fae2419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 -- 172.21.15.18:0/1549302468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2419f030 con 0x7fae24109760 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae29600640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005e30 tx=0x7fae1c032460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae21600640 1 -- 172.21.15.18:0/1549302468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c039040 con 0x7fae24109760 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae21600640 1 -- 172.21.15.18:0/1549302468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c044070 con 0x7fae24109760 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2419f2c0 con 0x7fae24109760 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.699+0000 7fae21600640 1 -- 172.21.15.18:0/1549302468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0042a0 con 0x7fae24109760 2024-04-21T22:44:17.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.700+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae241a6bb0 con 0x7fae24109760 2024-04-21T22:44:17.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.703+0000 7fae21600640 1 -- 172.21.15.18:0/1549302468 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fae1c003970 con 0x7fae24109760 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.703+0000 7fae2e1ed740 1 Processor -- start 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.703+0000 7fae2e1ed740 1 -- start start 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf165350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf170860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558aaf0c93a0 con 0x558aaf165890 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558aaf071930 con 0x558aaf16e470 2024-04-21T22:44:17.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558aaf0c5360 con 0x558aaf164f70 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae28c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae28c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48992/0 (socket says 172.21.15.18:48992) 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae28c00640 1 -- 172.21.15.18:0/324414167 learned_addr learned my addr 172.21.15.18:0/324414167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf165350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53408/0 (socket says 172.21.15.18:53408) 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.704+0000 7fae23e00640 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf170860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 -- 172.21.15.18:0/324414167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 msgr2=0x558aaf165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf165350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 -- 172.21.15.18:0/324414167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 msgr2=0x558aaf170860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf170860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 -- 172.21.15.18:0/324414167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aaeddd3f0 con 0x558aaf165890 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae23e00640 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf170860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae28c00640 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fae14009c70 tx=0x7fae14011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11996aa797ecde9f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae19c00640 1 -- 172.21.15.18:0/324414167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14004230 con 0x558aaf165890 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae21600640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 0x7fae080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae19c00640 1 -- 172.21.15.18:0/324414167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae140043d0 con 0x558aaf165890 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae19c00640 1 -- 172.21.15.18:0/324414167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14019740 con 0x558aaf165890 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae21600640 1 -- 172.21.15.18:0/1549302468 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fae1c0f1780 con 0x7fae24109760 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.705+0000 7fae23e00640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 0x7fae080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 -- 172.21.15.18:0/324414167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 msgr2=0x558aaf16df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fae14009c70 tx=0x7fae14011810 comp rx=0 tx=0).stop 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 -- 172.21.15.18:0/324414167 shutdown_connections 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf170860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16df30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/324414167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 -- 172.21.15.18:0/324414167 >> 172.21.15.18:0/324414167 conn(0x558aaf15f6a0 msgr2=0x558aaf15fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae23e00640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 0x7fae080a5240 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x558aaf160830 tx=0x7fae0c013040 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 -- 172.21.15.18:0/324414167 shutdown_connections 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.706+0000 7fae2e1ed740 1 -- 172.21.15.18:0/324414167 wait complete. 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.707+0000 7fae2e1ed740 1 -- start start 2024-04-21T22:44:17.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.707+0000 7fae2e1ed740 1 Processor -- start 2024-04-21T22:44:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.707+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf16bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558aaf171260 con 0x558aaf165890 2024-04-21T22:44:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558aaf084d80 con 0x558aaf16e470 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558aaf1713e0 con 0x558aaf164f70 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae2e1ed740 10 client.0 _ll_register_callbacks cb 0x558aaf0c12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53420/0 (socket says 172.21.15.18:53420) 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 -- 172.21.15.18:0/1818034925 learned_addr learned my addr 172.21.15.18:0/1818034925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae29600640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf16bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 -- 172.21.15.18:0/1818034925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 msgr2=0x558aaf16bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf16bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 -- 172.21.15.18:0/1818034925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 msgr2=0x558aaf16b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.708+0000 7fae28c00640 1 -- 172.21.15.18:0/1818034925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aaeea77d0 con 0x558aaf164f70 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.709+0000 7fae28c00640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae14009f60 tx=0x7fae14005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f73f9acd04c11b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.709+0000 7fae12000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.709+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14027070 con 0x558aaf164f70 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.709+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fae14003800 con 0x558aaf164f70 2024-04-21T22:44:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.709+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae140043d0 con 0x558aaf164f70 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae14033050 con 0x558aaf164f70 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 10 client.28156 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558aaf17d4e0 con 0x558aaf164f70 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae140043d0 con 0x558aaf164f70 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fae14018070 con 0x558aaf164f70 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 10 client.28156 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 10 client.28156 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:44:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 20 client.28156 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf17e890 0x558aaf180c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 4 client.28156 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.710+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aaf0d68e0 con 0x558aaf17e890 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.711+0000 7fae23e00640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf17e890 0x558aaf180c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.711+0000 7fae23e00640 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf17e890 0x558aaf180c80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a1f7109a3f13487 server_cookie=4c90a9aca8a5a67f in_seq=0 out_seq=0 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.711+0000 7fae12000640 10 client.28156 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.712+0000 7fae12000640 1 -- 172.21.15.18:0/1818034925 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558aaf0d68e0 con 0x558aaf17e890 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.712+0000 7fae12000640 10 client.28156 handle_command_reply: tid=0 2024-04-21T22:44:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.712+0000 7fae2e1ed740 1 client.28156 shutdown 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.712+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 msgr2=0x558aaf16b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.712+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fae14009f60 tx=0x7fae14005780 comp rx=0 tx=0).stop 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 shutdown_connections 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf17e890 0x558aaf180c80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf16e470 0x558aaf16bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf16b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae12000640 0 client.28156 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:44:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/1818034925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf164f70 0x558aaf16b450 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 >> 172.21.15.18:0/1818034925 conn(0x558aaf15f6a0 msgr2=0x558aaf1613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 shutdown_connections 2024-04-21T22:44:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 1 -- 172.21.15.18:0/1818034925 wait complete. 2024-04-21T22:44:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.713+0000 7fae2e1ed740 20 client.28156 trim_cache size 0 max 16384 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.728+0000 7fae2e1ed740 1 Processor -- start 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.728+0000 7fae2e1ed740 1 -- start start 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.728+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.728+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf165890 0x558aaf169c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.728+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf16bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae241af6d0 con 0x558aaf164f70 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b1210 con 0x558aaf165890 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae241afda0 con 0x558aaf16e470 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49014/0 (socket says 172.21.15.18:49014) 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 -- 172.21.15.18:0/3104307419 learned_addr learned my addr 172.21.15.18:0/3104307419 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae29600640 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf16bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae23e00640 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf165890 0x558aaf169c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 -- 172.21.15.18:0/3104307419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 msgr2=0x558aaf16bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf16bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 -- 172.21.15.18:0/3104307419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf165890 msgr2=0x558aaf169c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf165890 0x558aaf169c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.729+0000 7fae28c00640 1 -- 172.21.15.18:0/3104307419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aaf16aae0 con 0x558aaf164f70 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae28c00640 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae14019cf0 tx=0x7fae14009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01e0e0a49e336f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae19200640 1 -- 172.21.15.18:0/3104307419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14027030 con 0x558aaf164f70 2024-04-21T22:44:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae19200640 1 -- 172.21.15.18:0/3104307419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae14005c50 con 0x558aaf164f70 2024-04-21T22:44:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae19200640 1 -- 172.21.15.18:0/3104307419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1401a840 con 0x558aaf164f70 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae2e1ed740 1 -- 172.21.15.18:0/3104307419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 msgr2=0x558aaf17a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.730+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae14019cf0 tx=0x7fae14009fd0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 -- 172.21.15.18:0/3104307419 shutdown_connections 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf16bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf165890 0x558aaf169c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/3104307419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf164f70 0x558aaf17a150 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 -- 172.21.15.18:0/3104307419 >> 172.21.15.18:0/3104307419 conn(0x558aaf15f6a0 msgr2=0x558aaf15e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 -- 172.21.15.18:0/3104307419 shutdown_connections 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 -- 172.21.15.18:0/3104307419 wait complete. 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 -- start start 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.731+0000 7fae2e1ed740 1 Processor -- start 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf164f70 0x558aaf176a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf167e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b0b40 con 0x558aaf165890 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b0470 con 0x558aaf164f70 2024-04-21T22:44:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae241ad6d0 con 0x558aaf16e470 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae2e1ed740 10 client.0 _ll_register_callbacks cb 0x7fae0c009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf167e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae29600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae28c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf164f70 0x558aaf176a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae29600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53436/0 (socket says 172.21.15.18:53436) 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf167e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49022/0 (socket says 172.21.15.18:49022) 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.732+0000 7fae29600640 1 -- 172.21.15.18:0/4289605313 learned_addr learned my addr 172.21.15.18:0/4289605313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 -- 172.21.15.18:0/4289605313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf164f70 msgr2=0x558aaf176a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf164f70 0x558aaf176a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 -- 172.21.15.18:0/4289605313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 msgr2=0x558aaf167e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf167e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 -- 172.21.15.18:0/4289605313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aaf180ff0 con 0x558aaf16e470 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae29600640 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0ba1e0 tx=0x7fae1c0bd980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdce72440229aa22 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae12000640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0be1e0 con 0x558aaf16e470 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae14005c50 con 0x558aaf16e470 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mon.1 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fae1c0c64d0 con 0x558aaf16e470 2024-04-21T22:44:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.733+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae1c0c2130 con 0x558aaf16e470 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 10 client.28162 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558aaf1e4c30 con 0x558aaf16e470 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mon.1 v2:172.21.15.81:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae14005c50 con 0x558aaf16e470 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mon.1 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fae1c03c030 con 0x558aaf16e470 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 10 client.28162 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 10 client.28162 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.f 2024-04-21T22:44:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 20 client.28162 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf1e5330 0x558aaf1e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 4 client.28162 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 --> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558aaf0d0c30 con 0x558aaf1e5330 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.734+0000 7fae28c00640 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf1e5330 0x558aaf1e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae28c00640 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf1e5330 0x558aaf1e7750 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31bef8db1a8cb6a1 server_cookie=8e38f0603f78f92d in_seq=0 out_seq=0 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae12000640 10 client.28162 ms_handle_connect on v2:172.21.15.81:6834/1298670178 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae12000640 1 -- 172.21.15.18:0/4289605313 <== mds.2 v2:172.21.15.81:6834/1298670178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558aaf0d0c30 con 0x558aaf1e5330 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae12000640 10 client.28162 handle_command_reply: tid=0 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 client.28162 shutdown 2024-04-21T22:44:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 msgr2=0x558aaf168390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0ba1e0 tx=0x7fae1c0bd980 comp rx=0 tx=0).stop 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 shutdown_connections 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:6834/1298670178,v1:172.21.15.81:6835/1298670178] conn(0x558aaf1e5330 0x558aaf1e7750 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558aaf16e470 0x558aaf168390 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae12000640 0 client.28162 ms_handle_reset on v2:172.21.15.81:6834/1298670178 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558aaf165890 0x558aaf167e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 --2- 172.21.15.18:0/4289605313 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558aaf164f70 0x558aaf176a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 >> 172.21.15.18:0/4289605313 conn(0x558aaf15f6a0 msgr2=0x558aaf160860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 shutdown_connections 2024-04-21T22:44:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.735+0000 7fae2e1ed740 1 -- 172.21.15.18:0/4289605313 wait complete. 2024-04-21T22:44:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2e1ed740 20 client.28162 trim_cache size 0 max 16384 2024-04-21T22:44:17.745 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:44:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 msgr2=0x7fae080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 0x7fae080a5240 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x558aaf160830 tx=0x7fae0c013040 comp rx=0 tx=0).stop 2024-04-21T22:44:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 msgr2=0x7fae2419e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005e30 tx=0x7fae1c032460 comp rx=0 tx=0).stop 2024-04-21T22:44:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 shutdown_connections 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fae080a2d80 0x7fae080a5240 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae24109760 0x7fae2419e900 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae24104110 0x7fae2419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 --2- 172.21.15.18:0/1549302468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae24103750 0x7fae2419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 >> 172.21.15.18:0/1549302468 conn(0x7fae240ff220 msgr2=0x7fae240ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.736+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 shutdown_connections 2024-04-21T22:44:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.737+0000 7fae2a000640 1 -- 172.21.15.18:0/1549302468 wait complete. 2024-04-21T22:44:17.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:17 smithi018 ceph-mon[26614]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:17.751 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:17 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1841992655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:44:17.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-21T22:44:17.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:17 smithi081 ceph-mon[31692]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:17.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:17 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1841992655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:44:17.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:17 smithi047 ceph-mon[31561]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-21T22:44:17.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:17 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1841992655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:44:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 -- 172.21.15.18:0/1146925781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa114102720 msgr2=0x7fa114102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 --2- 172.21.15.18:0/1146925781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa114102720 0x7fa114102b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa108009900 tx=0x7fa10802bcd0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 -- 172.21.15.18:0/1146925781 shutdown_connections 2024-04-21T22:44:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 --2- 172.21.15.18:0/1146925781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa11410bb40 0x7fa11410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 --2- 172.21.15.18:0/1146925781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11410b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 --2- 172.21.15.18:0/1146925781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa114102720 0x7fa114102b00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 -- 172.21.15.18:0/1146925781 >> 172.21.15.18:0/1146925781 conn(0x7fa1140771f0 msgr2=0x7fa1140fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 -- 172.21.15.18:0/1146925781 shutdown_connections 2024-04-21T22:44:17.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.967+0000 7fa11b200640 1 -- 172.21.15.18:0/1146925781 wait complete. 2024-04-21T22:44:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.968+0000 7fa11b200640 1 Processor -- start 2024-04-21T22:44:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.968+0000 7fa11b200640 1 -- start start 2024-04-21T22:44:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.968+0000 7fa11b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.968+0000 7fa11b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.968+0000 7fa11b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa114111940 con 0x7fa11410bb40 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141117c0 con 0x7fa114103040 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa114111ac0 con 0x7fa114102720 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49034/0 (socket says 172.21.15.18:49034) 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11a800640 1 -- 172.21.15.18:0/2006158870 learned_addr learned my addr 172.21.15.18:0/2006158870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53454/0 (socket says 172.21.15.18:53454) 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119400640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 -- 172.21.15.18:0/2006158870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 msgr2=0x7fa11419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 -- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 msgr2=0x7fa11419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119e00640 1 -- 172.21.15.18:0/2006158870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11419f070 con 0x7fa114102720 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa119400640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.969+0000 7fa11a800640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa119e00640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa10802c210 tx=0x7fa108005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa10ea00640 1 -- 172.21.15.18:0/2006158870 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108042020 con 0x7fa114102720 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa10ea00640 1 -- 172.21.15.18:0/2006158870 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10802ce00 con 0x7fa114102720 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11419f300 con 0x7fa114102720 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa10ea00640 1 -- 172.21.15.18:0/2006158870 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108003a50 con 0x7fa114102720 2024-04-21T22:44:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.970+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141a6bf0 con 0x7fa114102720 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.973+0000 7fa11f407740 1 Processor -- start 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 -- start start 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa10ea00640 1 -- 172.21.15.18:0/2006158870 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fa108045020 con 0x7fa114102720 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 0x5595d72f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 0x5595d7300f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d7303860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5595d725c3a0 con 0x5595d7301470 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5595d7204930 con 0x5595d72f8890 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11f407740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595d7258360 con 0x5595d72f7f70 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa119400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d7303860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa119e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 0x5595d7300f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa119400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d7303860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49044/0 (socket says 172.21.15.18:49044) 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa11a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 0x5595d72f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.974+0000 7fa119400640 1 -- 172.21.15.18:0/932351707 learned_addr learned my addr 172.21.15.18:0/932351707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 -- 172.21.15.18:0/932351707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 msgr2=0x5595d72f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 0x5595d72f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 -- 172.21.15.18:0/932351707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 msgr2=0x5595d7303860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d7303860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 -- 172.21.15.18:0/932351707 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d6f703f0 con 0x5595d72f8890 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa11a800640 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 0x5595d72f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.975+0000 7fa119e00640 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 0x5595d7300f30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ee5d0 tx=0x7fa1080f4d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911540194ff3f43c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa103000640 1 -- 172.21.15.18:0/932351707 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1080f9aa0 con 0x5595d72f8890 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa103000640 1 -- 172.21.15.18:0/932351707 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1080fe070 con 0x5595d72f8890 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa103000640 1 -- 172.21.15.18:0/932351707 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108102630 con 0x5595d72f8890 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa10ea00640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 0x7fa0fc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa10ea00640 1 -- 172.21.15.18:0/2006158870 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fa1080f0e30 con 0x7fa114102720 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa11a800640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 0x7fa0fc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa11f407740 1 -- 172.21.15.18:0/932351707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 msgr2=0x5595d7300f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.976+0000 7fa11f407740 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 0x5595d7300f30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ee5d0 tx=0x7fa1080f4d80 comp rx=0 tx=0).stop 2024-04-21T22:44:17.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 -- 172.21.15.18:0/932351707 shutdown_connections 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d7303860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f8890 0x5595d7300f30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 --2- 172.21.15.18:0/932351707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f7f70 0x5595d72f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 -- 172.21.15.18:0/932351707 >> 172.21.15.18:0/932351707 conn(0x5595d72f26a0 msgr2=0x5595d72f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 -- 172.21.15.18:0/932351707 shutdown_connections 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 -- 172.21.15.18:0/932351707 wait complete. 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11a800640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 0x7fa0fc0a5240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa1100049d0 tx=0x7fa110009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.977+0000 7fa11f407740 1 -- start start 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 Processor -- start 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d72fe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d72fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5595d7304020 con 0x5595d7301470 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x5595d7217d80 con 0x5595d72f7f70 2024-04-21T22:44:17.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5595d73041a0 con 0x5595d72f8890 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11f407740 10 client.0 _ll_register_callbacks cb 0x5595d72542b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d72fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d72fefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49050/0 (socket says 172.21.15.18:49050) 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa119e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d72fe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.978+0000 7fa11a800640 1 -- 172.21.15.18:0/405439772 learned_addr learned my addr 172.21.15.18:0/405439772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119400640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 -- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 msgr2=0x5595d72fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 -- 172.21.15.18:0/405439772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 msgr2=0x5595d72fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d72fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 -- 172.21.15.18:0/405439772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d703a7d0 con 0x5595d72f7f70 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa119e00640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d72fe520 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ee630 tx=0x7fa108005660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda533a2db3025d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa0f7400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1080b9640 con 0x5595d72f7f70 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fa1080052c0 con 0x5595d72f7f70 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.979+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1080fe070 con 0x5595d72f7f70 2024-04-21T22:44:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa1080bcd00 con 0x5595d72f7f70 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 10 client.28112 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5595d7304020 con 0x5595d72f7f70 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1080fe070 con 0x5595d72f7f70 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa1080ee740 con 0x5595d72f7f70 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 10 client.28112 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 10 client.28112 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 20 client.28112 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7311490 0x5595d73138f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 4 client.28112 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.980+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d72698e0 con 0x5595d7311490 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.981+0000 7fa119400640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7311490 0x5595d73138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.981+0000 7fa119400640 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7311490 0x5595d73138f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c6e1ac9cf8ae445 server_cookie=9c99246021e45192 in_seq=0 out_seq=0 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.981+0000 7fa0f7400640 10 client.28112 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa0f7400640 1 -- 172.21.15.18:0/405439772 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5595d72698e0 con 0x5595d7311490 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa0f7400640 10 client.28112 handle_command_reply: tid=0 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 client.28112 shutdown 2024-04-21T22:44:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 msgr2=0x5595d72fe520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d72fe520 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1080ee630 tx=0x7fa108005660 comp rx=0 tx=0).stop 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 shutdown_connections 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7311490 0x5595d73138f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d7301470 0x5595d72fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 --2- 172.21.15.18:0/405439772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d72fe520 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:17.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa0f7400640 0 client.28112 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:44:17.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 >> 172.21.15.18:0/405439772 conn(0x5595d72f26a0 msgr2=0x5595d72f43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:17.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 shutdown_connections 2024-04-21T22:44:17.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.982+0000 7fa11f407740 1 -- 172.21.15.18:0/405439772 wait complete. 2024-04-21T22:44:17.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.983+0000 7fa11f407740 20 client.28112 trim_cache size 0 max 16384 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 Processor -- start 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 -- start start 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d7301470 0x5595d72f1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141af600 con 0x5595d72f7f70 2024-04-21T22:44:17.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b1140 con 0x5595d7301470 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11f407740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141afcd0 con 0x5595d72f8890 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa119e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa119e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49064/0 (socket says 172.21.15.18:49064) 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa119e00640 1 -- 172.21.15.18:0/89185356 learned_addr learned my addr 172.21.15.18:0/89185356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.998+0000 7fa11a800640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d7301470 0x5595d72f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119400640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 -- 172.21.15.18:0/89185356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 msgr2=0x5595d72fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 -- 172.21.15.18:0/89185356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d7301470 msgr2=0x5595d72f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d7301470 0x5595d72f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 -- 172.21.15.18:0/89185356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d72f86c0 con 0x5595d72f7f70 2024-04-21T22:44:18.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119400640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:44:18.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa119e00640 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa1080b9800 tx=0x7fa1080bb8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7cdba74c7ef436 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa102600640 1 -- 172.21.15.18:0/89185356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1080bcee0 con 0x5595d72f7f70 2024-04-21T22:44:18.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa102600640 1 -- 172.21.15.18:0/89185356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1080fe070 con 0x5595d72f7f70 2024-04-21T22:44:18.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:17.999+0000 7fa102600640 1 -- 172.21.15.18:0/89185356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1080bd170 con 0x5595d72f7f70 2024-04-21T22:44:18.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 -- 172.21.15.18:0/89185356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 msgr2=0x5595d730ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa1080b9800 tx=0x7fa1080bb8b0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 -- 172.21.15.18:0/89185356 shutdown_connections 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d7301470 0x5595d72f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d72f8890 0x5595d72fedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 --2- 172.21.15.18:0/89185356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f7f70 0x5595d730ce50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 -- 172.21.15.18:0/89185356 >> 172.21.15.18:0/89185356 conn(0x5595d72f26a0 msgr2=0x5595d72f0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 -- 172.21.15.18:0/89185356 shutdown_connections 2024-04-21T22:44:18.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.000+0000 7fa11f407740 1 -- 172.21.15.18:0/89185356 wait complete. 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 -- start start 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 Processor -- start 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 0x5595d72fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d7301470 0x5595d72fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b0a70 con 0x5595d72f8890 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b03a0 con 0x5595d72f7f70 2024-04-21T22:44:18.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ad600 con 0x5595d7301470 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.001+0000 7fa11f407740 10 client.0 _ll_register_callbacks cb 0x7fa104009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 0x5595d72fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40712/0 (socket says 172.21.15.18:40712) 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119e00640 1 -- 172.21.15.18:0/309770432 learned_addr learned my addr 172.21.15.18:0/309770432 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa11a800640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d7301470 0x5595d72fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 -- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d7301470 msgr2=0x5595d72fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d7301470 0x5595d72fb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 -- 172.21.15.18:0/309770432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 msgr2=0x5595d7309520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 -- 172.21.15.18:0/309770432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d72fb8e0 con 0x5595d72f8890 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119e00640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa119400640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 0x5595d72fadb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x5595d7314170 tx=0x7fa104012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e0d47381b6e617 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.002+0000 7fa0f7400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104010cf0 con 0x5595d72f8890 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7fa104021150 con 0x5595d72f8890 2024-04-21T22:44:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1080fe070 con 0x5595d72f8890 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa104031050 con 0x5595d72f8890 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa11f407740 10 client.18036 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5595d73778d0 con 0x5595d72f8890 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.003+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1080fe070 con 0x5595d72f8890 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fa108004f80 con 0x5595d72f8890 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 10 client.18036 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 10 client.18036 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-21T22:44:18.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 20 client.18036 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7378000 0x5595d737a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 4 client.18036 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 --> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595d7263c30 con 0x5595d7378000 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa119e00640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7378000 0x5595d737a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa119e00640 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7378000 0x5595d737a420 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a55a8a7e210d3939 server_cookie=9c129a74226caed0 in_seq=0 out_seq=0 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.004+0000 7fa0f7400640 10 client.18036 ms_handle_connect on v2:172.21.15.81:6838/3777779454 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa0f7400640 1 -- 172.21.15.18:0/309770432 <== mds.1 v2:172.21.15.81:6838/3777779454 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595d7263c30 con 0x5595d7378000 2024-04-21T22:44:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa0f7400640 10 client.18036 handle_command_reply: tid=0 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 client.18036 shutdown 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 msgr2=0x5595d72fadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 0x5595d72fadb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x5595d7314170 tx=0x7fa104012b80 comp rx=0 tx=0).stop 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 shutdown_connections 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:6838/3777779454,v1:172.21.15.81:6839/3777779454] conn(0x5595d7378000 0x5595d737a420 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5595d7301470 0x5595d72fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5595d72f8890 0x5595d72fadb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 --2- 172.21.15.18:0/309770432 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5595d72f7f70 0x5595d7309520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa0f7400640 0 client.18036 ms_handle_reset on v2:172.21.15.81:6838/3777779454 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 >> 172.21.15.18:0/309770432 conn(0x5595d72f26a0 msgr2=0x5595d72f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 shutdown_connections 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 1 -- 172.21.15.18:0/309770432 wait complete. 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.005+0000 7fa11f407740 20 client.18036 trim_cache size 0 max 16384 2024-04-21T22:44:18.013 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:44:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 msgr2=0x7fa0fc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 0x7fa0fc0a5240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa1100049d0 tx=0x7fa110009500 comp rx=0 tx=0).stop 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 msgr2=0x7fa11419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa10802c210 tx=0x7fa108005e80 comp rx=0 tx=0).stop 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 shutdown_connections 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fa0fc0a2d80 0x7fa0fc0a5240 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa11410bb40 0x7fa11419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa114103040 0x7fa11419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 --2- 172.21.15.18:0/2006158870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa114102720 0x7fa11419a080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 >> 172.21.15.18:0/2006158870 conn(0x7fa1140771f0 msgr2=0x7fa1141002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 shutdown_connections 2024-04-21T22:44:18.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.006+0000 7fa11b200640 1 -- 172.21.15.18:0/2006158870 wait complete. 2024-04-21T22:44:18.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-21T22:44:18.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 -- 172.21.15.18:0/436897823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 msgr2=0x7f488c10e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 --2- 172.21.15.18:0/436897823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c10e5d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4884009cd0 tx=0x7f488402c0f0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 -- 172.21.15.18:0/436897823 shutdown_connections 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 --2- 172.21.15.18:0/436897823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c10e5d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 --2- 172.21.15.18:0/436897823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c101700 0x7f488c101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 --2- 172.21.15.18:0/436897823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c107710 0x7f488c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 -- 172.21.15.18:0/436897823 >> 172.21.15.18:0/436897823 conn(0x7f488c0fd1f0 msgr2=0x7f488c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 -- 172.21.15.18:0/436897823 shutdown_connections 2024-04-21T22:44:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.236+0000 7f4890e00640 1 -- 172.21.15.18:0/436897823 wait complete. 2024-04-21T22:44:18.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 Processor -- start 2024-04-21T22:44:18.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 -- start start 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c107710 0x7f488c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f488c111b20 con 0x7f488c1020c0 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1119a0 con 0x7f488c107710 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.237+0000 7f4890e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f488c111ca0 con 0x7f488c101700 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:53514/0 (socket says 172.21.15.18:53514) 2024-04-21T22:44:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 -- 172.21.15.18:0/3561244404 learned_addr learned my addr 172.21.15.18:0/3561244404 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f488a800640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c107710 0x7f488c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 -- 172.21.15.18:0/3561244404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c107710 msgr2=0x7f488c19eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c107710 0x7f488c19eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 -- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 msgr2=0x7f488c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.238+0000 7f4889e00640 1 -- 172.21.15.18:0/3561244404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c19f1f0 con 0x7f488c101700 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4889e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e9f0 tx=0x7f487c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4882a00640 1 -- 172.21.15.18:0/3561244404 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00cd80 con 0x7f488c101700 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c19f4e0 con 0x7f488c101700 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4882a00640 1 -- 172.21.15.18:0/3561244404 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f487c005500 con 0x7f488c101700 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4882a00640 1 -- 172.21.15.18:0/3561244404 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c010690 con 0x7f488c101700 2024-04-21T22:44:18.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.239+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a6d70 con 0x7f488c101700 2024-04-21T22:44:18.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.242+0000 7f4893a22740 1 Processor -- start 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.242+0000 7f4882a00640 1 -- 172.21.15.18:0/3561244404 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f487c0046c0 con 0x7f488c101700 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.242+0000 7f4893a22740 1 -- start start 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 0x558afe898d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe89b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558afe7f43a0 con 0x558afe8906a0 2024-04-21T22:44:18.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558afe79c930 con 0x558afe88fd80 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4893a22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558afe7f0360 con 0x558afe899280 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f488a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f488a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40738/0 (socket says 172.21.15.18:40738) 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f488a800640 1 -- 172.21.15.18:0/4118660035 learned_addr learned my addr 172.21.15.18:0/4118660035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.243+0000 7f4889e00640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 0x558afe898d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f4889400640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe89b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 -- 172.21.15.18:0/4118660035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 msgr2=0x558afe89b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe89b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 -- 172.21.15.18:0/4118660035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 msgr2=0x558afe898d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 0x558afe898d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 -- 172.21.15.18:0/4118660035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe5083f0 con 0x558afe88fd80 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f4889e00640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 0x558afe898d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f488a800640 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4884004af0 tx=0x7f4884005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17153d6e0a936520 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f4882a00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 0x7f48700a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f4882a00640 1 -- 172.21.15.18:0/3561244404 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f487c0cf8c0 con 0x7f488c101700 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f4889e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 0x7f48700a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f487b400640 1 -- 172.21.15.18:0/4118660035 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884043070 con 0x558afe88fd80 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f487b400640 1 -- 172.21.15.18:0/4118660035 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f488402cca0 con 0x558afe88fd80 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.244+0000 7f487b400640 1 -- 172.21.15.18:0/4118660035 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884039040 con 0x558afe88fd80 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 -- 172.21.15.18:0/4118660035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 msgr2=0x558afe890160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4884004af0 tx=0x7f4884005f80 comp rx=0 tx=0).stop 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4889e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 0x7f48700a51c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558afe88f850 tx=0x7f487c004a40 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 -- 172.21.15.18:0/4118660035 shutdown_connections 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe89b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe8906a0 0x558afe898d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 --2- 172.21.15.18:0/4118660035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe88fd80 0x558afe890160 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 -- 172.21.15.18:0/4118660035 >> 172.21.15.18:0/4118660035 conn(0x558afe88a4b0 msgr2=0x558afe88a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 -- 172.21.15.18:0/4118660035 shutdown_connections 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.245+0000 7f4893a22740 1 -- 172.21.15.18:0/4118660035 wait complete. 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.246+0000 7f4893a22740 1 -- start start 2024-04-21T22:44:18.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.246+0000 7f4893a22740 1 Processor -- start 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.246+0000 7f4893a22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe896920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe896e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558afe89c010 con 0x558afe88fd80 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x558afe7afd80 con 0x558afe8906a0 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558afe89c190 con 0x558afe899280 2024-04-21T22:44:18.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4893a22740 10 client.0 _ll_register_callbacks cb 0x558afe7ec2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49092/0 (socket says 172.21.15.18:49092) 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe896920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f488a800640 1 -- 172.21.15.18:0/1054770657 learned_addr learned my addr 172.21.15.18:0/1054770657 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f488a800640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe896e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 -- 172.21.15.18:0/1054770657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 msgr2=0x558afe896e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe896e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 -- 172.21.15.18:0/1054770657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 msgr2=0x558afe8963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f4889400640 1 -- 172.21.15.18:0/1054770657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afe5d27d0 con 0x558afe8906a0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.247+0000 7f488a800640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.248+0000 7f4889400640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe896920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f488c100d80 tx=0x7f4874012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c838ee070247ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.248+0000 7f486fe00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.248+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487401f060 con 0x558afe8906a0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.248+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mon.2 v2:172.21.15.47:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f4874010930 con 0x558afe8906a0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.248+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f488402cca0 con 0x558afe8906a0 2024-04-21T22:44:18.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4874010b30 con 0x558afe8906a0 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 10 client.28130 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558afe8a83b0 con 0x558afe8906a0 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mon.2 v2:172.21.15.47:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f488402cca0 con 0x558afe8906a0 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mon.2 v2:172.21.15.47:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4874019030 con 0x558afe8906a0 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 10 client.28130 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 10 client.28130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 20 client.28130 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:18.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe8a97c0 0x558afe8abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 4 client.28130 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.249+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558afe8018e0 con 0x558afe8a97c0 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.250+0000 7f488a800640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe8a97c0 0x558afe8abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.250+0000 7f488a800640 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe8a97c0 0x558afe8abbb0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f67fd88eacd1887 server_cookie=505c5cf57e45d87e in_seq=0 out_seq=0 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.250+0000 7f486fe00640 10 client.28130 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.251+0000 7f486fe00640 1 -- 172.21.15.18:0/1054770657 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558afe8018e0 con 0x558afe8a97c0 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.251+0000 7f486fe00640 10 client.28130 handle_command_reply: tid=0 2024-04-21T22:44:18.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.251+0000 7f4893a22740 1 client.28130 shutdown 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.251+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 msgr2=0x558afe896920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.251+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe896920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f488c100d80 tx=0x7f4874012820 comp rx=0 tx=0).stop 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 shutdown_connections 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe8a97c0 0x558afe8abbb0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe896e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe896920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 --2- 172.21.15.18:0/1054770657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe8963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f486fe00640 0 client.28130 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 >> 172.21.15.18:0/1054770657 conn(0x558afe88a4b0 msgr2=0x558afe88c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 shutdown_connections 2024-04-21T22:44:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 1 -- 172.21.15.18:0/1054770657 wait complete. 2024-04-21T22:44:18.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.252+0000 7f4893a22740 20 client.28130 trim_cache size 0 max 16384 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 Processor -- start 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 -- start start 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe8a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe885520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1af870 con 0x558afe88fd80 2024-04-21T22:44:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1b13b0 con 0x558afe8906a0 2024-04-21T22:44:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f4893a22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1aff40 con 0x558afe899280 2024-04-21T22:44:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49106/0 (socket says 172.21.15.18:49106) 2024-04-21T22:44:18.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.267+0000 7f488a800640 1 -- 172.21.15.18:0/791877202 learned_addr learned my addr 172.21.15.18:0/791877202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe885520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f4889400640 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe8a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 -- 172.21.15.18:0/791877202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 msgr2=0x558afe885520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe885520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 -- 172.21.15.18:0/791877202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 msgr2=0x558afe8a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe8a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 -- 172.21.15.18:0/791877202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe895390 con 0x558afe88fd80 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f488a800640 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4884004af0 tx=0x7f4884005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac2e126158f49ed server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f487aa00640 1 -- 172.21.15.18:0/791877202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884039040 con 0x558afe88fd80 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f487aa00640 1 -- 172.21.15.18:0/791877202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4884055840 con 0x558afe88fd80 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.268+0000 7f487aa00640 1 -- 172.21.15.18:0/791877202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488402de60 con 0x558afe88fd80 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 -- 172.21.15.18:0/791877202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 msgr2=0x558afe898b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4884004af0 tx=0x7f4884005d80 comp rx=0 tx=0).stop 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 -- 172.21.15.18:0/791877202 shutdown_connections 2024-04-21T22:44:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe899280 0x558afe885520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe8906a0 0x558afe8a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 --2- 172.21.15.18:0/791877202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe898b10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 -- 172.21.15.18:0/791877202 >> 172.21.15.18:0/791877202 conn(0x558afe88a4b0 msgr2=0x558afe889690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 -- 172.21.15.18:0/791877202 shutdown_connections 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.269+0000 7f4893a22740 1 -- 172.21.15.18:0/791877202 wait complete. 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 -- start start 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 Processor -- start 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe8906a0 0x558afe89d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe899280 0x558afe89da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1b0ce0 con 0x558afe88fd80 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1b0610 con 0x558afe899280 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f488c1ad870 con 0x558afe8906a0 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.270+0000 7f4893a22740 10 client.0 _ll_register_callbacks cb 0x7f487400ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49118/0 (socket says 172.21.15.18:49118) 2024-04-21T22:44:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 -- 172.21.15.18:0/3437060659 learned_addr learned my addr 172.21.15.18:0/3437060659 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:18.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f4889400640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe8906a0 0x558afe89d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe899280 0x558afe89da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 -- 172.21.15.18:0/3437060659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe8906a0 msgr2=0x558afe89d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe8906a0 0x558afe89d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 -- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe899280 msgr2=0x558afe89da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T22:44:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe899280 0x558afe89da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 -- 172.21.15.18:0/3437060659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afe90ee50 con 0x558afe88fd80 2024-04-21T22:44:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f488a800640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f488402c130 tx=0x7f4884005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8e72e8a3fcf1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.271+0000 7f486fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-21T22:44:18.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884039040 con 0x558afe88fd80 2024-04-21T22:44:18.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8615+0+0 (secure 0 0 0) 0x7f4884055360 con 0x558afe88fd80 2024-04-21T22:44:18.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4884055840 con 0x558afe88fd80 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4884043040 con 0x558afe88fd80 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 10 client.18051 fetch_fsmap learned FSMap version 38 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558afe910130 con 0x558afe88fd80 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4884055840 con 0x558afe88fd80 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f4884004b40 con 0x558afe88fd80 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 10 client.18051 fetch_fsmap finished waiting for FSMap version 38 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 20 client.18051 populate_metadata read hostname 'smithi018' 2024-04-21T22:44:18.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.272+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe910410 0x558afe912800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.273+0000 7f4893a22740 4 client.18051 mds_command: new command op to 24596 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.273+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 --> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558afe7fbc30 con 0x558afe910410 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.273+0000 7f4889400640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe910410 0x558afe912800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.273+0000 7f4889400640 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe910410 0x558afe912800 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676ac97189f70ee server_cookie=6e662e13b31f059f in_seq=0 out_seq=0 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.273+0000 7f486fe00640 10 client.18051 ms_handle_connect on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f486fe00640 1 -- 172.21.15.18:0/3437060659 <== mds.0 v2:172.21.15.47:6838/3521127091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558afe7fbc30 con 0x558afe910410 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f486fe00640 10 client.18051 handle_command_reply: tid=0 2024-04-21T22:44:18.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 client.18051 shutdown 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 msgr2=0x558afe89cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f488402c130 tx=0x7f4884005bd0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 shutdown_connections 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x558afe899280 0x558afe89da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.47:6838/3521127091,v1:172.21.15.47:6839/3521127091] conn(0x558afe910410 0x558afe912800 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558afe8906a0 0x558afe89d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f486fe00640 0 client.18051 ms_handle_reset on v2:172.21.15.47:6838/3521127091 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 --2- 172.21.15.18:0/3437060659 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558afe88fd80 0x558afe89cf90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 >> 172.21.15.18:0/3437060659 conn(0x558afe88a4b0 msgr2=0x558afe8963a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 shutdown_connections 2024-04-21T22:44:18.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 1 -- 172.21.15.18:0/3437060659 wait complete. 2024-04-21T22:44:18.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.274+0000 7f4893a22740 20 client.18051 trim_cache size 0 max 16384 2024-04-21T22:44:18.284 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 msgr2=0x7f48700a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 0x7f48700a51c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x558afe88f850 tx=0x7f487c004a40 comp rx=0 tx=0).stop 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 msgr2=0x7f488c19a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f487c00e9f0 tx=0x7f487c00edf0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 shutdown_connections 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f48700a2d00 0x7f48700a51c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f488c107710 0x7f488c19eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f488c1020c0 0x7f488c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 --2- 172.21.15.18:0/3561244404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f488c101700 0x7f488c19a200 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 >> 172.21.15.18:0/3561244404 conn(0x7f488c0fd1f0 msgr2=0x7f488c10c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 shutdown_connections 2024-04-21T22:44:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:18.275+0000 7f4890e00640 1 -- 172.21.15.18:0/3561244404 wait complete. 2024-04-21T22:44:19.295 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-04-21T22:44:19.295 INFO:tasks.fwd_scrub:done joining 2024-04-21T22:44:19.295 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-21T22:44:19.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 -- 172.21.15.18:0/1059444990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568103920 msgr2=0x7ff568103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 --2- 172.21.15.18:0/1059444990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568103920 0x7ff568103da0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff554009900 tx=0x7ff55402bc40 comp rx=0 tx=0).stop 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 -- 172.21.15.18:0/1059444990 shutdown_connections 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 --2- 172.21.15.18:0/1059444990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff5681107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 --2- 172.21.15.18:0/1059444990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568103920 0x7ff568103da0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 --2- 172.21.15.18:0/1059444990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568109930 0x7ff568109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 -- 172.21.15.18:0/1059444990 >> 172.21.15.18:0/1059444990 conn(0x7ff5680ff450 msgr2=0x7ff568101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:19.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.543+0000 7ff56fe00640 1 -- 172.21.15.18:0/1059444990 shutdown_connections 2024-04-21T22:44:19.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.544+0000 7ff56fe00640 1 -- 172.21.15.18:0/1059444990 wait complete. 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 Processor -- start 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 -- start start 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568103920 0x7ff56819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 0x7ff56819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff568113d60 con 0x7ff5681042e0 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff568113be0 con 0x7ff568109930 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.545+0000 7ff56fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff568113ee0 con 0x7ff568103920 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49142/0 (socket says 172.21.15.18:49142) 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 -- 172.21.15.18:0/3688427963 learned_addr learned my addr 172.21.15.18:0/3688427963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56de00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 0x7ff56819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56d400640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568103920 0x7ff56819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:19.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 -- 172.21.15.18:0/3688427963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568103920 msgr2=0x7ff56819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568103920 0x7ff56819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 -- 172.21.15.18:0/3688427963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 msgr2=0x7ff56819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 0x7ff56819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56ca00640 1 -- 172.21.15.18:0/3688427963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56819f230 con 0x7ff5681042e0 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.546+0000 7ff56de00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 0x7ff56819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff56ca00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff554005ab0 tx=0x7ff5540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554041070 con 0x7ff5681042e0 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56819f4c0 con 0x7ff5681042e0 2024-04-21T22:44:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55402ccd0 con 0x7ff5681042e0 2024-04-21T22:44:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff554003d10 con 0x7ff5681042e0 2024-04-21T22:44:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.547+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5681a6db0 con 0x7ff5681042e0 2024-04-21T22:44:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.549+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5680685f0 con 0x7ff5681042e0 2024-04-21T22:44:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.551+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff554044070 con 0x7ff5681042e0 2024-04-21T22:44:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.552+0000 7ff566000640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 0x7ff5500a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.552+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7ff5540f1170 con 0x7ff5681042e0 2024-04-21T22:44:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.552+0000 7ff56d400640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 0x7ff5500a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:19.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.553+0000 7ff56d400640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 0x7ff5500a51c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00bb60 tx=0x7ff55c00b390 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:19.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.556+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff5540bd7c0 con 0x7ff5681042e0 2024-04-21T22:44:19.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.766+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff56810beb0 con 0x7ff5681042e0 2024-04-21T22:44:19.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.769+0000 7ff566000640 1 -- 172.21.15.18:0/3688427963 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23049 (secure 0 0 0) 0x7ff5540c1ac0 con 0x7ff5681042e0 2024-04-21T22:44:19.770 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:44:19.770 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:44:18.772899+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.771+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 msgr2=0x7ff5500a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.771+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 0x7ff5500a51c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00bb60 tx=0x7ff55c00b390 comp rx=0 tx=0).stop 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.771+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 msgr2=0x7ff56819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.771+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff554005ab0 tx=0x7ff5540042f0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 shutdown_connections 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff5500a2d00 0x7ff5500a51c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff568109930 0x7ff56819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5681042e0 0x7ff56819a780 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 --2- 172.21.15.18:0/3688427963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff568103920 0x7ff56819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:19.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 >> 172.21.15.18:0/3688427963 conn(0x7ff5680ff450 msgr2=0x7ff5680ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:19.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 shutdown_connections 2024-04-21T22:44:19.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:19.772+0000 7ff56fe00640 1 -- 172.21.15.18:0/3688427963 wait complete. 2024-04-21T22:44:19.788 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:19 smithi018 ceph-mon[26614]: pgmap v318: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:19.789 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:19 smithi018 ceph-mon[26614]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T22:44:19.793 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 95, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:44:19.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:44:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:19 smithi081 ceph-mon[31692]: pgmap v318: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:19.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:19 smithi081 ceph-mon[31692]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T22:44:19.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:19 smithi047 ceph-mon[31561]: pgmap v318: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:19.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:19 smithi047 ceph-mon[31561]: osdmap e96: 12 total, 12 up, 12 in 2024-04-21T22:44:20.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.006+0000 7f885b200640 1 -- 172.21.15.18:0/815118572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 msgr2=0x7f885c109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.006+0000 7f885b200640 1 --2- 172.21.15.18:0/815118572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c109b50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f884c009930 tx=0x7f884c02bc30 comp rx=0 tx=0).stop 2024-04-21T22:44:20.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 -- 172.21.15.18:0/815118572 shutdown_connections 2024-04-21T22:44:20.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 --2- 172.21.15.18:0/815118572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c104120 0x7f885c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 --2- 172.21.15.18:0/815118572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c103760 0x7f885c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 --2- 172.21.15.18:0/815118572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c109b50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 -- 172.21.15.18:0/815118572 >> 172.21.15.18:0/815118572 conn(0x7f885c0ff230 msgr2=0x7f885c101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 -- 172.21.15.18:0/815118572 shutdown_connections 2024-04-21T22:44:20.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.007+0000 7f885b200640 1 -- 172.21.15.18:0/815118572 wait complete. 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.008+0000 7f885b200640 1 Processor -- start 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.008+0000 7f885b200640 1 -- start start 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c104120 0x7f885c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f885c113bd0 con 0x7f885c103760 2024-04-21T22:44:20.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f885c113a50 con 0x7f885c104120 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f885c113d50 con 0x7f885c109770 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f8859e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f8859e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49154/0 (socket says 172.21.15.18:49154) 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f8859e00640 1 -- 172.21.15.18:0/1004184984 learned_addr learned my addr 172.21.15.18:0/1004184984 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f885a800640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.009+0000 7f8859400640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c104120 0x7f885c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 -- 172.21.15.18:0/1004184984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 msgr2=0x7f885c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 -- 172.21.15.18:0/1004184984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c104120 msgr2=0x7f885c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c104120 0x7f885c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 -- 172.21.15.18:0/1004184984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c19f0b0 con 0x7f885c103760 2024-04-21T22:44:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f885a800640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:20.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8859e00640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f884c009900 tx=0x7f884c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c043020 con 0x7f885c103760 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f884c0054e0 con 0x7f885c103760 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.010+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c19f340 con 0x7f885c103760 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.011+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c003bb0 con 0x7f885c103760 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.011+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c1a6c30 con 0x7f885c103760 2024-04-21T22:44:20.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.012+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c04f500 con 0x7f885c103760 2024-04-21T22:44:20.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.014+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f884c046020 con 0x7f885c103760 2024-04-21T22:44:20.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.015+0000 7f8852a00640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 0x7f88400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.015+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f884c0f1360 con 0x7f885c103760 2024-04-21T22:44:20.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.016+0000 7f8859400640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 0x7f88400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.016+0000 7f8859400640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 0x7f88400a51c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f885c1018c0 tx=0x7f8848005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.020+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f884c04d020 con 0x7f885c103760 2024-04-21T22:44:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.226+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f885c10bcd0 con 0x7f885c103760 2024-04-21T22:44:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.227+0000 7f8852a00640 1 -- 172.21.15.18:0/1004184984 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f884c0be060 con 0x7f885c103760 2024-04-21T22:44:20.227 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:44:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 msgr2=0x7f88400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 0x7f88400a51c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f885c1018c0 tx=0x7f8848005f90 comp rx=0 tx=0).stop 2024-04-21T22:44:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 msgr2=0x7f885c19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f884c009900 tx=0x7f884c004360 comp rx=0 tx=0).stop 2024-04-21T22:44:20.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 shutdown_connections 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f88400a2d00 0x7f88400a51c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885c109770 0x7f885c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c104120 0x7f885c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 --2- 172.21.15.18:0/1004184984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f885c103760 0x7f885c19a110 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 >> 172.21.15.18:0/1004184984 conn(0x7f885c0ff230 msgr2=0x7f885c0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 shutdown_connections 2024-04-21T22:44:20.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.230+0000 7f885b200640 1 -- 172.21.15.18:0/1004184984 wait complete. 2024-04-21T22:44:20.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:44:20.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 -- 172.21.15.18:0/681383737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74107e60 msgr2=0x7fbc741082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 --2- 172.21.15.18:0/681383737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74107e60 0x7fbc741082e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009890 tx=0x7fbc5c02bb70 comp rx=0 tx=0).stop 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 -- 172.21.15.18:0/681383737 shutdown_connections 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 --2- 172.21.15.18:0/681383737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74108820 0x7fbc74114ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 --2- 172.21.15.18:0/681383737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74107e60 0x7fbc741082e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 --2- 172.21.15.18:0/681383737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc7410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 -- 172.21.15.18:0/681383737 >> 172.21.15.18:0/681383737 conn(0x7fbc740775b0 msgr2=0x7fbc74106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 -- 172.21.15.18:0/681383737 shutdown_connections 2024-04-21T22:44:20.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.469+0000 7fbc7a200640 1 -- 172.21.15.18:0/681383737 wait complete. 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.470+0000 7fbc7a200640 1 Processor -- start 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.470+0000 7fbc7a200640 1 -- start start 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74107e60 0x7fbc7419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 0x7fbc7419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741181f0 con 0x7fbc74109d00 2024-04-21T22:44:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74118070 con 0x7fbc74107e60 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc7a200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74118370 con 0x7fbc74108820 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc72a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 0x7fbc7419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc73400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74107e60 0x7fbc7419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49184/0 (socket says 172.21.15.18:49184) 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc73e00640 1 -- 172.21.15.18:0/765178869 learned_addr learned my addr 172.21.15.18:0/765178869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc72a00640 1 -- 172.21.15.18:0/765178869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74107e60 msgr2=0x7fbc7419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.471+0000 7fbc72a00640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74107e60 0x7fbc7419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc72a00640 1 -- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 msgr2=0x7fbc741a2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc72a00640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc72a00640 1 -- 172.21.15.18:0/765178869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc741a36e0 con 0x7fbc74108820 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc73e00640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc72a00640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 0x7fbc7419ec30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0057c0 tx=0x7fbc5c004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c041020 con 0x7fbc74108820 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc5c02c9f0 con 0x7fbc74108820 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc741a3970 con 0x7fbc74108820 2024-04-21T22:44:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c039040 con 0x7fbc74108820 2024-04-21T22:44:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.472+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741ab260 con 0x7fbc74108820 2024-04-21T22:44:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.474+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc74068a40 con 0x7fbc74108820 2024-04-21T22:44:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.476+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fbc5c044020 con 0x7fbc74108820 2024-04-21T22:44:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.477+0000 7fbc6be00640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 0x7fbc580a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.477+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fbc5c0f0ba0 con 0x7fbc74108820 2024-04-21T22:44:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.478+0000 7fbc73400640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 0x7fbc580a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.478+0000 7fbc73400640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 0x7fbc580a5240 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005fd0 tx=0x7fbc64009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.482+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fbc5c04b020 con 0x7fbc74108820 2024-04-21T22:44:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.689+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc741103f0 con 0x7fbc74108820 2024-04-21T22:44:20.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.690+0000 7fbc6be00640 1 -- 172.21.15.18:0/765178869 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) ==== 104+0+11 (secure 0 0 0) 0x7fbc741103f0 con 0x7fbc74108820 2024-04-21T22:44:20.690 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 msgr2=0x7fbc580a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 0x7fbc580a5240 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005fd0 tx=0x7fbc64009260 comp rx=0 tx=0).stop 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 msgr2=0x7fbc7419ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 0x7fbc7419ec30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0057c0 tx=0x7fbc5c004360 comp rx=0 tx=0).stop 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 shutdown_connections 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fbc580a2d80 0x7fbc580a5240 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc74109d00 0x7fbc741a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc74108820 0x7fbc7419ec30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 --2- 172.21.15.18:0/765178869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc74107e60 0x7fbc7419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 >> 172.21.15.18:0/765178869 conn(0x7fbc740775b0 msgr2=0x7fbc74077b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:20.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 shutdown_connections 2024-04-21T22:44:20.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.693+0000 7fbc7a200640 1 -- 172.21.15.18:0/765178869 wait complete. 2024-04-21T22:44:20.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:44:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 -- 172.21.15.18:0/3841915068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 msgr2=0x7f89401052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 --2- 172.21.15.18:0/3841915068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f89401052e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8928009900 tx=0x7f892802bd10 comp rx=0 tx=0).stop 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 -- 172.21.15.18:0/3841915068 shutdown_connections 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 --2- 172.21.15.18:0/3841915068 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940105900 0x7f8940105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 --2- 172.21.15.18:0/3841915068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f89401052e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 --2- 172.21.15.18:0/3841915068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940100500 0x7f89401008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 -- 172.21.15.18:0/3841915068 >> 172.21.15.18:0/3841915068 conn(0x7f89400fbf50 msgr2=0x7f89400fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 -- 172.21.15.18:0/3841915068 shutdown_connections 2024-04-21T22:44:20.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.922+0000 7f893f200640 1 -- 172.21.15.18:0/3841915068 wait complete. 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.923+0000 7f893f200640 1 Processor -- start 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.923+0000 7f893f200640 1 -- start start 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 0x7f894019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940105900 0x7f89401a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8940117f90 con 0x7f8940100e20 2024-04-21T22:44:20.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8940117e10 con 0x7f8940100500 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8940118110 con 0x7f8940105900 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49214/0 (socket says 172.21.15.18:49214) 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 -- 172.21.15.18:0/1053199966 learned_addr learned my addr 172.21.15.18:0/1053199966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893de00640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 0x7f894019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893e800640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940105900 0x7f89401a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 -- 172.21.15.18:0/1053199966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940105900 msgr2=0x7f89401a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940105900 0x7f89401a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 -- 172.21.15.18:0/1053199966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 msgr2=0x7f894019e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 0x7f894019e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f8935400640 1 -- 172.21.15.18:0/1053199966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89401a3450 con 0x7f8940100e20 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.924+0000 7f893de00640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 0x7f894019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f8935400640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f89280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928042020 con 0x7f8940100e20 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8928005000 con 0x7f8940100e20 2024-04-21T22:44:20.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928003a10 con 0x7f8940100e20 2024-04-21T22:44:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89401a36e0 con 0x7f8940100e20 2024-04-21T22:44:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.925+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89401aafd0 con 0x7f8940100e20 2024-04-21T22:44:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.926+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8940069f50 con 0x7f8940100e20 2024-04-21T22:44:20.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.928+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8928045020 con 0x7f8940100e20 2024-04-21T22:44:20.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.930+0000 7f8937400640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 0x7f89240a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.931+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f89280f0e60 con 0x7f8940100e20 2024-04-21T22:44:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.931+0000 7f893de00640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 0x7f89240a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:20.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.931+0000 7f893de00640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 0x7f89240a5240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8930009fc0 tx=0x7f8930005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:20.935+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f892804c020 con 0x7f8940100e20 2024-04-21T22:44:20.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:20 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3688427963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:44:20.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:20 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1004184984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:44:21.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:20 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3688427963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:44:21.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:20 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1004184984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:44:21.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.132+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f89401ab1a0 con 0x7f8940100e20 2024-04-21T22:44:21.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.134+0000 7f8937400640 1 -- 172.21.15.18:0/1053199966 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) ==== 100+0+11 (secure 0 0 0) 0x7f89280bdb00 con 0x7f8940100e20 2024-04-21T22:44:21.134 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:44:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 msgr2=0x7f89240a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 0x7f89240a5240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8930009fc0 tx=0x7f8930005f90 comp rx=0 tx=0).stop 2024-04-21T22:44:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 msgr2=0x7f894019e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f89280042f0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 shutdown_connections 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f89240a2d80 0x7f89240a5240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8940105900 0x7f89401a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8940100e20 0x7f894019e9f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 --2- 172.21.15.18:0/1053199966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8940100500 0x7f894019e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 >> 172.21.15.18:0/1053199966 conn(0x7f89400fbf50 msgr2=0x7f89401032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 shutdown_connections 2024-04-21T22:44:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.136+0000 7f893f200640 1 -- 172.21.15.18:0/1053199966 wait complete. 2024-04-21T22:44:21.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:20 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3688427963' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:44:21.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:20 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1004184984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:44:21.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-21T22:44:21.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 -- 172.21.15.18:0/262982776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458074490 msgr2=0x7fc45810d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:21.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 --2- 172.21.15.18:0/262982776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458074490 0x7fc45810d8e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc444009860 tx=0x7fc44402bc10 comp rx=0 tx=0).stop 2024-04-21T22:44:21.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 -- 172.21.15.18:0/262982776 shutdown_connections 2024-04-21T22:44:21.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 --2- 172.21.15.18:0/262982776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc458110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 --2- 172.21.15.18:0/262982776 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458074490 0x7fc45810d8e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 --2- 172.21.15.18:0/262982776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458073b70 0x7fc458073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 -- 172.21.15.18:0/262982776 >> 172.21.15.18:0/262982776 conn(0x7fc4580fd150 msgr2=0x7fc4580ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:21.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 -- 172.21.15.18:0/262982776 shutdown_connections 2024-04-21T22:44:21.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.369+0000 7fc457200640 1 -- 172.21.15.18:0/262982776 wait complete. 2024-04-21T22:44:21.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.370+0000 7fc457200640 1 Processor -- start 2024-04-21T22:44:21.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 -- start start 2024-04-21T22:44:21.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 0x7fc45819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:21.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458074490 0x7fc45819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:21.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc45819e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:21.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113bc0 con 0x7fc45810de20 2024-04-21T22:44:21.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113a40 con 0x7fc458073b70 2024-04-21T22:44:21.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc457200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113d40 con 0x7fc458074490 2024-04-21T22:44:21.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc456800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc45819e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc455e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 0x7fc45819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc455e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 0x7fc45819a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:40852/0 (socket says 172.21.15.18:40852) 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc455e00640 1 -- 172.21.15.18:0/1985151682 learned_addr learned my addr 172.21.15.18:0/1985151682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.371+0000 7fc455400640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458074490 0x7fc45819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 -- 172.21.15.18:0/1985151682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458074490 msgr2=0x7fc45819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458074490 0x7fc45819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 -- 172.21.15.18:0/1985151682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 msgr2=0x7fc45819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 0x7fc45819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:21.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 -- 172.21.15.18:0/1985151682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45819f0d0 con 0x7fc45810de20 2024-04-21T22:44:21.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc456800640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc45819e9a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc450009fd0 tx=0x7fc45000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:21.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45000ce20 con 0x7fc45810de20 2024-04-21T22:44:21.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45819f3c0 con 0x7fc45810de20 2024-04-21T22:44:21.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc450005020 con 0x7fc45810de20 2024-04-21T22:44:21.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450010700 con 0x7fc45810de20 2024-04-21T22:44:21.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.372+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581a6c50 con 0x7fc45810de20 2024-04-21T22:44:21.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.374+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45804f570 con 0x7fc45810de20 2024-04-21T22:44:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.376+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fc450005540 con 0x7fc45810de20 2024-04-21T22:44:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.377+0000 7fc44ea00640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 0x7fc43c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:44:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.377+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fc4500cfae0 con 0x7fc45810de20 2024-04-21T22:44:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.377+0000 7fc455e00640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 0x7fc43c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:44:21.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.378+0000 7fc455e00640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 0x7fc43c0a51b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc4480058c0 tx=0x7fc448009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:44:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.382+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fc45009c670 con 0x7fc45810de20 2024-04-21T22:44:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.641+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc458108fa0 con 0x7fc45810de20 2024-04-21T22:44:21.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.663+0000 7fc44ea00640 1 -- 172.21.15.18:0/1985151682 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+740900 (secure 0 0 0) 0x7fc45009bf70 con 0x7fc45810de20 2024-04-21T22:44:21.678 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:44:21.678 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:21.678 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 27, 2024-04-21T22:44:21.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.678 INFO:teuthology.orchestra.run.smithi018.stdout: "active_gid": 25309, 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: "active_name": "x", 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addrs": { 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:21.679 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 325159611 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 325159611 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:21.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "active_addr": "172.21.15.18:6801/325159611", 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "active_change": "2024-04-21T22:34:02.010621+0000", 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "active_mgr_features": 4540701547738038271, 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "available": true, 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "standbys": [ 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 15177, 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "y", 2024-04-21T22:44:21.681 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:21.682 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.683 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.685 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.690 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-04-21T22:44:21.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-04-21T22:44:21.696 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.697 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-04-21T22:44:21.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-04-21T22:44:21.706 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.707 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-04-21T22:44:21.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:21.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:21.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-04-21T22:44:21.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.713 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-04-21T22:44:21.714 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-04-21T22:44:21.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-04-21T22:44:21.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-04-21T22:44:21.731 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.732 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.733 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:21.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.737 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.741 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.742 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.743 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:21.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.750 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-04-21T22:44:21.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-04-21T22:44:21.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-21T22:44:21.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.761 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-21T22:44:21.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.766 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.769 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.770 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-04-21T22:44:21.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-04-21T22:44:21.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.776 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-21T22:44:21.778 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-04-21T22:44:21.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-04-21T22:44:21.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.782 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.783 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.785 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-04-21T22:44:21.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-21T22:44:21.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-04-21T22:44:21.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-04-21T22:44:21.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.801 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.804 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.805 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.807 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.808 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-04-21T22:44:21.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.815 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.816 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-04-21T22:44:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-21T22:44:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.823 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.824 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-04-21T22:44:21.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.829 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.831 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-04-21T22:44:21.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.839 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.840 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.843 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.846 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.847 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.849 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.851 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-04-21T22:44:21.852 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-04-21T22:44:21.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.854 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.855 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.856 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.857 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.858 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.864 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.866 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-21T22:44:21.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.868 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.871 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-21T22:44:21.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.874 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-21T22:44:21.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-21T22:44:21.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.885 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.886 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.890 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-04-21T22:44:21.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.894 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.895 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-21T22:44:21.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.898 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.899 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.901 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.902 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.903 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-21T22:44:21.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.906 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.908 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.911 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-21T22:44:21.912 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.915 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.916 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.922 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-21T22:44:21.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.926 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.927 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-04-21T22:44:21.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:21.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.934 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.935 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.936 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.938 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:21.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-04-21T22:44:21.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:21.947 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.948 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.950 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.951 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.952 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:21.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-04-21T22:44:21.954 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.956 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.957 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.959 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.961 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.963 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-04-21T22:44:21.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-04-21T22:44:21.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-04-21T22:44:21.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.973 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.975 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-04-21T22:44:21.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:21.978 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.979 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.980 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.981 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.984 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.985 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.986 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.987 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-04-21T22:44:21.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.995 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.996 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:21.998 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:21.999 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.000 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.004 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.005 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.006 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.009 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.010 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.011 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.012 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-04-21T22:44:22.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-04-21T22:44:22.014 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.018 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.021 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.022 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.027 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.029 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.031 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.033 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-04-21T22:44:22.037 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.039 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.040 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.041 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.043 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.044 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.045 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.048 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.050 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.054 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.057 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-04-21T22:44:22.058 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.059 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.061 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.062 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-04-21T22:44:22.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-21T22:44:22.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.065 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.067 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.071 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.072 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.075 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.076 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.079 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.081 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.084 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.085 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.088 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.089 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.090 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.099 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.102 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.104 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.105 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.110 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.113 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.118 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.123 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.124 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.125 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.126 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.127 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.132 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.133 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:22.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.138 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.139 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.143 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.144 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.147 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.152 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.153 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.154 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.156 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.158 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-04-21T22:44:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-04-21T22:44:22.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-04-21T22:44:22.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.168 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.169 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-04-21T22:44:22.171 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.172 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:22.173 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.176 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.178 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.180 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-04-21T22:44:22.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.186 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.187 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.188 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.189 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.190 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.192 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.193 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.198 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.204 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.205 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.206 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.207 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.210 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.211 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.214 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.216 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.217 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-04-21T22:44:22.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.225 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.226 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.228 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.229 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.231 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-04-21T22:44:22.233 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.234 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.235 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.236 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.237 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.238 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.240 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-04-21T22:44:22.241 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.242 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.243 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.244 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-04-21T22:44:22.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.250 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.251 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.252 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-04-21T22:44:22.253 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-04-21T22:44:22.254 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.256 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.257 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.258 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.260 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.261 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.262 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.265 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.266 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.267 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.269 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.270 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.271 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.273 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.274 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.276 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.278 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-04-21T22:44:22.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.286 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.290 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-04-21T22:44:22.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-21T22:44:22.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.297 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-04-21T22:44:22.302 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.303 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.306 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:22.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-04-21T22:44:22.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.316 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.318 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.320 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-04-21T22:44:22.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.327 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.330 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.334 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.337 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.338 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.339 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.342 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.343 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.346 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.347 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.349 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.350 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:22.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.354 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.356 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.357 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.359 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.360 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.361 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.362 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.363 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-04-21T22:44:22.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.374 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: "gid": 25286, 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "z", 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_features": 4540701547738038271, 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-04-21T22:44:22.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.377 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.378 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.379 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.380 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.382 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.383 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-04-21T22:44:22.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-04-21T22:44:22.388 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.389 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-04-21T22:44:22.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.395 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.396 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-04-21T22:44:22.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-04-21T22:44:22.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-04-21T22:44:22.399 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-04-21T22:44:22.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.404 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.405 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.406 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.407 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-04-21T22:44:22.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-04-21T22:44:22.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-04-21T22:44:22.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.418 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.419 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:22.422 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-04-21T22:44:22.423 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.426 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-21T22:44:22.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.429 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.434 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-04-21T22:44:22.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-04-21T22:44:22.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-21T22:44:22.443 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.446 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-04-21T22:44:22.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.451 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.452 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-21T22:44:22.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-04-21T22:44:22.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-04-21T22:44:22.456 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.458 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-04-21T22:44:22.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-04-21T22:44:22.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.463 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.464 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.465 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-04-21T22:44:22.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-04-21T22:44:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-04-21T22:44:22.474 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.475 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.477 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-04-21T22:44:22.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-21T22:44:22.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.480 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.481 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.482 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.483 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.484 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.485 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-04-21T22:44:22.486 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-21T22:44:22.487 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.489 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.491 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.492 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.493 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.494 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.499 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.503 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-21T22:44:22.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.505 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.506 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.507 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.508 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.513 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.515 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.516 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.517 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.521 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.524 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-04-21T22:44:22.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.526 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.527 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.528 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-04-21T22:44:22.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.533 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.534 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-04-21T22:44:22.535 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.537 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.538 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.554 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.555 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.556 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.561 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-21T22:44:22.564 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.568 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.569 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:22.571 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.572 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-21T22:44:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-21T22:44:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-04-21T22:44:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-21T22:44:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-21T22:44:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-04-21T22:44:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-04-21T22:44:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-04-21T22:44:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-04-21T22:44:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-21T22:44:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.666 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.667 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.671 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.672 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.675 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.676 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.678 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.679 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.680 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.681 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.682 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.683 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-04-21T22:44:22.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-04-21T22:44:22.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.696 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.701 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.703 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-04-21T22:44:22.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.708 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.711 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.712 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.713 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.715 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.716 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.717 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.718 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.719 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.720 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.721 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.722 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.724 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.725 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.726 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.727 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-04-21T22:44:22.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-21T22:44:22.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.732 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.733 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.736 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.737 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.747 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.748 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.749 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-04-21T22:44:22.751 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-04-21T22:44:22.752 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.753 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.757 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.760 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.762 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.763 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.764 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.766 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.767 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.769 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.770 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-04-21T22:44:22.776 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.781 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.782 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.783 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.785 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.786 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.788 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.789 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.790 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.792 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-04-21T22:44:22.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-04-21T22:44:22.796 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.799 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.800 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.801 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.803 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.805 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.807 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.808 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.810 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.812 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.820 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.823 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.824 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.825 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.826 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.827 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.828 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-04-21T22:44:22.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.833 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.835 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.836 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.838 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.839 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.840 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.841 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.842 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-04-21T22:44:22.843 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:22.844 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-04-21T22:44:22.845 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-04-21T22:44:22.846 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.847 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.848 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.849 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.851 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.852 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.853 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.855 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.856 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.857 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.858 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.859 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.860 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-04-21T22:44:22.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.863 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.864 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.865 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.868 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.869 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:22.870 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.872 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.873 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.874 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.875 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.877 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.878 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.879 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.882 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-04-21T22:44:22.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.885 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.886 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:22.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.889 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.890 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.892 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.893 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.894 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.895 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.896 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.897 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.899 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.900 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.901 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.902 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.903 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.904 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.907 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.907 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.907 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.907 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.908 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.909 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.912 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.914 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.915 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.916 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-04-21T22:44:22.920 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.923 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.924 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.925 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.926 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.927 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.928 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.929 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.931 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-04-21T22:44:22.932 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.936 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-04-21T22:44:22.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.938 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.939 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.940 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.941 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.943 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-04-21T22:44:22.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.945 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.946 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.948 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.949 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.950 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.951 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.953 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.956 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.958 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.960 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.961 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.964 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.965 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.966 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.967 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.968 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.969 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.970 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.973 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.974 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.975 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.976 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.977 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.978 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.979 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.980 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.981 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-21T22:44:22.982 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:22.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:22.984 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.987 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.988 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.989 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.991 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:22.992 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.993 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:22.995 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.996 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-04-21T22:44:22.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-21T22:44:22.998 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:22.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.001 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-04-21T22:44:23.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.004 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.005 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.006 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-04-21T22:44:23.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.010 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.011 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.012 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.014 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-04-21T22:44:23.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.017 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.018 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.019 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.020 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.021 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.022 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.023 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.024 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-04-21T22:44:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.026 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.027 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-21T22:44:23.029 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.031 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.032 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.033 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.034 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.036 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.037 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.038 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.039 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.040 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.041 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.042 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.043 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.045 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.046 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.047 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.048 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.049 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.051 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-04-21T22:44:23.052 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.053 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-04-21T22:44:23.054 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-04-21T22:44:23.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.055 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.055 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.055 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-04-21T22:44:23.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.059 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.060 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.061 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.063 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.064 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.066 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.067 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.068 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.069 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.070 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.071 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-04-21T22:44:23.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-21T22:44:23.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: "modules": [ 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard", 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: "iostat", 2024-04-21T22:44:23.076 INFO:teuthology.orchestra.run.smithi018.stdout: "nfs", 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "restful", 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_schedule" 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "available_modules": [ 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "alerts", 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.077 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.078 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How frequently to reexamine health status", 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.080 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.082 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.084 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.085 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.086 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_destination": { 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_destination", 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email address to send alerts to", 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_from_name": { 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_from_name", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "Ceph", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Email From: name", 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_host": { 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_host", 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP server", 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_password": { 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_password", 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Password to authenticate with", 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_port": { 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_port", 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "465", 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP port", 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_sender": { 2024-04-21T22:44:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_sender", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SMTP envelope sender", 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_ssl": { 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_ssl", 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-21T22:44:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "smtp_user": { 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "smtp_user", 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "User to authenticate as", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "balancer", 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "active": { 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "active", 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically balance PGs across cluster", 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_time": { 2024-04-21T22:44:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_time", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0000", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "beginning time of day to automatically balance", 2024-04-21T22:44:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "begin_weekday": { 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "begin_weekday", 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_max_iterations": { 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_max_iterations", 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "25", 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "250", 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_metrics": { 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_metrics", 2024-04-21T22:44:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "pgs,objects,bytes", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-21T22:44:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_compat_step": { 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crush_compat_step", 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.5", 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0.001", 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "0.999", 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "aggressiveness of optimization", 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "end_time": { 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_time", 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2359", 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ending time of day to automatically balance", 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "end_weekday": { 2024-04-21T22:44:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "end_weekday", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "0", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "6", 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "min_score": { 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_score", 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "upmap", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-compat", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "none", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "read", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap-read" 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Balancer mode", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_ids": { 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_ids", 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_deviation": { 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_deviation", 2024-04-21T22:44:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-21T22:44:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "upmap_max_optimizations": { 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "upmap_max_optimizations", 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm", 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_down_multiplier": { 2024-04-21T22:44:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_down_multiplier", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_refresh_rate": { 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_refresh_rate", 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "20", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "agent_starting_port": { 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "agent_starting_port", 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4721", 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_ptrace": { 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_ptrace", 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_interval": { 2024-04-21T22:44:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_interval", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "autotune_memory_target_ratio": { 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "autotune_memory_target_ratio", 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0.7", 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_log_destination": { 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephadm_log_destination", 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "file", 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "file,syslog", 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "syslog" 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "cgroups_split": { 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cgroups_split", 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "config_checks_enabled": { 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_checks_enabled", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "config_dashboard": { 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_dashboard", 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_alertmanager": { 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_alertmanager", 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_base": { 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_base", 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Container image name, without the tag", 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_elasticsearch": { 2024-04-21T22:44:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_elasticsearch", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "elasticsearch container image", 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_grafana": { 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_grafana", 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_haproxy": { 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_haproxy", 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-21T22:44:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "HAproxy container image", 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_agent": { 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_agent", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger agent container image", 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_collector": { 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_collector", 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger collector container image", 2024-04-21T22:44:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_jaeger_query": { 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_jaeger_query", 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Jaeger query container image", 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_keepalived": { 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_keepalived", 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Keepalived container image", 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_loki": { 2024-04-21T22:44:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_loki", 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Loki container image", 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_node_exporter": { 2024-04-21T22:44:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_node_exporter", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_nvmeof": { 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_nvmeof", 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Nvme-of container image", 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_prometheus": { 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_prometheus", 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-21T22:44:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Prometheus container image", 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_promtail": { 2024-04-21T22:44:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_promtail", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Promtail container image", 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_samba": { 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_samba", 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Samba/SMB container image", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image_snmp_gateway": { 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_image_snmp_gateway", 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-21T22:44:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "SNMP Gateway container image", 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "container_init": { 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "container_init", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Run podman/docker with `--init`", 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "daemon_cache_timeout": { 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "daemon_cache_timeout", 2024-04-21T22:44:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_cephadm_command_timeout": { 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_cephadm_command_timeout", 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "900", 2024-04-21T22:44:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "default_registry": { 2024-04-21T22:44:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "default_registry", 2024-04-21T22:44:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "docker.io", 2024-04-21T22:44:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "device_cache_timeout": { 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_cache_timeout", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1800", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache device inventory", 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "device_enhanced_scan": { 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_enhanced_scan", 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "facts_cache_timeout": { 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "facts_cache_timeout", 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "seconds to cache host facts data", 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "grafana_dashboards_path": { 2024-04-21T22:44:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "grafana_dashboards_path", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.197 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "host_check_interval": { 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "host_check_interval", 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.198 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to perform a host check", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.199 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "hw_monitoring": { 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hw_monitoring", 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "inventory_list_all": { 2024-04-21T22:44:23.201 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "inventory_list_all", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.202 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.204 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "log_refresh_metadata": { 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_refresh_metadata", 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.207 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.208 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.209 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.210 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.211 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.212 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.212 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.213 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-21T22:44:23.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.216 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "*", 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.217 INFO:teuthology.orchestra.run.smithi018.stdout: "max_count_per_host": { 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_count_per_host", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.218 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of daemons per service per host", 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd_draining_count": { 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_osd_draining_count", 2024-04-21T22:44:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-21T22:44:23.220 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "migration_current": { 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "migration_current", 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.221 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "internal - do not modify", 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": { 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mode", 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.223 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "root", 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm-package", 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "root" 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "mode for remote execution of cephadm", 2024-04-21T22:44:23.224 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "oob_default_addr": { 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "oob_default_addr", 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.225 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "169.254.1.1", 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "prometheus_alerts_path": { 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus_alerts_path", 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.227 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_insecure": { 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_insecure", 2024-04-21T22:44:23.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-21T22:44:23.229 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_password": { 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_password", 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.230 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.231 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_url": { 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_url", 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.232 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "registry_username": { 2024-04-21T22:44:23.233 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "registry_username", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.234 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "secure_monitoring_stack": { 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "secure_monitoring_stack", 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.236 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "service_discovery_port": { 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "service_discovery_port", 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8765", 2024-04-21T22:44:23.237 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "cephadm service discovery port", 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.238 INFO:teuthology.orchestra.run.smithi018.stdout: "ssh_config_file": { 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssh_config_file", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.239 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "use_agent": { 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_agent", 2024-04-21T22:44:23.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-21T22:44:23.241 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "use_repo_digest": { 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "use_repo_digest", 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.242 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_failed_host_check": { 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_failed_host_check", 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.244 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if the host check fails", 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_daemons": { 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_daemons", 2024-04-21T22:44:23.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-21T22:44:23.246 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_on_stray_hosts": { 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_on_stray_hosts", 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.247 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crash", 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.249 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.250 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.251 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.252 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.254 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.255 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "retain_interval": { 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retain_interval", 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.258 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "31536000", 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_recent_interval": { 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_recent_interval", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1209600", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.260 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dashboard", 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.262 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.263 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_HOST": { 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.265 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.266 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_ENABLED": { 2024-04-21T22:44:23.267 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_ENABLED", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.268 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.269 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "ENABLE_BROWSABLE_API": { 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.271 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.272 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.273 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.274 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.275 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.276 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-21T22:44:23.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.278 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.279 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.280 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.281 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.282 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.284 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_PASSWORD": { 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-21T22:44:23.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.286 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.287 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.288 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_URL": { 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_URL", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.289 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_API_USERNAME": { 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.290 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.291 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.292 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.293 INFO:teuthology.orchestra.run.smithi018.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.294 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-21T22:44:23.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.296 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.298 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_HOST": { 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.301 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.302 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.303 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.304 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.305 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-21T22:44:23.306 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.307 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.308 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.309 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.310 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-21T22:44:23.311 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.312 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-21T22:44:23.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.314 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_ENABLED": { 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.315 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.317 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-21T22:44:23.318 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.319 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.320 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8", 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.321 INFO:teuthology.orchestra.run.smithi018.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "45", 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.322 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ACCESS_KEY": { 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-21T22:44:23.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.324 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.325 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "admin", 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SECRET_KEY": { 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.327 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "RGW_API_SSL_VERIFY": { 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-21T22:44:23.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.334 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "cross_origin_url": { 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cross_origin_url", 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "crt_file": { 2024-04-21T22:44:23.336 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "crt_file", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.337 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "debug": { 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "debug", 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.338 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Enable/disable debug options", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "jwt_token_ttl": { 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "jwt_token_ttl", 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "28800", 2024-04-21T22:44:23.340 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.341 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.342 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:23.342 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:23.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.342 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.343 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.343 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.343 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.343 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.344 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.345 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.345 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.345 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.346 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.346 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.346 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.347 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.347 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.347 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.347 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.348 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.348 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.348 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.348 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.349 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.349 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.349 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.350 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.350 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.351 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.353 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.354 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.355 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.356 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "motd": { 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "motd", 2024-04-21T22:44:23.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "The message of the day", 2024-04-21T22:44:23.358 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect_resolve_ip_addr": { 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "redirect_resolve_ip_addr", 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.359 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.361 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:23.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8080", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.363 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.364 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.365 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl_server_port": { 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl_server_port", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8443", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.366 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.367 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "redirect", 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "redirect" 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.368 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.369 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.370 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "url_prefix": { 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url_prefix", 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.372 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.373 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_monitoring": { 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_monitoring", 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "monitor device health metrics", 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "mark_out_threshold": { 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mark_out_threshold", 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "2419200", 2024-04-21T22:44:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": { 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pool_name", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "device_health_metrics", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "retention_period": { 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "retention_period", 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15552000", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long to retain device health metrics", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_frequency": { 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_frequency", 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "self_heal": { 2024-04-21T22:44:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "self_heal", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-21T22:44:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how frequently to wake up and check device health", 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "warn_threshold": { 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "warn_threshold", 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7257600", 2024-04-21T22:44:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "diskprediction_local", 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "predict_interval": { 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predict_interval", 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "86400", 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "predictor_model": { 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "predictor_model", 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "prophetstor", 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "600", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "influx", 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": false, 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "influxdb python module not found", 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "batch_size": { 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "batch_size", 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5000", 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "database": { 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "database", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "ceph", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": { 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "hostname", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server hostname", 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "30", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "5", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-21T22:44:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "password": { 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "password", 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "password of InfluxDB server user", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "port": { 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "port", 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "8086", 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "InfluxDB server port", 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "ssl": { 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ssl", 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "false", 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "threads": { 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threads", 2024-04-21T22:44:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "32", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-21T22:44:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "username": { 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "username", 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "username of InfluxDB server user", 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "verify_ssl": { 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "verify_ssl", 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "true", 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "insights", 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "iostat", 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "k8sevents", 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_event_retention_days": { 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "ceph_event_retention_days", 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "7", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "config_check_secs": { 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "config_check_secs", 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "10", 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "localpool", 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "failure_domain": { 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "failure_domain", 2024-04-21T22:44:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "host", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "failure domain for any created local pool", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-21T22:44:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": { 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "min_size", 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default min_size for any created local pool", 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "num_rep": { 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "num_rep", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default replica count for any created local pool", 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": { 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_num", 2024-04-21T22:44:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "128", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "default pg_num for any created local pool", 2024-04-21T22:44:23.486 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "prefix": { 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prefix", 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "name prefix for any created local pool", 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.488 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "subtree": { 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "subtree", 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.489 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "rack", 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.490 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mds_autoscaler", 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.491 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.492 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.493 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.494 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.495 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.496 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.497 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.498 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.499 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirroring", 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.501 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.502 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.503 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.505 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.508 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.509 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.511 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "nfs", 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.513 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.514 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.515 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.517 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.520 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.521 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.522 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.523 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "fail_fs": { 2024-04-21T22:44:23.525 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "fail_fs", 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.526 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.529 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.530 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.531 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.533 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.534 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.535 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.536 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator": { 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "orchestrator", 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm", 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "rook", 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: "test_orchestrator" 2024-04-21T22:44:23.538 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Orchestrator backend", 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_perf_query", 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.541 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.543 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.545 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.546 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "osd_support", 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.549 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.550 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.551 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.553 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.554 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.555 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.556 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.557 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.558 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "pg_autoscaler", 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.560 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.562 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.563 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.564 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.565 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.567 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.568 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "threshold": { 2024-04-21T22:44:23.569 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "threshold", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "3.0", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1.0", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.570 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "scaling threshold", 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "progress", 2024-04-21T22:44:23.571 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_pg_recovery_event": { 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_pg_recovery_event", 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.572 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.574 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.575 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.576 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.578 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.579 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.580 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.581 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.582 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max_completed_events": { 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_completed_events", 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "50", 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.584 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "number of past completed events to remember", 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "sleep_interval": { 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "sleep_interval", 2024-04-21T22:44:23.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "5", 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.586 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "how long the module is going to sleep", 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.587 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "prometheus", 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "cache": { 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cache", 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "exclude_perf_counters": { 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "exclude_perf_counters", 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.590 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.591 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.592 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.594 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.596 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.597 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.598 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.599 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools": { 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools", 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "300", 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.602 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "scrape_interval": { 2024-04-21T22:44:23.603 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "scrape_interval", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15.0", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.604 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.605 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "::", 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "9283", 2024-04-21T22:44:23.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.608 INFO:teuthology.orchestra.run.smithi018.stdout: "stale_cache_strategy": { 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stale_cache_strategy", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "log", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.609 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_behaviour": { 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_behaviour", 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.610 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "default", 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "default", 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "error" 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.611 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "standby_error_status_code": { 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "standby_error_status_code", 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.612 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "500", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "400", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "599", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.613 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.614 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.615 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.616 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.618 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.619 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.620 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.621 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.622 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.623 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_snap_create": { 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_snap_create", 2024-04-21T22:44:23.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "mirror_snapshot_schedule": { 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mirror_snapshot_schedule", 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.626 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "trash_purge_schedule": { 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "trash_purge_schedule", 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.628 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "restful", 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_auth": { 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enable_auth", 2024-04-21T22:44:23.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "key_file": { 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "key_file", 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.632 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.633 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.634 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.635 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.636 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.638 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.639 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "server_addr": { 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_addr", 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "server_port": { 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "server_port", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rgw", 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rook", 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "storage_class": { 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "storage_class", 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "local", 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "selftest", 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "roption1": { 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption1", 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "roption2": { 2024-04-21T22:44:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "roption2", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "xyz", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption1": { 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption1", 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption2": { 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption2", 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption3": { 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption3", 2024-04-21T22:44:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "float", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption4": { 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption4", 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption5": { 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption5", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption6": { 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption6", 2024-04-21T22:44:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "rwoption7": { 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rwoption7", 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "1", 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "42", 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "testkey": { 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testkey", 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "testlkey": { 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testlkey", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "testnewline": { 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "testnewline", 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_m_granularity": { 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "allow_m_granularity", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "allow minute scheduled snapshots", 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "dump_on_update": { 2024-04-21T22:44:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "dump_on_update", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "dump database to debug log on update", 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "stats", 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "status", 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.725 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.726 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telegraf", 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "address": { 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "address", 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.728 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "15", 2024-04-21T22:44:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.731 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.732 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.734 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.736 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.737 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.739 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "telemetry", 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_basic": { 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_basic", 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.740 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_crash": { 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_crash", 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_device": { 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_device", 2024-04-21T22:44:23.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.744 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_ident": { 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_ident", 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.746 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "channel_perf": { 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "channel_perf", 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.748 INFO:teuthology.orchestra.run.smithi018.stdout: "contact": { 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "contact", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.749 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "description": { 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "description", 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.750 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.751 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "device_url": { 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "device_url", 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-21T22:44:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "enabled": { 2024-04-21T22:44:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "enabled", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.754 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.755 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "24", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "8", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "last_opt_revision": { 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "last_opt_revision", 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "1", 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard": { 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard", 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.759 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "leaderboard_description": { 2024-04-21T22:44:23.760 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "leaderboard_description", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.761 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.762 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.763 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.764 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.765 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.766 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.767 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.769 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "organization": { 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "organization", 2024-04-21T22:44:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.771 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "proxy": { 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "proxy", 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.773 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "url": { 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "url", 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-21T22:44:23.774 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "test_orchestrator", 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.776 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.777 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.778 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.779 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.780 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.781 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.782 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.784 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.787 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.788 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.789 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.790 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.791 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.793 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max_concurrent_clones": { 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "max_concurrent_clones", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "4", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.795 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "periodic_async_work": { 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "periodic_async_work", 2024-04-21T22:44:23.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Periodically check for async work", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_delay": { 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_delay", 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.798 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "0", 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "snapshot_clone_no_wait": { 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snapshot_clone_no_wait", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "True", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.800 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.801 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix", 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "can_run": true, 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "error_string": "", 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "module_options": { 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "discovery_interval": { 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "discovery_interval", 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "uint", 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "100", 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.803 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.806 INFO:teuthology.orchestra.run.smithi018.stdout: "identifier": { 2024-04-21T22:44:23.806 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "identifier", 2024-04-21T22:44:23.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.806 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.807 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "interval": { 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "interval", 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "secs", 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "60", 2024-04-21T22:44:23.808 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "log_level": { 2024-04-21T22:44:23.809 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_level", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.810 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster": { 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster", 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.812 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_cluster_level": { 2024-04-21T22:44:23.813 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_cluster_level", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "info", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [ 2024-04-21T22:44:23.814 INFO:teuthology.orchestra.run.smithi018.stdout: "", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "critical", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "debug", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "error", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "info", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "warning" 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.815 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": { 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "log_to_file", 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "bool", 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "False", 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.817 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_host": { 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_host", 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "", 2024-04-21T22:44:23.818 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_port": { 2024-04-21T22:44:23.819 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_port", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "int", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "10051", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.820 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "zabbix_sender": { 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "zabbix_sender", 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "str", 2024-04-21T22:44:23.821 INFO:teuthology.orchestra.run.smithi018.stdout: "level": "advanced", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 0, 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "min": "", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "max": "", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "enum_allowed": [], 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "desc": "", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "long_desc": "", 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tags": [], 2024-04-21T22:44:23.822 INFO:teuthology.orchestra.run.smithi018.stdout: "see_also": [] 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: "services": { 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: "dashboard": "https://172.21.15.18:8443/" 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.823 INFO:teuthology.orchestra.run.smithi018.stdout: "always_on_modules": { 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "octopus": [ 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-04-21T22:44:23.824 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pacific": [ 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-04-21T22:44:23.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "quincy": [ 2024-04-21T22:44:23.826 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-04-21T22:44:23.827 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "reef": [ 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-04-21T22:44:23.828 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "squid": [ 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "balancer", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "crash", 2024-04-21T22:44:23.829 INFO:teuthology.orchestra.run.smithi018.stdout: "devicehealth", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "orchestrator", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscaler", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "progress", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_support", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "status", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "telemetry", 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: "volumes" 2024-04-21T22:44:23.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "last_failure_osd_epoch": 88, 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "active_clients": [ 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "devicehealth", 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.831 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3768025760 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "libcephsqlite", 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3035253401 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "rbd_support", 2024-04-21T22:44:23.833 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2021671494 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.834 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3900303806 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "snap_schedule", 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3821680572 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.836 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "volumes", 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-21T22:44:23.837 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2771900969 2024-04-21T22:44:23.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.838 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:23.838 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-21T22:44:23.838 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:21 smithi081 ceph-mon[31692]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:21 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/765178869' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:21 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1053199966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:22 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1985151682' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:22 smithi081 ceph-mon[31692]: pgmap v321: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:21 smithi047 ceph-mon[31561]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:23.840 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:21 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/765178869' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.841 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:21 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1053199966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.841 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:22 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1985151682' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-21T22:44:23.841 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:22 smithi047 ceph-mon[31561]: pgmap v321: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 msgr2=0x7fc43c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 0x7fc43c0a51b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc4480058c0 tx=0x7fc448009260 comp rx=0 tx=0).stop 2024-04-21T22:44:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 msgr2=0x7fc45819e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:44:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc45819e9a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc450009fd0 tx=0x7fc45000ef10 comp rx=0 tx=0).stop 2024-04-21T22:44:23.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 shutdown_connections 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fc43c0a2cf0 0x7fc43c0a51b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45810de20 0x7fc45819e9a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc458074490 0x7fc45819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 --2- 172.21.15.18:0/1985151682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc458073b70 0x7fc45819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 >> 172.21.15.18:0/1985151682 conn(0x7fc4580fd150 msgr2=0x7fc4580fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.679+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 shutdown_connections 2024-04-21T22:44:23.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:44:21.680+0000 7fc457200640 1 -- 172.21.15.18:0/1985151682 wait complete. 2024-04-21T22:44:23.851 DEBUG:tasks.check_counter:Getting stats from a 2024-04-21T22:44:23.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-21T22:44:23.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:21 smithi018 ceph-mon[26614]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:23.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:21 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/765178869' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:21 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1053199966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:44:23.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:22 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1985151682' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-21T22:44:23.852 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:22 smithi018 ceph-mon[26614]: pgmap v321: 97 pgs: 97 active+clean; 93 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-21T22:44:24.335 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:44:25.542 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:25 smithi018 ceph-mon[26614]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:25.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:25 smithi081 ceph-mon[31692]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:25.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:25 smithi047 ceph-mon[31561]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:26.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:26 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:44:26.750 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:26 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:44:26.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:26 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-21T22:44:26.972 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1023, 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 998, 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 2077168, 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 377582, 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.303385031, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.122461492, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.132626650, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.054601714, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 998, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.101186639, 2024-04-21T22:44:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000101389 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1818784, 2024-04-21T22:44:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 133040 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1405, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1564, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 478114, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 894243, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 7, 2024-04-21T22:44:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.265137075, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.104197122, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.063816524, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.073116197, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1561, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.153122246, 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000098092 2024-04-21T22:44:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-21T22:44:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448032 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 4, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 6, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1629, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 1284, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-04-21T22:44:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.003360682, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000146294, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.002878416, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000113092, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.004120757, 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001030189 2024-04-21T22:44:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3709, 2024-04-21T22:44:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.190371729, 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000051326 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 0, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 67, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 2, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 65, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 65, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 4, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-04-21T22:44:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-04-21T22:44:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-04-21T22:44:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-04-21T22:44:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 0, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-04-21T22:44:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 63, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-04-21T22:44:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4314592, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 4314018, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 63 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 68, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 68, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 0, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 15, 2024-04-21T22:44:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 15, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 0, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 67, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 67, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-04-21T22:44:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 49280, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 215420 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 0, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-04-21T22:44:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-04-21T22:44:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-04-21T22:44:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-04-21T22:44:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-04-21T22:44:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 1, 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 2, 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 2, 2024-04-21T22:44:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 3162, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 199841, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 119, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 171, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-04-21T22:44:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 225153, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 1875, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-04-21T22:44:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 2176, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 21, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 3, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 2176, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2176, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2.094975846, 2024-04-21T22:44:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000962764 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2176, 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2177 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 2176, 2024-04-21T22:44:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 2176, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 1394, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 780, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 0, 2024-04-21T22:44:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 1, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-04-21T22:44:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-04-21T22:44:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-04-21T22:44:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 96, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 11, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 6, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 6, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-04-21T22:44:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 0, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 2, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 0 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 0, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 2428, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 2322575, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 2428, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2428, 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2322575, 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2176, 2024-04-21T22:44:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 120293, 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2176, 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 120293, 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2176, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 2176, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2176, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2176, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55a97a58e780": { 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-04-21T22:44:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:27.050 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:27.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:27 smithi047 ceph-mon[31561]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:27 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:27 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:27 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:27 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:27 smithi018 ceph-mon[26614]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:27.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:27 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.710 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:27 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:27 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.711 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:27 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:27 smithi081 ceph-mon[31692]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-21T22:44:27.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:27 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:27 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:27 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:27.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:27 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.007 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:28.008 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:28.009 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-04-21T22:44:28.009 DEBUG:tasks.check_counter:Getting stats from d 2024-04-21T22:44:28.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-21T22:44:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:44:28.844 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:28 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.844 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:28 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:28 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:28 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:28 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:28.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:28 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.790 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:44:29.790 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.790 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.791 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:29 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:44:29.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.816 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.817 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:29 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-21T22:44:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:29.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:29.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:29 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.802 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.802 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.802 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.802 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.802 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.803 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:44:30.804 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:30 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:44:30.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:44:30.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:30 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:44:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi047 to 177.2M 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi047 to 185896345: error parsing value: Value '185896345' is below minimum 939524096 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:30.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi081 to 176.2M 2024-04-21T22:44:30.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:30 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi081 to 184783155: error parsing value: Value '184783155' is below minimum 939524096 2024-04-21T22:44:31.797 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:31 smithi018 ceph-mon[26614]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:44:31.798 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:31.798 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.004137071, 2024-04-21T22:44:31.799 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000752541, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.800 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.801 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 234, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 220, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1723936, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 134752, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.140001446, 2024-04-21T22:44:31.802 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.034359701, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.151024406, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.010309825, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 220, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.023053369, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000104788 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:31.803 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1723936, 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 134752 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.804 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 2, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 166, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 320, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 184720, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.034369409, 2024-04-21T22:44:31.805 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.024565752, 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.004295162, 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 163, 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.024340635, 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000149329 2024-04-21T22:44:31.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 184720 2024-04-21T22:44:31.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:31.808 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:31.809 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:31.810 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:31.811 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:31.812 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148714, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 30, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:31.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-04-21T22:44:31.814 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:31.815 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 232, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1688459, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 232, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:31.816 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 232, 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1688459, 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:31.817 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:31.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:31 smithi081 ceph-mon[31692]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:44:31.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:31 smithi047 ceph-mon[31561]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-21T22:44:32.623 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-21T22:44:32.623 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-21T22:44:32.623 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-21T22:44:32.623 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-21T22:44:32.624 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-21T22:44:32.624 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-21T22:44:32.624 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-21T22:44:32.624 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-04-21T22:44:32.624 DEBUG:tasks.check_counter:Getting stats from g 2024-04-21T22:44:32.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-21T22:44:33.110 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:44:33.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:33 smithi018 ceph-mon[26614]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:33.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:33 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:33.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:33 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:33.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:33 smithi081 ceph-mon[31692]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:33.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:33 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:33.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:33 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:33 smithi047 ceph-mon[31561]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:33 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:33.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:33 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:44:34.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:44:34.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:34 smithi018 ceph-mon[26614]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:34.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:44:34.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:44:34.890 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:34 smithi081 ceph-mon[31692]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-21T22:44:34.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-21T22:44:34.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-21T22:44:34.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:34 smithi047 ceph-mon[31561]: from='mgr.25309 ' entity='mgr.x' 2024-04-21T22:44:35.410 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:35.410 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 226, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 214, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1719776, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 131744, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-04-21T22:44:35.411 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.112939757, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.033381833, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.096019336, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.009804902, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 213, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.021357588, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000100270 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.412 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1719776, 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 131744 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.413 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 6, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 166, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3392, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 184816, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 3, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.034000085, 2024-04-21T22:44:35.414 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.024805432, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.003983525, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 164, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.028501270, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000173788 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.415 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 184816 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.416 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.000998713, 2024-04-21T22:44:35.417 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000791081, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.418 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-04-21T22:44:35.419 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:35.420 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:35.421 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:35.422 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:35.423 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 150008, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 31, 2024-04-21T22:44:35.424 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:35.425 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 928, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-04-21T22:44:35.426 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:35.427 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 228, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1687939, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 228, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 228, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1687939, 2024-04-21T22:44:35.428 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:35.429 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:35 smithi018 ceph-mon[26614]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:44:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:35 smithi018 ceph-mon[26614]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:44:35.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:35 smithi018 ceph-mon[26614]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:35 smithi081 ceph-mon[31692]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:44:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:35 smithi081 ceph-mon[31692]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:44:35.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:35 smithi081 ceph-mon[31692]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:35.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:35 smithi047 ceph-mon[31561]: Adjusting osd_memory_target on smithi018 to 177.5M 2024-04-21T22:44:35.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:35 smithi047 ceph-mon[31561]: Unable to set osd_memory_target on smithi018 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-04-21T22:44:35.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:35 smithi047 ceph-mon[31561]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:36.393 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-04-21T22:44:36.393 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-04-21T22:44:36.393 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-04-21T22:44:36.394 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-04-21T22:44:36.394 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-04-21T22:44:36.394 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-04-21T22:44:36.394 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-04-21T22:44:36.394 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-04-21T22:44:36.394 DEBUG:tasks.check_counter:Getting stats from j 2024-04-21T22:44:36.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-21T22:44:36.871 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.a/config 2024-04-21T22:44:37.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:37 smithi018 ceph-mon[26614]: pgmap v328: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:37.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:37 smithi081 ceph-mon[31692]: pgmap v328: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:37.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:37 smithi047 ceph-mon[31561]: pgmap v328: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 846, 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 528, 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 409412, 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 422600, 2024-04-21T22:44:39.227 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 23, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.148022277, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.051343474, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.092368840, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.010963665, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 525, 2024-04-21T22:44:39.228 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.079100516, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000150667 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 960, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000255231, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000265 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2144, 2024-04-21T22:44:39.229 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 3024 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1691, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 1393, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 557908, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 639280, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 10, 2024-04-21T22:44:39.230 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.364322975, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.172840611, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.217851867, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.011905583, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1391, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.201878037, 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000145131 2024-04-21T22:44:39.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2710, 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.001249155, 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000460 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.232 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 137440 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 483, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 584, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1878860, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 875307, 2024-04-21T22:44:39.233 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 37, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 6, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.189738652, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.057909601, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.149156244, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.018160134, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 584, 2024-04-21T22:44:39.234 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.099236334, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000169925 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 30, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000004490, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000149 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1839952, 2024-04-21T22:44:39.235 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 473056 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-04-21T22:44:39.236 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 250, 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.153693531, 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000614774 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-04-21T22:44:39.237 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000008455, 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000004227 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 6, 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 4, 2024-04-21T22:44:39.238 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.003565294, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000891323 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 2, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:39.239 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 11, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 96, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 10, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 86, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 80, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 7, 2024-04-21T22:44:39.240 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 1, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 1, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 7, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 62, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 33, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 2, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 25, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:39.241 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 2, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 28, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:39.242 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 364, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 3454, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 6, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 364, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:39.243 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 364, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:44:39.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 52, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 52, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 1, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-04-21T22:44:39.245 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 79, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 50, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 57, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 2, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:39.246 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-04-21T22:44:39.247 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.248 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 63, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 63, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-04-21T22:44:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 2, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4314592, 2024-04-21T22:44:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9, 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.033676418, 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.003741824 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.251 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 98, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 101, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 3, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 51, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 59, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 8, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 96, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 103, 2024-04-21T22:44:39.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 7, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 1, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 29, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 28, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 53184, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 223612 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-04-21T22:44:39.253 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 10, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 6, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 13, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 1, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.002350708, 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.002350708 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.255 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-04-21T22:44:39.256 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000960512, 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000480256 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000254074, 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000254074 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.258 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.261 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-04-21T22:44:39.261 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.261 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.262 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.263 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.264 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.265 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-04-21T22:44:39.266 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.267 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.268 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.269 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.270 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.271 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:39.272 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 1, 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 2, 2024-04-21T22:44:39.273 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 1, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 3, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 1, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 637, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:39.275 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:39.276 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:39.277 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:39.278 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 299305, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 177, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-04-21T22:44:39.279 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 171, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:39.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 372129, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2644, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.281 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 418, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 136461, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 27, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 418, 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-04-21T22:44:39.282 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 418, 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.714991758, 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001710506 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 418, 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 447 2024-04-21T22:44:39.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 418, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 364, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 54, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 0, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 10, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 0, 2024-04-21T22:44:39.284 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 9, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 9, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 6, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-04-21T22:44:39.285 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 364, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 20, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-04-21T22:44:39.286 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-04-21T22:44:39.287 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-04-21T22:44:39.288 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 96, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 11, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 12, 2024-04-21T22:44:39.289 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 12, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 24, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 0, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 5 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-04-21T22:44:39.290 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "osd-slow-ops": { 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-04-21T22:44:39.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.292 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 3016, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 2556723, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 3016, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:39.293 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3016, 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2556723, 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:39.295 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 418, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 136461, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 418, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 136461, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:39.297 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 418, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 418, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 418, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 418, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.298 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-04-21T22:44:39.299 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.300 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x562576d52460": { 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 63, 2024-04-21T22:44:39.301 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 120288, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 63, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 9, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 120288, 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-04-21T22:44:39.302 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-04-21T22:44:39.303 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-04-21T22:44:39.303 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-04-21T22:44:39.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-21T22:44:39.303 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-21T22:44:39.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:39 smithi018 ceph-mon[26614]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:39.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:39 smithi081 ceph-mon[31692]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:39.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:39 smithi047 ceph-mon[31561]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:40.255 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-04-21T22:44:40.255 INFO:tasks.check_counter:Daemon mds.j mds.imported=2 2024-04-21T22:44:40.255 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update=0 2024-04-21T22:44:40.255 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update_receipt=79 2024-04-21T22:44:40.256 INFO:tasks.check_counter:Daemon mds.j mds.root_rsnaps=6 2024-04-21T22:44:40.256 INFO:tasks.check_counter:Daemon mds.j mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:40.256 INFO:tasks.check_counter:Daemon mds.j mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:40.256 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-04-21T22:44:40.256 DEBUG:tasks.check_counter:Getting stats from b 2024-04-21T22:44:40.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-21T22:44:40.516 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:44:41.814 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:41 smithi047 ceph-mon[31561]: pgmap v330: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:41.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:41 smithi018 ceph-mon[26614]: pgmap v330: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:41.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:41 smithi081 ceph-mon[31692]: pgmap v330: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:42.365 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-21T22:44:42.365 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:42.365 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 948, 2024-04-21T22:44:42.365 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 912, 2024-04-21T22:44:42.365 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2046249, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 2208647, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 152, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 11, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.160620329, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.034886918, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.102589810, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.020025178, 2024-04-21T22:44:42.366 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 902, 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.290733039, 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001430967 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 411, 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000061409, 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000149 2024-04-21T22:44:42.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 1961648, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 517920 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 6603, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 5241, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2221682, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 1920227, 2024-04-21T22:44:42.368 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 12, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.555822458, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.176739173, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.357522505, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.090185146, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 5245, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.427473533, 2024-04-21T22:44:42.369 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000081501 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 9680, 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.002069650, 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000213 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 42720, 2024-04-21T22:44:42.370 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 218592 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 3618, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 3618, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 1491535, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 2806847, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 22, 2024-04-21T22:44:42.371 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 6, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.405650045, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.136584967, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.172788481, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.098129738, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3619, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.379549999, 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000104877 2024-04-21T22:44:42.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 5773, 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.001157779, 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000200 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 348064, 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 88512 2024-04-21T22:44:42.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 896, 2024-04-21T22:44:42.374 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.376564354, 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000420272 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 41, 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.001204648, 2024-04-21T22:44:42.375 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000029381 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 660, 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 502, 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 502, 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2.559857313, 2024-04-21T22:44:42.376 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.005099317 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 158, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 12, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 0, 2024-04-21T22:44:42.377 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 46, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 10, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 18, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 18, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 30, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 134, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 5, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 5, 2024-04-21T22:44:42.378 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 4, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 968, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 681, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 157, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 17, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 0, 2024-04-21T22:44:42.379 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 0, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 0, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 7, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 128, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 1, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 0, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 245, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:42.380 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 3454, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 6, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 245, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 173, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 18, 2024-04-21T22:44:42.381 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 155, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 72, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 2, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 213, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 51, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:42.382 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 232, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 9, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 8, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 41 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 12, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 67, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 42, 2024-04-21T22:44:42.383 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 45, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 33, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 9, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 9, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-04-21T22:44:42.384 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 18, 2024-04-21T22:44:42.385 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 7, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-04-21T22:44:42.386 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 418, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 418, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 2, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 0, 2024-04-21T22:44:42.387 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 2, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 2, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 0, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 4194304, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 5649016, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 0, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 335, 2024-04-21T22:44:42.388 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.625867477, 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001868261 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 0 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 48, 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 102, 2024-04-21T22:44:42.389 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 54, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 50, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 61, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 11, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 46, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 189, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 143, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 5, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 57, 2024-04-21T22:44:42.390 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 52, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 56892, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 231804 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 903, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 965, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 660, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 40, 2024-04-21T22:44:42.391 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 1932, 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 31, 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.049663607, 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001602051 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 302, 2024-04-21T22:44:42.392 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.866470929, 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.006180367 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-04-21T22:44:42.393 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2, 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000672885, 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000336442 2024-04-21T22:44:42.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.395 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.396 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-04-21T22:44:42.397 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 10, 2024-04-21T22:44:42.398 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.002223302, 2024-04-21T22:44:42.398 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000222330 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 19, 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.026824735, 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001411828 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-04-21T22:44:42.399 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 10, 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.522513468, 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.052251346 2024-04-21T22:44:42.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 100, 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.025359839, 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000253598 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1, 2024-04-21T22:44:42.401 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000630286, 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000630286 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 10, 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.015539222, 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001553922 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.402 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 4, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.022491167, 2024-04-21T22:44:42.404 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.005622791 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-04-21T22:44:42.405 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1, 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.001082712, 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001082712 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.407 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 8, 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.022121856, 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002765232 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-04-21T22:44:42.408 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000686042, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000686042 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.003577263, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001192421 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.409 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.410 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 2, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 6, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 4, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 2, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 28, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 14, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 607, 2024-04-21T22:44:42.411 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:42.412 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:42.413 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:42.414 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:42.415 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 304832, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 145, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 88, 2024-04-21T22:44:42.416 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 1, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 171, 2024-04-21T22:44:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 254843, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2099, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:42.418 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 1218, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 1474729, 2024-04-21T22:44:42.419 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 37, 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 1218, 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1218, 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 23.607495643, 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.019382180 2024-04-21T22:44:42.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.421 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-04-21T22:44:42.421 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-04-21T22:44:42.421 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1218, 2024-04-21T22:44:42.421 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1259 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 1218, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 285, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 933, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 0, 2024-04-21T22:44:42.422 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 11, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 22, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 339, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 32, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 0, 2024-04-21T22:44:42.423 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 521, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 263, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 22, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:42.424 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-04-21T22:44:42.425 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-04-21T22:44:42.426 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 96, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-04-21T22:44:42.427 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 12, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 12, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 12, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 0, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 42, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 0, 2024-04-21T22:44:42.428 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 7 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 1, 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.429 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 0 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 6, 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 6, 2024-04-21T22:44:42.430 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 9, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 9, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 11165, 2024-04-21T22:44:42.431 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 4706681, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 11165, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 11165, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 4706681, 2024-04-21T22:44:42.432 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:42.433 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 1218, 2024-04-21T22:44:42.434 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 1475638, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 1218, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 1475638, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.435 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:42.436 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 1218, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 1218, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 1218, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 1218, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 9, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 909, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 9, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 4, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 909, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x55e46fc44460": { 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 418, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 1454712, 2024-04-21T22:44:42.440 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 418, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 335, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 1454712, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:42.441 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:42.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:42.442 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds.exported=7 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=12 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=67 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-21T22:44:43.151 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-04-21T22:44:43.152 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-21T22:44:43.152 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-04-21T22:44:43.152 DEBUG:tasks.check_counter:Getting stats from e 2024-04-21T22:44:43.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-21T22:44:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:44:43.793 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:43 smithi047 ceph-mon[31561]: pgmap v331: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:43.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:43 smithi018 ceph-mon[26614]: pgmap v331: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:43.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:43 smithi081 ceph-mon[31692]: pgmap v331: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:45.267 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-21T22:44:45.267 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:45.267 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 691, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 820, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 193436, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 1393552, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 50, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 6, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.073440025, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.021447860, 2024-04-21T22:44:45.268 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.026258339, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.016393578, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 819, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.061054927, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000074548 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 64, 2024-04-21T22:44:45.269 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000008459, 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000132 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 4160, 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 321104 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1757, 2024-04-21T22:44:45.270 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1740, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 789882, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 709881, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 13, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.121383820, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.045260556, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.082018515, 2024-04-21T22:44:45.271 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.010965491, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1737, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.051086131, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000029410 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1983, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000537069, 2024-04-21T22:44:45.272 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000270 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 143664 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 2351, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 2013, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2455745, 2024-04-21T22:44:45.273 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 892458, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 10, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.229152519, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.089926685, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.141141154, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.024998297, 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:45.274 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2012, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.090883333, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000045170 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2421, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000558161, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000230 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.275 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 1848000, 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 165072 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-04-21T22:44:45.276 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1265, 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.340668185, 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000269302 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:45.277 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 17, 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000551505, 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000032441 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 164, 2024-04-21T22:44:45.278 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 12, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 12, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.018327794, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.001527316 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 152, 2024-04-21T22:44:45.279 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 11, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 0, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 270, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 18, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 252, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:45.280 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 243, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 8, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 71, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 71, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 8, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 233, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 43, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 151, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 30, 2024-04-21T22:44:45.281 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 0, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 10, 2024-04-21T22:44:45.282 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 128, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 1624, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 3454, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 6, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 1624, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:45.283 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 182, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 182, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 1442, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:45.284 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 16, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 217, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 207, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 5, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 5 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.285 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 3, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 75, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 47, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 64, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 3, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:45.286 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 2, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 2, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:45.287 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:45.288 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 257, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 0, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 0, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 257, 2024-04-21T22:44:45.289 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 2, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 2, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 2, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 0, 2024-04-21T22:44:45.290 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 4194304, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 5016809, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 0, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 34, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.174734813, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.005139259 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.291 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 0 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 261, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 268, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 7, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 64, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 70, 2024-04-21T22:44:45.292 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 6, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 270, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 280, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 10, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 71, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 122, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 51, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 56964, 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 223612 2024-04-21T22:44:45.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 169, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 164, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 28, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 5, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3, 2024-04-21T22:44:45.294 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.012096426, 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.004032142 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1, 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000206141, 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000206141 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:45.295 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.296 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 6, 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.001846540, 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000307756 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.297 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.298 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:45.299 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.300 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.301 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.301 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-04-21T22:44:45.301 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.303 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.304 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.306 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.307 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.309 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.310 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.311 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2, 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.004178687, 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.002089343 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.312 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-04-21T22:44:45.313 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 2, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 5, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 3, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 2, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 9, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 4, 2024-04-21T22:44:45.314 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 567, 2024-04-21T22:44:45.315 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:45.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.315 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-04-21T22:44:45.315 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:45.315 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:45.318 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:45.319 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:45.320 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:45.321 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 311114, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 273, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 264, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 3, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-04-21T22:44:45.322 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 171, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:45.323 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 916247, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 8022, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-04-21T22:44:45.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 1723, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 855226, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 33, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 1723, 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-04-21T22:44:45.325 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1723, 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.524967398, 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000885065 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1723, 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1756 2024-04-21T22:44:45.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 1723, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 1625, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 98, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 0, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 10, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 1, 2024-04-21T22:44:45.327 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 35, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 15, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 0, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 14, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-04-21T22:44:45.328 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 1624, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 20, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-04-21T22:44:45.329 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-04-21T22:44:45.330 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-04-21T22:44:45.331 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 96, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 11, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 12, 2024-04-21T22:44:45.332 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 12, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 0, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 30, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 0, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 7 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 1, 2024-04-21T22:44:45.333 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 0 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:45.334 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 2, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 2, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 2, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 2, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:45.335 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 4795, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 2993634, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 4795, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:45.336 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 4795, 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 2993634, 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.337 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 1723, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 855444, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 1723, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 855444, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:45.340 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 1723, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 1723, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 1723, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 1723, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 2, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 218, 2024-04-21T22:44:45.342 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 2, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 1, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 218, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.343 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x555784e92460": { 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 257, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 822505, 2024-04-21T22:44:45.344 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 257, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 34, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 822505, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:45.345 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.346 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:45.346 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-21T22:44:45.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:45 smithi018 ceph-mon[26614]: pgmap v332: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:45.873 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:45 smithi047 ceph-mon[31561]: pgmap v332: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:45.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:45 smithi081 ceph-mon[31692]: pgmap v332: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:46.076 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds.imported=10 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=3 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=75 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:46.077 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-04-21T22:44:46.078 DEBUG:tasks.check_counter:Getting stats from h 2024-04-21T22:44:46.078 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-21T22:44:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:44:47.694 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:47 smithi047 ceph-mon[31561]: pgmap v333: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:47.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:47 smithi018 ceph-mon[26614]: pgmap v333: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:47.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:47 smithi081 ceph-mon[31692]: pgmap v333: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-21T22:44:48.150 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-21T22:44:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:48.150 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1058, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1028, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 2113728, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 389886, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 1, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.135476457, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.046851877, 2024-04-21T22:44:48.151 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.061716624, 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.029147292, 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1027, 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.047740947, 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000046485 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:48.152 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 1847280, 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 137712 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:48.153 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1496, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1660, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 899399, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 1011022, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 8, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.105265748, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.028632113, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.029301009, 2024-04-21T22:44:48.154 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.039400415, 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1658, 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.064529088, 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000038919 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.155 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 537776 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 48, 2024-04-21T22:44:48.156 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 50, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 14120, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 15271, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 4, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 3, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.004302184, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.001057136, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.001630762, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.001174080, 2024-04-21T22:44:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 48, 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.002847376, 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000059320 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.158 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-04-21T22:44:48.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3928, 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.095667319, 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000024355 2024-04-21T22:44:48.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.161 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 0, 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 0, 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-04-21T22:44:48.163 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 140, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 1, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 139, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 139, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 0, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 0, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 0, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 3, 2024-04-21T22:44:48.164 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 0, 2024-04-21T22:44:48.165 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 0, 2024-04-21T22:44:48.166 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 0, 2024-04-21T22:44:48.166 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 0, 2024-04-21T22:44:48.166 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 0, 2024-04-21T22:44:48.166 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 0, 2024-04-21T22:44:48.166 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:48.167 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:44:48.168 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 0, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 0 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-04-21T22:44:48.169 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-04-21T22:44:48.170 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:48.171 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:48.172 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 0, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 0, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 0, 2024-04-21T22:44:48.173 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 289, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 2, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 2, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-04-21T22:44:48.174 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 0, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 4194304, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 4712576, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 4712002, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 289 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 90, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 131, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 41, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 11, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 11, 2024-04-21T22:44:48.176 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 0, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 140, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 140, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 0, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 0, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 0, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 0, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 53152, 2024-04-21T22:44:48.177 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 215420 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 0, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 0, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 0, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 0, 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-04-21T22:44:48.178 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.180 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:48.180 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-04-21T22:44:48.181 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.183 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.184 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-04-21T22:44:48.186 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.188 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-04-21T22:44:48.189 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.191 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.192 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.193 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-04-21T22:44:48.194 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.196 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.197 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.198 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 2, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 4, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 2, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 2, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 0, 2024-04-21T22:44:48.200 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 0, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 3656, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:48.201 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:48.202 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:48.203 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:48.204 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 192482, 2024-04-21T22:44:48.205 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 135, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:48.206 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 171, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-04-21T22:44:48.207 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 321018, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 2555, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-04-21T22:44:48.208 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 2329, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 21, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 3, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 2329, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2329, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2.300950818, 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000987956 2024-04-21T22:44:48.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2329, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2330 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 2329, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 2329, 2024-04-21T22:44:48.210 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 1514, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 813, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-04-21T22:44:48.211 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 1, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 0, 2024-04-21T22:44:48.212 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:48.213 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-04-21T22:44:48.214 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-04-21T22:44:48.215 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 96, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 11, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 5, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 5, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 0, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 0, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 2, 2024-04-21T22:44:48.216 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 0 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 0, 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-04-21T22:44:48.217 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 0 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 0, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 0, 2024-04-21T22:44:48.218 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 0, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 2598, 2024-04-21T22:44:48.219 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 2776827, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 2598, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2598, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 2776827, 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:48.220 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:48.221 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 2329, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 518277, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2329, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 518277, 2024-04-21T22:44:48.222 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-04-21T22:44:48.223 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 2329, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 2329, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2329, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 2329, 2024-04-21T22:44:48.224 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:48.225 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-04-21T22:44:48.226 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x555ba4cec6e0": { 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:48.227 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-04-21T22:44:48.228 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:48.229 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:48.929 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:48.930 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-04-21T22:44:48.930 DEBUG:tasks.check_counter:Getting stats from k 2024-04-21T22:44:48.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-21T22:44:49.178 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.b/config 2024-04-21T22:44:49.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:49 smithi018 ceph-mon[26614]: pgmap v334: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:49.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:49 smithi081 ceph-mon[31692]: pgmap v334: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:49.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:49 smithi047 ceph-mon[31561]: pgmap v334: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:50.852 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-21T22:44:50.852 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:50.852 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 1606, 2024-04-21T22:44:50.853 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 1608, 2024-04-21T22:44:50.853 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 1301780, 2024-04-21T22:44:50.853 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 510709, 2024-04-21T22:44:50.853 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 6, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.155416321, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.055821334, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.038464649, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.045489038, 2024-04-21T22:44:50.854 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 1606, 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.064333553, 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000040058 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.855 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:50.856 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 734, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 903, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 183046, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 767942, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 8, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.079906026, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.025293743, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.018659078, 2024-04-21T22:44:50.857 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.028044366, 2024-04-21T22:44:50.858 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:50.858 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 900, 2024-04-21T22:44:50.858 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.040000156, 2024-04-21T22:44:50.858 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000044444 2024-04-21T22:44:50.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 536688 2024-04-21T22:44:50.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_messages": 265, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages": 242, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_bytes": 1819788, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_bytes": 141870, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_created_connections": 3, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_active_connections": 2, 2024-04-21T22:44:50.860 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_total_time": 0.051446017, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_send_time": 0.014981847, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_recv_time": 0.041422117, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_running_fast_dispatch_time": 0.006064504, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 241, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.013876676, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000057579 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.861 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_recv_encrypted_bytes": 1819520, 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "msgr_send_encrypted_bytes": 141552 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.862 INFO:teuthology.orchestra.run.smithi047.stdout: "cct": { 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "total_workers": 1, 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "unhealthy_workers": 0 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-MDSRank": { 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 3839, 2024-04-21T22:44:50.863 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.107478386, 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000027996 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "queue_len": 0, 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "complete_latency": { 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": { 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "request": 0, 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "reply": 0, 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "reply_latency": { 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_reply": 0, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "forward": 0, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_commit": 0, 2024-04-21T22:44:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_split": 0, 2024-04-21T22:44:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_merge": 0, 2024-04-21T22:44:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes": 245, 2024-04-21T22:44:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_top": 9, 2024-04-21T22:44:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_bottom": 236, 2024-04-21T22:44:50.868 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:50.868 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_pinned": 232, 2024-04-21T22:44:50.868 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_expired": 0, 2024-04-21T22:44:50.868 INFO:teuthology.orchestra.run.smithi047.stdout: "inodes_with_caps": 0, 2024-04-21T22:44:50.869 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": 0, 2024-04-21T22:44:50.869 INFO:teuthology.orchestra.run.smithi047.stdout: "subtrees": 6, 2024-04-21T22:44:50.869 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse": 0, 2024-04-21T22:44:50.869 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_hit": 0, 2024-04-21T22:44:50.870 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_forward": 0, 2024-04-21T22:44:50.870 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_discover": 0, 2024-04-21T22:44:50.870 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:50.870 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "traverse_lock": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "load_cent": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "q": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "exported": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "exported_inodes": 0, 2024-04-21T22:44:50.871 INFO:teuthology.orchestra.run.smithi047.stdout: "imported": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "imported_inodes": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_backtrace_fetch": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rfiles": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rbytes": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "root_rsnaps": 0, 2024-04-21T22:44:50.872 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_fetch": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "scrub_file_inodes": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:50.873 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_caps_dirty": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_cap_release": 0, 2024-04-21T22:44:50.874 INFO:teuthology.orchestra.run.smithi047.stdout: "process_request_cap_release": 0 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_cache": { 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update": 0, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_update_receipt": 0, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_try_discover": 0, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_send_discover": 0, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "dir_handle_discover": 0, 2024-04-21T22:44:50.875 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_created": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_enqueued": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "strays_migrated": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:50.876 INFO:teuthology.orchestra.run.smithi047.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_started": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "recovery_completed": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:50.877 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_flush": 0, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "ireq_inodestats": 0 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_log": { 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "evlrg": 0, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "evadd": 0, 2024-04-21T22:44:50.878 INFO:teuthology.orchestra.run.smithi047.stdout: "evex": 0, 2024-04-21T22:44:50.879 INFO:teuthology.orchestra.run.smithi047.stdout: "evtrm": 0, 2024-04-21T22:44:50.879 INFO:teuthology.orchestra.run.smithi047.stdout: "ev": 257, 2024-04-21T22:44:50.879 INFO:teuthology.orchestra.run.smithi047.stdout: "evexg": 0, 2024-04-21T22:44:50.879 INFO:teuthology.orchestra.run.smithi047.stdout: "evexd": 0, 2024-04-21T22:44:50.879 INFO:teuthology.orchestra.run.smithi047.stdout: "segadd": 0, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "segex": 0, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "segtrm": 0, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "seg": 2, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "segmjr": 2, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "segexg": 0, 2024-04-21T22:44:50.880 INFO:teuthology.orchestra.run.smithi047.stdout: "segexd": 0, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "expos": 4194304, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "wrpos": 5016809, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "rdpos": 5016235, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "jlat": { 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.881 INFO:teuthology.orchestra.run.smithi047.stdout: "replayed": 257 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_mem": { 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ino": 233, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ino+": 235, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "ino-": 2, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "dir": 27, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "dir+": 27, 2024-04-21T22:44:50.882 INFO:teuthology.orchestra.run.smithi047.stdout: "dir-": 0, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "dn": 245, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "dn+": 245, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "dn-": 0, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "cap": 0, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "cap+": 0, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "cap-": 0, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "rss": 54112, 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: "heap": 215420 2024-04-21T22:44:50.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_server": { 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_client_request": 0, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_request": 0, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_client_session": 0, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "handle_peer_request": 0, 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "req_create_latency": { 2024-04-21T22:44:50.884 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getattr_latency": { 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.885 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "req_link_latency": { 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.886 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookup_latency": { 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:50.887 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupino_latency": { 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupname_latency": { 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.889 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.890 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:50.890 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.890 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.890 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: "req_lssnap_latency": { 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.891 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mkdir_latency": { 2024-04-21T22:44:50.892 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.892 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.892 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mknod_latency": { 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "req_mksnap_latency": { 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.893 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "req_open_latency": { 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "req_readdir_latency": { 2024-04-21T22:44:50.894 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rename_latency": { 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.896 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmdir_latency": { 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:50.897 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.898 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.898 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.898 INFO:teuthology.orchestra.run.smithi047.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setattr_latency": { 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.899 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:50.900 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setlayout_latency": { 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.901 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "req_setxattr_latency": { 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.902 INFO:teuthology.orchestra.run.smithi047.stdout: "req_symlink_latency": { 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "req_unlink_latency": { 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.903 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.904 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_sessions": { 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: "session_count": 2, 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: "session_add": 5, 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: "session_remove": 3, 2024-04-21T22:44:50.905 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_open": 2, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "sessions_stale": 0, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "total_load": 0, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "average_load": 0, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "avg_session_uptime": 5170, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.906 INFO:teuthology.orchestra.run.smithi047.stdout: "mempool": { 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:50.907 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:50.908 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:50.909 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:50.910 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:50.910 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:50.910 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:50.910 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:50.911 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:50.911 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:50.911 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:50.911 INFO:teuthology.orchestra.run.smithi047.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_items": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:50.912 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_bytes": 199056, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_anon_items": 293, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_bytes": 0, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_items": 0, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:50.913 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_items": 171, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:50.914 INFO:teuthology.orchestra.run.smithi047.stdout: "pgmap_items": 0, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_bytes": 755460, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_co_items": 7546, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_1_items": 0, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "unittest_2_items": 0 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.915 INFO:teuthology.orchestra.run.smithi047.stdout: "objecter": { 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_active": 0, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_laggy": 0, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send": 2334, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_send_bytes": 21, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_resend": 3, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_reply": 2334, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "op_latency": { 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2334, 2024-04-21T22:44:50.916 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 1.192974478, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000511128 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "op_inflight": 0, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "oplen_avg": { 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 2334, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 2335 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "op": 2334, 2024-04-21T22:44:50.917 INFO:teuthology.orchestra.run.smithi047.stdout: "op_r": 2334, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "op_w": 0, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "op_rmw": 0, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "op_pg": 0, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_stat": 1518, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_create": 0, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_read": 814, 2024-04-21T22:44:50.918 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_write": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writefull": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_writesame": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_append": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_zero": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_truncate": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_delete": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_mapext": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:50.919 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_getxattr": 1, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_setxattr": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_call": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_watch": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_notify": 0, 2024-04-21T22:44:50.920 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "osdop_other": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_active": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_send": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_resend": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "linger_ping": 0, 2024-04-21T22:44:50.921 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_active": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_send": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "poolop_resend": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_active": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_send": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "poolstat_resend": 0, 2024-04-21T22:44:50.922 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_active": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_send": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "statfs_resend": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "command_active": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "command_send": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "command_resend": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "map_epoch": 96, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "map_full": 0, 2024-04-21T22:44:50.923 INFO:teuthology.orchestra.run.smithi047.stdout: "map_inc": 11, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_sessions": 5, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_open": 5, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_session_close": 0, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_laggy": 0, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_wr": 0, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_rd": 2, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_del": 0 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.924 INFO:teuthology.orchestra.run.smithi047.stdout: "oft": { 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_objs": 0, 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_updates": 0, 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "omap_total_removes": 0 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "osd-slow-ops": { 2024-04-21T22:44:50.925 INFO:teuthology.orchestra.run.smithi047.stdout: "slow_ops_count": 0 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "purge_queue": { 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing": 0, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executing_high_water": 0, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed_ops": 0, 2024-04-21T22:44:50.926 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_executed": 0, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 2601, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 3053937, 2024-04-21T22:44:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 2601, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2601, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 3053937, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.928 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 104857600, 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:50.929 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 2334, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 822510, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2334, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 822510, 2024-04-21T22:44:50.930 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 1024, 2024-04-21T22:44:50.931 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 2334, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 2334, 2024-04-21T22:44:50.932 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 2334, 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 2334, 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:50.934 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.935 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "throttle-write_buf_throttle-0x55b7405546e0": { 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "val": 0, 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "max": 3758096384, 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "get_started": 0, 2024-04-21T22:44:50.936 INFO:teuthology.orchestra.run.smithi047.stdout: "get": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "get_sum": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "take": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "take_sum": 0, 2024-04-21T22:44:50.937 INFO:teuthology.orchestra.run.smithi047.stdout: "put": 0, 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: "put_sum": 0, 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: "wait": { 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: "avgcount": 0, 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: "sum": 0.000000000, 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: "avgtime": 0.000000000 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-21T22:44:50.938 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-21T22:44:51.813 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:51 smithi047 ceph-mon[31561]: pgmap v335: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:51.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:51 smithi018 ceph-mon[26614]: pgmap v335: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:51.848 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-04-21T22:44:51.849 DEBUG:tasks.check_counter:Getting stats from c 2024-04-21T22:44:51.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-21T22:44:51.875 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:51 smithi081 ceph-mon[31692]: pgmap v335: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:44:53.830 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:53 smithi081 ceph-mon[31692]: pgmap v336: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:53.831 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-21T22:44:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1957, 2024-04-21T22:44:53.831 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1925, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3805558, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 675434, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.212764678, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.066956025, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.082576419, 2024-04-21T22:44:53.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.058878244, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1925, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.083340839, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000043293 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1851056, 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 139600 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6, 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 174, 2024-04-21T22:44:53.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1976, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 462266, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.010980161, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.007034397, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001941021, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000102326, 2024-04-21T22:44:53.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 171, 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.032613528, 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000190722 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 460928 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 788, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 789, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 194150, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 250273, 2024-04-21T22:44:53.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 4, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.077279997, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.028203535, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.015921997, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.025333524, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 787, 2024-04-21T22:44:53.838 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.027876948, 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000035421 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.840 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4123, 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.126262279, 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000030623 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:53.841 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.842 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-04-21T22:44:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 25, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 25, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 25, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-04-21T22:44:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 3, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:53.846 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-04-21T22:44:53.847 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 3454, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 6, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-04-21T22:44:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-04-21T22:44:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 418, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-04-21T22:44:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 5649016, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 5648904, 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-04-21T22:44:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 418 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 17, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 57, 2024-04-21T22:44:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 40, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 12, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 24, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 12, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 25, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 59, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 34, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-04-21T22:44:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 51316, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215420 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-04-21T22:44:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-04-21T22:44:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-04-21T22:44:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-04-21T22:44:53.866 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:53 smithi018 ceph-mon[26614]: pgmap v336: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-04-21T22:44:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-04-21T22:44:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-04-21T22:44:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 6, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 4, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 5, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-04-21T22:44:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 4391, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 197932, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 68, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:44:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 171, 2024-04-21T22:44:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 96479, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 601, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2476, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 26, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 4, 2024-04-21T22:44:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2476, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2476, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2.131959649, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000861049 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2476, 2024-04-21T22:44:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2477 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2476, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2476, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1583, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-04-21T22:44:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 890, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-04-21T22:44:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 2, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-04-21T22:44:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-04-21T22:44:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 96, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-04-21T22:44:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 6, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 6, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2747, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 3737747, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2747, 2024-04-21T22:44:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2747, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 3737747, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2476, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 1454722, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2476, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1454722, 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2476, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2476, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2476, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2476, 2024-04-21T22:44:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-04-21T22:44:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x561665e8c6e0": { 2024-04-21T22:44:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:53.909 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-21T22:44:53.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:53 smithi047 ceph-mon[31561]: pgmap v336: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:54.585 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:54.586 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-04-21T22:44:54.587 DEBUG:tasks.check_counter:Getting stats from f 2024-04-21T22:44:54.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-21T22:44:54.890 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:44:55.859 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:55 smithi081 ceph-mon[31692]: pgmap v337: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:55.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:55 smithi047 ceph-mon[31561]: pgmap v337: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:56.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:55 smithi018 ceph-mon[26614]: pgmap v337: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:56.502 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 16995, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 17398, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 4357218, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 28371024, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 48, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-04-21T22:44:56.503 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.877195338, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.324786305, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.212375117, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.283266340, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 17396, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.365105396, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000020987 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.504 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1348, 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000217104, 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000161 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 325040 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:56.505 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 44455, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 61921, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 14928536, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 55057849, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 8, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:56.506 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 2.194641101, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.969836457, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 1.725997989, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.406151671, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 61921, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.096983964, 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000017715 2024-04-21T22:44:56.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 31876, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007655059, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000240 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1859008, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 160336 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.508 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 22371, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 23767, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 6193586, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 16947058, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 16, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 1.065454233, 2024-04-21T22:44:56.509 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.375511482, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.329612849, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.313263412, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 23764, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.372114042, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000015658 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:56.510 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 7444, 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001170906, 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000157 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 2656, 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 143216 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-04-21T22:44:56.511 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 37324, 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 20.352807004, 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000545300 2024-04-21T22:44:56.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5966, 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.274381885, 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000213607 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 10790, 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 10786, 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 10786, 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 31.612138215, 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002930849 2024-04-21T22:44:56.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 4, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 250, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 29, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 1, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 9465, 2024-04-21T22:44:56.515 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 734, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 7725, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 1006, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 8413, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 222, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 3323, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 3323, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 8, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 12944, 2024-04-21T22:44:56.516 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 10349, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 3, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 8, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 40, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-04-21T22:44:56.517 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 14, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 206, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 7, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 128, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 49665, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 3454, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 6, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 49665, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 789, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 789, 2024-04-21T22:44:56.519 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 48876, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 1, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 95, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 11932, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 8, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 13654, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 9575, 2024-04-21T22:44:56.520 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 1814, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 4160 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 89, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 9, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 6, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 12, 2024-04-21T22:44:56.521 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 182, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 1, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 3195, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 3191, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 3, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:56.522 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 14, 2024-04-21T22:44:56.523 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 30, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 26259, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-04-21T22:44:56.524 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 26259, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 37, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 37, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 4, 2024-04-21T22:44:56.525 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 70452731, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 471, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 25.433939139, 2024-04-21T22:44:56.526 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.053999870 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 6573, 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 9943, 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 3370, 2024-04-21T22:44:56.527 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 279, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 330, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 51, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 9465, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 11624, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 2159, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 3323, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 6720, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 3397, 2024-04-21T22:44:56.528 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 117488, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 223612 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 12522, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 79, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 10790, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 40, 2024-04-21T22:44:56.529 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 1122, 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6616, 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 22.651612098, 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003423762 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 5, 2024-04-21T22:44:56.530 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.004585216, 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000917043 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.005351844, 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001783948 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 390, 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.396175769, 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.003579937 2024-04-21T22:44:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2024-04-21T22:44:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000114257, 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000114257 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-04-21T22:44:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 66, 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.066445814, 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001006754 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 341, 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.089730556, 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000263139 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-04-21T22:44:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 106, 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.147959501, 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001395844 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 72, 2024-04-21T22:44:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.184167946, 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002557888 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 22, 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.565899222, 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.025722691 2024-04-21T22:44:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8, 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.184085288, 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.023010661 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 8, 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.002747446, 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000343430 2024-04-21T22:44:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 6, 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.007785486, 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001297581 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3142, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 6.305477772, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.002006835 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 4, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 2, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2024-04-21T22:44:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 6570, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 3285, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 615, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 494951, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 4764, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 1408, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 16, 2024-04-21T22:44:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 171, 2024-04-21T22:44:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 23325824, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 225528, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-04-21T22:44:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 53864, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 71380020, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 33, 2024-04-21T22:44:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 53864, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 53864, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 34.627344814, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000642866 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 53864, 2024-04-21T22:44:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 54219 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 53864, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 49712, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 4152, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-04-21T22:44:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 47, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 518, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 40, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 10, 2024-04-21T22:44:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 3245, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 49665, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 8, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-04-21T22:44:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-04-21T22:44:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 96, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-04-21T22:44:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 622, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 34 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-04-21T22:44:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 6, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 6, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 3191, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 3191, 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 83817, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 18325289, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 83817, 2024-04-21T22:44:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 83817, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 18325289, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 53864, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 71712439, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 53864, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 71712439, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 53864, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 53864, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 53864, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 53864, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 3191, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 332419, 2024-04-21T22:44:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 3191, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 47, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 332419, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x560d25348460": { 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 26259, 2024-04-21T22:44:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 66258427, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 26259, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 471, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 66258427, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:56.581 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-21T22:44:57.291 INFO:tasks.check_counter:Daemon mds.f mds.exported=14 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds.imported=7 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=89 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=9 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:57.292 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=29 2024-04-21T22:44:57.292 DEBUG:tasks.check_counter:Getting stats from i 2024-04-21T22:44:57.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-21T22:44:57.529 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:44:57.885 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:57 smithi081 ceph-mon[31692]: pgmap v338: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:57.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:57 smithi047 ceph-mon[31561]: pgmap v338: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:58.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:57 smithi018 ceph-mon[26614]: pgmap v338: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:44:59.219 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 975, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 783, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 437167, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 676196, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 50, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.074814186, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.022546584, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.046340909, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.006816473, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 776, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.033109359, 2024-04-21T22:44:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000042666 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1150, 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000159521, 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000138 2024-04-21T22:44:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3424, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 6864 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2183, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2330, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 705001, 2024-04-21T22:44:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 1410983, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 12, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.161307474, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.068911465, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.099255821, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.010258072, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2332, 2024-04-21T22:44:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.080195780, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000034389 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3147, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000724262, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000230 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-21T22:44:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 463920 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 592, 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 559, 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1951683, 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 824894, 2024-04-21T22:44:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 10, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 7, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.073894730, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.023959973, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.047571635, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.012087231, 2024-04-21T22:44:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 559, 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.043611284, 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000078016 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 17, 2024-04-21T22:44:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000002074, 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000122 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1862272, 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 156880 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-04-21T22:44:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 536, 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.167523991, 2024-04-21T22:44:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000312544 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 88, 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.002665954, 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000030294 2024-04-21T22:44:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 303, 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 167, 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 167, 2024-04-21T22:44:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.137942189, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000826001 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 136, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 11, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-04-21T22:44:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 126, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 9, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 117, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 112, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 7, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 41, 2024-04-21T22:44:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 41, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 5, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 523, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 281, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 136, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 23, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-04-21T22:44:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 1, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 50, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 595, 2024-04-21T22:44:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 3454, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 26625192, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 6, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 595, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:44:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 595, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 118, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 193, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:44:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 279, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 119, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 2, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 84 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-04-21T22:44:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 9, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 78, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 50, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 51, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 9, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 41, 2024-04-21T22:44:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 41, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-04-21T22:44:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-04-21T22:44:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 289, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 289, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-04-21T22:44:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 2, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 2, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-04-21T22:44:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-04-21T22:44:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 4712576, 2024-04-21T22:44:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 0, 2024-04-21T22:44:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-04-21T22:44:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 18, 2024-04-21T22:44:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.035881958, 2024-04-21T22:44:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001993442 2024-04-21T22:44:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 0 2024-04-21T22:44:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-04-21T22:44:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 119, 2024-04-21T22:44:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 164, 2024-04-21T22:44:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 45, 2024-04-21T22:44:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 48, 2024-04-21T22:44:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 54, 2024-04-21T22:44:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 6, 2024-04-21T22:44:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 126, 2024-04-21T22:44:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 176, 2024-04-21T22:44:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 50, 2024-04-21T22:44:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 41, 2024-04-21T22:44:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 82, 2024-04-21T22:44:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 41, 2024-04-21T22:44:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 57952, 2024-04-21T22:44:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 223612 2024-04-21T22:44:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-04-21T22:44:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 379, 2024-04-21T22:44:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-04-21T22:44:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 303, 2024-04-21T22:44:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 24, 2024-04-21T22:44:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 72, 2024-04-21T22:44:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-04-21T22:44:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 31, 2024-04-21T22:44:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.030253714, 2024-04-21T22:44:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000975926 2024-04-21T22:44:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-04-21T22:44:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-04-21T22:44:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-04-21T22:44:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 93, 2024-04-21T22:44:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.029831814, 2024-04-21T22:44:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000320772 2024-04-21T22:44:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-04-21T22:44:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-04-21T22:44:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-04-21T22:44:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-04-21T22:44:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-04-21T22:44:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-04-21T22:44:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2024-04-21T22:44:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000371562, 2024-04-21T22:44:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000371562 2024-04-21T22:44:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-04-21T22:44:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1, 2024-04-21T22:44:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.001911432, 2024-04-21T22:44:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001911432 2024-04-21T22:44:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-04-21T22:44:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-04-21T22:44:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-04-21T22:44:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-04-21T22:44:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-04-21T22:44:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-04-21T22:44:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 41, 2024-04-21T22:44:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.075573667, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001843260 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 4, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 2, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-04-21T22:44:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 108, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 54, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 579, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:44:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:44:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:44:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:44:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:44:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:44:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-04-21T22:44:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:44:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-04-21T22:44:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 312118, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 208, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 880, 2024-04-21T22:44:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 10, 2024-04-21T22:44:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-04-21T22:44:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-04-21T22:44:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:44:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8224, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 171, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:44:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:44:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-04-21T22:44:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-04-21T22:44:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 452044, 2024-04-21T22:44:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 3369, 2024-04-21T22:44:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-04-21T22:44:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 711, 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 548282, 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 30, 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 711, 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 711, 2024-04-21T22:44:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.003980972, 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.001412068 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 711, 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 740 2024-04-21T22:44:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 711, 2024-04-21T22:44:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 596, 2024-04-21T22:44:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 115, 2024-04-21T22:44:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-04-21T22:44:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 0, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 10, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 1, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 19, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 13, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-04-21T22:44:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 53, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-04-21T22:44:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 595, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 20, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:44:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-04-21T22:44:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-04-21T22:44:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 96, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 12, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 12, 2024-04-21T22:44:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 25, 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 0, 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 4 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-04-21T22:44:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 1, 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 6, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 6, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 41, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 41, 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-04-21T22:44:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 3746, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 2746235, 2024-04-21T22:44:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 3746, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 3746, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2746235, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 711, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 552423, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 711, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 552423, 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-04-21T22:44:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 711, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 711, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 711, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 711, 2024-04-21T22:44:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 41, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 4141, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 41, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 1, 2024-04-21T22:44:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 4141, 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x56309b6c6460": { 2024-04-21T22:44:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 289, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 518272, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 289, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:44:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 18, 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 518272, 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:44:59.312 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-21T22:44:59.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:44:59 smithi081 ceph-mon[31692]: pgmap v339: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:59.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:44:59 smithi047 ceph-mon[31561]: pgmap v339: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=9 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=78 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:44:59.947 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:44:59.948 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-04-21T22:44:59.948 DEBUG:tasks.check_counter:Getting stats from l 2024-04-21T22:44:59.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b shell --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-21T22:45:00.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:44:59 smithi018 ceph-mon[26614]: pgmap v339: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-21T22:45:00.185 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/mon.c/config 2024-04-21T22:45:01.828 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:01 smithi081 ceph-mon[31692]: pgmap v340: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:01.828 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-04-21T22:45:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 353, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 330, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 14431584, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 171148, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 6, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.064789593, 2024-04-21T22:45:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.017330196, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.049056420, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.007785516, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 329, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.017450426, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000053040 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1820608, 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 144112 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 271, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 445, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 29427901, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 627021, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 9, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 6, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.046468505, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.012757400, 2024-04-21T22:45:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.020375902, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.009459733, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 442, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.035134803, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000079490 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 541792 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2162, 2024-04-21T22:45:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2162, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 24944707, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 686750, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 6, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.218381508, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.063069194, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.067811601, 2024-04-21T22:45:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.068801122, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2161, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.082626176, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000038235 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 4150, 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.116918976, 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000028173 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-04-21T22:45:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-04-21T22:45:01.840 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 10989, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 67, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 10922, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-04-21T22:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 10893, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 6, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-04-21T22:45:01.842 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-04-21T22:45:01.843 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-04-21T22:45:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-04-21T22:45:01.845 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-04-21T22:45:01.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-04-21T22:45:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-04-21T22:45:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-04-21T22:45:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 26259, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-04-21T22:45:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 37, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 4, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-04-21T22:45:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 70452731, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 70452157, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 26259 2024-04-21T22:45:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 6560, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 9941, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 3381, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 268, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 327, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 59, 2024-04-21T22:45:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 10989, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 11230, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 241, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 83644, 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215420 2024-04-21T22:45:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-04-21T22:45:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-04-21T22:45:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-04-21T22:45:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-04-21T22:45:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 4, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 2, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 3, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-04-21T22:45:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2903, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-04-21T22:45:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-04-21T22:45:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-04-21T22:45:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-04-21T22:45:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 467499, 2024-04-21T22:45:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 6672, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-04-21T22:45:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 8224, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 171, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 23028748, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 200650, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-04-21T22:45:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2511, 2024-04-21T22:45:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2511, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2511, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.978962531, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000788117 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-04-21T22:45:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2511, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2512 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2511, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2511, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-04-21T22:45:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1619, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 890, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-04-21T22:45:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-04-21T22:45:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-04-21T22:45:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-04-21T22:45:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 96, 2024-04-21T22:45:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 9, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 9, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-04-21T22:45:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-04-21T22:45:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-04-21T22:45:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2782, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 68537017, 2024-04-21T22:45:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2782, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2782, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 68537017, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:45:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2511, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 66274828, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2511, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 66274828, 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:45:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2511, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2511, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2511, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2511, 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:45:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:45:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-04-21T22:45:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x563538c106e0": { 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-04-21T22:45:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-04-21T22:45:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-04-21T22:45:01.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-04-21T22:45:01.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:01 smithi047 ceph-mon[31561]: pgmap v340: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:02.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:01 smithi018 ceph-mon[26614]: pgmap v340: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:02.618 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-21T22:45:02.619 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-04-21T22:45:02.620 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-21T22:45:02.630 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-21T22:45:02.631 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:45:02.631 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T22:45:02.693 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-21T22:45:02.693 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T22:45:02.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:45:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 -- 172.21.15.18:0/1567497754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519810bd80 msgr2=0x7f519810e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 --2- 172.21.15.18:0/1567497754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519810bd80 0x7f519810e1b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5190009900 tx=0x7f519002bcd0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 -- 172.21.15.18:0/1567497754 shutdown_connections 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 --2- 172.21.15.18:0/1567497754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f519810bd80 0x7f519810e1b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 --2- 172.21.15.18:0/1567497754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51981032d0 0x7f519810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 --2- 172.21.15.18:0/1567497754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f5198102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 -- 172.21.15.18:0/1567497754 >> 172.21.15.18:0/1567497754 conn(0x7f5198077760 msgr2=0x7f5198077b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 -- 172.21.15.18:0/1567497754 shutdown_connections 2024-04-21T22:45:02.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.975+0000 7f519e800640 1 -- 172.21.15.18:0/1567497754 wait complete. 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.976+0000 7f519e800640 1 Processor -- start 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 -- start start 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f519819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 0x7f519819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f519810bd80 0x7f519819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5198111b60 con 0x7f51981032d0 2024-04-21T22:45:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51981119e0 con 0x7f519810bd80 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f519e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5198111ce0 con 0x7f51981029b0 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f5197400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f519819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f5196a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 0x7f519819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f5196a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 0x7f519819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34638/0 (socket says 172.21.15.18:34638) 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.977+0000 7f5196a00640 1 -- 172.21.15.18:0/251429758 learned_addr learned my addr 172.21.15.18:0/251429758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197e00640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f519810bd80 0x7f519819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 -- 172.21.15.18:0/251429758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f519810bd80 msgr2=0x7f519819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f519810bd80 0x7f519819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 -- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 msgr2=0x7f519819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 0x7f519819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 -- 172.21.15.18:0/251429758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519819f210 con 0x7f51981029b0 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f5197400640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f519819a220 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f518800e9f0 tx=0x7f518800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.978+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518800ccc0 con 0x7f51981029b0 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.979+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519819f500 con 0x7f51981029b0 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.979+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5188005020 con 0x7f51981029b0 2024-04-21T22:45:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.979+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51880049e0 con 0x7f51981029b0 2024-04-21T22:45:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.979+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51981a6d90 con 0x7f51981029b0 2024-04-21T22:45:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.980+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5198067d60 con 0x7f51981029b0 2024-04-21T22:45:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.982+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5188005560 con 0x7f51981029b0 2024-04-21T22:45:02.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.983+0000 7f518fe00640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 0x7f51780a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:02.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.983+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f51880cf330 con 0x7f51981029b0 2024-04-21T22:45:02.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.984+0000 7f5196a00640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 0x7f51780a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.984+0000 7f5196a00640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 0x7f51780a5240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f519810b5d0 tx=0x7f5180009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:02.985+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f51880051d0 con 0x7f51981029b0 2024-04-21T22:45:03.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.196+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51981a7120 con 0x7f51981029b0 2024-04-21T22:45:03.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.199+0000 7f518fe00640 1 -- 172.21.15.18:0/251429758 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23049 (secure 0 0 0) 0x7f518809bec0 con 0x7f51981029b0 2024-04-21T22:45:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:45:03.200 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:44:18.772899+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:45:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 msgr2=0x7f51780a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 0x7f51780a5240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f519810b5d0 tx=0x7f5180009500 comp rx=0 tx=0).stop 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 msgr2=0x7f519819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f519819a220 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f518800e9f0 tx=0x7f518800eeb0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 shutdown_connections 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f51780a2d80 0x7f51780a5240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f519810bd80 0x7f519819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51981032d0 0x7f519819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 --2- 172.21.15.18:0/251429758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51981029b0 0x7f519819a220 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.201+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 >> 172.21.15.18:0/251429758 conn(0x7f5198077760 msgr2=0x7f5198107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.202+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 shutdown_connections 2024-04-21T22:45:03.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.202+0000 7f519e800640 1 -- 172.21.15.18:0/251429758 wait complete. 2024-04-21T22:45:03.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T22:26:08.657002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T22:31:27.060476+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T22:31:28.476373+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 95, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T22:45:03.224 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T22:45:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 -- 172.21.15.18:0/4028866238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4104110 msgr2=0x7fd9b4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/4028866238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4104110 0x7fd9b4110620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009900 tx=0x7fd9a402bc30 comp rx=0 tx=0).stop 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 -- 172.21.15.18:0/4028866238 shutdown_connections 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/4028866238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4104110 0x7fd9b4110620 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/4028866238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4103750 0x7fd9b4103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/4028866238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4109760 0x7fd9b4109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 -- 172.21.15.18:0/4028866238 >> 172.21.15.18:0/4028866238 conn(0x7fd9b40ff1e0 msgr2=0x7fd9b4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 -- 172.21.15.18:0/4028866238 shutdown_connections 2024-04-21T22:45:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.435+0000 7fd9b9e00640 1 -- 172.21.15.18:0/4028866238 wait complete. 2024-04-21T22:45:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.436+0000 7fd9b9e00640 1 Processor -- start 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.436+0000 7fd9b9e00640 1 -- start start 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 0x7fd9b419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 0x7fd9b419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4113bc0 con 0x7fd9b4104110 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4113a40 con 0x7fd9b4103750 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4113d40 con 0x7fd9b4109760 2024-04-21T22:45:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 0x7fd9b419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34660/0 (socket says 172.21.15.18:34660) 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b3e00640 1 -- 172.21.15.18:0/1621342143 learned_addr learned my addr 172.21.15.18:0/1621342143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b8a00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 0x7fd9b419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 -- 172.21.15.18:0/1621342143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 msgr2=0x7fd9b419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 0x7fd9b419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 -- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 msgr2=0x7fd9b419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b9400640 1 -- 172.21.15.18:0/1621342143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b419eff0 con 0x7fd9b4109760 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b3e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.437+0000 7fd9b8a00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 0x7fd9b419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b9400640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 0x7fd9b419e8c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4036040 tx=0x7fd9a40043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4041070 con 0x7fd9b4109760 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b419f280 con 0x7fd9b4109760 2024-04-21T22:45:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9a402ccc0 con 0x7fd9b4109760 2024-04-21T22:45:03.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4003c50 con 0x7fd9b4109760 2024-04-21T22:45:03.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.438+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b41a6b70 con 0x7fd9b4109760 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.439+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b404f500 con 0x7fd9b4109760 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.441+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd9a4044070 con 0x7fd9b4109760 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.443+0000 7fd9b1600640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 0x7fd9980a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.443+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7fd9a40f0ff0 con 0x7fd9b4109760 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.443+0000 7fd9b8a00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 0x7fd9980a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.444+0000 7fd9b8a00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 0x7fd9980a51c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009370 tx=0x7fd9ac009260 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:03.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.445+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fd9a40bdcd0 con 0x7fd9b4109760 2024-04-21T22:45:03.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.654+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd9b410bd40 con 0x7fd9b4109760 2024-04-21T22:45:03.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.655+0000 7fd9b1600640 1 -- 172.21.15.18:0/1621342143 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7fd9a40bd5d0 con 0x7fd9b4109760 2024-04-21T22:45:03.656 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-21T22:45:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 msgr2=0x7fd9980a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 0x7fd9980a51c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009370 tx=0x7fd9ac009260 comp rx=0 tx=0).stop 2024-04-21T22:45:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 msgr2=0x7fd9b419e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 0x7fd9b419e8c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4036040 tx=0x7fd9a40043b0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 shutdown_connections 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fd9980a2d00 0x7fd9980a51c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9b4109760 0x7fd9b419e8c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9b4104110 0x7fd9b419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 --2- 172.21.15.18:0/1621342143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9b4103750 0x7fd9b419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 >> 172.21.15.18:0/1621342143 conn(0x7fd9b40ff1e0 msgr2=0x7fd9b40ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 shutdown_connections 2024-04-21T22:45:03.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.658+0000 7fd9b9e00640 1 -- 172.21.15.18:0/1621342143 wait complete. 2024-04-21T22:45:03.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T22:45:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:03 smithi081 ceph-mon[31692]: pgmap v341: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:03.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:03 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/251429758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:03.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 -- 172.21.15.18:0/2423085903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc109770 msgr2=0x7f5bfc109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 --2- 172.21.15.18:0/2423085903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc109770 0x7f5bfc109b50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009cd0 tx=0x7f5bf002c0f0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 -- 172.21.15.18:0/2423085903 shutdown_connections 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 --2- 172.21.15.18:0/2423085903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc104120 0x7f5bfc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 --2- 172.21.15.18:0/2423085903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc103760 0x7f5bfc103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 --2- 172.21.15.18:0/2423085903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc109770 0x7f5bfc109b50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 -- 172.21.15.18:0/2423085903 >> 172.21.15.18:0/2423085903 conn(0x7f5bfc0ff230 msgr2=0x7f5bfc101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 -- 172.21.15.18:0/2423085903 shutdown_connections 2024-04-21T22:45:03.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.891+0000 7f5c02800640 1 -- 172.21.15.18:0/2423085903 wait complete. 2024-04-21T22:45:03.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.892+0000 7f5c02800640 1 Processor -- start 2024-04-21T22:45:03.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 -- start start 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc104120 0x7f5bfc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc109770 0x7f5bfc19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc113b80 con 0x7f5bfc104120 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc113a00 con 0x7f5bfc103760 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c02800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc113d00 con 0x7f5bfc109770 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c01400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c00a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc104120 0x7f5bfc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c01400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:41688/0 (socket says 172.21.15.18:41688) 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c01400640 1 -- 172.21.15.18:0/4099387579 learned_addr learned my addr 172.21.15.18:0/4099387579 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.893+0000 7f5c01e00640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc109770 0x7f5bfc19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 -- 172.21.15.18:0/4099387579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc109770 msgr2=0x7f5bfc19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc109770 0x7f5bfc19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 -- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc104120 msgr2=0x7f5bfc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc104120 0x7f5bfc19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:03.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 -- 172.21.15.18:0/4099387579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc19f0f0 con 0x7f5bfc103760 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5c01400640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0004af0 tx=0x7f5bf0032ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.894+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0041020 con 0x7f5bfc103760 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.895+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc19f380 con 0x7f5bfc103760 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.895+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf0034cd0 con 0x7f5bfc103760 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.895+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0039040 con 0x7f5bfc103760 2024-04-21T22:45:03.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.895+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1a6c70 con 0x7f5bfc103760 2024-04-21T22:45:03.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.896+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc04f500 con 0x7f5bfc103760 2024-04-21T22:45:03.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.898+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5bf0044020 con 0x7f5bfc103760 2024-04-21T22:45:03.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.899+0000 7f5bfa000640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 0x7f5be40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:03.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.900+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f5bf00f1450 con 0x7f5bfc103760 2024-04-21T22:45:03.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.900+0000 7f5c00a00640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 0x7f5be40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:03.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.900+0000 7f5c00a00640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 0x7f5be40a51c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc101930 tx=0x7f5be8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:03.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:03.902+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f5bf004b020 con 0x7f5bfc103760 2024-04-21T22:45:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:03 smithi047 ceph-mon[31561]: pgmap v341: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:03.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:03 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/251429758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:04.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:03 smithi018 ceph-mon[26614]: pgmap v341: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-21T22:45:04.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:03 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/251429758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:04.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.105+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5bfc10bcd0 con 0x7f5bfc103760 2024-04-21T22:45:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.106+0000 7f5bfa000640 1 -- 172.21.15.18:0/4099387579 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) ==== 104+0+11 (secure 0 0 0) 0x7f5bf00be210 con 0x7f5bfc103760 2024-04-21T22:45:04.107 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-21T22:45:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.108+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 msgr2=0x7f5be40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.108+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 0x7f5be40a51c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc101930 tx=0x7f5be8005f90 comp rx=0 tx=0).stop 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.108+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 msgr2=0x7f5bfc19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.108+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0004af0 tx=0x7f5bf0032ea0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.108+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 shutdown_connections 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f5be40a2d00 0x7f5be40a51c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bfc109770 0x7f5bfc19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bfc104120 0x7f5bfc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 --2- 172.21.15.18:0/4099387579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5bfc103760 0x7f5bfc19a100 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 >> 172.21.15.18:0/4099387579 conn(0x7f5bfc0ff230 msgr2=0x7f5bfc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 shutdown_connections 2024-04-21T22:45:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.109+0000 7f5c02800640 1 -- 172.21.15.18:0/4099387579 wait complete. 2024-04-21T22:45:04.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T22:45:04.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 -- 172.21.15.18:0/4196197173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c109760 msgr2=0x7f8f0c109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 --2- 172.21.15.18:0/4196197173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c109760 0x7f8f0c109b40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009930 tx=0x7f8f0002bc30 comp rx=0 tx=0).stop 2024-04-21T22:45:04.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 -- 172.21.15.18:0/4196197173 shutdown_connections 2024-04-21T22:45:04.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 --2- 172.21.15.18:0/4196197173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c104110 0x7f8f0c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 --2- 172.21.15.18:0/4196197173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c103750 0x7f8f0c103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 --2- 172.21.15.18:0/4196197173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c109760 0x7f8f0c109b40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 -- 172.21.15.18:0/4196197173 >> 172.21.15.18:0/4196197173 conn(0x7f8f0c0ff1e0 msgr2=0x7f8f0c101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:04.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 -- 172.21.15.18:0/4196197173 shutdown_connections 2024-04-21T22:45:04.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.342+0000 7f8f12000640 1 -- 172.21.15.18:0/4196197173 wait complete. 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 Processor -- start 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 -- start start 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c103750 0x7f8f0c19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c109760 0x7f8f0c19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c113b80 con 0x7f8f0c103750 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c113a00 con 0x7f8f0c109760 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.343+0000 7f8f12000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c113d00 con 0x7f8f0c104110 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f10c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c103750 0x7f8f0c19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:50776/0 (socket says 172.21.15.18:50776) 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 -- 172.21.15.18:0/4234168867 learned_addr learned my addr 172.21.15.18:0/4234168867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f11600640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c109760 0x7f8f0c19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 -- 172.21.15.18:0/4234168867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c109760 msgr2=0x7f8f0c19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c109760 0x7f8f0c19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 -- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c103750 msgr2=0x7f8f0c19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c103750 0x7f8f0c19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 -- 172.21.15.18:0/4234168867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c19f050 con 0x7f8f0c104110 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.344+0000 7f8f0be00640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800d950 tx=0x7f8ef800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.345+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8017030 con 0x7f8f0c104110 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.345+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c19f340 con 0x7f8f0c104110 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.345+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ef8004020 con 0x7f8f0c104110 2024-04-21T22:45:04.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.345+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80047a0 con 0x7f8f0c104110 2024-04-21T22:45:04.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.345+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c1a6bd0 con 0x7f8f0c104110 2024-04-21T22:45:04.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.346+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c04f500 con 0x7f8f0c104110 2024-04-21T22:45:04.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.349+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f8ef80041d0 con 0x7f8f0c104110 2024-04-21T22:45:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.350+0000 7f8f09600640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 0x7f8ef40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.350+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f8ef80cf410 con 0x7f8f0c104110 2024-04-21T22:45:04.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.351+0000 7f8f10c00640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 0x7f8ef40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.351+0000 7f8f10c00640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 0x7f8ef40a5240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009900 tx=0x7f8f0002df90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:04.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.352+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f8ef809c020 con 0x7f8f0c104110 2024-04-21T22:45:04.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.565+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8f0c02d170 con 0x7f8f0c104110 2024-04-21T22:45:04.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.566+0000 7f8f09600640 1 -- 172.21.15.18:0/4234168867 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) ==== 100+0+11 (secure 0 0 0) 0x7f8ef809b920 con 0x7f8f0c104110 2024-04-21T22:45:04.567 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-21T22:45:04.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 msgr2=0x7f8ef40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 0x7f8ef40a5240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009900 tx=0x7f8f0002df90 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 msgr2=0x7f8f0c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800d950 tx=0x7f8ef800de10 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 shutdown_connections 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f8ef40a2d80 0x7f8ef40a5240 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f0c109760 0x7f8f0c19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f0c104110 0x7f8f0c19a5a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 --2- 172.21.15.18:0/4234168867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f0c103750 0x7f8f0c19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.568+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 >> 172.21.15.18:0/4234168867 conn(0x7f8f0c0ff1e0 msgr2=0x7f8f0c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:04.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.569+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 shutdown_connections 2024-04-21T22:45:04.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.569+0000 7f8f12000640 1 -- 172.21.15.18:0/4234168867 wait complete. 2024-04-21T22:45:04.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-21T22:45:04.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 -- 172.21.15.18:0/2449494089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100e50 msgr2=0x7f511010dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 --2- 172.21.15.18:0/2449494089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100e50 0x7f511010dba0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009900 tx=0x7f50f802bc40 comp rx=0 tx=0).stop 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 -- 172.21.15.18:0/2449494089 shutdown_connections 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 --2- 172.21.15.18:0/2449494089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f51101104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 --2- 172.21.15.18:0/2449494089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100e50 0x7f511010dba0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 --2- 172.21.15.18:0/2449494089 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100530 0x7f5110100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 -- 172.21.15.18:0/2449494089 >> 172.21.15.18:0/2449494089 conn(0x7f51100777f0 msgr2=0x7f5110077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:04.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 -- 172.21.15.18:0/2449494089 shutdown_connections 2024-04-21T22:45:04.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.792+0000 7f5116200640 1 -- 172.21.15.18:0/2449494089 wait complete. 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.793+0000 7f5116200640 1 Processor -- start 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.793+0000 7f5116200640 1 -- start start 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100530 0x7f511019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100e50 0x7f511019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5110113d60 con 0x7f511010e0e0 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5110113be0 con 0x7f5110100e50 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f5116200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5110113ee0 con 0x7f5110100530 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34726/0 (socket says 172.21.15.18:34726) 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 -- 172.21.15.18:0/1766227462 learned_addr learned my addr 172.21.15.18:0/1766227462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510f400640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100530 0x7f511019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510ea00640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100e50 0x7f511019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 -- 172.21.15.18:0/1766227462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100530 msgr2=0x7f511019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100530 0x7f511019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 -- 172.21.15.18:0/1766227462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100e50 msgr2=0x7f511019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100e50 0x7f511019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.794+0000 7f510fe00640 1 -- 172.21.15.18:0/1766227462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511019f2a0 con 0x7f511010e0e0 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f510fe00640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f510800e970 tx=0x7f510800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510800cab0 con 0x7f511010e0e0 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511019f590 con 0x7f511010e0e0 2024-04-21T22:45:04.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5108005500 con 0x7f511010e0e0 2024-04-21T22:45:04.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108010430 con 0x7f511010e0e0 2024-04-21T22:45:04.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.795+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51101a6e20 con 0x7f511010e0e0 2024-04-21T22:45:04.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.797+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5110068a40 con 0x7f511010e0e0 2024-04-21T22:45:04.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.798+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f5108005020 con 0x7f511010e0e0 2024-04-21T22:45:04.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.800+0000 7f5107e00640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 0x7f50f40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:04.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.800+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f51080cf920 con 0x7f511010e0e0 2024-04-21T22:45:04.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.800+0000 7f510f400640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 0x7f50f40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:04.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.801+0000 7f510f400640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 0x7f50f40a51c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5100005fd0 tx=0x7f5100009500 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:04.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:04.805+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f510809c4b0 con 0x7f511010e0e0 2024-04-21T22:45:04.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1621342143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4099387579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:04 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/4234168867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:04 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1621342143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:04 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4099387579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:04 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/4234168867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:04 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1621342143' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:04 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4099387579' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-21T22:45:04.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:04 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/4234168867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-21T22:45:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.028+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f511002d170 con 0x7f511010e0e0 2024-04-21T22:45:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.029+0000 7f5107e00640 1 -- 172.21.15.18:0/1766227462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v96) ==== 81+0+945 (secure 0 0 0) 0x7f510809bdb0 con 0x7f511010e0e0 2024-04-21T22:45:05.030 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3549237195 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.030 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3148841055 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1645784357 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3597214442 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/1190552149 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1190708936 2024-04-22T22:23:15.934588+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1049747041 2024-04-22T22:23:15.934588+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/3876986128 2024-04-22T22:23:15.934588+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/1190552149 2024-04-22T22:34:02.010145+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3234192848 2024-04-22T22:22:40.017835+0000 2024-04-21T22:45:05.031 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/1652127099 2024-04-22T22:22:40.017835+0000 2024-04-21T22:45:05.032 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/810668682 2024-04-22T22:23:15.934588+0000 2024-04-21T22:45:05.032 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:0/3055541210 2024-04-22T22:22:40.017835+0000 2024-04-21T22:45:05.032 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/4119930103 2024-04-22T22:22:40.017835+0000 2024-04-21T22:45:05.032 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6801/4119930103 2024-04-22T22:22:40.017835+0000 2024-04-21T22:45:05.032 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6800/3876986128 2024-04-22T22:23:15.934588+0000 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:listed 16 entries 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.031+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 msgr2=0x7f50f40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.031+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 0x7f50f40a51c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5100005fd0 tx=0x7f5100009500 comp rx=0 tx=0).stop 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 msgr2=0x7f511019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f510800e970 tx=0x7f510800ee30 comp rx=0 tx=0).stop 2024-04-21T22:45:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 shutdown_connections 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f50f40a2d00 0x7f50f40a51c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f511010e0e0 0x7f511019eb70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5110100e50 0x7f511019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 --2- 172.21.15.18:0/1766227462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5110100530 0x7f511019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 >> 172.21.15.18:0/1766227462 conn(0x7f51100777f0 msgr2=0x7f511010f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 shutdown_connections 2024-04-21T22:45:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.032+0000 7f5116200640 1 -- 172.21.15.18:0/1766227462 wait complete. 2024-04-21T22:45:05.052 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-21T22:45:05.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:45:05.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-21T22:45:05.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:45:05.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:45:05.321 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-21T22:45:05.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:45:05.395 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-21T22:45:05.436 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-21T22:45:05.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:45:05.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T22:45:05.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T22:45:05.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-21T22:45:05.642 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-21T22:45:05.653 INFO:tasks.cephadm:Teardown begin 2024-04-21T22:45:05.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-21T22:45:05.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:45:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.828+0000 7ff20e800640 1 -- 172.21.15.18:0/2623817209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff208107ef0 msgr2=0x7ff2081082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.828+0000 7ff20e800640 1 --2- 172.21.15.18:0/2623817209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff208107ef0 0x7ff2081082d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009900 tx=0x7ff1fc02bc40 comp rx=0 tx=0).stop 2024-04-21T22:45:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.828+0000 7ff20e800640 1 -- 172.21.15.18:0/2623817209 shutdown_connections 2024-04-21T22:45:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.828+0000 7ff20e800640 1 --2- 172.21.15.18:0/2623817209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff208114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.828+0000 7ff20e800640 1 --2- 172.21.15.18:0/2623817209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2081088a0 0x7ff20810c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.829+0000 7ff20e800640 1 --2- 172.21.15.18:0/2623817209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff208107ef0 0x7ff2081082d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.829+0000 7ff20e800640 1 -- 172.21.15.18:0/2623817209 >> 172.21.15.18:0/2623817209 conn(0x7ff208077510 msgr2=0x7ff208106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.829+0000 7ff20e800640 1 -- 172.21.15.18:0/2623817209 shutdown_connections 2024-04-21T22:45:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.829+0000 7ff20e800640 1 -- 172.21.15.18:0/2623817209 wait complete. 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.830+0000 7ff20e800640 1 Processor -- start 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.830+0000 7ff20e800640 1 -- start start 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff208107ef0 0x7ff20819e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2081a2da0 0x7ff2081a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff208118070 con 0x7ff20810cf70 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff208117ef0 con 0x7ff208107ef0 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2081181f0 con 0x7ff2081a2da0 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40846/0 (socket says 172.21.15.18:40846) 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 -- 172.21.15.18:0/2787606829 learned_addr learned my addr 172.21.15.18:0/2787606829 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20d400640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff208107ef0 0x7ff20819e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20de00640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2081a2da0 0x7ff2081a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 -- 172.21.15.18:0/2787606829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2081a2da0 msgr2=0x7ff2081a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2081a2da0 0x7ff2081a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 -- 172.21.15.18:0/2787606829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff208107ef0 msgr2=0x7ff20819e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff208107ef0 0x7ff20819e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.831+0000 7ff20ca00640 1 -- 172.21.15.18:0/2787606829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2081a3890 con 0x7ff20810cf70 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff20ca00640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400e970 tx=0x7ff1f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400ccc0 con 0x7ff20810cf70 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f40035f0 con 0x7ff20810cf70 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2081a3b80 con 0x7ff20810cf70 2024-04-21T22:45:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400ce60 con 0x7ff20810cf70 2024-04-21T22:45:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.832+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2081ab370 con 0x7ff20810cf70 2024-04-21T22:45:05.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.833+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20804f570 con 0x7ff20810cf70 2024-04-21T22:45:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.836+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff1f40037a0 con 0x7ff20810cf70 2024-04-21T22:45:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.837+0000 7ff206000640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 0x7ff1f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.838+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7ff1f40cf730 con 0x7ff20810cf70 2024-04-21T22:45:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.838+0000 7ff20d400640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 0x7ff1f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.839+0000 7ff20d400640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 0x7ff1f00a51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02efd0 tx=0x7ff1fc02cf90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:05.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:05.842+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7ff1f409c2c0 con 0x7ff20810cf70 2024-04-21T22:45:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:05 smithi081 ceph-mon[31692]: pgmap v342: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:45:05.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:05 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1766227462' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-21T22:45:05.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:05 smithi047 ceph-mon[31561]: pgmap v342: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:45:05.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:05 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1766227462' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-21T22:45:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.082+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2081088a0 con 0x7ff20810cf70 2024-04-21T22:45:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.083+0000 7ff206000640 1 -- 172.21.15.18:0/2787606829 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7ff1f409bbc0 con 0x7ff20810cf70 2024-04-21T22:45:06.084 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:45:06.085 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:45:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:45:06.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 msgr2=0x7ff1f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 0x7ff1f00a51b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02efd0 tx=0x7ff1fc02cf90 comp rx=0 tx=0).stop 2024-04-21T22:45:06.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 msgr2=0x7ff20819ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400e970 tx=0x7ff1f400ed70 comp rx=0 tx=0).stop 2024-04-21T22:45:06.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 shutdown_connections 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7ff1f00a2cf0 0x7ff1f00a51b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2081a2da0 0x7ff2081a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff20810cf70 0x7ff20819ea70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 --2- 172.21.15.18:0/2787606829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff208107ef0 0x7ff20819e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 >> 172.21.15.18:0/2787606829 conn(0x7ff208077510 msgr2=0x7ff2080790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 shutdown_connections 2024-04-21T22:45:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.086+0000 7ff20e800640 1 -- 172.21.15.18:0/2787606829 wait complete. 2024-04-21T22:45:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:05 smithi018 ceph-mon[26614]: pgmap v342: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-21T22:45:06.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:05 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1766227462' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-21T22:45:06.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 -- 172.21.15.18:0/3896254394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2058102850 msgr2=0x7f2058102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 --2- 172.21.15.18:0/3896254394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2058102850 0x7f2058102c30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f204c009ca0 tx=0x7f204c02c100 comp rx=0 tx=0).stop 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 -- 172.21.15.18:0/3896254394 shutdown_connections 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 --2- 172.21.15.18:0/3896254394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f205810bc20 0x7f205810e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 --2- 172.21.15.18:0/3896254394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205810b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 --2- 172.21.15.18:0/3896254394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2058102850 0x7f2058102c30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 -- 172.21.15.18:0/3896254394 >> 172.21.15.18:0/3896254394 conn(0x7f20580fbff0 msgr2=0x7f20580fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:06.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.302+0000 7f205ea00640 1 -- 172.21.15.18:0/3896254394 shutdown_connections 2024-04-21T22:45:06.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.303+0000 7f205ea00640 1 -- 172.21.15.18:0/3896254394 wait complete. 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.303+0000 7f205ea00640 1 Processor -- start 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 -- start start 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205810bc20 0x7f205819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20581119d0 con 0x7f2058102850 2024-04-21T22:45:06.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2058111850 con 0x7f2058103170 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205ea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2058111b50 con 0x7f205810bc20 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40866/0 (socket says 172.21.15.18:40866) 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205d600640 1 -- 172.21.15.18:0/3671687330 learned_addr learned my addr 172.21.15.18:0/3671687330 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.304+0000 7f205e000640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205810bc20 0x7f205819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 -- 172.21.15.18:0/3671687330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205810bc20 msgr2=0x7f205819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205810bc20 0x7f205819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 -- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 msgr2=0x7f205819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 -- 172.21.15.18:0/3671687330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205819f150 con 0x7f2058103170 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205d600640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f205cc00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205819a6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f204400e9c0 tx=0x7f204400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.305+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400ccc0 con 0x7f2058103170 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.306+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205819f440 con 0x7f2058103170 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.306+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2044005020 con 0x7f2058103170 2024-04-21T22:45:06.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.306+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044004a00 con 0x7f2058103170 2024-04-21T22:45:06.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.306+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20581a6cd0 con 0x7f2058103170 2024-04-21T22:45:06.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.307+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205804f570 con 0x7f2058103170 2024-04-21T22:45:06.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.310+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f20440051d0 con 0x7f2058103170 2024-04-21T22:45:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.311+0000 7f2056000640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 0x7f20400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.311+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f20440cf430 con 0x7f2058103170 2024-04-21T22:45:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.312+0000 7f205d600640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 0x7f20400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.312+0000 7f205d600640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 0x7f20400a51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f204c009a60 tx=0x7f204c005d80 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:06.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.313+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f204409bfc0 con 0x7f2058103170 2024-04-21T22:45:06.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.555+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f205819b4b0 con 0x7f2058103170 2024-04-21T22:45:06.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.556+0000 7f2056000640 1 -- 172.21.15.18:0/3671687330 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11914 (secure 0 0 0) 0x7f205819b4b0 con 0x7f2058103170 2024-04-21T22:45:06.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:45:06.558 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14409,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/260606364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":260606364},{"type":"v1","addr":"172.21.15.18:6837","nonce":260606364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14457,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/1438768551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":1438768551},{"type":"v1","addr":"172.21.15.18:6839","nonce":1438768551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-21T22:31:28.985001+0000","modified":"2024-04-21T22:38:43.104169+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24596,"mds_1":24568,"mds_2":24538,"mds_3":24509,"mds_4":24496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14475":{"gid":14475,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6841/2953480850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6840","nonce":2953480850},{"type":"v1","addr":"172.21.15.18:6841","nonce":2953480850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6833/3754896489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":3754896489},{"type":"v1","addr":"172.21.15.47:6833","nonce":3754896489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6833/2486302783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2486302783},{"type":"v1","addr":"172.21.15.81:6833","nonce":2486302783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"j","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.18:6835/1168118848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1168118848},{"type":"v1","addr":"172.21.15.18:6835","nonce":1168118848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.47:6835/877045007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":877045007},{"type":"v1","addr":"172.21.15.47:6835","nonce":877045007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/1298670178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1298670178},{"type":"v1","addr":"172.21.15.81:6835","nonce":1298670178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.47:6837/639724797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":639724797},{"type":"v1","addr":"172.21.15.47:6837","nonce":639724797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6837/2293229120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2293229120},{"type":"v1","addr":"172.21.15.81:6837","nonce":2293229120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.81:6839/3777779454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3777779454},{"type":"v1","addr":"172.21.15.81:6839","nonce":3777779454}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6839/3521127091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6838","nonce":3521127091},{"type":"v1","addr":"172.21.15.47:6839","nonce":3521127091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24596,"qdb_cluster":[24538,24496,24509,24596,24568]},"id":1}]} 2024-04-21T22:45:06.558 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 msgr2=0x7f20400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 0x7f20400a51b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f204c009a60 tx=0x7f204c005d80 comp rx=0 tx=0).stop 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 msgr2=0x7f205819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205819a6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f204400e9c0 tx=0x7f204400ee80 comp rx=0 tx=0).stop 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 shutdown_connections 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f20400a2cf0 0x7f20400a51b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f205810bc20 0x7f205819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2058103170 0x7f205819a6f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 --2- 172.21.15.18:0/3671687330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2058102850 0x7f205819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 >> 172.21.15.18:0/3671687330 conn(0x7f20580fbff0 msgr2=0x7f20581014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:06.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 shutdown_connections 2024-04-21T22:45:06.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.559+0000 7f205ea00640 1 -- 172.21.15.18:0/3671687330 wait complete. 2024-04-21T22:45:06.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T22:45:06.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 -- 172.21.15.18:0/926725870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81005c0 msgr2=0x7effe81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 --2- 172.21.15.18:0/926725870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81005c0 0x7effe81009a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7effd8009ca0 tx=0x7effd802c1d0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 -- 172.21.15.18:0/926725870 shutdown_connections 2024-04-21T22:45:06.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 --2- 172.21.15.18:0/926725870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81059c0 0x7effe8105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 --2- 172.21.15.18:0/926725870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 0x7effe81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 --2- 172.21.15.18:0/926725870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81005c0 0x7effe81009a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 -- 172.21.15.18:0/926725870 >> 172.21.15.18:0/926725870 conn(0x7effe80fbfd0 msgr2=0x7effe80fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 -- 172.21.15.18:0/926725870 shutdown_connections 2024-04-21T22:45:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.789+0000 7effe7e00640 1 -- 172.21.15.18:0/926725870 wait complete. 2024-04-21T22:45:06.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 Processor -- start 2024-04-21T22:45:06.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 -- start start 2024-04-21T22:45:06.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 0x7effe819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81059c0 0x7effe81a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7effe8118000 con 0x7effe81059c0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7effe8117e80 con 0x7effe8100ee0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.790+0000 7effe7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effe8118180 con 0x7effe81005c0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81059c0 0x7effe81a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46886/0 (socket says 172.21.15.18:46886) 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 0x7effe819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 -- 172.21.15.18:0/2312006319 learned_addr learned my addr 172.21.15.18:0/2312006319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 -- 172.21.15.18:0/2312006319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 msgr2=0x7effe819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 0x7effe819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 -- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81059c0 msgr2=0x7effe81a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81059c0 0x7effe81a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 -- 172.21.15.18:0/2312006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe81a34d0 con 0x7effe81005c0 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.791+0000 7effe6a00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7effd8005e30 tx=0x7effd8035d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.792+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8039040 con 0x7effe81005c0 2024-04-21T22:45:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.792+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd8044070 con 0x7effe81005c0 2024-04-21T22:45:06.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.792+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe81a3760 con 0x7effe81005c0 2024-04-21T22:45:06.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.792+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8032860 con 0x7effe81005c0 2024-04-21T22:45:06.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.792+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe81ab050 con 0x7effe81005c0 2024-04-21T22:45:06.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.793+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe804f570 con 0x7effe81005c0 2024-04-21T22:45:06.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.795+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7effd8032a00 con 0x7effe81005c0 2024-04-21T22:45:06.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.796+0000 7effeca00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 0x7effcc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:06.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.796+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7effd80f1d90 con 0x7effe81005c0 2024-04-21T22:45:06.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.796+0000 7effe6000640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 0x7effcc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:06.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.797+0000 7effe6000640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 0x7effcc0a5230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effe80ff7a0 tx=0x7effd0005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:06.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.798+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7effd80beb50 con 0x7effe81005c0 2024-04-21T22:45:06.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2787606829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:06 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/3671687330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.888 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2787606829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.889 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:06 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/3671687330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2787606829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:06 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/3671687330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-21T22:45:06.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.996+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effe81ab220 con 0x7effe81005c0 2024-04-21T22:45:06.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:06.999+0000 7effeca00640 1 -- 172.21.15.18:0/2312006319 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23049 (secure 0 0 0) 0x7effd80be450 con 0x7effe81005c0 2024-04-21T22:45:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-21T22:45:07.000 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"6ef0a334-002d-11ef-bc93-c7b262605968","created":"2024-04-21T22:22:06.206207+0000","modified":"2024-04-21T22:44:18.772899+0000","last_up_change":"2024-04-21T22:30:25.889375+0000","last_in_change":"2024-04-21T22:30:05.351527+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T22:26:08.657002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T22:31:27.060476+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T22:31:28.476373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9b5963bb-e3f6-4a79-9d69-dc70c4eda5cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6803","nonce":4177425963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6805","nonce":4177425963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6809","nonce":4177425963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":4177425963},{"type":"v1","addr":"172.21.15.18:6807","nonce":4177425963}]},"public_addr":"172.21.15.18:6803/4177425963","cluster_addr":"172.21.15.18:6805/4177425963","heartbeat_back_addr":"172.21.15.18:6809/4177425963","heartbeat_front_addr":"172.21.15.18:6807/4177425963","state":["exists","up"]},{"osd":1,"uuid":"8f6cdaa3-369b-4d5e-9da1-d7ab2cccdf43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6801","nonce":253370991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6803","nonce":253370991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6807","nonce":253370991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":253370991},{"type":"v1","addr":"172.21.15.47:6805","nonce":253370991}]},"public_addr":"172.21.15.47:6801/253370991","cluster_addr":"172.21.15.47:6803/253370991","heartbeat_back_addr":"172.21.15.47:6807/253370991","heartbeat_front_addr":"172.21.15.47:6805/253370991","state":["exists","up"]},{"osd":2,"uuid":"49058d27-4b5c-4142-b287-4036d3c90a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6801","nonce":311690470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6803","nonce":311690470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6807","nonce":311690470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":311690470},{"type":"v1","addr":"172.21.15.81:6805","nonce":311690470}]},"public_addr":"172.21.15.81:6801/311690470","cluster_addr":"172.21.15.81:6803/311690470","heartbeat_back_addr":"172.21.15.81:6807/311690470","heartbeat_front_addr":"172.21.15.81:6805/311690470","state":["exists","up"]},{"osd":3,"uuid":"b1c370c5-aee2-453e-af57-9defb8842429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6811","nonce":334022394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6813","nonce":334022394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6817","nonce":334022394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":334022394},{"type":"v1","addr":"172.21.15.18:6815","nonce":334022394}]},"public_addr":"172.21.15.18:6811/334022394","cluster_addr":"172.21.15.18:6813/334022394","heartbeat_back_addr":"172.21.15.18:6817/334022394","heartbeat_front_addr":"172.21.15.18:6815/334022394","state":["exists","up"]},{"osd":4,"uuid":"feeccde7-a47e-468e-b3d5-9aa13e0ac807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6809","nonce":2276965592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6811","nonce":2276965592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6815","nonce":2276965592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2276965592},{"type":"v1","addr":"172.21.15.47:6813","nonce":2276965592}]},"public_addr":"172.21.15.47:6809/2276965592","cluster_addr":"172.21.15.47:6811/2276965592","heartbeat_back_addr":"172.21.15.47:6815/2276965592","heartbeat_front_addr":"172.21.15.47:6813/2276965592","state":["exists","up"]},{"osd":5,"uuid":"589fe240-12d2-42f3-9a1e-a2aaee0959ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6809","nonce":1072045728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6811","nonce":1072045728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6815","nonce":1072045728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1072045728},{"type":"v1","addr":"172.21.15.81:6813","nonce":1072045728}]},"public_addr":"172.21.15.81:6809/1072045728","cluster_addr":"172.21.15.81:6811/1072045728","heartbeat_back_addr":"172.21.15.81:6815/1072045728","heartbeat_front_addr":"172.21.15.81:6813/1072045728","state":["exists","up"]},{"osd":6,"uuid":"d5e511f2-088a-40f5-b6a1-b95c04890eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6819","nonce":1273593856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6821","nonce":1273593856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6825","nonce":1273593856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1273593856},{"type":"v1","addr":"172.21.15.18:6823","nonce":1273593856}]},"public_addr":"172.21.15.18:6819/1273593856","cluster_addr":"172.21.15.18:6821/1273593856","heartbeat_back_addr":"172.21.15.18:6825/1273593856","heartbeat_front_addr":"172.21.15.18:6823/1273593856","state":["exists","up"]},{"osd":7,"uuid":"2fcb5522-f12d-4b28-8765-a40c88b42ae1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6817","nonce":2420410882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6819","nonce":2420410882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6823","nonce":2420410882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2420410882},{"type":"v1","addr":"172.21.15.47:6821","nonce":2420410882}]},"public_addr":"172.21.15.47:6817/2420410882","cluster_addr":"172.21.15.47:6819/2420410882","heartbeat_back_addr":"172.21.15.47:6823/2420410882","heartbeat_front_addr":"172.21.15.47:6821/2420410882","state":["exists","up"]},{"osd":8,"uuid":"7046706c-9c23-47c7-bda8-4225a7b15865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6817","nonce":338495809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6819","nonce":338495809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6823","nonce":338495809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":338495809},{"type":"v1","addr":"172.21.15.81:6821","nonce":338495809}]},"public_addr":"172.21.15.81:6817/338495809","cluster_addr":"172.21.15.81:6819/338495809","heartbeat_back_addr":"172.21.15.81:6823/338495809","heartbeat_front_addr":"172.21.15.81:6821/338495809","state":["exists","up"]},{"osd":9,"uuid":"5876c45c-6319-41bd-9555-8b327bc0f71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6827","nonce":2641133682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6829","nonce":2641133682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6833","nonce":2641133682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2641133682},{"type":"v1","addr":"172.21.15.18:6831","nonce":2641133682}]},"public_addr":"172.21.15.18:6827/2641133682","cluster_addr":"172.21.15.18:6829/2641133682","heartbeat_back_addr":"172.21.15.18:6833/2641133682","heartbeat_front_addr":"172.21.15.18:6831/2641133682","state":["exists","up"]},{"osd":10,"uuid":"ffe5b328-b599-4eda-9a41-a022b00456df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6825","nonce":3325470664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6827","nonce":3325470664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6831","nonce":3325470664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3325470664},{"type":"v1","addr":"172.21.15.47:6829","nonce":3325470664}]},"public_addr":"172.21.15.47:6825/3325470664","cluster_addr":"172.21.15.47:6827/3325470664","heartbeat_back_addr":"172.21.15.47:6831/3325470664","heartbeat_front_addr":"172.21.15.47:6829/3325470664","state":["exists","up"]},{"osd":11,"uuid":"4039a314-53cb-4831-bb48-ece414ca7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6825","nonce":2968006366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6827","nonce":2968006366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6831","nonce":2968006366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2968006366},{"type":"v1","addr":"172.21.15.81:6829","nonce":2968006366}]},"public_addr":"172.21.15.81:6825/2968006366","cluster_addr":"172.21.15.81:6827/2968006366","heartbeat_back_addr":"172.21.15.81:6831/2968006366","heartbeat_front_addr":"172.21.15.81:6829/2968006366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:13.955022+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:25:39.813204+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:04.270595+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:26:39.097688+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:05.470314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:27:29.653577+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:04.120400+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:30.819229+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:28:55.860234+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:30.973108+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:29:58.126987+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T22:30:23.237927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:0/3549237195":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3148841055":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1645784357":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3597214442":"2024-04-22T22:34:02.010145+0000","172.21.15.18:6801/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/1190708936":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/1049747041":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6801/3876986128":"2024-04-22T22:23:15.934588+0000","172.21.15.18:6800/1190552149":"2024-04-22T22:34:02.010145+0000","172.21.15.18:0/3234192848":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/1652127099":"2024-04-22T22:22:40.017835+0000","172.21.15.18:0/810668682":"2024-04-22T22:23:15.934588+0000","172.21.15.18:0/3055541210":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6801/4119930103":"2024-04-22T22:22:40.017835+0000","172.21.15.18:6800/3876986128":"2024-04-22T22:23:15.934588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 msgr2=0x7effcc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 0x7effcc0a5230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effe80ff7a0 tx=0x7effd0005f90 comp rx=0 tx=0).stop 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 msgr2=0x7effe819e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7effd8005e30 tx=0x7effd8035d70 comp rx=0 tx=0).stop 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 shutdown_connections 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7effcc0a2d70 0x7effcc0a5230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe81059c0 0x7effe81a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7effe8100ee0 0x7effe819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 --2- 172.21.15.18:0/2312006319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe81005c0 0x7effe819e4e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 >> 172.21.15.18:0/2312006319 conn(0x7effe80fbfd0 msgr2=0x7effe8103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 shutdown_connections 2024-04-21T22:45:07.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.002+0000 7effe7e00640 1 -- 172.21.15.18:0/2312006319 wait complete. 2024-04-21T22:45:07.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-21T22:45:07.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 -- 172.21.15.18:0/3705399701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c1029b0 msgr2=0x7f763c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 --2- 172.21.15.18:0/3705399701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c1029b0 0x7f763c102d90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7634009ca0 tx=0x7f763402c180 comp rx=0 tx=0).stop 2024-04-21T22:45:07.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 -- 172.21.15.18:0/3705399701 shutdown_connections 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 --2- 172.21.15.18:0/3705399701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c10bcf0 0x7f763c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 --2- 172.21.15.18:0/3705399701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1032d0 0x7f763c10b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 --2- 172.21.15.18:0/3705399701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c1029b0 0x7f763c102d90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 -- 172.21.15.18:0/3705399701 >> 172.21.15.18:0/3705399701 conn(0x7f763c0777f0 msgr2=0x7f763c077c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 -- 172.21.15.18:0/3705399701 shutdown_connections 2024-04-21T22:45:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.222+0000 7f7643800640 1 -- 172.21.15.18:0/3705399701 wait complete. 2024-04-21T22:45:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 Processor -- start 2024-04-21T22:45:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 -- start start 2024-04-21T22:45:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 0x7f763c100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 0x7f763c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f763c111af0 con 0x7f763c10bcf0 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f763c111970 con 0x7f763c1029b0 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.223+0000 7f7643800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f763c111c70 con 0x7f763c1032d0 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f7641800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 0x7f763c101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46898/0 (socket says 172.21.15.18:46898) 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 -- 172.21.15.18:0/862972439 learned_addr learned my addr 172.21.15.18:0/862972439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f7640e00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 0x7f763c100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 -- 172.21.15.18:0/862972439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 msgr2=0x7f763c100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 0x7f763c100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 -- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 msgr2=0x7f763c101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 0x7f763c101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f763be00640 1 -- 172.21.15.18:0/862972439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c1a6470 con 0x7f763c1032d0 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f7640e00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 0x7f763c100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.224+0000 7f7641800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 0x7f763c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f763be00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f762400ea60 tx=0x7f762400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762400cde0 con 0x7f763c1032d0 2024-04-21T22:45:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76240035f0 con 0x7f763c1032d0 2024-04-21T22:45:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624010670 con 0x7f763c1032d0 2024-04-21T22:45:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c1a6760 con 0x7f763c1032d0 2024-04-21T22:45:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.225+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c1a6cb0 con 0x7f763c1032d0 2024-04-21T22:45:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.226+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763c068a40 con 0x7f763c1032d0 2024-04-21T22:45:07.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.228+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f76240037a0 con 0x7f763c1032d0 2024-04-21T22:45:07.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.230+0000 7f7639600640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 0x7f76200a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.230+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8571+0+0 (secure 0 0 0) 0x7f76240cf7b0 con 0x7f763c1032d0 2024-04-21T22:45:07.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.230+0000 7f7640e00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 0x7f76200a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.231+0000 7f7640e00640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 0x7f76200a51f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f80 tx=0x7f7634005fd0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:07.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.234+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f762409c340 con 0x7f763c1032d0 2024-04-21T22:45:07.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.484+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f763c106e70 con 0x7f763c1032d0 2024-04-21T22:45:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.496+0000 7f7639600640 1 -- 172.21.15.18:0/862972439 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f762409bc40 con 0x7f763c1032d0 2024-04-21T22:45:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-21T22:45:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 msgr2=0x7f76200a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 0x7f76200a51f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f80 tx=0x7f7634005fd0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 msgr2=0x7f763c100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f762400ea60 tx=0x7f762400ef20 comp rx=0 tx=0).stop 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 shutdown_connections 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f76200a2d30 0x7f76200a51f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763c10bcf0 0x7f763c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c1032d0 0x7f763c100b40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 --2- 172.21.15.18:0/862972439 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f763c1029b0 0x7f763c100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.500+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 >> 172.21.15.18:0/862972439 conn(0x7f763c0777f0 msgr2=0x7f763c0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:07.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.501+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 shutdown_connections 2024-04-21T22:45:07.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.501+0000 7f7643800640 1 -- 172.21.15.18:0/862972439 wait complete. 2024-04-21T22:45:07.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-21T22:45:07.638 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a[68673]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.638 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a[68673]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.638 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mds[68677]: -- 172.21.15.18:0/2273389840 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c7eaf4da40 con 0x55c7eaf21000 2024-04-21T22:45:07.638 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a[68673]: starting mds.a at 2024-04-21T22:45:07.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a[26610]: 2024-04-21T22:45:07.487+0000 7fdf9bc00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-21T22:45:07.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: pgmap v343: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:45:07.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/2312006319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:07.639 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/862972439' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.640 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.641 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mds[67318]: -- 172.21.15.18:0/4132976020 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c11df5a40 con 0x556c11dc8c00 2024-04-21T22:45:07.641 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: starting mds.j at 2024-04-21T22:45:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 -- 172.21.15.18:0/1465657985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 msgr2=0x7fb2dc10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 --2- 172.21.15.18:0/1465657985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc10e5e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009ca0 tx=0x7fb2d402c100 comp rx=0 tx=0).stop 2024-04-21T22:45:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 -- 172.21.15.18:0/1465657985 shutdown_connections 2024-04-21T22:45:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 --2- 172.21.15.18:0/1465657985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc10e5e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 --2- 172.21.15.18:0/1465657985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 --2- 172.21.15.18:0/1465657985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 -- 172.21.15.18:0/1465657985 >> 172.21.15.18:0/1465657985 conn(0x7fb2dc0fd200 msgr2=0x7fb2dc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 -- 172.21.15.18:0/1465657985 shutdown_connections 2024-04-21T22:45:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.734+0000 7fb2e2600640 1 -- 172.21.15.18:0/1465657985 wait complete. 2024-04-21T22:45:07.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 Processor -- start 2024-04-21T22:45:07.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 -- start start 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc111af0 con 0x7fb2dc107720 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc111970 con 0x7fb2dc1020d0 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.736+0000 7fb2e2600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc111c70 con 0x7fb2dc101710 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.18:46960/0 (socket says 172.21.15.18:46960) 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 -- 172.21.15.18:0/918253180 learned_addr learned my addr 172.21.15.18:0/918253180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2dbe00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2daa00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 -- 172.21.15.18:0/918253180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 msgr2=0x7fb2dc073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc073f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 -- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 msgr2=0x7fb2dc0744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc0744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 -- 172.21.15.18:0/918253180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc1a6470 con 0x7fb2dc101710 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2dbe00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.737+0000 7fb2db400640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00ea60 tx=0x7fb2cc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.738+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00cde0 con 0x7fb2dc101710 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.738+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2cc0035f0 con 0x7fb2dc101710 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.738+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc010670 con 0x7fb2dc101710 2024-04-21T22:45:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.738+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc1a6760 con 0x7fb2dc101710 2024-04-21T22:45:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.738+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc1a6c60 con 0x7fb2dc101710 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.739+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc0685f0 con 0x7fb2dc101710 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.741+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb2cc0037a0 con 0x7fb2dc101710 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.742+0000 7fb2d3e00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 0x7fb2c00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.742+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8957+0+0 (secure 0 0 0) 0x7fb2cc0cf830 con 0x7fb2dc101710 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.742+0000 7fb2daa00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 0x7fb2c00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.743+0000 7fb2daa00640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 0x7fb2c00a5240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0754d0 tx=0x7fb2c8005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:07.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.746+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7fb2cc09c240 con 0x7fb2dc101710 2024-04-21T22:45:07.846 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.846 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.847 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mds[61912]: -- 172.21.15.47:0/1262179539 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f50137a40 con 0x562f5010b000 2024-04-21T22:45:07.847 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: starting mds.b at 2024-04-21T22:45:07.847 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: pgmap v343: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:45:07.847 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/2312006319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:07.847 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/862972439' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T22:45:07.848 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mon[31561]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-21T22:45:07.849 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.849 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.849 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mds[61283]: -- 172.21.15.47:0/2185305810 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b80d0b5a40 con 0x55b80d088c00 2024-04-21T22:45:07.849 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: starting mds.e at 2024-04-21T22:45:07.849 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mds[61602]: -- 172.21.15.47:0/1599593506 <== mon.2 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcba659a40 con 0x55bcba62c800 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: starting mds.h at 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.850 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-mds[60964]: -- 172.21.15.47:0/2184584651 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eab63ada40 con 0x55eab6381000 2024-04-21T22:45:07.851 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:45:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: starting mds.k at 2024-04-21T22:45:07.888 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.889 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.889 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mds[62381]: -- 172.21.15.81:0/2992058298 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1ee8f7a40 con 0x55a1ee8ca800 2024-04-21T22:45:07.889 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: starting mds.f at 2024-04-21T22:45:07.889 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c[62684]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.889 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c[62684]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.890 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mds[62688]: -- 172.21.15.81:0/1998699351 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56514c6d5a40 con 0x56514c6a8c00 2024-04-21T22:45:07.890 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c[62684]: starting mds.c at 2024-04-21T22:45:07.890 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.890 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.890 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mds[62998]: -- 172.21.15.81:0/4106895120 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb74175a40 con 0x55cb74148800 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: starting mds.i at 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: ignoring --setuser ceph since I am not root 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: ignoring --setgroup ceph since I am not root 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mds[62062]: -- 172.21.15.81:0/514899627 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c01b9a84e0 con 0x55c01b97f000 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mds[62062]: -- 172.21.15.81:0/514899627 <== mon.1 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c01b9aba40 con 0x55c01b97f000 2024-04-21T22:45:07.891 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: starting mds.l at 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: pgmap v343: 97 pgs: 97 active+clean; 93 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/2312006319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/862972439' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-21T22:45:07.892 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-21T22:45:07.893 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: osdmap e97: 12 total, 12 up, 12 in 2024-04-21T22:45:07.893 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:07 smithi081 ceph-mon[31692]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-21T22:45:07.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:07.992+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb2dc109ca0 con 0x7fb2dc101710 2024-04-21T22:45:08.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:07 smithi018 ceph-mon[26614]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-21T22:45:08.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.496+0000 7fb2d3e00640 1 -- 172.21.15.18:0/918253180 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7fb2cc09bb40 con 0x7fb2dc101710 2024-04-21T22:45:08.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 msgr2=0x7fb2c00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:08.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 0x7fb2c00a5240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0754d0 tx=0x7fb2c8005f90 comp rx=0 tx=0).stop 2024-04-21T22:45:08.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 msgr2=0x7fb2dc073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:08.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00ea60 tx=0x7fb2cc00ef20 comp rx=0 tx=0).stop 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 shutdown_connections 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7fb2c00a2d80 0x7fb2c00a5240 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2dc107720 0x7fb2dc0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2dc1020d0 0x7fb2dc073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 --2- 172.21.15.18:0/918253180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2dc101710 0x7fb2dc073a40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.499+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 >> 172.21.15.18:0/918253180 conn(0x7fb2dc0fd200 msgr2=0x7fb2dc0fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:08.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.500+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 shutdown_connections 2024-04-21T22:45:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.502+0000 7fb2e2600640 1 -- 172.21.15.18:0/918253180 wait complete. 2024-04-21T22:45:08.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-21T22:45:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 -- 172.21.15.18:0/1802276221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1010de50 msgr2=0x7feb10110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 --2- 172.21.15.18:0/1802276221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1010de50 0x7feb10110240 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feb08009ca0 tx=0x7feb0802c0f0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 -- 172.21.15.18:0/1802276221 shutdown_connections 2024-04-21T22:45:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 --2- 172.21.15.18:0/1802276221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb1010de50 0x7feb10110240 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 --2- 172.21.15.18:0/1802276221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 0x7feb1010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 --2- 172.21.15.18:0/1802276221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb101002a0 0x7feb10100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 -- 172.21.15.18:0/1802276221 >> 172.21.15.18:0/1802276221 conn(0x7feb100771f0 msgr2=0x7feb100fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 -- 172.21.15.18:0/1802276221 shutdown_connections 2024-04-21T22:45:08.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.714+0000 7feb17000640 1 -- 172.21.15.18:0/1802276221 wait complete. 2024-04-21T22:45:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 Processor -- start 2024-04-21T22:45:08.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 -- start start 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 0x7feb1019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 0x7feb1019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb10113b40 con 0x7feb101002a0 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb101139c0 con 0x7feb10100c50 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb17000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb10113cc0 con 0x7feb1010de50 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb15c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:08.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb15c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40990/0 (socket says 172.21.15.18:40990) 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.715+0000 7feb15c00640 1 -- 172.21.15.18:0/1259377834 learned_addr learned my addr 172.21.15.18:0/1259377834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15200640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 0x7feb1019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb16600640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 0x7feb1019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 -- 172.21.15.18:0/1259377834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 msgr2=0x7feb1019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 0x7feb1019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 -- 172.21.15.18:0/1259377834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 msgr2=0x7feb1019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 0x7feb1019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 -- 172.21.15.18:0/1259377834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1019f010 con 0x7feb101002a0 2024-04-21T22:45:08.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb16600640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 0x7feb1019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb15c00640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e9f0 tx=0x7feb0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0400cd80 con 0x7feb101002a0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.716+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb04005500 con 0x7feb101002a0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.717+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1019f300 con 0x7feb101002a0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.717+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04010690 con 0x7feb101002a0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.717+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb101a6b40 con 0x7feb101002a0 2024-04-21T22:45:08.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.718+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1004f500 con 0x7feb101002a0 2024-04-21T22:45:08.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.720+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7feb040046c0 con 0x7feb101002a0 2024-04-21T22:45:08.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.721+0000 7feb0e000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 0x7feaf80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:08.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.721+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8957+0+0 (secure 0 0 0) 0x7feb040cfd20 con 0x7feb101002a0 2024-04-21T22:45:08.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.721+0000 7feb15200640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 0x7feaf80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:08.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.722+0000 7feb15200640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 0x7feaf80a51c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb10102210 tx=0x7feb00005f90 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:08.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.724+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7feb040536f0 con 0x7feb101002a0 2024-04-21T22:45:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/918253180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-21T22:45:08.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: Cluster is now healthy 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6832/2318364063,v1:172.21.15.81:6834/2318364063] up:boot 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6833/2093698198,v1:172.21.15.81:6835/2093698198] up:boot 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6832/1735158485,v1:172.21.15.47:6834/1735158485] up:boot 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6833/4224653404,v1:172.21.15.47:6835/4224653404] up:boot 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6836/1560377725,v1:172.21.15.47:6837/1560377725] up:boot 2024-04-21T22:45:08.847 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6836/1084230780,v1:172.21.15.81:6837/1084230780] up:boot 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.81:6838/1721921342,v1:172.21.15.81:6839/1721921342] up:boot 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.47:6838/795622965,v1:172.21.15.47:6839/795622965] up:boot 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6834/561135494,v1:172.21.15.18:6835/561135494] up:boot 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: mds.? [v2:172.21.15.18:6840/4011157005,v1:172.21.15.18:6841/4011157005] up:boot 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: fsmap 12 up:standby 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:45:08.848 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:45:08.849 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:08 smithi018 ceph-mon[26614]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:45:08.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:08.928+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb1019b320 con 0x7feb101002a0 2024-04-21T22:45:08.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/918253180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:08.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:08.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: Cluster is now healthy 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6832/2318364063,v1:172.21.15.81:6834/2318364063] up:boot 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6833/2093698198,v1:172.21.15.81:6835/2093698198] up:boot 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6832/1735158485,v1:172.21.15.47:6834/1735158485] up:boot 2024-04-21T22:45:08.946 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6833/4224653404,v1:172.21.15.47:6835/4224653404] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6836/1560377725,v1:172.21.15.47:6837/1560377725] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6836/1084230780,v1:172.21.15.81:6837/1084230780] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.81:6838/1721921342,v1:172.21.15.81:6839/1721921342] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.47:6838/795622965,v1:172.21.15.47:6839/795622965] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6834/561135494,v1:172.21.15.18:6835/561135494] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: mds.? [v2:172.21.15.18:6840/4011157005,v1:172.21.15.18:6841/4011157005] up:boot 2024-04-21T22:45:08.947 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: fsmap 12 up:standby 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:45:08.948 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:08 smithi047 ceph-mon[31561]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:45:09.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/918253180' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: Cluster is now healthy 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-21T22:45:09.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6832/2318364063,v1:172.21.15.81:6834/2318364063] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6833/2093698198,v1:172.21.15.81:6835/2093698198] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6832/1735158485,v1:172.21.15.47:6834/1735158485] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6833/4224653404,v1:172.21.15.47:6835/4224653404] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6836/1560377725,v1:172.21.15.47:6837/1560377725] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6836/1084230780,v1:172.21.15.81:6837/1084230780] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.81:6838/1721921342,v1:172.21.15.81:6839/1721921342] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.47:6838/795622965,v1:172.21.15.47:6839/795622965] up:boot 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-21T22:45:09.140 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6834/561135494,v1:172.21.15.18:6835/561135494] up:boot 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: mds.? [v2:172.21.15.18:6840/4011157005,v1:172.21.15.18:6841/4011157005] up:boot 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: fsmap 12 up:standby 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-21T22:45:09.141 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-21T22:45:09.142 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-21T22:45:09.142 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:08 smithi081 ceph-mon[31692]: from='mgr.25309 172.21.15.18:0/2498294697' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-21T22:45:09.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.657+0000 7feb0e000640 1 -- 172.21.15.18:0/1259377834 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) ==== 181+0+0 (secure 0 0 0) 0x7feb0409c730 con 0x7feb101002a0 2024-04-21T22:45:09.659 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-21T22:45:09.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.663+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 msgr2=0x7feaf80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:09.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.663+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 0x7feaf80a51c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb10102210 tx=0x7feb00005f90 comp rx=0 tx=0).stop 2024-04-21T22:45:09.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.663+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 msgr2=0x7feb1019a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:09.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.663+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feb0400e9f0 tx=0x7feb0400edf0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 shutdown_connections 2024-04-21T22:45:09.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7feaf80a2d00 0x7feaf80a51c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb1010de50 0x7feb1019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb10100c50 0x7feb1019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 --2- 172.21.15.18:0/1259377834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb101002a0 0x7feb1019a020 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.665+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 >> 172.21.15.18:0/1259377834 conn(0x7feb100771f0 msgr2=0x7feb100feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.666+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 shutdown_connections 2024-04-21T22:45:09.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.666+0000 7feb17000640 1 -- 172.21.15.18:0/1259377834 wait complete. 2024-04-21T22:45:09.693 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-21T22:45:09.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.890+0000 7f6d4ea00640 1 -- 172.21.15.18:0/3326801387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 msgr2=0x7f6d48103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.890+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/3326801387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d48103be0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009900 tx=0x7f6d3402bc30 comp rx=0 tx=0).stop 2024-04-21T22:45:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 -- 172.21.15.18:0/3326801387 shutdown_connections 2024-04-21T22:45:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/3326801387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48104120 0x7f6d48110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/3326801387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d48103be0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/3326801387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48109770 0x7f6d48109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 -- 172.21.15.18:0/3326801387 >> 172.21.15.18:0/3326801387 conn(0x7f6d480ff230 msgr2=0x7f6d48101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 -- 172.21.15.18:0/3326801387 shutdown_connections 2024-04-21T22:45:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.891+0000 7f6d4ea00640 1 -- 172.21.15.18:0/3326801387 wait complete. 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.892+0000 7f6d4ea00640 1 Processor -- start 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.892+0000 7f6d4ea00640 1 -- start start 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48104120 0x7f6d4819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48109770 0x7f6d4819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48113b90 con 0x7f6d48104120 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48113a10 con 0x7f6d48103760 2024-04-21T22:45:09.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4ea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d48113d10 con 0x7f6d48109770 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48104120 0x7f6d4819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.18:42614/0 (socket says 172.21.15.18:42614) 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 -- 172.21.15.18:0/1366234381 learned_addr learned my addr 172.21.15.18:0/1366234381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4e000640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48109770 0x7f6d4819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 -- 172.21.15.18:0/1366234381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48109770 msgr2=0x7f6d4819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:09.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48109770 0x7f6d4819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 -- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48104120 msgr2=0x7f6d4819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48104120 0x7f6d4819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.893+0000 7f6d4d600640 1 -- 172.21.15.18:0/1366234381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4819f060 con 0x7f6d48103760 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d4d600640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d950 tx=0x7f6d3c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c017030 con 0x7f6d48103760 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d3c004020 con 0x7f6d48103760 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0047a0 con 0x7f6d48103760 2024-04-21T22:45:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4819f350 con 0x7f6d48103760 2024-04-21T22:45:09.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.894+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481a6be0 con 0x7f6d48103760 2024-04-21T22:45:09.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.895+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4804f500 con 0x7f6d48103760 2024-04-21T22:45:09.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.897+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6d3c0041d0 con 0x7f6d48103760 2024-04-21T22:45:09.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.899+0000 7f6d46000640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 0x7f6d300a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T22:45:09.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.899+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8345+0+0 (secure 0 0 0) 0x7f6d3c0cec20 con 0x7f6d48103760 2024-04-21T22:45:09.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.899+0000 7f6d4cc00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 0x7f6d300a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T22:45:09.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.900+0000 7f6d4cc00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 0x7f6d300a5240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d3402efd0 tx=0x7f6d34000bc0 comp rx=0 tx=0).ready entity=mgr.25309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T22:45:09.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:09.903+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186074 (secure 0 0 0) 0x7f6d3c09b890 con 0x7f6d48103760 2024-04-21T22:45:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:09 smithi047 ceph-mon[31561]: pgmap v345: 97 pgs: 97 active+clean; 93 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-04-21T22:45:09.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:09 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:10.095 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:09 smithi018 ceph-mon[26614]: pgmap v345: 97 pgs: 97 active+clean; 93 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-04-21T22:45:10.096 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:09 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:10.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.118+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d4810bcf0 con 0x7f6d48103760 2024-04-21T22:45:10.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:09 smithi081 ceph-mon[31692]: pgmap v345: 97 pgs: 97 active+clean; 93 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-04-21T22:45:10.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:09 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:10.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.673+0000 7f6d46000640 1 -- 172.21.15.18:0/1366234381 <== mon.2 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) ==== 169+0+0 (secure 0 0 0) 0x7f6d3c09b190 con 0x7f6d48103760 2024-04-21T22:45:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.681+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 msgr2=0x7f6d300a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.681+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 0x7f6d300a5240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d3402efd0 tx=0x7f6d34000bc0 comp rx=0 tx=0).stop 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.681+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 msgr2=0x7f6d4819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.681+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d950 tx=0x7f6d3c00de10 comp rx=0 tx=0).stop 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 shutdown_connections 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:6800/325159611,v1:172.21.15.18:6801/325159611] conn(0x7f6d300a2d80 0x7f6d300a5240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:10.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d48109770 0x7f6d4819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d48104120 0x7f6d4819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 --2- 172.21.15.18:0/1366234381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d48103760 0x7f6d4819a070 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T22:45:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.682+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 >> 172.21.15.18:0/1366234381 conn(0x7f6d480ff230 msgr2=0x7f6d480ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T22:45:10.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.683+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 shutdown_connections 2024-04-21T22:45:10.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-21T22:45:10.683+0000 7f6d4ea00640 1 -- 172.21.15.18:0/1366234381 wait complete. 2024-04-21T22:45:10.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:45:10.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:45:10.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:45:10.850 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-21T22:45:10.850 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-21T22:45:10.907 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-21T22:45:10.933 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-21T22:45:10.944 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:10 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-21T22:45:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:10 smithi047 ceph-mon[31561]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T22:45:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:10 smithi047 ceph-mon[31561]: from='client.? 172.21.15.18:0/1366234381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:10.945 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:10 smithi047 ceph-mon[31561]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:10.949 INFO:tasks.cephadm:Stopping all daemons... 2024-04-21T22:45:10.949 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-21T22:45:10.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a 2024-04-21T22:45:11.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:10 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-21T22:45:11.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:10 smithi018 ceph-mon[26614]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T22:45:11.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:10 smithi018 ceph-mon[26614]: from='client.? 172.21.15.18:0/1366234381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:11.010 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:10 smithi018 ceph-mon[26614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:11.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:10 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1259377834' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-21T22:45:11.138 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:10 smithi081 ceph-mon[31692]: osdmap e98: 12 total, 12 up, 12 in 2024-04-21T22:45:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:10 smithi081 ceph-mon[31692]: from='client.? 172.21.15.18:0/1366234381' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:11.139 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:10 smithi081 ceph-mon[31692]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-21T22:45:11.345 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:11 smithi018 systemd[1]: Stopping Ceph mon.a for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a[26610]: 2024-04-21T22:45:11.531+0000 7fdfa2a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a[26610]: 2024-04-21T22:45:11.531+0000 7fdfa2a00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-21T22:45:11.846 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:11 smithi018 podman[101893]: 2024-04-21 22:45:11.636005459 +0000 UTC m=+0.273965904 container died bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:45:12.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:12 smithi018 podman[101893]: 2024-04-21 22:45:12.098853182 +0000 UTC m=+0.736813587 container cleanup bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:45:12.346 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:12 smithi018 bash[101893]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a 2024-04-21T22:45:12.845 INFO:journalctl@ceph.mon.a.smithi018.stdout:Apr 21 22:45:12 smithi018 podman[101908]: 2024-04-21 22:45:12.366963183 +0000 UTC m=+0.712077797 container remove bee3d151b772d13184837e839e6a560a71aeca4e197996e3266afe02b622e37a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-21T22:45:12.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.a.service' 2024-04-21T22:45:13.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:13.101 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-21T22:45:13.102 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-21T22:45:13.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.b 2024-04-21T22:45:13.426 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 systemd[1]: Stopping Ceph mon.b for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b[31557]: 2024-04-21T22:45:13.425+0000 7f2da017f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b[31557]: 2024-04-21T22:45:13.425+0000 7f2da017f700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-21T22:45:13.695 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 podman[67407]: 2024-04-21 22:45:13.457013203 +0000 UTC m=+0.156925914 container died ae1d53615a0983d00f2d83caabb6e403fe7b9b008a35ba7ab72e0f838afd22ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-21T22:45:14.161 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 podman[67407]: 2024-04-21 22:45:13.834958221 +0000 UTC m=+0.534870923 container cleanup ae1d53615a0983d00f2d83caabb6e403fe7b9b008a35ba7ab72e0f838afd22ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-21T22:45:14.161 INFO:journalctl@ceph.mon.b.smithi047.stdout:Apr 21 22:45:13 smithi047 bash[67407]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-b 2024-04-21T22:45:14.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.b.service' 2024-04-21T22:45:14.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:14.352 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-21T22:45:14.352 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-21T22:45:14.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.c 2024-04-21T22:45:14.638 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:14 smithi081 systemd[1]: Stopping Ceph mon.c for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:15.111 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c[31688]: 2024-04-21T22:45:14.810+0000 7fe115884700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:15.111 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c[31688]: 2024-04-21T22:45:14.810+0000 7fe115884700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-21T22:45:15.111 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:14 smithi081 podman[68585]: 2024-04-21 22:45:14.831278216 +0000 UTC m=+0.281291376 container died b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-21T22:45:15.388 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:15 smithi081 podman[68585]: 2024-04-21 22:45:15.219125296 +0000 UTC m=+0.669138438 container cleanup b77a6ef78c88c20fc3c67f84423adaafc94b5c34137d18a0ce3eabc1c1a783cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:45:15.389 INFO:journalctl@ceph.mon.c.smithi081.stdout:Apr 21 22:45:15 smithi081 bash[68585]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mon-c 2024-04-21T22:45:15.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mon.c.service' 2024-04-21T22:45:15.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:15.718 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-21T22:45:15.718 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-21T22:45:15.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x 2024-04-21T22:45:16.096 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:15 smithi018 systemd[1]: Stopping Ceph mgr.x for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:16.847 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:45:16.451+0000 7f6924400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:16.847 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x[26846]: 2024-04-21T22:45:16.451+0000 7f6924400700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-21T22:45:16.847 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:16 smithi018 podman[102015]: 2024-04-21 22:45:16.555283333 +0000 UTC m=+0.354766246 container died 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-21T22:45:17.272 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:17 smithi018 podman[102015]: 2024-04-21 22:45:17.012080251 +0000 UTC m=+0.811563071 container cleanup 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-21T22:45:17.272 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:17 smithi018 bash[102015]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x 2024-04-21T22:45:17.595 INFO:journalctl@ceph.mgr.x.smithi018.stdout:Apr 21 22:45:17 smithi018 podman[102028]: 2024-04-21 22:45:17.271497919 +0000 UTC m=+0.696487750 container remove 653fbebb8fe7f08f810358b8c33f7382e7ac815eb6bea05f3d42a47673af1799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:820a2f8ced66152ed3d765c31444b8076ea28c6b, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-21T22:45:17.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-21T22:45:17.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:17.946 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-21T22:45:17.946 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-21T22:45:17.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y 2024-04-21T22:45:18.268 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:17 smithi047 systemd[1]: Stopping Ceph mgr.y for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:18.548 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:18 smithi047 podman[67530]: 2024-04-21 22:45:18.268502214 +0000 UTC m=+0.124308220 container died d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:45:18.933 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:18 smithi047 podman[67530]: 2024-04-21 22:45:18.690072757 +0000 UTC m=+0.545878752 container cleanup d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-21T22:45:18.933 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:18 smithi047 bash[67530]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y 2024-04-21T22:45:19.162 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-21T22:45:19.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:18 smithi047 podman[67544]: 2024-04-21 22:45:18.933752487 +0000 UTC m=+0.660712488 container remove d189d8fca7186e68d7df01c80513f5b468153ac7d1c80449aa34f822085915b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-y, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-21T22:45:19.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:18 smithi047 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-04-21T22:45:19.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:19 smithi047 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-04-21T22:45:19.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:19 smithi047 systemd[1]: Stopped Ceph mgr.y for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:45:19.184 INFO:journalctl@ceph.mgr.y.smithi047.stdout:Apr 21 22:45:19 smithi047 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.y.service: Consumed 21.640s CPU time. 2024-04-21T22:45:19.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:19.198 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-21T22:45:19.198 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-21T22:45:19.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.z 2024-04-21T22:45:19.527 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:45:19 smithi081 systemd[1]: Stopping Ceph mgr.z for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:19.849 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:45:19 smithi081 podman[68708]: 2024-04-21 22:45:19.528032294 +0000 UTC m=+0.136070990 container died 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, io.buildah.version=1.33.5) 2024-04-21T22:45:20.139 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:45:19 smithi081 podman[68708]: 2024-04-21 22:45:19.932549455 +0000 UTC m=+0.540588140 container cleanup 4e46bb695ce026690aaa40e11b29b2489866a0299e26f7ef34b8a57a41e52d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8) 2024-04-21T22:45:20.139 INFO:journalctl@ceph.mgr.z.smithi081.stdout:Apr 21 22:45:19 smithi081 bash[68708]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mgr-z 2024-04-21T22:45:20.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-21T22:45:20.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:20.345 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-21T22:45:20.345 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-21T22:45:20.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.0 2024-04-21T22:45:20.845 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:20 smithi018 systemd[1]: Stopping Ceph osd.0 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:21.346 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0[41324]: 2024-04-21T22:45:20.972+0000 7fcf68a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:21.347 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0[41324]: 2024-04-21T22:45:20.972+0000 7fcf68a00700 -1 osd.0 99 *** Got signal Terminated *** 2024-04-21T22:45:21.347 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0[41324]: 2024-04-21T22:45:20.972+0000 7fcf68a00700 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:45:26.622 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:26 smithi018 podman[102134]: 2024-04-21 22:45:26.350430037 +0000 UTC m=+5.513549433 container died dfae22c007e497255ae572f805447d2ff49817479dc237e7d9dc6c8b735a4493 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-21T22:45:26.976 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:26 smithi018 podman[102134]: 2024-04-21 22:45:26.807982536 +0000 UTC m=+5.971101976 container cleanup dfae22c007e497255ae572f805447d2ff49817479dc237e7d9dc6c8b735a4493 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416) 2024-04-21T22:45:26.976 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:26 smithi018 bash[102134]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0 2024-04-21T22:45:27.345 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:26 smithi018 podman[102153]: 2024-04-21 22:45:26.975970417 +0000 UTC m=+0.614185781 container remove dfae22c007e497255ae572f805447d2ff49817479dc237e7d9dc6c8b735a4493 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416) 2024-04-21T22:45:28.096 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:27 smithi018 podman[102243]: 2024-04-21 22:45:27.843269632 +0000 UTC m=+0.130284554 container create 9c5c2e8d32f96a7f431f911c52c8d672e7af9ffec619cb8b855c0083412fa2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-21T22:45:28.096 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:27 smithi018 podman[102243]: 2024-04-21 22:45:27.750880128 +0000 UTC m=+0.037895041 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:45:28.595 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:28 smithi018 podman[102243]: 2024-04-21 22:45:28.205353019 +0000 UTC m=+0.492367976 container init 9c5c2e8d32f96a7f431f911c52c8d672e7af9ffec619cb8b855c0083412fa2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-21T22:45:28.596 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:28 smithi018 podman[102243]: 2024-04-21 22:45:28.217418532 +0000 UTC m=+0.504433499 container start 9c5c2e8d32f96a7f431f911c52c8d672e7af9ffec619cb8b855c0083412fa2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-21T22:45:28.596 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:28 smithi018 podman[102243]: 2024-04-21 22:45:28.352854136 +0000 UTC m=+0.639869120 container attach 9c5c2e8d32f96a7f431f911c52c8d672e7af9ffec619cb8b855c0083412fa2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:45:29.029 INFO:journalctl@ceph.osd.0.smithi018.stdout:Apr 21 22:45:28 smithi018 podman[102243]: 2024-04-21 22:45:28.68911953 +0000 UTC m=+0.976134443 container died 9c5c2e8d32f96a7f431f911c52c8d672e7af9ffec619cb8b855c0083412fa2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-21T22:45:29.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.0.service' 2024-04-21T22:45:29.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:29.626 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-21T22:45:29.626 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-21T22:45:29.626 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.1 2024-04-21T22:45:29.936 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:29 smithi047 systemd[1]: Stopping Ceph osd.1 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:30.195 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1[36169]: 2024-04-21T22:45:29.936+0000 7f20fb5c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:30.195 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1[36169]: 2024-04-21T22:45:29.936+0000 7f20fb5c7700 -1 osd.1 99 *** Got signal Terminated *** 2024-04-21T22:45:30.195 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1[36169]: 2024-04-21T22:45:29.936+0000 7f20fb5c7700 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:45:35.695 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:35 smithi047 podman[67655]: 2024-04-21 22:45:35.334270907 +0000 UTC m=+5.512112383 container died 0a20fe85827c346dc99d861f5d87e8915666b8f5caffc086d5a0e2f63f609529 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-21T22:45:36.062 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:35 smithi047 podman[67655]: 2024-04-21 22:45:35.853544565 +0000 UTC m=+6.031386028 container cleanup 0a20fe85827c346dc99d861f5d87e8915666b8f5caffc086d5a0e2f63f609529 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-21T22:45:36.063 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:35 smithi047 bash[67655]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1 2024-04-21T22:45:36.445 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67673]: 2024-04-21 22:45:36.06318653 +0000 UTC m=+0.725247108 container remove 0a20fe85827c346dc99d861f5d87e8915666b8f5caffc086d5a0e2f63f609529 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-21T22:45:36.768 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67762]: 2024-04-21 22:45:36.38223361 +0000 UTC m=+0.018208943 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:45:36.768 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67762]: 2024-04-21 22:45:36.506070222 +0000 UTC m=+0.142045595 container create ccb756695405e8cce509d70efce103933dce50b0f4d7622e796142c6c047fc0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-04-21T22:45:36.768 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67762]: 2024-04-21 22:45:36.7691406 +0000 UTC m=+0.405115915 container init ccb756695405e8cce509d70efce103933dce50b0f4d7622e796142c6c047fc0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:45:37.078 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67762]: 2024-04-21 22:45:36.772503462 +0000 UTC m=+0.408478778 container start ccb756695405e8cce509d70efce103933dce50b0f4d7622e796142c6c047fc0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-21T22:45:37.079 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:36 smithi047 podman[67762]: 2024-04-21 22:45:36.835767452 +0000 UTC m=+0.471742773 container attach ccb756695405e8cce509d70efce103933dce50b0f4d7622e796142c6c047fc0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-21T22:45:37.352 INFO:journalctl@ceph.osd.1.smithi047.stdout:Apr 21 22:45:37 smithi047 podman[67762]: 2024-04-21 22:45:37.079416727 +0000 UTC m=+0.715392057 container died ccb756695405e8cce509d70efce103933dce50b0f4d7622e796142c6c047fc0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-820a2f8) 2024-04-21T22:45:37.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.1.service' 2024-04-21T22:45:37.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:37.865 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-21T22:45:37.865 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-21T22:45:37.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.2 2024-04-21T22:45:38.178 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:37 smithi081 systemd[1]: Stopping Ceph osd.2 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:38.638 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2[37006]: 2024-04-21T22:45:38.178+0000 7f4b1a07f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:38.639 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2[37006]: 2024-04-21T22:45:38.178+0000 7f4b1a07f700 -1 osd.2 99 *** Got signal Terminated *** 2024-04-21T22:45:38.639 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2[37006]: 2024-04-21T22:45:38.178+0000 7f4b1a07f700 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:45:44.021 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:43 smithi081 podman[68839]: 2024-04-21 22:45:43.723391118 +0000 UTC m=+5.666695234 container died 601429b9f40a1fb81c64343010fe43fb35722000d6880928cac1b268d36ce23e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:45:44.337 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68839]: 2024-04-21 22:45:44.153831796 +0000 UTC m=+6.097135953 container cleanup 601429b9f40a1fb81c64343010fe43fb35722000d6880928cac1b268d36ce23e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-21T22:45:44.338 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 bash[68839]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2 2024-04-21T22:45:44.638 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68868]: 2024-04-21 22:45:44.338303838 +0000 UTC m=+0.616895951 container remove 601429b9f40a1fb81c64343010fe43fb35722000d6880928cac1b268d36ce23e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-21T22:45:45.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68958]: 2024-04-21 22:45:44.764161819 +0000 UTC m=+0.113033851 container create cd66288f7d98820959d26d02ca22a1dd69c42b557aa0f67db022b9cce7925699 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-21T22:45:45.074 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68958]: 2024-04-21 22:45:44.668752099 +0000 UTC m=+0.017624145 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:45:45.075 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68958]: 2024-04-21 22:45:44.991517781 +0000 UTC m=+0.340389812 container init cd66288f7d98820959d26d02ca22a1dd69c42b557aa0f67db022b9cce7925699 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-21T22:45:45.075 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:44 smithi081 podman[68958]: 2024-04-21 22:45:44.994528243 +0000 UTC m=+0.343400277 container start cd66288f7d98820959d26d02ca22a1dd69c42b557aa0f67db022b9cce7925699 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-21T22:45:45.075 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:45 smithi081 podman[68958]: 2024-04-21 22:45:45.074672689 +0000 UTC m=+0.423544730 container attach cd66288f7d98820959d26d02ca22a1dd69c42b557aa0f67db022b9cce7925699 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-21T22:45:45.388 INFO:journalctl@ceph.osd.2.smithi081.stdout:Apr 21 22:45:45 smithi081 podman[68958]: 2024-04-21 22:45:45.295181608 +0000 UTC m=+0.644053655 container died cd66288f7d98820959d26d02ca22a1dd69c42b557aa0f67db022b9cce7925699 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-21T22:45:46.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.2.service' 2024-04-21T22:45:46.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:46.109 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-21T22:45:46.109 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-21T22:45:46.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.3 2024-04-21T22:45:46.595 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:46 smithi018 systemd[1]: Stopping Ceph osd.3 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:47.096 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:46.707+0000 7fbf38200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:47.097 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:46.707+0000 7fbf38200700 -1 osd.3 99 *** Got signal Terminated *** 2024-04-21T22:45:47.097 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:46 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:46.707+0000 7fbf38200700 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:45:47.138 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:46.653+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:47.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:47.606+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:47.889 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:47.779+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:48.845 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:48 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:48.387+0000 7fbf34400700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.193305+0000 front 2024-04-21T22:45:25.193593+0000 (oldest deadline 2024-04-21T22:45:47.492888+0000) 2024-04-21T22:45:48.888 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:48.737+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:48.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:48.603+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:49.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:48.729+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:49.845 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:49 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:49.432+0000 7fbf34400700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.193305+0000 front 2024-04-21T22:45:25.193593+0000 (oldest deadline 2024-04-21T22:45:47.492888+0000) 2024-04-21T22:45:50.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:49.786+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:50.139 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:49.647+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:50.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:49.724+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:50.595 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:50 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:50.466+0000 7fbf34400700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.193305+0000 front 2024-04-21T22:45:25.193593+0000 (oldest deadline 2024-04-21T22:45:47.492888+0000) 2024-04-21T22:45:50.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:50 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:50.324+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:51.139 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:50.756+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:51.140 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:50.654+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:51.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:50.737+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:51.449 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:51 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:51.355+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:51.450 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:51 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:51.124+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:51.841 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:51 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3[48309]: 2024-04-21T22:45:51.449+0000 7fbf34400700 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.193305+0000 front 2024-04-21T22:45:25.193593+0000 (oldest deadline 2024-04-21T22:45:47.492888+0000) 2024-04-21T22:45:51.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:51.611+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:51.889 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:51.751+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:52.194 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:51.718+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:52.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:52.359+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:52.596 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:52 smithi018 podman[102347]: 2024-04-21 22:45:52.288607312 +0000 UTC m=+5.730196753 container died c87506c095946a1a1d43296c6b369523b965c4370c45b9f3de56c8bfa849b896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=squid-820a2f8) 2024-04-21T22:45:52.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:52 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:52.116+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:52.888 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:52.739+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:52.569+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:53.095 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:52 smithi018 podman[102347]: 2024-04-21 22:45:52.825671564 +0000 UTC m=+6.267261050 container cleanup c87506c095946a1a1d43296c6b369523b965c4370c45b9f3de56c8bfa849b896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-21T22:45:53.096 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:52 smithi018 bash[102347]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3 2024-04-21T22:45:53.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:52 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:52.708+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:53.348 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:53 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:53.143+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:53.349 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:53 smithi018 podman[102374]: 2024-04-21 22:45:53.102039396 +0000 UTC m=+0.798427975 container remove c87506c095946a1a1d43296c6b369523b965c4370c45b9f3de56c8bfa849b896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:45:53.845 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:53 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:53.347+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:53.888 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:53.725+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:53.529+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:53.944 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:53 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:53.681+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:54.318 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:54 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:54.142+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:54.319 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:53 smithi018 podman[102463]: 2024-04-21 22:45:53.867526469 +0000 UTC m=+0.036478873 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:45:54.319 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:54 smithi018 podman[102463]: 2024-04-21 22:45:54.00293707 +0000 UTC m=+0.171889499 container create ea3c55f9e183a62998cb61032b0574b624e229cb16f6402c3a9742785749d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-21T22:45:54.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:54 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:54.318+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:54.596 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:54 smithi018 podman[102463]: 2024-04-21 22:45:54.415215673 +0000 UTC m=+0.584168109 container init ea3c55f9e183a62998cb61032b0574b624e229cb16f6402c3a9742785749d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-21T22:45:54.596 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:54 smithi018 podman[102463]: 2024-04-21 22:45:54.426828402 +0000 UTC m=+0.595780834 container start ea3c55f9e183a62998cb61032b0574b624e229cb16f6402c3a9742785749d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8) 2024-04-21T22:45:54.596 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:54 smithi018 podman[102463]: 2024-04-21 22:45:54.547202299 +0000 UTC m=+0.716154768 container attach ea3c55f9e183a62998cb61032b0574b624e229cb16f6402c3a9742785749d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:45:54.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:54.535+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:54.889 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:54.704+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:54.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:54 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:54.682+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:55.150 INFO:journalctl@ceph.osd.3.smithi018.stdout:Apr 21 22:45:54 smithi018 podman[102463]: 2024-04-21 22:45:54.898900014 +0000 UTC m=+1.067852457 container died ea3c55f9e183a62998cb61032b0574b624e229cb16f6402c3a9742785749d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-21T22:45:55.584 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:55 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:55.359+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:55.584 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:55 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:55.149+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:55.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.3.service' 2024-04-21T22:45:55.771 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:45:55.772 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-21T22:45:55.772 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-21T22:45:55.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.4 2024-04-21T22:45:55.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:55.490+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:55.889 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:55.701+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:55.945 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:45:55 smithi047 systemd[1]: Stopping Ceph osd.4 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:45:55.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:55 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:55.661+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:56.445 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:45:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:45:56.108+0000 7f5a67e63700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:45:56.445 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:45:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:45:56.108+0000 7f5a67e63700 -1 osd.4 99 *** Got signal Terminated *** 2024-04-21T22:45:56.445 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:45:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:45:56.108+0000 7f5a67e63700 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:45:56.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:56.394+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:56.598 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:56 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:56.157+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:56.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:56.466+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:56.889 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:56.680+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:56.944 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:56.617+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:56.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:45:56 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:45:56.628+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:45:57.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:57 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:57.186+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:57.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:57 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:57.349+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:57.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:57 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:57.349+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:45:57.730 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:57.448+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:57.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:57.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:57.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:45:57 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:45:57.675+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:45:58.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:57.729+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:58.139 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:57.729+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:45:58.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:58.333+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:58.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:58.333+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:45:58.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:58.226+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:58.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:58 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:58.226+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:45:58.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:58.420+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:58.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:45:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:45:58.311+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:45:58.944 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:58.537+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:58.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:45:58 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:45:58.627+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:45:59.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:58.753+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:45:59.139 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:58.753+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:45:59.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:59.340+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:45:59.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:45:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:45:59.340+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:45:59.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:59.242+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:45:59.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:45:59 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:45:59.242+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:45:59.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:45:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:45:59.279+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:45:59.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:45:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:45:59.376+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:45:59.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:45:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:45:59.604+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:45:59.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:59.490+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:45:59.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:45:59 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:45:59.490+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:00.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:59.784+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:00.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:45:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:45:59.784+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:00.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:00.371+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:00.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:00.371+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:00.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:00.222+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:00.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:00 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:00.222+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:00.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:00 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:00.274+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:00.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:00 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:00.384+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:00.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:00 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:00.384+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:00.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:00 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:00.600+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:00.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:00 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:00.504+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:00.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:00 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:00.504+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:01.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:00 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:00.805+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:01.138 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:00 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:00.805+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:01.445 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:01 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4[42858]: 2024-04-21T22:46:01.067+0000 7f5a64c58700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.815192+0000 front 2024-04-21T22:45:34.815160+0000 (oldest deadline 2024-04-21T22:46:00.715321+0000) 2024-04-21T22:46:01.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:01 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:01.413+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:01.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:01 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:01.413+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:01.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:01 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:01.181+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:01.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:01 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:01.181+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:01.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:01 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:01.228+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:01.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:01 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:01.374+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:01.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:01 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:01.374+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:01.884 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:01 smithi047 podman[67881]: 2024-04-21 22:46:01.49908673 +0000 UTC m=+5.525492038 container died 14b2c614f4ef9f0a3f3fd5369d757b451e40ac7cb2da80a023feb61f308faf7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:01.884 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:01 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:01.641+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:01.885 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:01 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:01.508+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:01.885 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:01 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:01.508+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:02.139 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:01 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:01.811+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:02.139 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:01 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:01.811+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:02.195 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:01 smithi047 podman[67881]: 2024-04-21 22:46:01.98313249 +0000 UTC m=+6.009537802 container cleanup 14b2c614f4ef9f0a3f3fd5369d757b451e40ac7cb2da80a023feb61f308faf7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:02.196 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:01 smithi047 bash[67881]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4 2024-04-21T22:46:02.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:02.384+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:02.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:02.384+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:02.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:02.156+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:02.598 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:02 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:02.156+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:02.605 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67898]: 2024-04-21 22:46:02.259423072 +0000 UTC m=+0.753544723 container remove 14b2c614f4ef9f0a3f3fd5369d757b451e40ac7cb2da80a023feb61f308faf7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-21T22:46:02.605 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:02 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:02.460+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:02.605 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:02 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:02.460+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:02.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:02 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:02.183+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:02.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:02 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:02.328+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:02.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:02 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:02.328+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:02.861 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:02 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:02.682+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:02.862 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67984]: 2024-04-21 22:46:02.50926334 +0000 UTC m=+0.018646785 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:02.862 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67984]: 2024-04-21 22:46:02.626821511 +0000 UTC m=+0.136204924 container create 78d21dd39c4262d348fd51f3c1613db2b3a7d309c9c6c403b0952d4acd350918 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:46:03.134 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:02 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:02.848+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:03.135 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:02 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:02.848+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:03.170 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67984]: 2024-04-21 22:46:02.862556546 +0000 UTC m=+0.371939967 container init 78d21dd39c4262d348fd51f3c1613db2b3a7d309c9c6c403b0952d4acd350918 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-820a2f8) 2024-04-21T22:46:03.171 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67984]: 2024-04-21 22:46:02.865827028 +0000 UTC m=+0.375210450 container start 78d21dd39c4262d348fd51f3c1613db2b3a7d309c9c6c403b0952d4acd350918 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:46:03.171 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:02 smithi047 podman[67984]: 2024-04-21 22:46:02.945997428 +0000 UTC m=+0.455380870 container attach 78d21dd39c4262d348fd51f3c1613db2b3a7d309c9c6c403b0952d4acd350918 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-21T22:46:03.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:03.134+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:03.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:03.311+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:03.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:03.311+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:03.444 INFO:journalctl@ceph.osd.4.smithi047.stdout:Apr 21 22:46:03 smithi047 podman[67984]: 2024-04-21 22:46:03.171134344 +0000 UTC m=+0.680517764 container died 78d21dd39c4262d348fd51f3c1613db2b3a7d309c9c6c403b0952d4acd350918 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-21T22:46:03.595 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:03.396+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:03.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:03.396+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:03.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:03.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:03.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:03.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:03.815 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:03 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:03.649+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:03.816 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:03 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:03.493+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:03.816 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:03 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:03.493+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:03.835 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.4.service' 2024-04-21T22:46:03.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:03.878 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-21T22:46:03.879 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-21T22:46:03.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.5 2024-04-21T22:46:04.115 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:03.819+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:04.115 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:03 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:03.819+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:04.116 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:03 smithi081 systemd[1]: Stopping Ceph osd.5 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:04.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:04.115+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:04.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:04.306+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:04.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:04.306+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:04.390 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.189+0000 7fb249c03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:04.390 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.189+0000 7fb249c03700 -1 osd.5 99 *** Got signal Terminated *** 2024-04-21T22:46:04.390 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.189+0000 7fb249c03700 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:04.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:04 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:04.188+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:04.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:04 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:04.189+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:04.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:04 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:04.387+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:04.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:04 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:04.387+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:04.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:04 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:04.387+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:04.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:04 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:04.604+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:04.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:04 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:04.460+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:04.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:04 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:04.460+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:04.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:04 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:04.460+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:05.107 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.841+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:05.107 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.841+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:05.108 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:04 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:04.841+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:38.649444+0000 front 2024-04-21T22:45:38.649479+0000 (oldest deadline 2024-04-21T22:46:03.949796+0000) 2024-04-21T22:46:05.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:05.106+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:05.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:05.355+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:05.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:05.355+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:05.422 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:05.157+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:05.422 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:05.157+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:05.845 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:05.422+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:05.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:05.422+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:05.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:05 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:05.422+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:05.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:05 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:05.624+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:05.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:05 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:05.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:05.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:05 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:05.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:05.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:05 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:05.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:06.078 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:05.815+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:06.078 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:05.815+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:06.078 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:05 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:05.815+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:38.649444+0000 front 2024-04-21T22:45:38.649479+0000 (oldest deadline 2024-04-21T22:46:03.949796+0000) 2024-04-21T22:46:06.330 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:06.078+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:06.330 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:06.078+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:06.431 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:06.151+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:06.432 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:06.151+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:06.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:06.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:06.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:06.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:06.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:06.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:06.845 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:06.431+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:06.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:06.431+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:06.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:06 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:06.431+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:06.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:06.622+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:06.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:06.622+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:06.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:06.463+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:06.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:06.463+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:06.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:06 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:06.463+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:07.030 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:06.770+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:07.030 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:06.770+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:07.031 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:06 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:06.770+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:38.649444+0000 front 2024-04-21T22:45:38.649479+0000 (oldest deadline 2024-04-21T22:46:03.949796+0000) 2024-04-21T22:46:07.331 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:07.030+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:07.331 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:07.030+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:07.429 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:07.123+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:07.429 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:07.123+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:07.429 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:07.123+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:07.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:07.332+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:07.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:07.332+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:07.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:07.332+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:07.845 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:07.613+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:07.845 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:07.613+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:07.846 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:07.461+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:07.846 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:07.461+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:07.846 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:07 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:07.461+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:07.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:07.428+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:07.847 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:07.428+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:07.847 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:07 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:07.428+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:08.041 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:07.765+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:08.042 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:07.765+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:08.042 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:07 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:07.765+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:38.649444+0000 front 2024-04-21T22:45:38.649479+0000 (oldest deadline 2024-04-21T22:46:03.949796+0000) 2024-04-21T22:46:08.317 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:08.041+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:08.317 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:08.041+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:08.382 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:08.104+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:08.382 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:08.104+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:08.382 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:08.104+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:08.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:08.316+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:08.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:08.316+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:08.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:08.316+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:08.845 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:08.382+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:08.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:08.382+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:08.846 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:08 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:08.382+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:08.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:08.573+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:08.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:08.573+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:08.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:08.494+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:08.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:08.494+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:08.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:08 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:08.494+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:09.087 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:08.747+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:21.846377+0000 front 2024-04-21T22:45:21.846330+0000 (oldest deadline 2024-04-21T22:45:47.146190+0000) 2024-04-21T22:46:09.087 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:08.747+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.648786+0000 front 2024-04-21T22:45:31.648675+0000 (oldest deadline 2024-04-21T22:45:56.948759+0000) 2024-04-21T22:46:09.087 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:08 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5[43993]: 2024-04-21T22:46:08.747+0000 7fb2429f0700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:38.649444+0000 front 2024-04-21T22:45:38.649479+0000 (oldest deadline 2024-04-21T22:46:03.949796+0000) 2024-04-21T22:46:09.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:09 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:09.086+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:09.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:09 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:09.086+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:09.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:09 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:09.314+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:09.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:09 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:09.314+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:09.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:09 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:09.314+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:09.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:09.358+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:09.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:09.358+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:09.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:09.358+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:09.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:09.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:09.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:09.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:09.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:09.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:09.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:09 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:09.614+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:09.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:09 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:09.614+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:09.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:09 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:09.448+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:09.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:09 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:09.448+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:09.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:09 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:09.448+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:09.973 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:09 smithi081 podman[69064]: 2024-04-21 22:46:09.699311591 +0000 UTC m=+5.627731109 container died 89b0df1185df6657f26296ea363c89492c6b798ac2df5b8503fc967bf18e8442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:10.286 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:10 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:10.110+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:10.287 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:10 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:10.110+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:10.287 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69064]: 2024-04-21 22:46:10.072783395 +0000 UTC m=+6.001202904 container cleanup 89b0df1185df6657f26296ea363c89492c6b798ac2df5b8503fc967bf18e8442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:10.287 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 bash[69064]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5 2024-04-21T22:46:10.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:10.322+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:10.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:10.322+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:10.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:10.322+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:10.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:10.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:10.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:10.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:10.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:10 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:10.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:10.639 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69083]: 2024-04-21 22:46:10.407795425 +0000 UTC m=+0.702614365 container remove 89b0df1185df6657f26296ea363c89492c6b798ac2df5b8503fc967bf18e8442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-21T22:46:10.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:10 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:10.285+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:10.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:10 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:10.285+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:10.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:10 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:10.285+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:10.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:10 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:10.474+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:10.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:10 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:10.474+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:10.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:10 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:10.474+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:10.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:10 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:10.583+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:10.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:10 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:10.583+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:10.989 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69176]: 2024-04-21 22:46:10.640346934 +0000 UTC m=+0.017862123 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:10.989 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69176]: 2024-04-21 22:46:10.741963389 +0000 UTC m=+0.119478546 container create da3bfea04f577b7fb3da3ae81ab52eac4421fe2c7d8b4e73e0d254e908ee9bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-21T22:46:10.989 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69176]: 2024-04-21 22:46:10.986011902 +0000 UTC m=+0.363527058 container init da3bfea04f577b7fb3da3ae81ab52eac4421fe2c7d8b4e73e0d254e908ee9bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:46:10.989 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:10 smithi081 podman[69176]: 2024-04-21 22:46:10.989181334 +0000 UTC m=+0.366696492 container start da3bfea04f577b7fb3da3ae81ab52eac4421fe2c7d8b4e73e0d254e908ee9bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=squid-820a2f8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-21T22:46:11.276 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:11.087+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:11.276 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:11.088+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:11.277 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:11 smithi081 podman[69176]: 2024-04-21 22:46:11.061245956 +0000 UTC m=+0.438761130 container attach da3bfea04f577b7fb3da3ae81ab52eac4421fe2c7d8b4e73e0d254e908ee9bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:11.589 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:11.313+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:11.589 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:11.313+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:11.589 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:11 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:11.313+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:11.589 INFO:journalctl@ceph.osd.5.smithi081.stdout:Apr 21 22:46:11 smithi081 podman[69176]: 2024-04-21 22:46:11.277090863 +0000 UTC m=+0.654606031 container died da3bfea04f577b7fb3da3ae81ab52eac4421fe2c7d8b4e73e0d254e908ee9bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:11.293+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:11.293+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:11.293+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:11.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:11.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:11.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:11 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:11.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:11.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.5.service' 2024-04-21T22:46:11.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:11 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:11.582+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:11.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:11 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:11.582+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:11.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:11 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:11.476+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:11.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:11 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:11.476+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:11.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:11 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:11.476+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:11.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:11.951 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-21T22:46:11.951 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-21T22:46:11.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.6 2024-04-21T22:46:12.290 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:12 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:12.121+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:12.290 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:12 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:12.121+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:12.314 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 systemd[1]: Stopping Ceph osd.6 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:12.315 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:12.152+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:12.315 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:12.152+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:12.315 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:12.152+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.314+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.314+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.314+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.501+0000 7f45b4800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.501+0000 7f45b4800700 -1 osd.6 99 *** Got signal Terminated *** 2024-04-21T22:46:12.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:12 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:12.501+0000 7f45b4800700 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:12.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:12 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:12.289+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:12.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:12 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:12.289+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:12.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:12 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:12.289+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:12.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:12 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:12.571+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:12.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:12 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:12.571+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:12.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:12 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:12.457+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:12.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:12 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:12.457+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:12.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:12 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:12.457+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:13.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:13.153+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:13.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:13.153+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:13.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:13.153+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:13.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:13.308+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:13.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:13.308+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:13.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:13.308+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:13.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:13 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:13.308+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:48.938395+0000 front 2024-04-21T22:45:48.938924+0000 (oldest deadline 2024-04-21T22:46:12.438203+0000) 2024-04-21T22:46:13.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:13 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:13.155+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:13.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:13 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:13.155+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:13.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:13 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:13.249+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:13.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:13 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:13.249+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:13.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:13 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:13.249+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:13.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:13.591+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:13.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:13.591+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:13.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:13.409+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:13.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:13.409+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:13.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:13 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:13.409+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:14.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:14.140+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:14.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:14.140+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:14.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:14.140+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:14.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:14.282+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:14.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:14.282+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:14.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:14.282+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:14.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:14 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:14.282+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:48.938395+0000 front 2024-04-21T22:45:48.938924+0000 (oldest deadline 2024-04-21T22:46:12.438203+0000) 2024-04-21T22:46:14.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:14.150+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:14.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:14.150+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:14.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:14.250+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:14.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:14.250+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:14.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:14 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:14.250+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:14.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:14.594+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:14.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:14.594+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:14.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:14.449+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:14.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:14.449+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:14.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:14.449+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:14.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:14 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:14.449+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:15.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:15.131+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:15.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:15.131+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:15.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:15.131+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:15.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:15.233+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:15.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:15.233+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:15.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:15 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:15.233+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:15.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:15.184+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:15.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:15.184+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:15.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:15.184+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:15.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:15.316+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:15.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:15.316+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:15.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:15.316+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:15.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:15.316+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:48.938395+0000 front 2024-04-21T22:45:48.938924+0000 (oldest deadline 2024-04-21T22:46:12.438203+0000) 2024-04-21T22:46:15.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:15.605+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:15.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:15.605+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:15.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:15.426+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:15.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:15.426+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:15.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:15.426+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:15.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:15 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:15.426+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:16.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:16.154+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:16.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:16.154+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:16.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:16.154+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:16.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:16.357+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:16.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:16.357+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:16.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:16.357+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:16.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:16 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:16.357+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:48.938395+0000 front 2024-04-21T22:45:48.938924+0000 (oldest deadline 2024-04-21T22:46:12.438203+0000) 2024-04-21T22:46:16.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:16.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:16.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:16.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:16.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:16.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:16.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:16.273+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:16.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:16.273+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:16.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:16 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:16.273+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:16.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:16.637+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:16.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:16.637+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:16.695 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:16.637+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:16.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:16.404+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:16.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:16.404+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:16.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:16.404+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:16.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:16 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:16.404+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:17.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:17.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:17.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:17.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:17.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:17.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:17.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:17.388+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:25.425563+0000 front 2024-04-21T22:45:25.425792+0000 (oldest deadline 2024-04-21T22:45:50.125939+0000) 2024-04-21T22:46:17.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:17.388+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.329896+0000 front 2024-04-21T22:45:32.330003+0000 (oldest deadline 2024-04-21T22:45:56.430064+0000) 2024-04-21T22:46:17.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:17.388+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.233299+0000 front 2024-04-21T22:45:42.233455+0000 (oldest deadline 2024-04-21T22:46:03.933286+0000) 2024-04-21T22:46:17.597 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:17 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6[54827]: 2024-04-21T22:46:17.388+0000 7f45aba00700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:48.938395+0000 front 2024-04-21T22:45:48.938924+0000 (oldest deadline 2024-04-21T22:46:12.438203+0000) 2024-04-21T22:46:17.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:17.180+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:17.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:17.180+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:17.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:17.180+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:17.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:17.319+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:17.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:17.319+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:17.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:17 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:17.319+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:17.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:17.662+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:17.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:17.662+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:17.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:17.662+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:17.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:17.444+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:17.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:17.444+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:17.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:17.444+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:17.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:17 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:17.444+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:18.216 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:17 smithi018 podman[102566]: 2024-04-21 22:46:17.943922987 +0000 UTC m=+5.567892516 container died 28dff93182b9a973195763db13488c438966c4dbd3118bd15e55a4d961408c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-21T22:46:18.217 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:18.159+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:18.217 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:18.159+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:18.217 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:18.159+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:18.217 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:18 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:18.159+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:18.561 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:18 smithi018 podman[102566]: 2024-04-21 22:46:18.34404417 +0000 UTC m=+5.968013693 container cleanup 28dff93182b9a973195763db13488c438966c4dbd3118bd15e55a4d961408c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=) 2024-04-21T22:46:18.562 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:18 smithi018 bash[102566]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6 2024-04-21T22:46:18.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:18.184+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:18.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:18.184+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:18.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:18.184+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:18.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:18.365+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:18.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:18.365+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:18.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:18 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:18.365+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:18.845 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:18 smithi018 podman[102584]: 2024-04-21 22:46:18.561554995 +0000 UTC m=+0.606588227 container remove 28dff93182b9a973195763db13488c438966c4dbd3118bd15e55a4d961408c42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6, RELEASE=squid-820a2f8, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-21T22:46:18.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:18.688+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:18.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:18.688+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:18.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:18.688+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:18.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:18.483+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:18.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:18.483+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:18.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:18.483+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:18.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:18 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:18.483+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:19.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:19.203+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:19.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:19.203+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:19.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:19.203+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:19.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:19 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:19.203+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:19.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:19 smithi018 podman[102673]: 2024-04-21 22:46:19.305852867 +0000 UTC m=+0.042866235 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:19.596 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:19 smithi018 podman[102673]: 2024-04-21 22:46:19.454057457 +0000 UTC m=+0.191070847 container create 0307369ad834aecb00bbe2cfe7dbe8eda02ba36f15f7e803d7d14e55ade27f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:46:19.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:19.216+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:19.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:19.216+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:19.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:19.216+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:19.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:19.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:19.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:19.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:19.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:19 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:19.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:19.877 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:19 smithi018 podman[102673]: 2024-04-21 22:46:19.740924073 +0000 UTC m=+0.477937470 container init 0307369ad834aecb00bbe2cfe7dbe8eda02ba36f15f7e803d7d14e55ade27f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-21T22:46:19.877 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:19 smithi018 podman[102673]: 2024-04-21 22:46:19.752598081 +0000 UTC m=+0.489611505 container start 0307369ad834aecb00bbe2cfe7dbe8eda02ba36f15f7e803d7d14e55ade27f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:19.877 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:19 smithi018 podman[102673]: 2024-04-21 22:46:19.876615448 +0000 UTC m=+0.613628868 container attach 0307369ad834aecb00bbe2cfe7dbe8eda02ba36f15f7e803d7d14e55ade27f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8) 2024-04-21T22:46:19.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:19.674+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:19.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:19.674+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:19.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:19.674+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:19.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:19.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:19.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:19.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:19.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:19.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:19.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:19 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:19.488+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:20.548 INFO:journalctl@ceph.osd.6.smithi018.stdout:Apr 21 22:46:20 smithi018 podman[102673]: 2024-04-21 22:46:20.220290532 +0000 UTC m=+0.957303916 container died 0307369ad834aecb00bbe2cfe7dbe8eda02ba36f15f7e803d7d14e55ade27f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:20.548 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:20.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:20.549 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:20.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:20.549 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:20.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:20.549 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:20 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:20.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:20.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:20.183+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:20.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:20.183+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:20.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:20.183+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:20.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:20.328+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:20.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:20.328+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:20.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:20 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:20.328+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:20.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:20.522+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:20.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:20.522+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:20.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:20.522+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:20.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:20.522+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:20.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:20.718+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:20.946 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:20.718+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:20.946 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:20 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:20.718+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:20.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.6.service' 2024-04-21T22:46:21.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:21.115 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-21T22:46:21.115 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-21T22:46:21.116 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.7 2024-04-21T22:46:21.418 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 systemd[1]: Stopping Ceph osd.7 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:21.418 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.418+0000 7f2f6a324700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:21.419 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.418+0000 7f2f6a324700 -1 osd.7 99 *** Got signal Terminated *** 2024-04-21T22:46:21.419 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.418+0000 7f2f6a324700 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:21.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:21.199+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:21.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:21.199+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:21.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:21.199+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:21.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:21.199+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:21.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:21.206+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:21.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:21.206+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:21.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:21.206+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:21.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:21.342+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:21.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:21.342+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:21.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:21 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:21.342+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:21.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:21.534+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:21.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:21.534+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:21.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:21.534+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:21.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:21.534+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:22.195 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.756+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:22.195 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.756+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:22.195 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:21 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:21.756+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:22.588 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:22.150+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:22.588 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:22.150+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:22.588 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:22.150+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:22.588 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:22 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:22.150+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:22.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:22.238+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:22.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:22.238+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:22.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:22.238+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:22.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:22.336+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:22.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:22.336+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:22.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:22.336+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:22.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:22 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:22.336+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:22.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:22.743+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:22.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:22.743+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:22.946 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:22.743+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:22.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:22.561+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:22.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:22.561+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:22.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:22.561+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:22.947 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:22 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:22.561+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:23.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:23.116+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:23.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:23.116+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:23.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:23.116+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:23.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:23 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:23.116+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:23.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:23.194+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:23.194+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:23.194+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:23.194+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:23.350+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:23.350+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:23.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:23.350+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:23.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:23 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:23.350+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:23.944 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:23.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:23.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:23.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:23.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:23.746+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:23.746+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:23.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:23 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:23.747+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:24.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:24.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:24.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:24.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:24.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:24.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:24.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:24 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:24.138+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:24.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:24.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:24.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:24.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:24.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:24.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:24.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:24.166+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:24.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:24.385+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:24.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:24.385+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:24.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:24.385+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:24.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:24 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:24.385+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:24.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:24.633+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:24.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:24.633+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:24.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:24.633+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:24.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:24.633+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:24.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:24.724+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:24.946 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:24.724+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:24.946 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:24 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:24.724+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:25.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:25.128+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:25.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:25.128+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:25.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:25.128+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:25.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:25.128+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:25.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:25 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:25.144+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:25.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:25 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:25.144+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:25.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:25 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:25.144+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:25.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:25 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:25.144+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:25.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:25 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:25.144+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:25.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:25.393+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:25.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:25.393+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:25.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:25.393+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:25.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:25 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:25.393+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:25.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:25.736+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:31.011977+0000 front 2024-04-21T22:45:31.012020+0000 (oldest deadline 2024-04-21T22:45:55.712089+0000) 2024-04-21T22:46:25.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:25.736+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.813225+0000 front 2024-04-21T22:45:39.813076+0000 (oldest deadline 2024-04-21T22:46:05.713248+0000) 2024-04-21T22:46:25.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:25.736+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.414880+0000 front 2024-04-21T22:45:50.414631+0000 (oldest deadline 2024-04-21T22:46:15.714474+0000) 2024-04-21T22:46:25.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7[49568]: 2024-04-21T22:46:25.736+0000 7f2f67119700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:59.815381+0000 front 2024-04-21T22:45:59.815455+0000 (oldest deadline 2024-04-21T22:46:25.115597+0000) 2024-04-21T22:46:25.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:25.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:25.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:25.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:25.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:25.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:25.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:25.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:26.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:26 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:26.117+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:26.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:26 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:26.117+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:26.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:26 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:26.117+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:26.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:26 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:26.117+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:26.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:26 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:26.117+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:26.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:26.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:26.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:26.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:26.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:26.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:26.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:26.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:26.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:26.357+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:26.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:26.358+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:26.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:26.358+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:26.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:26 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:26.358+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:26.945 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:26 smithi047 podman[68104]: 2024-04-21 22:46:26.814028892 +0000 UTC m=+5.502181372 container died fa4afdcb43f6ecdadcfa8f743931545f38f0a421902935309bd9b5abd6696dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:26.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:26 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:26.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:26.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:26 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:26.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:26.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:26 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:26.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:26.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:26 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:26.672+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:27.446 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:27 smithi047 podman[68104]: 2024-04-21 22:46:27.184974783 +0000 UTC m=+5.873127268 container cleanup fa4afdcb43f6ecdadcfa8f743931545f38f0a421902935309bd9b5abd6696dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:46:27.446 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:27 smithi047 bash[68104]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7 2024-04-21T22:46:27.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:27 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:27.110+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:27.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:27 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:27.110+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:27.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:27 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:27.110+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:27.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:27 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:27.110+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:27.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:27 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:27.110+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:27.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:27.187+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:27.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:27.187+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:27.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:27.187+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:27.640 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:27.187+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:27.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:27.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:27.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:27.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:27.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:27.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:27.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:27 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:27.330+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:27.864 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:27 smithi047 podman[68122]: 2024-04-21 22:46:27.494154604 +0000 UTC m=+0.671440974 container remove fa4afdcb43f6ecdadcfa8f743931545f38f0a421902935309bd9b5abd6696dbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-21T22:46:27.865 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:27 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:27.685+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:27.866 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:27 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:27.685+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:27.866 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:27 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:27.685+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:27.867 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:27 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:27.685+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:27.867 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:27 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:27.685+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:28.181 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:27 smithi047 podman[68214]: 2024-04-21 22:46:27.76683178 +0000 UTC m=+0.018603707 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:28.182 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:27 smithi047 podman[68214]: 2024-04-21 22:46:27.882043476 +0000 UTC m=+0.133815390 container create 5b03ce859eadce8e9e53fe4f1a48dc644d235771760b73c432db495072557d3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-21T22:46:28.182 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:28 smithi047 podman[68214]: 2024-04-21 22:46:28.097730272 +0000 UTC m=+0.349502196 container init 5b03ce859eadce8e9e53fe4f1a48dc644d235771760b73c432db495072557d3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-21T22:46:28.183 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:28 smithi047 podman[68214]: 2024-04-21 22:46:28.101231001 +0000 UTC m=+0.353002918 container start 5b03ce859eadce8e9e53fe4f1a48dc644d235771760b73c432db495072557d3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-21T22:46:28.183 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:28 smithi047 podman[68214]: 2024-04-21 22:46:28.180478225 +0000 UTC m=+0.432250142 container attach 5b03ce859eadce8e9e53fe4f1a48dc644d235771760b73c432db495072557d3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8) 2024-04-21T22:46:28.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:28 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:28.088+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:28.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:28 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:28.088+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:28.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:28 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:28.088+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:28.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:28 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:28.088+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:28.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:28 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:28.088+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:28.445 INFO:journalctl@ceph.osd.7.smithi047.stdout:Apr 21 22:46:28 smithi047 podman[68214]: 2024-04-21 22:46:28.407469418 +0000 UTC m=+0.659241324 container died 5b03ce859eadce8e9e53fe4f1a48dc644d235771760b73c432db495072557d3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-21T22:46:28.638 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:28.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:28.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:28.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:28.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:28.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:28.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:28.145+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:28.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:28.335+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:28.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:28.335+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:28.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:28.335+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:28.640 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:28 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:28.335+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:28.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:28.640+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:28.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:28.640+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:28.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:28.640+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:28.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:28.640+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:28.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:28.640+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:29.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.7.service' 2024-04-21T22:46:29.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:29.152 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-21T22:46:29.152 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-21T22:46:29.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.8 2024-04-21T22:46:29.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:29 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:29.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:29.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:29 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:29.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:29.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:29 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:29.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:29.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:29 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:29.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:29.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:29 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:29.136+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:29.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:29.369+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:29.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:29.369+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:29.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:29.369+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:29.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:29.369+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:29.639 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.167+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:29.640 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.167+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:29.640 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.167+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:29.640 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.167+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:29.640 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 systemd[1]: Stopping Ceph osd.8 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:29.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:29.651+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:29.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:29.651+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:29.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:29.651+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:29.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:29.651+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:29.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:29 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:29.651+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.743+0000 7f1e569c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.743+0000 7f1e569c5700 -1 osd.8 99 *** Got signal Terminated *** 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:29 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:29.743+0000 7f1e569c5700 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:30.118+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:30.118+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:30.118+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:30.119 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:30.118+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:30.388 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:30.368+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:30.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:30.368+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:30.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:30.368+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:30.389 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:30 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:30.368+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:30.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:30 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:30.167+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:30.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:30 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:30.167+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:30.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:30 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:30.167+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:30.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:30 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:30.167+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:30.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:30 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:30.167+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:30.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:30 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:30.637+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:30.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:30 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:30.637+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:30.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:30 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:30.637+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:30.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:30 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:30.637+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:30.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:30 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:30.637+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:31.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:31.116+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:31.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:31.116+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:31.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:31.116+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:31.390 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:31.116+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:31.390 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:31.363+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:31.390 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:31.363+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:31.391 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:31.363+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:31.391 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:31.363+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:31.391 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:31 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:31.363+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:31.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:31.183+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:31.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:31.183+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:31.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:31.183+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:31.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:31.183+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:31.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:31 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:31.183+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:31.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:31.626+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:31.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:31.626+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:31.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:31.626+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:31.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:31.626+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:31.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:31 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:31.626+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:32.368 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:32.082+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:32.368 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:32.082+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:32.368 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:32.082+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:32.368 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:32.082+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:32.369 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:32.082+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.391722+0000 front 2024-04-21T22:46:07.391640+0000 (oldest deadline 2024-04-21T22:46:31.491777+0000) 2024-04-21T22:46:32.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:32.197+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:32.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:32.197+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:32.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:32.197+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:32.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:32.197+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:32.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:32 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:32.197+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:32.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:32.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:32.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:32.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:32.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:32.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:32.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:32.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:32.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:32 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:32.367+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:32.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:32.613+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:32.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:32.613+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:32.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:32.613+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:32.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:32.613+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:32.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:32.613+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:33.378 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:33.055+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:33.378 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:33.055+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:33.379 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:33.055+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:33.379 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:33.055+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:33.379 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:33.055+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.391722+0000 front 2024-04-21T22:46:07.391640+0000 (oldest deadline 2024-04-21T22:46:31.491777+0000) 2024-04-21T22:46:33.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:33.233+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:33.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:33.233+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:33.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:33.233+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:33.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:33.233+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:33.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:33 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:33.233+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:33.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:33.378+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:33.638 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:33.378+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:33.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:33.378+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:33.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:33.378+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:33.639 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:33 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:33.378+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:33.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:33 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:33.593+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:34.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:34.213+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:34.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:34.213+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:34.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:34.213+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:34.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:34.213+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:34.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:34 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:34.213+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:34.388 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:34.044+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:33.586402+0000 front 2024-04-21T22:45:33.586420+0000 (oldest deadline 2024-04-21T22:45:57.686399+0000) 2024-04-21T22:46:34.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:34.044+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:40.587464+0000 front 2024-04-21T22:45:40.587588+0000 (oldest deadline 2024-04-21T22:46:05.887564+0000) 2024-04-21T22:46:34.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:34.044+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:49.889089+0000 front 2024-04-21T22:45:49.889104+0000 (oldest deadline 2024-04-21T22:46:14.588881+0000) 2024-04-21T22:46:34.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:34.044+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:00.390669+0000 front 2024-04-21T22:46:00.390648+0000 (oldest deadline 2024-04-21T22:46:22.690675+0000) 2024-04-21T22:46:34.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8[50567]: 2024-04-21T22:46:34.044+0000 7f1e537ba700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.391722+0000 front 2024-04-21T22:46:07.391640+0000 (oldest deadline 2024-04-21T22:46:31.491777+0000) 2024-04-21T22:46:34.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:34.421+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:34.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:34.421+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:34.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:34.421+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:34.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:34.421+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:34.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:34 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:34.421+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:34.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:34 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:34.596+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:35.433 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:35 smithi081 podman[69283]: 2024-04-21 22:46:35.154607548 +0000 UTC m=+5.816087447 container died 89a4d452581a9315852b5bbc6862bd4d8bc2299dd839ead57a0784443577ee23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:35.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:35 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:35.171+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:35.686 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:35 smithi081 podman[69283]: 2024-04-21 22:46:35.476587301 +0000 UTC m=+6.138067200 container cleanup 89a4d452581a9315852b5bbc6862bd4d8bc2299dd839ead57a0784443577ee23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-21T22:46:35.687 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:35 smithi081 bash[69283]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8 2024-04-21T22:46:35.687 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:35 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:35.433+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:35.687 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:35 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:35.433+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:35.688 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:35 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:35.433+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:35.688 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:35 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:35.433+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:35.688 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:35 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:35.433+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:35.944 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:35.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:35.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:35.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:35.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:35.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:35 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:35.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:36.096 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:35 smithi081 podman[69300]: 2024-04-21 22:46:35.686869904 +0000 UTC m=+0.533917666 container remove 89a4d452581a9315852b5bbc6862bd4d8bc2299dd839ead57a0784443577ee23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8) 2024-04-21T22:46:36.389 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:35.999828123 +0000 UTC m=+0.017902701 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:36.390 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:36.104900093 +0000 UTC m=+0.122974654 container create 1a5b1ae129ae17cebc15edfe8a97dfe68b78e64cdd7a0f8f4a71edf47215e72a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-21T22:46:36.390 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:36.341051069 +0000 UTC m=+0.359125641 container init 1a5b1ae129ae17cebc15edfe8a97dfe68b78e64cdd7a0f8f4a71edf47215e72a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, ceph=True) 2024-04-21T22:46:36.390 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:36.344399241 +0000 UTC m=+0.362473800 container start 1a5b1ae129ae17cebc15edfe8a97dfe68b78e64cdd7a0f8f4a71edf47215e72a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:36.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:36 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:36.176+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:36.889 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:36.42431666 +0000 UTC m=+0.442391236 container attach 1a5b1ae129ae17cebc15edfe8a97dfe68b78e64cdd7a0f8f4a71edf47215e72a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:36.889 INFO:journalctl@ceph.osd.8.smithi081.stdout:Apr 21 22:46:36 smithi081 podman[69385]: 2024-04-21 22:46:36.633187608 +0000 UTC m=+0.651262178 container died 1a5b1ae129ae17cebc15edfe8a97dfe68b78e64cdd7a0f8f4a71edf47215e72a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-21T22:46:36.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:36 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:36.437+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:36.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:36 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:36.437+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:36.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:36 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:36.437+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:36.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:36 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:36.437+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:36.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:36 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:36.437+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:36.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:36.555+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:37.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.8.service' 2024-04-21T22:46:37.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:37.335 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-21T22:46:37.336 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-21T22:46:37.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.9 2024-04-21T22:46:37.460 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:37.460 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:37.461 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:37.461 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:37.461 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:37.461 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.182+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:37.549 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:37 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:37.413+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:37.550 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:37 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:37.413+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:37.550 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:37 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:37.413+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:37.550 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:37 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:37.413+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:37.550 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:37 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:37.413+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:37.845 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 systemd[1]: Stopping Ceph osd.9 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:37.857 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:37.857 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:37.857 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:37.857 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:37.857 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:37.858 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:37 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:37.600+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:38.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.926+0000 7f6826e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:38.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.926+0000 7f6826e00700 -1 osd.9 99 *** Got signal Terminated *** 2024-04-21T22:46:38.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:37 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:37.926+0000 7f6826e00700 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:38.347 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:38 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:38.137+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:38.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:38.459+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:38.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:38.459+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:38.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:38.459+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:38.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:38.459+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:38.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:38 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:38.459+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:38.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:38.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:38 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:38.576+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:39.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:39 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:39.118+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:39.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:39 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:39.464+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:39.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:39 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:39.464+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:39.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:39 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:39.464+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:39.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:39 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:39.464+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:39.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:39 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:39.464+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:39.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:39.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:39.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:39.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:39.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:39.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:39.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:39 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:39.573+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:40.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:40.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:40.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:40.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:40.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:40.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:40 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:40.128+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:40.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:40.452+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:40.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:40.452+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:40.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:40.452+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:40.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:40.452+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:40.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:40.452+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:40.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:40.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:40.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:40.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:40.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:40.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:40.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:40 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:40.598+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:41.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:41.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:41.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:41.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:41.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:41.597 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:41 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:41.127+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:41.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:41.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:41.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:41.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:41.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:41.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:41 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:41.501+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:41.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:41.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:41.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:41.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.556+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:41.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:41.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:41.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:41 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:41.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:42.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.573410+0000 front 2024-04-21T22:45:24.573972+0000 (oldest deadline 2024-04-21T22:45:50.473534+0000) 2024-04-21T22:46:42.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:32.775999+0000 front 2024-04-21T22:45:32.776109+0000 (oldest deadline 2024-04-21T22:45:58.075887+0000) 2024-04-21T22:46:42.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.777838+0000 front 2024-04-21T22:45:42.777774+0000 (oldest deadline 2024-04-21T22:46:06.277849+0000) 2024-04-21T22:46:42.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:50.880819+0000 front 2024-04-21T22:45:50.880874+0000 (oldest deadline 2024-04-21T22:46:17.281522+0000) 2024-04-21T22:46:42.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.383795+0000 front 2024-04-21T22:45:58.384214+0000 (oldest deadline 2024-04-21T22:46:24.283969+0000) 2024-04-21T22:46:42.596 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:42 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9[61722]: 2024-04-21T22:46:42.160+0000 7f6823000700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:08.986273+0000 front 2024-04-21T22:46:08.986143+0000 (oldest deadline 2024-04-21T22:46:34.886393+0000) 2024-04-21T22:46:42.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:42.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:42.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:42.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:42.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:42.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:42 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:42.518+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:42.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:42.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:42.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:42.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:42.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:42.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:42.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:42 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:42.513+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:43.735 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:43 smithi018 podman[102789]: 2024-04-21 22:46:43.414888604 +0000 UTC m=+5.614927512 container died cc94cd9006cc71e3eb4caf319a71694e30dbaf787a8ded4c1b695b2fed667e99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8) 2024-04-21T22:46:43.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:43.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:43.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:43.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:43.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:43.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:43 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:43.523+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:43.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:43.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:43 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:43.529+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:44.095 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:43 smithi018 podman[102789]: 2024-04-21 22:46:43.844589733 +0000 UTC m=+6.044628597 container cleanup cc94cd9006cc71e3eb4caf319a71694e30dbaf787a8ded4c1b695b2fed667e99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9, ceph=True, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:44.096 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:43 smithi018 bash[102789]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9 2024-04-21T22:46:44.595 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:44 smithi018 podman[102807]: 2024-04-21 22:46:44.203999474 +0000 UTC m=+0.777451087 container remove cc94cd9006cc71e3eb4caf319a71694e30dbaf787a8ded4c1b695b2fed667e99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-21T22:46:44.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:44.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:44.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:44.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:44.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:44.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:44.560+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:44.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:44.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:44.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:44.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:44.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:44.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:44.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:44 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:44.524+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:45.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:44.985478743 +0000 UTC m=+0.032704143 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:45.346 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:45.080072306 +0000 UTC m=+0.127297737 container create 15aaf19338b356f15b146d408e6fffa87c477db9cfcb25d995a258dcb58ada28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-21T22:46:45.817 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:45.408657124 +0000 UTC m=+0.455882555 container init 15aaf19338b356f15b146d408e6fffa87c477db9cfcb25d995a258dcb58ada28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:45.817 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:45.420278287 +0000 UTC m=+0.467503727 container start 15aaf19338b356f15b146d408e6fffa87c477db9cfcb25d995a258dcb58ada28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:46:45.817 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:45.507281875 +0000 UTC m=+0.554507345 container attach 15aaf19338b356f15b146d408e6fffa87c477db9cfcb25d995a258dcb58ada28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-21T22:46:45.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:45.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:45.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:45.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:45.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:45.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:45 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:45.573+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:45.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:45 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:45.550+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:46.095 INFO:journalctl@ceph.osd.9.smithi018.stdout:Apr 21 22:46:45 smithi018 podman[102898]: 2024-04-21 22:46:45.871900672 +0000 UTC m=+0.919126103 container died 15aaf19338b356f15b146d408e6fffa87c477db9cfcb25d995a258dcb58ada28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-21T22:46:46.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.9.service' 2024-04-21T22:46:46.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:46.803 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-21T22:46:46.803 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-21T22:46:46.804 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.10 2024-04-21T22:46:46.854 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:46.855 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:46.594+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:46.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:46.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:46.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:46.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:46.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:46.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:46 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:46.538+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:47.194 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:46 smithi047 systemd[1]: Stopping Ceph osd.10 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:47.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.102+0000 7f58eb125700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:47.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.102+0000 7f58eb125700 -1 osd.10 99 *** Got signal Terminated *** 2024-04-21T22:46:47.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.102+0000 7f58eb125700 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:47.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:47.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:47.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:47.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:47.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:47.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:47 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:47.526+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:47.901 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:47.901 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:47.901 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:47.902 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:47.902 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:47.902 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:47.902 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:47 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:47.557+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:48.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:49.310 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:49.310 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:49.310 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:49.310 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:49.311 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:48.532+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:49.311 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:49.311 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:49.312 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:49.312 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:49.312 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:49.312 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:49.312 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:48 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:48.514+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:49.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:49.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:49.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:49.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:49.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:49.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:49 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:49.565+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:49.945 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:49.946 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:49 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:49.465+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:50.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:50.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:50.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:50.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:50.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:50.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:50.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:50 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:50.428+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:50.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:50.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:50.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:50.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:50.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:50.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:50 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:50.534+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:51.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.449456+0000 front 2024-04-21T22:45:24.449597+0000 (oldest deadline 2024-04-21T22:45:48.549408+0000) 2024-04-21T22:46:51.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.450544+0000 front 2024-04-21T22:45:34.450571+0000 (oldest deadline 2024-04-21T22:45:58.550790+0000) 2024-04-21T22:46:51.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:42.651917+0000 front 2024-04-21T22:45:42.652043+0000 (oldest deadline 2024-04-21T22:46:04.351961+0000) 2024-04-21T22:46:51.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6814 osd.3 since back 2024-04-21T22:45:51.254312+0000 front 2024-04-21T22:45:51.254433+0000 (oldest deadline 2024-04-21T22:46:13.554088+0000) 2024-04-21T22:46:51.695 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:46:01.056077+0000 front 2024-04-21T22:46:01.056038+0000 (oldest deadline 2024-04-21T22:46:26.956071+0000) 2024-04-21T22:46:51.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:07.457116+0000 front 2024-04-21T22:46:07.457136+0000 (oldest deadline 2024-04-21T22:46:33.357146+0000) 2024-04-21T22:46:51.696 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:51 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10[56201]: 2024-04-21T22:46:51.414+0000 7f58e3f12700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:15.558643+0000 front 2024-04-21T22:46:15.558853+0000 (oldest deadline 2024-04-21T22:46:38.458496+0000) 2024-04-21T22:46:51.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:51.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:51.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:51.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:51.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:51.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:51.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:51 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:51.521+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:52.777 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:52 smithi047 podman[68331]: 2024-04-21 22:46:52.447422381 +0000 UTC m=+5.442213091 container died 1d88d3092547dee048666abd454d6394aaa4fa9bb58c016376e53333eafa9227 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-04-21T22:46:52.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:52.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:52.519+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:53.103 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:52 smithi047 podman[68331]: 2024-04-21 22:46:52.777381667 +0000 UTC m=+5.772172361 container cleanup 1d88d3092547dee048666abd454d6394aaa4fa9bb58c016376e53333eafa9227 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-820a2f8, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-21T22:46:53.103 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:52 smithi047 bash[68331]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10 2024-04-21T22:46:53.444 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68350]: 2024-04-21 22:46:53.103489449 +0000 UTC m=+0.655808125 container remove 1d88d3092547dee048666abd454d6394aaa4fa9bb58c016376e53333eafa9227 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:46:53.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:53.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:53 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:53.481+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:53.906 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68439]: 2024-04-21 22:46:53.459076801 +0000 UTC m=+0.018201105 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:46:53.906 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68439]: 2024-04-21 22:46:53.562675754 +0000 UTC m=+0.121800058 container create 353f869ae0bd064960f45f1a6adbe75d041f56112a3ba13e891fad5df316489a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-21T22:46:53.906 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68439]: 2024-04-21 22:46:53.790152007 +0000 UTC m=+0.349276311 container init 353f869ae0bd064960f45f1a6adbe75d041f56112a3ba13e891fad5df316489a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:46:53.906 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68439]: 2024-04-21 22:46:53.793380579 +0000 UTC m=+0.352504885 container start 353f869ae0bd064960f45f1a6adbe75d041f56112a3ba13e891fad5df316489a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-21T22:46:53.906 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:53 smithi047 podman[68439]: 2024-04-21 22:46:53.906660349 +0000 UTC m=+0.465784670 container attach 353f869ae0bd064960f45f1a6adbe75d041f56112a3ba13e891fad5df316489a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-21T22:46:54.195 INFO:journalctl@ceph.osd.10.smithi047.stdout:Apr 21 22:46:54 smithi047 podman[68439]: 2024-04-21 22:46:54.089362056 +0000 UTC m=+0.648486363 container died 353f869ae0bd064960f45f1a6adbe75d041f56112a3ba13e891fad5df316489a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux ) 2024-04-21T22:46:54.678 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.10.service' 2024-04-21T22:46:54.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:46:54.716 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-21T22:46:54.717 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-21T22:46:54.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.11 2024-04-21T22:46:54.744 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:54.744 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:54.744 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:54.744 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:54.745 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:54.745 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:54.745 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:54.467+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:55.030 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:54 smithi081 systemd[1]: Stopping Ceph osd.11 for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:46:55.388 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.030+0000 7f17b68d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:46:55.388 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.030+0000 7f17b68d0700 -1 osd.11 99 *** Got signal Terminated *** 2024-04-21T22:46:55.388 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.030+0000 7f17b68d0700 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T22:46:55.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:55.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:55 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:55.515+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:56.888 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:56.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:56 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:56.508+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:57.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:57.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:57.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:57 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:57.517+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6820 osd.8 since back 2024-04-21T22:46:31.483593+0000 front 2024-04-21T22:46:31.483618+0000 (oldest deadline 2024-04-21T22:46:56.783564+0000) 2024-04-21T22:46:58.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:58.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:58.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:58.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:58.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:58.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:58.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:58.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:58 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:58.559+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6820 osd.8 since back 2024-04-21T22:46:31.483593+0000 front 2024-04-21T22:46:31.483618+0000 (oldest deadline 2024-04-21T22:46:56.783564+0000) 2024-04-21T22:46:59.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6806 osd.0 since back 2024-04-21T22:45:24.874611+0000 front 2024-04-21T22:45:24.874643+0000 (oldest deadline 2024-04-21T22:45:46.574590+0000) 2024-04-21T22:46:59.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6804 osd.1 since back 2024-04-21T22:45:34.076997+0000 front 2024-04-21T22:45:34.076884+0000 (oldest deadline 2024-04-21T22:45:59.976787+0000) 2024-04-21T22:46:59.889 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6804 osd.2 since back 2024-04-21T22:45:39.977061+0000 front 2024-04-21T22:45:39.977118+0000 (oldest deadline 2024-04-21T22:46:05.877206+0000) 2024-04-21T22:46:59.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6812 osd.4 since back 2024-04-21T22:45:58.080087+0000 front 2024-04-21T22:45:58.080209+0000 (oldest deadline 2024-04-21T22:46:22.180017+0000) 2024-04-21T22:46:59.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6812 osd.5 since back 2024-04-21T22:46:05.681069+0000 front 2024-04-21T22:46:05.681155+0000 (oldest deadline 2024-04-21T22:46:30.981199+0000) 2024-04-21T22:46:59.890 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.18:6822 osd.6 since back 2024-04-21T22:46:16.882280+0000 front 2024-04-21T22:46:16.882329+0000 (oldest deadline 2024-04-21T22:46:40.982075+0000) 2024-04-21T22:46:59.891 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.47:6820 osd.7 since back 2024-04-21T22:46:25.683166+0000 front 2024-04-21T22:46:25.683135+0000 (oldest deadline 2024-04-21T22:46:50.982867+0000) 2024-04-21T22:46:59.891 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:46:59 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11[57374]: 2024-04-21T22:46:59.556+0000 7f17af6bd700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.81:6820 osd.8 since back 2024-04-21T22:46:31.483593+0000 front 2024-04-21T22:46:31.483618+0000 (oldest deadline 2024-04-21T22:46:56.783564+0000) 2024-04-21T22:47:00.788 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:00 smithi081 podman[69503]: 2024-04-21 22:47:00.469213583 +0000 UTC m=+5.562975755 container died c989e63b6ab5a84b72637798f959842d62f09fb0d704c98b533e42636b686c9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-21T22:47:00.788 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:00 smithi081 podman[69503]: 2024-04-21 22:47:00.788754561 +0000 UTC m=+5.882516723 container cleanup c989e63b6ab5a84b72637798f959842d62f09fb0d704c98b533e42636b686c9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-21T22:47:01.138 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:00 smithi081 bash[69503]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11 2024-04-21T22:47:01.139 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:00 smithi081 podman[69520]: 2024-04-21 22:47:00.981596287 +0000 UTC m=+0.511195084 container remove c989e63b6ab5a84b72637798f959842d62f09fb0d704c98b533e42636b686c9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11, RELEASE=squid-820a2f8, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-21T22:47:01.709 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.307892338 +0000 UTC m=+0.017773682 image pull 6702148920adeca800d3e709b657e413bd3a63e83b20c5b975b68dabf7989f32 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9 2024-04-21T22:47:01.710 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.407235961 +0000 UTC m=+0.117117289 container create 81257c01da18780959479818dd1c3330494d9197e58edd6a09b56f2b2ccfe06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, ceph=True) 2024-04-21T22:47:01.710 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.635259776 +0000 UTC m=+0.345141104 container init 81257c01da18780959479818dd1c3330494d9197e58edd6a09b56f2b2ccfe06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-21T22:47:01.710 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.638267975 +0000 UTC m=+0.348149313 container start 81257c01da18780959479818dd1c3330494d9197e58edd6a09b56f2b2ccfe06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-21T22:47:01.710 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.710234606 +0000 UTC m=+0.420115952 container attach 81257c01da18780959479818dd1c3330494d9197e58edd6a09b56f2b2ccfe06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-21T22:47:02.138 INFO:journalctl@ceph.osd.11.smithi081.stdout:Apr 21 22:47:01 smithi081 podman[69609]: 2024-04-21 22:47:01.925175279 +0000 UTC m=+0.635056607 container died 81257c01da18780959479818dd1c3330494d9197e58edd6a09b56f2b2ccfe06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-04-21T22:47:02.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@osd.11.service' 2024-04-21T22:47:02.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:02.624 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-21T22:47:02.624 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-21T22:47:02.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.a 2024-04-21T22:47:03.095 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:02 smithi018 systemd[1]: Stopping Ceph mds.a for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:03.595 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a[68673]: 2024-04-21T22:47:03.336+0000 7f17a3800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:03.596 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:03 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a[68673]: 2024-04-21T22:47:03.336+0000 7f17a3800700 -1 mds.a *** got signal Terminated *** 2024-04-21T22:47:07.675 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:07 smithi018 podman[103028]: 2024-04-21 22:47:07.350240372 +0000 UTC m=+4.253353179 container died 04e6faa97f1b87f34c525a78f37b58177a4318736f8d7b2f201d4535441fc85e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, ceph=True) 2024-04-21T22:47:07.990 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:07 smithi018 podman[103028]: 2024-04-21 22:47:07.795048154 +0000 UTC m=+4.698160988 container cleanup 04e6faa97f1b87f34c525a78f37b58177a4318736f8d7b2f201d4535441fc85e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-21T22:47:07.990 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:07 smithi018 bash[103028]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a 2024-04-21T22:47:08.345 INFO:journalctl@ceph.mds.a.smithi018.stdout:Apr 21 22:47:08 smithi018 podman[103042]: 2024-04-21 22:47:08.171159964 +0000 UTC m=+0.800880884 container remove 04e6faa97f1b87f34c525a78f37b58177a4318736f8d7b2f201d4535441fc85e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-a, RELEASE=squid-820a2f8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-21T22:47:08.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.a.service' 2024-04-21T22:47:08.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:08.823 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-21T22:47:08.823 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-21T22:47:08.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.d 2024-04-21T22:47:09.346 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:08 smithi018 systemd[1]: Stopping Ceph mds.d for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:09.845 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d[67692]: 2024-04-21T22:47:09.471+0000 7f704c000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:09.845 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:09 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d[67692]: 2024-04-21T22:47:09.472+0000 7f704c000700 -1 mds.d *** got signal Terminated *** 2024-04-21T22:47:13.594 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:13 smithi018 podman[103148]: 2024-04-21 22:47:13.245118291 +0000 UTC m=+3.933927047 container died 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-21T22:47:13.845 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:13 smithi018 podman[103148]: 2024-04-21 22:47:13.698190662 +0000 UTC m=+4.386999442 container cleanup 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:13.846 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:13 smithi018 bash[103148]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d 2024-04-21T22:47:14.345 INFO:journalctl@ceph.mds.d.smithi018.stdout:Apr 21 22:47:14 smithi018 podman[103162]: 2024-04-21 22:47:14.065901518 +0000 UTC m=+0.798450522 container remove 13319b2bc17a473dd6be785211c03c31cd5615dba17c065623a689a241d72e0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:47:14.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.d.service' 2024-04-21T22:47:14.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:14.736 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-21T22:47:14.736 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-21T22:47:14.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.g 2024-04-21T22:47:15.346 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:14 smithi018 systemd[1]: Stopping Ceph mds.g for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:15.845 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g[68286]: 2024-04-21T22:47:15.359+0000 7f243e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:15.845 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:15 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g[68286]: 2024-04-21T22:47:15.359+0000 7f243e200700 -1 mds.g *** got signal Terminated *** 2024-04-21T22:47:19.797 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:19 smithi018 podman[103268]: 2024-04-21 22:47:19.377334804 +0000 UTC m=+4.136359583 container died 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-21T22:47:20.095 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:19 smithi018 podman[103268]: 2024-04-21 22:47:19.909849513 +0000 UTC m=+4.668874288 container cleanup 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-21T22:47:20.096 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:19 smithi018 bash[103268]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g 2024-04-21T22:47:20.596 INFO:journalctl@ceph.mds.g.smithi018.stdout:Apr 21 22:47:20 smithi018 podman[103281]: 2024-04-21 22:47:20.219275527 +0000 UTC m=+0.820918313 container remove 6be4feab8b133c57e58c3361b446ad7173c449a229b968511c9e3dc53215494b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-820a2f8, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-21T22:47:20.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.g.service' 2024-04-21T22:47:20.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:20.850 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-21T22:47:20.850 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-21T22:47:20.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.j 2024-04-21T22:47:21.095 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:20 smithi018 systemd[1]: Stopping Ceph mds.j for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:21.845 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: 2024-04-21T22:47:21.469+0000 7fd5cdc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:21.846 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:21 smithi018 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j[67313]: 2024-04-21T22:47:21.469+0000 7fd5cdc00700 -1 mds.j *** got signal Terminated *** 2024-04-21T22:47:23.846 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:23 smithi018 podman[103387]: 2024-04-21 22:47:23.632883109 +0000 UTC m=+2.288807896 container died a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:47:24.290 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:24 smithi018 podman[103387]: 2024-04-21 22:47:24.063364302 +0000 UTC m=+2.719289099 container cleanup a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:24.290 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:24 smithi018 bash[103387]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j 2024-04-21T22:47:24.595 INFO:journalctl@ceph.mds.j.smithi018.stdout:Apr 21 22:47:24 smithi018 podman[103412]: 2024-04-21 22:47:24.288917372 +0000 UTC m=+0.642629995 container remove a2bd32e9261d628843a05c438764376b2ba5f2aef2c362dfcec2d44089c63af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:24.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.j.service' 2024-04-21T22:47:24.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:24.984 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-21T22:47:24.985 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-21T22:47:24.985 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.b 2024-04-21T22:47:25.285 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:25 smithi047 systemd[1]: Stopping Ceph mds.b for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:25.564 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: 2024-04-21T22:47:25.284+0000 7f522f145700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:25.565 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:25 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b[61908]: 2024-04-21T22:47:25.284+0000 7f522f145700 -1 mds.b *** got signal Terminated *** 2024-04-21T22:47:27.826 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:27 smithi047 podman[68546]: 2024-04-21 22:47:27.561937216 +0000 UTC m=+2.384551143 container died 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-21T22:47:28.194 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:27 smithi047 podman[68546]: 2024-04-21 22:47:27.92635763 +0000 UTC m=+2.748971550 container cleanup 4838d455bf22a18fd3ccd7c138a79ac9e696624600c577cc8bd19498d4a328bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:28.195 INFO:journalctl@ceph.mds.b.smithi047.stdout:Apr 21 22:47:27 smithi047 bash[68546]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-b 2024-04-21T22:47:28.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.b.service' 2024-04-21T22:47:28.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:28.370 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-21T22:47:28.370 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-21T22:47:28.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.e 2024-04-21T22:47:28.694 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:28 smithi047 systemd[1]: Stopping Ceph mds.e for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:29.194 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: 2024-04-21T22:47:28.696+0000 7f0e0d5fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:29.195 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:28 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e[61279]: 2024-04-21T22:47:28.696+0000 7f0e0d5fe700 -1 mds.e *** got signal Terminated *** 2024-04-21T22:47:31.938 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:31 smithi047 podman[68678]: 2024-04-21 22:47:31.570961808 +0000 UTC m=+2.978268121 container died 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-21T22:47:32.195 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:32 smithi047 podman[68678]: 2024-04-21 22:47:32.021615568 +0000 UTC m=+3.428921872 container cleanup 6eff87e796c047cbb39c024cdd11b84524cc9980c72636540a1b2efedec3dd41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, org.label-schema.build-date=20240416) 2024-04-21T22:47:32.195 INFO:journalctl@ceph.mds.e.smithi047.stdout:Apr 21 22:47:32 smithi047 bash[68678]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-e 2024-04-21T22:47:32.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.e.service' 2024-04-21T22:47:32.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:32.494 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-21T22:47:32.495 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-21T22:47:32.495 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.h 2024-04-21T22:47:32.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:32 smithi047 systemd[1]: Stopping Ceph mds.h for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:32.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: 2024-04-21T22:47:32.816+0000 7fd5a8cbf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:32.945 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:32 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h[61598]: 2024-04-21T22:47:32.816+0000 7fd5a8cbf700 -1 mds.h *** got signal Terminated *** 2024-04-21T22:47:35.850 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:35 smithi047 podman[68800]: 2024-04-21 22:47:35.567675651 +0000 UTC m=+2.857724522 container died e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-21T22:47:36.195 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:35 smithi047 podman[68800]: 2024-04-21 22:47:35.933148947 +0000 UTC m=+3.223197825 container cleanup e81a73ea2b369901150a6d7e93aebfdbf197f0556bd0fc79cf09dc7f3652938d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-820a2f8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:36.195 INFO:journalctl@ceph.mds.h.smithi047.stdout:Apr 21 22:47:35 smithi047 bash[68800]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-h 2024-04-21T22:47:36.386 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.h.service' 2024-04-21T22:47:36.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:36.417 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-21T22:47:36.417 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-21T22:47:36.418 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.k 2024-04-21T22:47:36.762 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:36 smithi047 systemd[1]: Stopping Ceph mds.k for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:37.195 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: 2024-04-21T22:47:36.761+0000 7fe1ef287700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:37.195 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:36 smithi047 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k[60960]: 2024-04-21T22:47:36.761+0000 7fe1ef287700 -1 mds.k *** got signal Terminated *** 2024-04-21T22:47:39.886 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:39 smithi047 podman[68920]: 2024-04-21 22:47:39.56361213 +0000 UTC m=+2.913540169 container died d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_BRANCH=HEAD) 2024-04-21T22:47:40.195 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:39 smithi047 podman[68920]: 2024-04-21 22:47:39.886827851 +0000 UTC m=+3.236755896 container cleanup d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-21T22:47:40.195 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:39 smithi047 bash[68920]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k 2024-04-21T22:47:40.195 INFO:journalctl@ceph.mds.k.smithi047.stdout:Apr 21 22:47:40 smithi047 podman[68934]: 2024-04-21 22:47:40.11275188 +0000 UTC m=+0.551846188 container remove d78ec9de268ac9bdf755c907482e41093fab2d1901b6dad14ea8bd0dd153f2aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-21T22:47:40.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.k.service' 2024-04-21T22:47:40.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:40.379 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-21T22:47:40.379 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-21T22:47:40.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.c 2024-04-21T22:47:40.729 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:40 smithi081 systemd[1]: Stopping Ceph mds.c for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:41.138 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c[62684]: 2024-04-21T22:47:40.763+0000 7f54b8206700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:41.138 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:40 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c[62684]: 2024-04-21T22:47:40.763+0000 7f54b8206700 -1 mds.c *** got signal Terminated *** 2024-04-21T22:47:43.889 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:43 smithi081 podman[69714]: 2024-04-21 22:47:43.56048663 +0000 UTC m=+2.995039503 container died 0d263ddff047ab0fddae3ff5177dbaac323bed70d3951e1a811aced15d8284ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True) 2024-04-21T22:47:44.290 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 podman[69714]: 2024-04-21 22:47:44.105810608 +0000 UTC m=+3.540363484 container cleanup 0d263ddff047ab0fddae3ff5177dbaac323bed70d3951e1a811aced15d8284ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=squid-820a2f8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-21T22:47:44.290 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 bash[69714]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c 2024-04-21T22:47:44.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.c.service' 2024-04-21T22:47:44.550 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 podman[69739]: 2024-04-21 22:47:44.290317745 +0000 UTC m=+0.724043775 container remove 0d263ddff047ab0fddae3ff5177dbaac323bed70d3951e1a811aced15d8284ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=squid-820a2f8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-04-21T22:47:44.550 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.c.service: Deactivated successfully. 2024-04-21T22:47:44.550 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 systemd[1]: Stopped Ceph mds.c for 6ef0a334-002d-11ef-bc93-c7b262605968. 2024-04-21T22:47:44.550 INFO:journalctl@ceph.mds.c.smithi081.stdout:Apr 21 22:47:44 smithi081 systemd[1]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.c.service: Consumed 2.327s CPU time. 2024-04-21T22:47:44.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:44.563 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-21T22:47:44.563 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-21T22:47:44.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.f 2024-04-21T22:47:44.888 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:44 smithi081 systemd[1]: Stopping Ceph mds.f for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:45.388 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: 2024-04-21T22:47:44.934+0000 7f4930baa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:45.389 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:44 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f[62377]: 2024-04-21T22:47:44.934+0000 7f4930baa700 -1 mds.f *** got signal Terminated *** 2024-04-21T22:47:47.834 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:47 smithi081 podman[69849]: 2024-04-21 22:47:47.55799982 +0000 UTC m=+2.779427155 container died a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-21T22:47:48.138 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:47 smithi081 podman[69849]: 2024-04-21 22:47:47.934667451 +0000 UTC m=+3.156094786 container cleanup a13756a7d8e34c44b4e94a7cb4a7eb40109bdfb8e5310d9454d16b8be7c3064f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=squid-820a2f8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-21T22:47:48.139 INFO:journalctl@ceph.mds.f.smithi081.stdout:Apr 21 22:47:47 smithi081 bash[69849]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-f 2024-04-21T22:47:48.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.f.service' 2024-04-21T22:47:48.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:48.442 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-21T22:47:48.443 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-21T22:47:48.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.i 2024-04-21T22:47:48.763 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:48 smithi081 systemd[1]: Stopping Ceph mds.i for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:49.138 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: 2024-04-21T22:47:48.763+0000 7f70f647b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:49.139 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:48 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i[62994]: 2024-04-21T22:47:48.763+0000 7f70f647b700 -1 mds.i *** got signal Terminated *** 2024-04-21T22:47:51.840 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:51 smithi081 podman[69968]: 2024-04-21 22:47:51.558607697 +0000 UTC m=+2.908086510 container died ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-21T22:47:52.138 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:51 smithi081 podman[69968]: 2024-04-21 22:47:51.947582592 +0000 UTC m=+3.297061405 container cleanup ef1ea682a0cf94a0845c9c5a7a51c49400361a35900c194e44d665f973e19931 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-820a2f8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-21T22:47:52.139 INFO:journalctl@ceph.mds.i.smithi081.stdout:Apr 21 22:47:51 smithi081 bash[69968]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-i 2024-04-21T22:47:52.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.i.service' 2024-04-21T22:47:52.313 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:52.313 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-21T22:47:52.313 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-21T22:47:52.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.l 2024-04-21T22:47:52.438 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:52 smithi081 systemd[1]: Stopping Ceph mds.l for 6ef0a334-002d-11ef-bc93-c7b262605968... 2024-04-21T22:47:52.888 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: 2024-04-21T22:47:52.643+0000 7f1d67143700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-21T22:47:52.888 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:52 smithi081 ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l[62058]: 2024-04-21T22:47:52.643+0000 7f1d67143700 -1 mds.l *** got signal Terminated *** 2024-04-21T22:47:55.818 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:55 smithi081 podman[70089]: 2024-04-21 22:47:55.56247818 +0000 UTC m=+3.030147608 container died dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-820a2f8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-21T22:47:56.138 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:55 smithi081 podman[70089]: 2024-04-21 22:47:55.918378609 +0000 UTC m=+3.386048034 container cleanup dabc1de13a74523c0cd8bcc422f461123a0cf5eee598aef4babe56f8582b7971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d4c08cf2bab46b9f2f2d301f0b4aed7a04ebf590fcda86c56afbf3304d624cb9, name=ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l, RELEASE=squid-820a2f8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-21T22:47:56.138 INFO:journalctl@ceph.mds.l.smithi081.stdout:Apr 21 22:47:55 smithi081 bash[70089]: ceph-6ef0a334-002d-11ef-bc93-c7b262605968-mds-l 2024-04-21T22:47:56.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6ef0a334-002d-11ef-bc93-c7b262605968@mds.l.service' 2024-04-21T22:47:56.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-21T22:47:56.383 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-21T22:47:56.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-21T22:47:56.718 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:01.776 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-21T22:48:01.975 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:04.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-21T22:48:04.641 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:06.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:48:07.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:48:07.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-21T22:48:07.147 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-21T22:48:07.149 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi018/crash 2024-04-21T22:48:07.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash -- . 2024-04-21T22:48:07.264 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-21T22:48:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-04-21T22:48:07.269 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi047/crash 2024-04-21T22:48:07.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash -- . 2024-04-21T22:48:07.320 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-21T22:48:07.321 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-04-21T22:48:07.323 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi081/crash 2024-04-21T22:48:07.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash -- . 2024-04-21T22:48:07.356 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-21T22:48:07.356 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-04-21T22:48:07.357 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-21T22:48:07.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-21T22:48:07.464 INFO:tasks.cephadm:Compressing logs... 2024-04-21T22:48:07.464 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-21T22:48:07.468 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-21T22:48:07.471 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-21T22:48:07.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.z.log: 87.5% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-21T22:48:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.i.log: 90.2% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-21T22:48:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-21T22:48:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.4% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-21T22:48:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:: No such file or directory 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-21T22:48:07.508 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr: 87.5% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.2% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-21T22:48:07.509 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.5% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-21T22:48:07.510 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-21T22:48:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.11.log: 92.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-21T22:48:07.511 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-21T22:48:07.512 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.e.log: 92.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-21T22:48:07.512 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-21T22:48:07.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-21T22:48:07.523 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-21T22:48:07.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log 2024-04-21T22:48:07.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-21T22:48:07.524 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-21T22:48:07.526 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-21T22:48:07.526 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-21T22:48:07.527 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-21T22:48:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.0.log 87.4% 2024-04-21T22:48:07.528 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-21T22:48:07.529 INFO:teuthology.orchestra.run.smithi018.stderr: 90.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-21T22:48:07.530 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-21T22:48:07.531 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-21T22:48:07.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-21T22:48:07.533 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-21T22:48:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.0.log: /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip 94.5% -5 -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.g.log.gz --verbose 2024-04-21T22:48:07.533 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-21T22:48:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-21T22:48:07.536 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.6.log: /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-21T22:48:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-21T22:48:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-21T22:48:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-21T22:48:07.546 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-21T22:48:07.548 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-21T22:48:07.553 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.9.log: /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-21T22:48:07.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 91.0% 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-21T22:48:07.561 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-21T22:48:07.564 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-21T22:48:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-21T22:48:07.579 INFO:teuthology.orchestra.run.smithi018.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-21T22:48:07.580 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-21T22:48:07.589 INFO:teuthology.orchestra.run.smithi047.stderr: 94.6% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-21T22:48:07.597 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-21T22:48:07.647 INFO:teuthology.orchestra.run.smithi018.stderr: 94.3% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-21T22:48:07.657 INFO:teuthology.orchestra.run.smithi047.stderr: 94.3% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-21T22:48:07.742 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-21T22:48:07.922 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-21T22:48:07.949 INFO:teuthology.orchestra.run.smithi018.stderr: 90.2% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-21T22:48:08.006 INFO:teuthology.orchestra.run.smithi047.stderr: 94.3% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-21T22:48:08.051 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-21T22:48:08.066 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-21T22:48:08.346 INFO:teuthology.orchestra.run.smithi047.stderr: 93.6% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-21T22:48:08.634 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-21T22:48:08.703 INFO:teuthology.orchestra.run.smithi047.stderr: 93.7% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-21T22:48:08.872 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-21T22:48:08.945 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-21T22:48:09.012 INFO:teuthology.orchestra.run.smithi047.stderr: 94.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-21T22:48:09.029 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-21T22:48:09.162 INFO:teuthology.orchestra.run.smithi081.stderr: 93.9% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-21T22:48:09.189 INFO:teuthology.orchestra.run.smithi018.stderr: 94.1% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-21T22:48:09.194 INFO:teuthology.orchestra.run.smithi018.stderr: 93.7% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-21T22:48:09.208 INFO:teuthology.orchestra.run.smithi081.stderr: 93.7% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-21T22:48:09.246 INFO:teuthology.orchestra.run.smithi047.stderr: 94.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-21T22:48:09.248 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-21T22:48:09.248 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m1.762s 2024-04-21T22:48:09.248 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m7.749s 2024-04-21T22:48:09.248 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.244s 2024-04-21T22:48:09.254 INFO:teuthology.orchestra.run.smithi081.stderr: 95.4% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-21T22:48:09.420 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-21T22:48:09.440 INFO:teuthology.orchestra.run.smithi018.stderr: 94.0% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-21T22:48:09.444 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-21T22:48:09.444 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m1.945s 2024-04-21T22:48:09.444 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m8.131s 2024-04-21T22:48:09.444 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.686s 2024-04-21T22:48:25.902 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/6ef0a334-002d-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-21T22:48:25.903 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-04-21T22:48:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m18.419s 2024-04-21T22:48:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m26.546s 2024-04-21T22:48:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.865s 2024-04-21T22:48:25.904 INFO:tasks.cephadm:Archiving logs... 2024-04-21T22:48:25.905 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi018/log 2024-04-21T22:48:25.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-21T22:48:26.942 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi047/log 2024-04-21T22:48:26.943 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-21T22:48:27.896 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi081/log 2024-04-21T22:48:27.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-21T22:48:31.590 INFO:tasks.cephadm:Removing cluster... 2024-04-21T22:48:31.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force 2024-04-21T22:48:31.921 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:32.491 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force 2024-04-21T22:48:32.691 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:32.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6ef0a334-002d-11ef-bc93-c7b262605968 --force 2024-04-21T22:48:33.151 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 6ef0a334-002d-11ef-bc93-c7b262605968 2024-04-21T22:48:33.425 INFO:tasks.cephadm:Removing cephadm ... 2024-04-21T22:48:33.425 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-21T22:48:33.485 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-21T22:48:33.501 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-21T22:48:33.517 INFO:tasks.cephadm:Teardown complete 2024-04-21T22:48:33.522 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-21T22:48:33.534 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-21T22:48:33.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-21T22:48:33.541 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-21T22:48:33.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-21T22:48:33.705 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-21T22:48:33.715 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-21T22:48:33.716 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:48:33.726 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:48:33.728 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T22:48:33.739 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:48:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:48:33.744 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:48:33.744 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-04-21T22:48:33.745 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 -270us[ -270us] +/- 73ms 2024-04-21T22:48:33.745 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv02.front.sepia.ceph.com 3 7 377 17 -174us[ -178us] +/- 79ms 2024-04-21T22:48:33.745 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +374us[ +370us] +/- 72ms 2024-04-21T22:48:33.745 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:48:33.746 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:48:33.746 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-04-21T22:48:33.746 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 -259us[ -263us] +/- 73ms 2024-04-21T22:48:33.747 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -156us[ -160us] +/- 79ms 2024-04-21T22:48:33.747 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +381us[ +377us] +/- 72ms 2024-04-21T22:48:33.747 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:48:33.774 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-04-21T22:48:33.785 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-21T22:48:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-04-21T22:48:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 141 -205us[ -178us] +/- 87ms 2024-04-21T22:48:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -140us[ -132us] +/- 79ms 2024-04-21T22:48:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +386us[ +394us] +/- 72ms 2024-04-21T22:48:33.786 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-21T22:48:33.787 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-21T22:48:33.798 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-21T22:48:33.799 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-21T22:48:33.821 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-21T22:48:34.047 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-21T22:48:34.113 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-21T22:48:34.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:48:34.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:34.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:48:34.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:34.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-21T22:48:34.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:34.333 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-21T22:48:34.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-21T22:48:34.380 INFO:teuthology.task.internal:Duration was 2087.446620 seconds 2024-04-21T22:48:34.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-21T22:48:34.413 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-21T22:48:34.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-21T22:48:34.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-21T22:48:34.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-21T22:48:34.459 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:48:34.461 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:48:34.573 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-21T22:48:34.944 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-21T22:48:34.944 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-04-21T22:48:34.944 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-21T22:48:35.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-21T22:48:35.016 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-21T22:48:35.042 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-04-21T22:48:35.042 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-21T22:48:35.073 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-21T22:48:35.073 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-21T22:48:35.081 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-21T22:48:35.084 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-21T22:48:35.170 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-21T22:48:35.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-21T22:48:35.176 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-21T22:48:35.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-21T22:48:35.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-21T22:48:35.721 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-21T22:48:35.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-21T22:48:35.805 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-21T22:48:35.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-21T22:48:35.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-21T22:48:35.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:35.878 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:35.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:35.901 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-21T22:48:35.917 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-04-21T22:48:35.976 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-04-21T22:48:36.019 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:36.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:36.071 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:36.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:36.085 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-21T22:48:36.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T22:48:36.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-21T22:48:36.112 INFO:teuthology.task.internal:Transferring archived files... 2024-04-21T22:48:36.112 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi018 2024-04-21T22:48:36.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-21T22:48:36.221 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi047 2024-04-21T22:48:36.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-21T22:48:36.259 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544/remote/smithi081 2024-04-21T22:48:36.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-21T22:48:36.293 INFO:teuthology.task.internal:Removing archive directory... 2024-04-21T22:48:36.293 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-21T22:48:36.302 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-21T22:48:36.304 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-21T22:48:36.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-21T22:48:36.370 INFO:teuthology.task.internal:Not uploading archives. 2024-04-21T22:48:36.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-21T22:48:36.390 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-21T22:48:36.391 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-21T22:48:36.397 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-21T22:48:36.400 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-21T22:48:36.412 INFO:teuthology.orchestra.run.smithi047.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 21 22:48 /home/ubuntu/cephtest 2024-04-21T22:48:36.414 INFO:teuthology.orchestra.run.smithi081.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 21 22:48 /home/ubuntu/cephtest 2024-04-21T22:48:36.445 INFO:teuthology.orchestra.run.smithi018.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 21 22:48 /home/ubuntu/cephtest 2024-04-21T22:48:36.448 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-21T22:48:36.462 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-21T22:48:36.523 INFO:teuthology.nuke:Checking targets against current locks 2024-04-21T22:48:36.551 DEBUG:teuthology.nuke:shortname: smithi018 2024-04-21T22:48:36.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T22:48:36.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.535473', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdvywbN7HWnt1rJMBnL0ktxobcfHJiZYTiU+V1Muo8x8eNVKcd2DXAp3L/tQat06JgMe/hoKNQHzAzeS9pK/Hs='} 2024-04-21T22:48:36.582 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-21T22:48:36.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T22:48:36.607 DEBUG:teuthology.nuke:shortname: smithi081 2024-04-21T22:48:36.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T22:48:36.614 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.532087', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJv2qeaG3WP5r1PBOBCQU3FYz0fdWZUHMfdIzFJa9lDj1m+QjavqSpU6dmUmZJLVqdjld9xV7hluTWCdc+pbyk='} 2024-04-21T22:48:36.638 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-21_21:24:02-fs-squid-distro-default-smithi/7667544', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 22:05:06.533678', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDq7nOWza3WbMav0MTBFDPrDaw8LNNnt/QvoZBGcu/ij/1x+JPIdfA73+seCZajB2WpanGOSPCJguy75JQYBA0='} 2024-04-21T22:48:36.651 INFO:teuthology.orchestra.console.smithi018:Power off 2024-04-21T22:48:36.651 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-21T22:48:36.676 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-04-21T22:48:36.677 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:36.695 INFO:teuthology.orchestra.console.smithi081:Power off 2024-04-21T22:48:36.696 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-21T22:48:36.711 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-21T22:48:36.711 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-21T22:48:36.720 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-04-21T22:48:36.721 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:36.729 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-04-21T22:48:36.734 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-21T22:48:36.734 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:36.747 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-04-21T22:48:36.757 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-21T22:48:40.730 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:40.748 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:40.758 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:40.840 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-04-21T22:48:40.859 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-04-21T22:48:40.871 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-21T22:48:44.842 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:44.860 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:44.872 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T22:48:44.953 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-04-21T22:48:44.970 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-21T22:48:44.982 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-21T22:48:45.054 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-04-21T22:48:45.070 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-04-21T22:48:45.083 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-21T22:48:45.190 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} duration: 2087.446619987488 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi018 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=430e09df97c8fc7dc2b2ae424f68ed11366c540f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b60e3b9377784a7f834c8c1242ebb7e4 status: fail success: false 2024-04-21T22:48:45.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T22:48:45.291 INFO:teuthology.run:FAIL